00:00:00.000 Started by upstream project "autotest-spdk-v24.01-LTS-vs-dpdk-v23.11" build number 1009 00:00:00.000 originally caused by: 00:00:00.001 Started by upstream project "nightly-trigger" build number 3676 00:00:00.001 originally caused by: 00:00:00.001 Started by timer 00:00:00.089 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.090 The recommended git tool is: git 00:00:00.090 using credential 00000000-0000-0000-0000-000000000002 00:00:00.092 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.126 Fetching changes from the remote Git repository 00:00:00.130 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.168 Using shallow fetch with depth 1 00:00:00.168 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.168 > git --version # timeout=10 00:00:00.203 > git --version # 'git version 2.39.2' 00:00:00.203 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.225 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.225 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:05.110 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:05.124 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:05.137 Checking out Revision db4637e8b949f278f369ec13f70585206ccd9507 (FETCH_HEAD) 00:00:05.137 > git config core.sparsecheckout # timeout=10 00:00:05.149 > git read-tree -mu HEAD # timeout=10 00:00:05.164 > git checkout -f db4637e8b949f278f369ec13f70585206ccd9507 # timeout=5 00:00:05.191 Commit message: "jenkins/jjb-config: Add missing SPDK_TEST_NVME_INTERRUPT flag" 00:00:05.191 > git rev-list --no-walk db4637e8b949f278f369ec13f70585206ccd9507 # timeout=10 00:00:05.272 [Pipeline] Start of Pipeline 00:00:05.286 [Pipeline] library 00:00:05.288 Loading library shm_lib@master 00:00:05.288 Library shm_lib@master is cached. Copying from home. 00:00:05.302 [Pipeline] node 00:00:05.309 Running on GP11 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:05.311 [Pipeline] { 00:00:05.318 [Pipeline] catchError 00:00:05.319 [Pipeline] { 00:00:05.328 [Pipeline] wrap 00:00:05.336 [Pipeline] { 00:00:05.342 [Pipeline] stage 00:00:05.343 [Pipeline] { (Prologue) 00:00:05.504 [Pipeline] sh 00:00:05.782 + logger -p user.info -t JENKINS-CI 00:00:05.802 [Pipeline] echo 00:00:05.804 Node: GP11 00:00:05.811 [Pipeline] sh 00:00:06.111 [Pipeline] setCustomBuildProperty 00:00:06.122 [Pipeline] echo 00:00:06.124 Cleanup processes 00:00:06.129 [Pipeline] sh 00:00:06.413 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:06.413 2238223 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:06.425 [Pipeline] sh 00:00:06.707 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:06.707 ++ grep -v 'sudo pgrep' 00:00:06.707 ++ awk '{print $1}' 00:00:06.707 + sudo kill -9 00:00:06.707 + true 00:00:06.720 [Pipeline] cleanWs 00:00:06.728 [WS-CLEANUP] Deleting project workspace... 00:00:06.728 [WS-CLEANUP] Deferred wipeout is used... 00:00:06.735 [WS-CLEANUP] done 00:00:06.739 [Pipeline] setCustomBuildProperty 00:00:06.753 [Pipeline] sh 00:00:07.038 + sudo git config --global --replace-all safe.directory '*' 00:00:07.105 [Pipeline] httpRequest 00:00:08.828 [Pipeline] echo 00:00:08.830 Sorcerer 10.211.164.101 is alive 00:00:08.841 [Pipeline] retry 00:00:08.843 [Pipeline] { 00:00:08.855 [Pipeline] httpRequest 00:00:08.860 HttpMethod: GET 00:00:08.860 URL: http://10.211.164.101/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:08.861 Sending request to url: http://10.211.164.101/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:08.870 Response Code: HTTP/1.1 200 OK 00:00:08.870 Success: Status code 200 is in the accepted range: 200,404 00:00:08.870 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:10.061 [Pipeline] } 00:00:10.083 [Pipeline] // retry 00:00:10.093 [Pipeline] sh 00:00:10.380 + tar --no-same-owner -xf jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:10.400 [Pipeline] httpRequest 00:00:12.179 [Pipeline] echo 00:00:12.181 Sorcerer 10.211.164.101 is alive 00:00:12.191 [Pipeline] retry 00:00:12.193 [Pipeline] { 00:00:12.211 [Pipeline] httpRequest 00:00:12.216 HttpMethod: GET 00:00:12.217 URL: http://10.211.164.101/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:12.218 Sending request to url: http://10.211.164.101/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:12.237 Response Code: HTTP/1.1 200 OK 00:00:12.237 Success: Status code 200 is in the accepted range: 200,404 00:00:12.238 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:25.256 [Pipeline] } 00:01:25.278 [Pipeline] // retry 00:01:25.287 [Pipeline] sh 00:01:25.578 + tar --no-same-owner -xf spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:28.122 [Pipeline] sh 00:01:28.427 + git -C spdk log --oneline -n5 00:01:28.427 c13c99a5e test: Various fixes for Fedora40 00:01:28.427 726a04d70 test/nvmf: adjust timeout for bigger nvmes 00:01:28.427 61c96acfb dpdk: Point dpdk submodule at a latest fix from spdk-23.11 00:01:28.427 7db6dcdb8 nvme/fio_plugin: update the way ruhs descriptors are fetched 00:01:28.427 ff6f5c41e nvme/fio_plugin: trim add support for multiple ranges 00:01:28.445 [Pipeline] withCredentials 00:01:28.457 > git --version # timeout=10 00:01:28.470 > git --version # 'git version 2.39.2' 00:01:28.488 Masking supported pattern matches of $GIT_PASSWORD or $GIT_ASKPASS 00:01:28.491 [Pipeline] { 00:01:28.504 [Pipeline] retry 00:01:28.506 [Pipeline] { 00:01:28.525 [Pipeline] sh 00:01:28.815 + git ls-remote http://dpdk.org/git/dpdk-stable v23.11 00:01:28.828 [Pipeline] } 00:01:28.847 [Pipeline] // retry 00:01:28.852 [Pipeline] } 00:01:28.869 [Pipeline] // withCredentials 00:01:28.879 [Pipeline] httpRequest 00:01:30.007 [Pipeline] echo 00:01:30.009 Sorcerer 10.211.164.101 is alive 00:01:30.020 [Pipeline] retry 00:01:30.022 [Pipeline] { 00:01:30.038 [Pipeline] httpRequest 00:01:30.044 HttpMethod: GET 00:01:30.044 URL: http://10.211.164.101/packages/dpdk_d15625009dced269fcec27fc81dd74fd58d54cdb.tar.gz 00:01:30.045 Sending request to url: http://10.211.164.101/packages/dpdk_d15625009dced269fcec27fc81dd74fd58d54cdb.tar.gz 00:01:30.055 Response Code: HTTP/1.1 200 OK 00:01:30.056 Success: Status code 200 is in the accepted range: 200,404 00:01:30.056 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk_d15625009dced269fcec27fc81dd74fd58d54cdb.tar.gz 00:01:36.904 [Pipeline] } 00:01:36.927 [Pipeline] // retry 00:01:36.935 [Pipeline] sh 00:01:37.218 + tar --no-same-owner -xf dpdk_d15625009dced269fcec27fc81dd74fd58d54cdb.tar.gz 00:01:38.609 [Pipeline] sh 00:01:38.895 + git -C dpdk log --oneline -n5 00:01:38.895 eeb0605f11 version: 23.11.0 00:01:38.895 238778122a doc: update release notes for 23.11 00:01:38.895 46aa6b3cfc doc: fix description of RSS features 00:01:38.895 dd88f51a57 devtools: forbid DPDK API in cnxk base driver 00:01:38.895 7e421ae345 devtools: support skipping forbid rule check 00:01:38.905 [Pipeline] } 00:01:38.919 [Pipeline] // stage 00:01:38.927 [Pipeline] stage 00:01:38.929 [Pipeline] { (Prepare) 00:01:38.949 [Pipeline] writeFile 00:01:38.965 [Pipeline] sh 00:01:39.252 + logger -p user.info -t JENKINS-CI 00:01:39.266 [Pipeline] sh 00:01:39.551 + logger -p user.info -t JENKINS-CI 00:01:39.565 [Pipeline] sh 00:01:39.857 + cat autorun-spdk.conf 00:01:39.857 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:39.857 SPDK_TEST_NVMF=1 00:01:39.857 SPDK_TEST_NVME_CLI=1 00:01:39.857 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:39.857 SPDK_TEST_NVMF_NICS=e810 00:01:39.857 SPDK_TEST_VFIOUSER=1 00:01:39.857 SPDK_RUN_UBSAN=1 00:01:39.857 NET_TYPE=phy 00:01:39.857 SPDK_TEST_NATIVE_DPDK=v23.11 00:01:39.857 SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:39.867 RUN_NIGHTLY=1 00:01:39.872 [Pipeline] readFile 00:01:39.898 [Pipeline] withEnv 00:01:39.900 [Pipeline] { 00:01:39.913 [Pipeline] sh 00:01:40.202 + set -ex 00:01:40.202 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:01:40.202 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:40.202 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:40.202 ++ SPDK_TEST_NVMF=1 00:01:40.202 ++ SPDK_TEST_NVME_CLI=1 00:01:40.202 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:40.202 ++ SPDK_TEST_NVMF_NICS=e810 00:01:40.202 ++ SPDK_TEST_VFIOUSER=1 00:01:40.202 ++ SPDK_RUN_UBSAN=1 00:01:40.202 ++ NET_TYPE=phy 00:01:40.202 ++ SPDK_TEST_NATIVE_DPDK=v23.11 00:01:40.202 ++ SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:40.202 ++ RUN_NIGHTLY=1 00:01:40.202 + case $SPDK_TEST_NVMF_NICS in 00:01:40.202 + DRIVERS=ice 00:01:40.202 + [[ tcp == \r\d\m\a ]] 00:01:40.202 + [[ -n ice ]] 00:01:40.202 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:01:40.202 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:01:40.202 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:01:40.202 rmmod: ERROR: Module irdma is not currently loaded 00:01:40.202 rmmod: ERROR: Module i40iw is not currently loaded 00:01:40.202 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:01:40.202 + true 00:01:40.202 + for D in $DRIVERS 00:01:40.202 + sudo modprobe ice 00:01:40.202 + exit 0 00:01:40.213 [Pipeline] } 00:01:40.228 [Pipeline] // withEnv 00:01:40.233 [Pipeline] } 00:01:40.247 [Pipeline] // stage 00:01:40.256 [Pipeline] catchError 00:01:40.258 [Pipeline] { 00:01:40.272 [Pipeline] timeout 00:01:40.273 Timeout set to expire in 1 hr 0 min 00:01:40.275 [Pipeline] { 00:01:40.289 [Pipeline] stage 00:01:40.291 [Pipeline] { (Tests) 00:01:40.305 [Pipeline] sh 00:01:40.591 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:40.591 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:40.591 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:40.591 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:01:40.591 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:40.591 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:40.591 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:01:40.591 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:40.591 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:40.591 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:40.591 + [[ nvmf-tcp-phy-autotest == pkgdep-* ]] 00:01:40.591 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:40.591 + source /etc/os-release 00:01:40.591 ++ NAME='Fedora Linux' 00:01:40.591 ++ VERSION='39 (Cloud Edition)' 00:01:40.591 ++ ID=fedora 00:01:40.591 ++ VERSION_ID=39 00:01:40.591 ++ VERSION_CODENAME= 00:01:40.591 ++ PLATFORM_ID=platform:f39 00:01:40.591 ++ PRETTY_NAME='Fedora Linux 39 (Cloud Edition)' 00:01:40.591 ++ ANSI_COLOR='0;38;2;60;110;180' 00:01:40.591 ++ LOGO=fedora-logo-icon 00:01:40.591 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:39 00:01:40.591 ++ HOME_URL=https://fedoraproject.org/ 00:01:40.591 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f39/system-administrators-guide/ 00:01:40.591 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:01:40.591 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:01:40.591 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:01:40.591 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=39 00:01:40.591 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:01:40.591 ++ REDHAT_SUPPORT_PRODUCT_VERSION=39 00:01:40.591 ++ SUPPORT_END=2024-11-12 00:01:40.591 ++ VARIANT='Cloud Edition' 00:01:40.591 ++ VARIANT_ID=cloud 00:01:40.591 + uname -a 00:01:40.591 Linux spdk-gp-11 6.8.9-200.fc39.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jul 24 03:04:40 UTC 2024 x86_64 GNU/Linux 00:01:40.591 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:01:41.531 Hugepages 00:01:41.531 node hugesize free / total 00:01:41.531 node0 1048576kB 0 / 0 00:01:41.531 node0 2048kB 0 / 0 00:01:41.531 node1 1048576kB 0 / 0 00:01:41.531 node1 2048kB 0 / 0 00:01:41.531 00:01:41.531 Type BDF Vendor Device NUMA Driver Device Block devices 00:01:41.531 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:01:41.531 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:01:41.531 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:01:41.531 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:01:41.531 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:01:41.531 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:01:41.531 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:01:41.531 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:01:41.531 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:01:41.531 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:01:41.531 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:01:41.531 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:01:41.531 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:01:41.531 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:01:41.532 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:01:41.532 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:01:41.532 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:01:41.532 + rm -f /tmp/spdk-ld-path 00:01:41.532 + source autorun-spdk.conf 00:01:41.532 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:41.532 ++ SPDK_TEST_NVMF=1 00:01:41.532 ++ SPDK_TEST_NVME_CLI=1 00:01:41.532 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:41.532 ++ SPDK_TEST_NVMF_NICS=e810 00:01:41.532 ++ SPDK_TEST_VFIOUSER=1 00:01:41.532 ++ SPDK_RUN_UBSAN=1 00:01:41.532 ++ NET_TYPE=phy 00:01:41.532 ++ SPDK_TEST_NATIVE_DPDK=v23.11 00:01:41.532 ++ SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:41.532 ++ RUN_NIGHTLY=1 00:01:41.532 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:01:41.532 + [[ -n '' ]] 00:01:41.532 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:41.532 + for M in /var/spdk/build-*-manifest.txt 00:01:41.532 + [[ -f /var/spdk/build-kernel-manifest.txt ]] 00:01:41.532 + cp /var/spdk/build-kernel-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:41.532 + for M in /var/spdk/build-*-manifest.txt 00:01:41.532 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:01:41.532 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:41.532 + for M in /var/spdk/build-*-manifest.txt 00:01:41.532 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:01:41.532 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:41.532 ++ uname 00:01:41.532 + [[ Linux == \L\i\n\u\x ]] 00:01:41.532 + sudo dmesg -T 00:01:41.532 + sudo dmesg --clear 00:01:41.532 + dmesg_pid=2238938 00:01:41.532 + [[ Fedora Linux == FreeBSD ]] 00:01:41.532 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:41.532 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:41.532 + sudo dmesg -Tw 00:01:41.532 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:01:41.532 + [[ -x /usr/src/fio-static/fio ]] 00:01:41.532 + export FIO_BIN=/usr/src/fio-static/fio 00:01:41.532 + FIO_BIN=/usr/src/fio-static/fio 00:01:41.532 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:01:41.532 + [[ ! -v VFIO_QEMU_BIN ]] 00:01:41.532 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:01:41.532 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:41.532 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:41.532 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:01:41.532 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:41.532 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:41.532 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:41.532 Test configuration: 00:01:41.532 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:41.532 SPDK_TEST_NVMF=1 00:01:41.532 SPDK_TEST_NVME_CLI=1 00:01:41.532 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:41.532 SPDK_TEST_NVMF_NICS=e810 00:01:41.532 SPDK_TEST_VFIOUSER=1 00:01:41.532 SPDK_RUN_UBSAN=1 00:01:41.532 NET_TYPE=phy 00:01:41.532 SPDK_TEST_NATIVE_DPDK=v23.11 00:01:41.532 SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:41.791 RUN_NIGHTLY=1 22:53:45 -- common/autotest_common.sh@1689 -- $ [[ n == y ]] 00:01:41.791 22:53:45 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:01:41.791 22:53:45 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:01:41.791 22:53:45 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:41.791 22:53:45 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:41.791 22:53:45 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:41.791 22:53:45 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:41.791 22:53:45 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:41.791 22:53:45 -- paths/export.sh@5 -- $ export PATH 00:01:41.791 22:53:45 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:41.791 22:53:45 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:01:41.791 22:53:45 -- common/autobuild_common.sh@440 -- $ date +%s 00:01:41.791 22:53:45 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732830825.XXXXXX 00:01:41.791 22:53:45 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732830825.K0RMRe 00:01:41.791 22:53:45 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:01:41.791 22:53:45 -- common/autobuild_common.sh@446 -- $ '[' -n v23.11 ']' 00:01:41.791 22:53:45 -- common/autobuild_common.sh@447 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:41.791 22:53:45 -- common/autobuild_common.sh@447 -- $ scanbuild_exclude=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk' 00:01:41.791 22:53:45 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:01:41.791 22:53:45 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:01:41.791 22:53:45 -- common/autobuild_common.sh@456 -- $ get_config_params 00:01:41.791 22:53:45 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:01:41.791 22:53:45 -- common/autotest_common.sh@10 -- $ set +x 00:01:41.791 22:53:45 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build' 00:01:41.791 22:53:45 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:01:41.791 22:53:45 -- spdk/autobuild.sh@12 -- $ umask 022 00:01:41.791 22:53:45 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:41.791 22:53:45 -- spdk/autobuild.sh@16 -- $ date -u 00:01:41.791 Thu Nov 28 09:53:45 PM UTC 2024 00:01:41.791 22:53:45 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:01:41.791 LTS-67-gc13c99a5e 00:01:41.791 22:53:45 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:01:41.791 22:53:45 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:01:41.791 22:53:45 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:01:41.791 22:53:45 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:41.791 22:53:45 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:41.791 22:53:45 -- common/autotest_common.sh@10 -- $ set +x 00:01:41.791 ************************************ 00:01:41.791 START TEST ubsan 00:01:41.791 ************************************ 00:01:41.791 22:53:45 -- common/autotest_common.sh@1114 -- $ echo 'using ubsan' 00:01:41.791 using ubsan 00:01:41.791 00:01:41.791 real 0m0.000s 00:01:41.791 user 0m0.000s 00:01:41.791 sys 0m0.000s 00:01:41.791 22:53:45 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:01:41.791 22:53:45 -- common/autotest_common.sh@10 -- $ set +x 00:01:41.791 ************************************ 00:01:41.791 END TEST ubsan 00:01:41.791 ************************************ 00:01:41.791 22:53:45 -- spdk/autobuild.sh@27 -- $ '[' -n v23.11 ']' 00:01:41.791 22:53:45 -- spdk/autobuild.sh@28 -- $ build_native_dpdk 00:01:41.791 22:53:45 -- common/autobuild_common.sh@432 -- $ run_test build_native_dpdk _build_native_dpdk 00:01:41.791 22:53:45 -- common/autotest_common.sh@1087 -- $ '[' 2 -le 1 ']' 00:01:41.791 22:53:45 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:41.791 22:53:45 -- common/autotest_common.sh@10 -- $ set +x 00:01:41.791 ************************************ 00:01:41.791 START TEST build_native_dpdk 00:01:41.791 ************************************ 00:01:41.791 22:53:45 -- common/autotest_common.sh@1114 -- $ _build_native_dpdk 00:01:41.791 22:53:45 -- common/autobuild_common.sh@48 -- $ local external_dpdk_dir 00:01:41.791 22:53:45 -- common/autobuild_common.sh@49 -- $ local external_dpdk_base_dir 00:01:41.791 22:53:45 -- common/autobuild_common.sh@50 -- $ local compiler_version 00:01:41.791 22:53:45 -- common/autobuild_common.sh@51 -- $ local compiler 00:01:41.791 22:53:45 -- common/autobuild_common.sh@52 -- $ local dpdk_kmods 00:01:41.791 22:53:45 -- common/autobuild_common.sh@53 -- $ local repo=dpdk 00:01:41.791 22:53:45 -- common/autobuild_common.sh@55 -- $ compiler=gcc 00:01:41.791 22:53:45 -- common/autobuild_common.sh@61 -- $ export CC=gcc 00:01:41.791 22:53:45 -- common/autobuild_common.sh@61 -- $ CC=gcc 00:01:41.791 22:53:45 -- common/autobuild_common.sh@63 -- $ [[ gcc != *clang* ]] 00:01:41.791 22:53:45 -- common/autobuild_common.sh@63 -- $ [[ gcc != *gcc* ]] 00:01:41.791 22:53:45 -- common/autobuild_common.sh@68 -- $ gcc -dumpversion 00:01:41.791 22:53:45 -- common/autobuild_common.sh@68 -- $ compiler_version=13 00:01:41.791 22:53:45 -- common/autobuild_common.sh@69 -- $ compiler_version=13 00:01:41.791 22:53:45 -- common/autobuild_common.sh@70 -- $ external_dpdk_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:41.791 22:53:45 -- common/autobuild_common.sh@71 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:41.791 22:53:45 -- common/autobuild_common.sh@71 -- $ external_dpdk_base_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:41.791 22:53:45 -- common/autobuild_common.sh@73 -- $ [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk ]] 00:01:41.791 22:53:45 -- common/autobuild_common.sh@82 -- $ orgdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:41.791 22:53:45 -- common/autobuild_common.sh@83 -- $ git -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk log --oneline -n 5 00:01:41.791 eeb0605f11 version: 23.11.0 00:01:41.791 238778122a doc: update release notes for 23.11 00:01:41.791 46aa6b3cfc doc: fix description of RSS features 00:01:41.791 dd88f51a57 devtools: forbid DPDK API in cnxk base driver 00:01:41.791 7e421ae345 devtools: support skipping forbid rule check 00:01:41.791 22:53:45 -- common/autobuild_common.sh@85 -- $ dpdk_cflags='-fPIC -g -fcommon' 00:01:41.791 22:53:45 -- common/autobuild_common.sh@86 -- $ dpdk_ldflags= 00:01:41.791 22:53:45 -- common/autobuild_common.sh@87 -- $ dpdk_ver=23.11.0 00:01:41.791 22:53:45 -- common/autobuild_common.sh@89 -- $ [[ gcc == *gcc* ]] 00:01:41.791 22:53:45 -- common/autobuild_common.sh@89 -- $ [[ 13 -ge 5 ]] 00:01:41.791 22:53:45 -- common/autobuild_common.sh@90 -- $ dpdk_cflags+=' -Werror' 00:01:41.791 22:53:45 -- common/autobuild_common.sh@93 -- $ [[ gcc == *gcc* ]] 00:01:41.791 22:53:45 -- common/autobuild_common.sh@93 -- $ [[ 13 -ge 10 ]] 00:01:41.791 22:53:45 -- common/autobuild_common.sh@94 -- $ dpdk_cflags+=' -Wno-stringop-overflow' 00:01:41.791 22:53:45 -- common/autobuild_common.sh@100 -- $ DPDK_DRIVERS=("bus" "bus/pci" "bus/vdev" "mempool/ring" "net/i40e" "net/i40e/base") 00:01:41.791 22:53:45 -- common/autobuild_common.sh@102 -- $ local mlx5_libs_added=n 00:01:41.791 22:53:45 -- common/autobuild_common.sh@103 -- $ [[ 0 -eq 1 ]] 00:01:41.791 22:53:45 -- common/autobuild_common.sh@103 -- $ [[ 0 -eq 1 ]] 00:01:41.791 22:53:45 -- common/autobuild_common.sh@139 -- $ [[ 0 -eq 1 ]] 00:01:41.791 22:53:45 -- common/autobuild_common.sh@167 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:41.791 22:53:45 -- common/autobuild_common.sh@168 -- $ uname -s 00:01:41.791 22:53:45 -- common/autobuild_common.sh@168 -- $ '[' Linux = Linux ']' 00:01:41.791 22:53:45 -- common/autobuild_common.sh@169 -- $ lt 23.11.0 21.11.0 00:01:41.791 22:53:45 -- scripts/common.sh@372 -- $ cmp_versions 23.11.0 '<' 21.11.0 00:01:41.791 22:53:45 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:01:41.791 22:53:45 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:01:41.791 22:53:45 -- scripts/common.sh@335 -- $ IFS=.-: 00:01:41.791 22:53:45 -- scripts/common.sh@335 -- $ read -ra ver1 00:01:41.791 22:53:45 -- scripts/common.sh@336 -- $ IFS=.-: 00:01:41.791 22:53:45 -- scripts/common.sh@336 -- $ read -ra ver2 00:01:41.791 22:53:45 -- scripts/common.sh@337 -- $ local 'op=<' 00:01:41.791 22:53:45 -- scripts/common.sh@339 -- $ ver1_l=3 00:01:41.791 22:53:45 -- scripts/common.sh@340 -- $ ver2_l=3 00:01:41.791 22:53:45 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:01:41.791 22:53:45 -- scripts/common.sh@343 -- $ case "$op" in 00:01:41.791 22:53:45 -- scripts/common.sh@344 -- $ : 1 00:01:41.791 22:53:45 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:01:41.791 22:53:45 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:01:41.791 22:53:45 -- scripts/common.sh@364 -- $ decimal 23 00:01:41.791 22:53:45 -- scripts/common.sh@352 -- $ local d=23 00:01:41.791 22:53:45 -- scripts/common.sh@353 -- $ [[ 23 =~ ^[0-9]+$ ]] 00:01:41.791 22:53:45 -- scripts/common.sh@354 -- $ echo 23 00:01:41.792 22:53:45 -- scripts/common.sh@364 -- $ ver1[v]=23 00:01:41.792 22:53:45 -- scripts/common.sh@365 -- $ decimal 21 00:01:41.792 22:53:45 -- scripts/common.sh@352 -- $ local d=21 00:01:41.792 22:53:45 -- scripts/common.sh@353 -- $ [[ 21 =~ ^[0-9]+$ ]] 00:01:41.792 22:53:45 -- scripts/common.sh@354 -- $ echo 21 00:01:41.792 22:53:45 -- scripts/common.sh@365 -- $ ver2[v]=21 00:01:41.792 22:53:45 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:01:41.792 22:53:45 -- scripts/common.sh@366 -- $ return 1 00:01:41.792 22:53:45 -- common/autobuild_common.sh@173 -- $ patch -p1 00:01:41.792 patching file config/rte_config.h 00:01:41.792 Hunk #1 succeeded at 60 (offset 1 line). 00:01:41.792 22:53:45 -- common/autobuild_common.sh@176 -- $ lt 23.11.0 24.07.0 00:01:41.792 22:53:45 -- scripts/common.sh@372 -- $ cmp_versions 23.11.0 '<' 24.07.0 00:01:41.792 22:53:45 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:01:41.792 22:53:45 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:01:41.792 22:53:45 -- scripts/common.sh@335 -- $ IFS=.-: 00:01:41.792 22:53:45 -- scripts/common.sh@335 -- $ read -ra ver1 00:01:41.792 22:53:45 -- scripts/common.sh@336 -- $ IFS=.-: 00:01:41.792 22:53:45 -- scripts/common.sh@336 -- $ read -ra ver2 00:01:41.792 22:53:45 -- scripts/common.sh@337 -- $ local 'op=<' 00:01:41.792 22:53:45 -- scripts/common.sh@339 -- $ ver1_l=3 00:01:41.792 22:53:45 -- scripts/common.sh@340 -- $ ver2_l=3 00:01:41.792 22:53:45 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:01:41.792 22:53:45 -- scripts/common.sh@343 -- $ case "$op" in 00:01:41.792 22:53:45 -- scripts/common.sh@344 -- $ : 1 00:01:41.792 22:53:45 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:01:41.792 22:53:45 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:01:41.792 22:53:45 -- scripts/common.sh@364 -- $ decimal 23 00:01:41.792 22:53:45 -- scripts/common.sh@352 -- $ local d=23 00:01:41.792 22:53:45 -- scripts/common.sh@353 -- $ [[ 23 =~ ^[0-9]+$ ]] 00:01:41.792 22:53:45 -- scripts/common.sh@354 -- $ echo 23 00:01:41.792 22:53:45 -- scripts/common.sh@364 -- $ ver1[v]=23 00:01:41.792 22:53:45 -- scripts/common.sh@365 -- $ decimal 24 00:01:41.792 22:53:45 -- scripts/common.sh@352 -- $ local d=24 00:01:41.792 22:53:45 -- scripts/common.sh@353 -- $ [[ 24 =~ ^[0-9]+$ ]] 00:01:41.792 22:53:45 -- scripts/common.sh@354 -- $ echo 24 00:01:41.792 22:53:45 -- scripts/common.sh@365 -- $ ver2[v]=24 00:01:41.792 22:53:45 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:01:41.792 22:53:45 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:01:41.792 22:53:45 -- scripts/common.sh@367 -- $ return 0 00:01:41.792 22:53:45 -- common/autobuild_common.sh@177 -- $ patch -p1 00:01:41.792 patching file lib/pcapng/rte_pcapng.c 00:01:41.792 22:53:45 -- common/autobuild_common.sh@180 -- $ dpdk_kmods=false 00:01:41.792 22:53:45 -- common/autobuild_common.sh@181 -- $ uname -s 00:01:41.792 22:53:45 -- common/autobuild_common.sh@181 -- $ '[' Linux = FreeBSD ']' 00:01:41.792 22:53:45 -- common/autobuild_common.sh@185 -- $ printf %s, bus bus/pci bus/vdev mempool/ring net/i40e net/i40e/base 00:01:41.792 22:53:45 -- common/autobuild_common.sh@185 -- $ meson build-tmp --prefix=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build --libdir lib -Denable_docs=false -Denable_kmods=false -Dtests=false -Dc_link_args= '-Dc_args=-fPIC -g -fcommon -Werror -Wno-stringop-overflow' -Dmachine=native -Denable_drivers=bus,bus/pci,bus/vdev,mempool/ring,net/i40e,net/i40e/base, 00:01:45.993 The Meson build system 00:01:45.993 Version: 1.5.0 00:01:45.993 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:45.993 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp 00:01:45.993 Build type: native build 00:01:45.993 Program cat found: YES (/usr/bin/cat) 00:01:45.993 Project name: DPDK 00:01:45.993 Project version: 23.11.0 00:01:45.993 C compiler for the host machine: gcc (gcc 13.3.1 "gcc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:01:45.993 C linker for the host machine: gcc ld.bfd 2.40-14 00:01:45.993 Host machine cpu family: x86_64 00:01:45.993 Host machine cpu: x86_64 00:01:45.993 Message: ## Building in Developer Mode ## 00:01:45.993 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:45.993 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/check-symbols.sh) 00:01:45.993 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/options-ibverbs-static.sh) 00:01:45.993 Program python3 found: YES (/usr/bin/python3) 00:01:45.993 Program cat found: YES (/usr/bin/cat) 00:01:45.993 config/meson.build:113: WARNING: The "machine" option is deprecated. Please use "cpu_instruction_set" instead. 00:01:45.993 Compiler for C supports arguments -march=native: YES 00:01:45.993 Checking for size of "void *" : 8 00:01:45.993 Checking for size of "void *" : 8 (cached) 00:01:45.993 Library m found: YES 00:01:45.993 Library numa found: YES 00:01:45.993 Has header "numaif.h" : YES 00:01:45.993 Library fdt found: NO 00:01:45.993 Library execinfo found: NO 00:01:45.993 Has header "execinfo.h" : YES 00:01:45.993 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:01:45.993 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:45.993 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:45.993 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:45.993 Run-time dependency openssl found: YES 3.1.1 00:01:45.993 Run-time dependency libpcap found: YES 1.10.4 00:01:45.993 Has header "pcap.h" with dependency libpcap: YES 00:01:45.993 Compiler for C supports arguments -Wcast-qual: YES 00:01:45.993 Compiler for C supports arguments -Wdeprecated: YES 00:01:45.993 Compiler for C supports arguments -Wformat: YES 00:01:45.993 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:45.993 Compiler for C supports arguments -Wformat-security: NO 00:01:45.993 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:45.993 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:45.993 Compiler for C supports arguments -Wnested-externs: YES 00:01:45.993 Compiler for C supports arguments -Wold-style-definition: YES 00:01:45.993 Compiler for C supports arguments -Wpointer-arith: YES 00:01:45.993 Compiler for C supports arguments -Wsign-compare: YES 00:01:45.993 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:45.993 Compiler for C supports arguments -Wundef: YES 00:01:45.993 Compiler for C supports arguments -Wwrite-strings: YES 00:01:45.993 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:45.993 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:45.993 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:45.993 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:45.993 Program objdump found: YES (/usr/bin/objdump) 00:01:45.993 Compiler for C supports arguments -mavx512f: YES 00:01:45.993 Checking if "AVX512 checking" compiles: YES 00:01:45.993 Fetching value of define "__SSE4_2__" : 1 00:01:45.993 Fetching value of define "__AES__" : 1 00:01:45.993 Fetching value of define "__AVX__" : 1 00:01:45.993 Fetching value of define "__AVX2__" : (undefined) 00:01:45.993 Fetching value of define "__AVX512BW__" : (undefined) 00:01:45.993 Fetching value of define "__AVX512CD__" : (undefined) 00:01:45.993 Fetching value of define "__AVX512DQ__" : (undefined) 00:01:45.993 Fetching value of define "__AVX512F__" : (undefined) 00:01:45.993 Fetching value of define "__AVX512VL__" : (undefined) 00:01:45.993 Fetching value of define "__PCLMUL__" : 1 00:01:45.993 Fetching value of define "__RDRND__" : 1 00:01:45.993 Fetching value of define "__RDSEED__" : (undefined) 00:01:45.993 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:45.993 Fetching value of define "__znver1__" : (undefined) 00:01:45.993 Fetching value of define "__znver2__" : (undefined) 00:01:45.993 Fetching value of define "__znver3__" : (undefined) 00:01:45.994 Fetching value of define "__znver4__" : (undefined) 00:01:45.994 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:45.994 Message: lib/log: Defining dependency "log" 00:01:45.994 Message: lib/kvargs: Defining dependency "kvargs" 00:01:45.994 Message: lib/telemetry: Defining dependency "telemetry" 00:01:45.994 Checking for function "getentropy" : NO 00:01:45.994 Message: lib/eal: Defining dependency "eal" 00:01:45.994 Message: lib/ring: Defining dependency "ring" 00:01:45.994 Message: lib/rcu: Defining dependency "rcu" 00:01:45.994 Message: lib/mempool: Defining dependency "mempool" 00:01:45.994 Message: lib/mbuf: Defining dependency "mbuf" 00:01:45.994 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:45.994 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:45.994 Compiler for C supports arguments -mpclmul: YES 00:01:45.994 Compiler for C supports arguments -maes: YES 00:01:45.994 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:45.994 Compiler for C supports arguments -mavx512bw: YES 00:01:45.994 Compiler for C supports arguments -mavx512dq: YES 00:01:45.994 Compiler for C supports arguments -mavx512vl: YES 00:01:45.994 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:45.994 Compiler for C supports arguments -mavx2: YES 00:01:45.994 Compiler for C supports arguments -mavx: YES 00:01:45.994 Message: lib/net: Defining dependency "net" 00:01:45.994 Message: lib/meter: Defining dependency "meter" 00:01:45.994 Message: lib/ethdev: Defining dependency "ethdev" 00:01:45.994 Message: lib/pci: Defining dependency "pci" 00:01:45.994 Message: lib/cmdline: Defining dependency "cmdline" 00:01:45.994 Message: lib/metrics: Defining dependency "metrics" 00:01:45.994 Message: lib/hash: Defining dependency "hash" 00:01:45.994 Message: lib/timer: Defining dependency "timer" 00:01:45.994 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:45.994 Fetching value of define "__AVX512VL__" : (undefined) (cached) 00:01:45.994 Fetching value of define "__AVX512CD__" : (undefined) (cached) 00:01:45.994 Fetching value of define "__AVX512BW__" : (undefined) (cached) 00:01:45.994 Compiler for C supports arguments -mavx512f -mavx512vl -mavx512cd -mavx512bw: YES 00:01:45.994 Message: lib/acl: Defining dependency "acl" 00:01:45.994 Message: lib/bbdev: Defining dependency "bbdev" 00:01:45.994 Message: lib/bitratestats: Defining dependency "bitratestats" 00:01:45.994 Run-time dependency libelf found: YES 0.191 00:01:45.994 Message: lib/bpf: Defining dependency "bpf" 00:01:45.994 Message: lib/cfgfile: Defining dependency "cfgfile" 00:01:45.994 Message: lib/compressdev: Defining dependency "compressdev" 00:01:45.994 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:45.994 Message: lib/distributor: Defining dependency "distributor" 00:01:45.994 Message: lib/dmadev: Defining dependency "dmadev" 00:01:45.994 Message: lib/efd: Defining dependency "efd" 00:01:45.994 Message: lib/eventdev: Defining dependency "eventdev" 00:01:45.994 Message: lib/dispatcher: Defining dependency "dispatcher" 00:01:45.994 Message: lib/gpudev: Defining dependency "gpudev" 00:01:45.994 Message: lib/gro: Defining dependency "gro" 00:01:45.994 Message: lib/gso: Defining dependency "gso" 00:01:45.994 Message: lib/ip_frag: Defining dependency "ip_frag" 00:01:45.994 Message: lib/jobstats: Defining dependency "jobstats" 00:01:45.994 Message: lib/latencystats: Defining dependency "latencystats" 00:01:45.994 Message: lib/lpm: Defining dependency "lpm" 00:01:45.994 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:45.994 Fetching value of define "__AVX512DQ__" : (undefined) (cached) 00:01:45.994 Fetching value of define "__AVX512IFMA__" : (undefined) 00:01:45.994 Compiler for C supports arguments -mavx512f -mavx512dq -mavx512ifma: YES 00:01:45.994 Message: lib/member: Defining dependency "member" 00:01:45.994 Message: lib/pcapng: Defining dependency "pcapng" 00:01:45.994 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:45.994 Message: lib/power: Defining dependency "power" 00:01:45.994 Message: lib/rawdev: Defining dependency "rawdev" 00:01:45.994 Message: lib/regexdev: Defining dependency "regexdev" 00:01:45.994 Message: lib/mldev: Defining dependency "mldev" 00:01:45.994 Message: lib/rib: Defining dependency "rib" 00:01:45.994 Message: lib/reorder: Defining dependency "reorder" 00:01:45.994 Message: lib/sched: Defining dependency "sched" 00:01:45.994 Message: lib/security: Defining dependency "security" 00:01:45.994 Message: lib/stack: Defining dependency "stack" 00:01:45.994 Has header "linux/userfaultfd.h" : YES 00:01:45.994 Has header "linux/vduse.h" : YES 00:01:45.994 Message: lib/vhost: Defining dependency "vhost" 00:01:45.994 Message: lib/ipsec: Defining dependency "ipsec" 00:01:45.994 Message: lib/pdcp: Defining dependency "pdcp" 00:01:45.994 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:45.994 Fetching value of define "__AVX512DQ__" : (undefined) (cached) 00:01:45.994 Compiler for C supports arguments -mavx512f -mavx512dq: YES 00:01:45.994 Compiler for C supports arguments -mavx512bw: YES (cached) 00:01:45.994 Message: lib/fib: Defining dependency "fib" 00:01:45.994 Message: lib/port: Defining dependency "port" 00:01:45.994 Message: lib/pdump: Defining dependency "pdump" 00:01:45.994 Message: lib/table: Defining dependency "table" 00:01:45.994 Message: lib/pipeline: Defining dependency "pipeline" 00:01:45.994 Message: lib/graph: Defining dependency "graph" 00:01:45.994 Message: lib/node: Defining dependency "node" 00:01:47.928 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:47.928 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:47.928 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:47.928 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:47.928 Compiler for C supports arguments -Wno-sign-compare: YES 00:01:47.928 Compiler for C supports arguments -Wno-unused-value: YES 00:01:47.928 Compiler for C supports arguments -Wno-format: YES 00:01:47.928 Compiler for C supports arguments -Wno-format-security: YES 00:01:47.928 Compiler for C supports arguments -Wno-format-nonliteral: YES 00:01:47.928 Compiler for C supports arguments -Wno-strict-aliasing: YES 00:01:47.928 Compiler for C supports arguments -Wno-unused-but-set-variable: YES 00:01:47.928 Compiler for C supports arguments -Wno-unused-parameter: YES 00:01:47.928 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:47.928 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:47.928 Compiler for C supports arguments -mavx512bw: YES (cached) 00:01:47.928 Compiler for C supports arguments -march=skylake-avx512: YES 00:01:47.928 Message: drivers/net/i40e: Defining dependency "net_i40e" 00:01:47.928 Has header "sys/epoll.h" : YES 00:01:47.928 Program doxygen found: YES (/usr/local/bin/doxygen) 00:01:47.928 Configuring doxy-api-html.conf using configuration 00:01:47.928 Configuring doxy-api-man.conf using configuration 00:01:47.928 Program mandb found: YES (/usr/bin/mandb) 00:01:47.928 Program sphinx-build found: NO 00:01:47.928 Configuring rte_build_config.h using configuration 00:01:47.928 Message: 00:01:47.928 ================= 00:01:47.928 Applications Enabled 00:01:47.928 ================= 00:01:47.928 00:01:47.928 apps: 00:01:47.928 dumpcap, graph, pdump, proc-info, test-acl, test-bbdev, test-cmdline, test-compress-perf, 00:01:47.928 test-crypto-perf, test-dma-perf, test-eventdev, test-fib, test-flow-perf, test-gpudev, test-mldev, test-pipeline, 00:01:47.928 test-pmd, test-regex, test-sad, test-security-perf, 00:01:47.928 00:01:47.928 Message: 00:01:47.928 ================= 00:01:47.928 Libraries Enabled 00:01:47.928 ================= 00:01:47.928 00:01:47.928 libs: 00:01:47.928 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:01:47.928 net, meter, ethdev, pci, cmdline, metrics, hash, timer, 00:01:47.928 acl, bbdev, bitratestats, bpf, cfgfile, compressdev, cryptodev, distributor, 00:01:47.928 dmadev, efd, eventdev, dispatcher, gpudev, gro, gso, ip_frag, 00:01:47.928 jobstats, latencystats, lpm, member, pcapng, power, rawdev, regexdev, 00:01:47.928 mldev, rib, reorder, sched, security, stack, vhost, ipsec, 00:01:47.928 pdcp, fib, port, pdump, table, pipeline, graph, node, 00:01:47.928 00:01:47.928 00:01:47.928 Message: 00:01:47.928 =============== 00:01:47.928 Drivers Enabled 00:01:47.928 =============== 00:01:47.928 00:01:47.928 common: 00:01:47.928 00:01:47.928 bus: 00:01:47.928 pci, vdev, 00:01:47.928 mempool: 00:01:47.928 ring, 00:01:47.928 dma: 00:01:47.928 00:01:47.928 net: 00:01:47.928 i40e, 00:01:47.928 raw: 00:01:47.928 00:01:47.928 crypto: 00:01:47.928 00:01:47.928 compress: 00:01:47.928 00:01:47.928 regex: 00:01:47.928 00:01:47.928 ml: 00:01:47.928 00:01:47.928 vdpa: 00:01:47.928 00:01:47.928 event: 00:01:47.928 00:01:47.928 baseband: 00:01:47.928 00:01:47.928 gpu: 00:01:47.928 00:01:47.928 00:01:47.928 Message: 00:01:47.928 ================= 00:01:47.928 Content Skipped 00:01:47.928 ================= 00:01:47.928 00:01:47.928 apps: 00:01:47.928 00:01:47.928 libs: 00:01:47.928 00:01:47.928 drivers: 00:01:47.928 common/cpt: not in enabled drivers build config 00:01:47.928 common/dpaax: not in enabled drivers build config 00:01:47.928 common/iavf: not in enabled drivers build config 00:01:47.928 common/idpf: not in enabled drivers build config 00:01:47.928 common/mvep: not in enabled drivers build config 00:01:47.928 common/octeontx: not in enabled drivers build config 00:01:47.928 bus/auxiliary: not in enabled drivers build config 00:01:47.928 bus/cdx: not in enabled drivers build config 00:01:47.928 bus/dpaa: not in enabled drivers build config 00:01:47.928 bus/fslmc: not in enabled drivers build config 00:01:47.928 bus/ifpga: not in enabled drivers build config 00:01:47.928 bus/platform: not in enabled drivers build config 00:01:47.928 bus/vmbus: not in enabled drivers build config 00:01:47.928 common/cnxk: not in enabled drivers build config 00:01:47.928 common/mlx5: not in enabled drivers build config 00:01:47.928 common/nfp: not in enabled drivers build config 00:01:47.928 common/qat: not in enabled drivers build config 00:01:47.928 common/sfc_efx: not in enabled drivers build config 00:01:47.928 mempool/bucket: not in enabled drivers build config 00:01:47.928 mempool/cnxk: not in enabled drivers build config 00:01:47.928 mempool/dpaa: not in enabled drivers build config 00:01:47.928 mempool/dpaa2: not in enabled drivers build config 00:01:47.928 mempool/octeontx: not in enabled drivers build config 00:01:47.928 mempool/stack: not in enabled drivers build config 00:01:47.928 dma/cnxk: not in enabled drivers build config 00:01:47.928 dma/dpaa: not in enabled drivers build config 00:01:47.928 dma/dpaa2: not in enabled drivers build config 00:01:47.928 dma/hisilicon: not in enabled drivers build config 00:01:47.928 dma/idxd: not in enabled drivers build config 00:01:47.928 dma/ioat: not in enabled drivers build config 00:01:47.928 dma/skeleton: not in enabled drivers build config 00:01:47.928 net/af_packet: not in enabled drivers build config 00:01:47.928 net/af_xdp: not in enabled drivers build config 00:01:47.928 net/ark: not in enabled drivers build config 00:01:47.928 net/atlantic: not in enabled drivers build config 00:01:47.928 net/avp: not in enabled drivers build config 00:01:47.928 net/axgbe: not in enabled drivers build config 00:01:47.928 net/bnx2x: not in enabled drivers build config 00:01:47.928 net/bnxt: not in enabled drivers build config 00:01:47.928 net/bonding: not in enabled drivers build config 00:01:47.928 net/cnxk: not in enabled drivers build config 00:01:47.928 net/cpfl: not in enabled drivers build config 00:01:47.928 net/cxgbe: not in enabled drivers build config 00:01:47.928 net/dpaa: not in enabled drivers build config 00:01:47.928 net/dpaa2: not in enabled drivers build config 00:01:47.928 net/e1000: not in enabled drivers build config 00:01:47.928 net/ena: not in enabled drivers build config 00:01:47.928 net/enetc: not in enabled drivers build config 00:01:47.928 net/enetfec: not in enabled drivers build config 00:01:47.928 net/enic: not in enabled drivers build config 00:01:47.928 net/failsafe: not in enabled drivers build config 00:01:47.928 net/fm10k: not in enabled drivers build config 00:01:47.928 net/gve: not in enabled drivers build config 00:01:47.928 net/hinic: not in enabled drivers build config 00:01:47.928 net/hns3: not in enabled drivers build config 00:01:47.929 net/iavf: not in enabled drivers build config 00:01:47.929 net/ice: not in enabled drivers build config 00:01:47.929 net/idpf: not in enabled drivers build config 00:01:47.929 net/igc: not in enabled drivers build config 00:01:47.929 net/ionic: not in enabled drivers build config 00:01:47.929 net/ipn3ke: not in enabled drivers build config 00:01:47.929 net/ixgbe: not in enabled drivers build config 00:01:47.929 net/mana: not in enabled drivers build config 00:01:47.929 net/memif: not in enabled drivers build config 00:01:47.929 net/mlx4: not in enabled drivers build config 00:01:47.929 net/mlx5: not in enabled drivers build config 00:01:47.929 net/mvneta: not in enabled drivers build config 00:01:47.929 net/mvpp2: not in enabled drivers build config 00:01:47.929 net/netvsc: not in enabled drivers build config 00:01:47.929 net/nfb: not in enabled drivers build config 00:01:47.929 net/nfp: not in enabled drivers build config 00:01:47.929 net/ngbe: not in enabled drivers build config 00:01:47.929 net/null: not in enabled drivers build config 00:01:47.929 net/octeontx: not in enabled drivers build config 00:01:47.929 net/octeon_ep: not in enabled drivers build config 00:01:47.929 net/pcap: not in enabled drivers build config 00:01:47.929 net/pfe: not in enabled drivers build config 00:01:47.929 net/qede: not in enabled drivers build config 00:01:47.929 net/ring: not in enabled drivers build config 00:01:47.929 net/sfc: not in enabled drivers build config 00:01:47.929 net/softnic: not in enabled drivers build config 00:01:47.929 net/tap: not in enabled drivers build config 00:01:47.929 net/thunderx: not in enabled drivers build config 00:01:47.929 net/txgbe: not in enabled drivers build config 00:01:47.929 net/vdev_netvsc: not in enabled drivers build config 00:01:47.929 net/vhost: not in enabled drivers build config 00:01:47.929 net/virtio: not in enabled drivers build config 00:01:47.929 net/vmxnet3: not in enabled drivers build config 00:01:47.929 raw/cnxk_bphy: not in enabled drivers build config 00:01:47.929 raw/cnxk_gpio: not in enabled drivers build config 00:01:47.929 raw/dpaa2_cmdif: not in enabled drivers build config 00:01:47.929 raw/ifpga: not in enabled drivers build config 00:01:47.929 raw/ntb: not in enabled drivers build config 00:01:47.929 raw/skeleton: not in enabled drivers build config 00:01:47.929 crypto/armv8: not in enabled drivers build config 00:01:47.929 crypto/bcmfs: not in enabled drivers build config 00:01:47.929 crypto/caam_jr: not in enabled drivers build config 00:01:47.929 crypto/ccp: not in enabled drivers build config 00:01:47.929 crypto/cnxk: not in enabled drivers build config 00:01:47.929 crypto/dpaa_sec: not in enabled drivers build config 00:01:47.929 crypto/dpaa2_sec: not in enabled drivers build config 00:01:47.929 crypto/ipsec_mb: not in enabled drivers build config 00:01:47.929 crypto/mlx5: not in enabled drivers build config 00:01:47.929 crypto/mvsam: not in enabled drivers build config 00:01:47.929 crypto/nitrox: not in enabled drivers build config 00:01:47.929 crypto/null: not in enabled drivers build config 00:01:47.929 crypto/octeontx: not in enabled drivers build config 00:01:47.929 crypto/openssl: not in enabled drivers build config 00:01:47.929 crypto/scheduler: not in enabled drivers build config 00:01:47.929 crypto/uadk: not in enabled drivers build config 00:01:47.929 crypto/virtio: not in enabled drivers build config 00:01:47.929 compress/isal: not in enabled drivers build config 00:01:47.929 compress/mlx5: not in enabled drivers build config 00:01:47.929 compress/octeontx: not in enabled drivers build config 00:01:47.929 compress/zlib: not in enabled drivers build config 00:01:47.929 regex/mlx5: not in enabled drivers build config 00:01:47.929 regex/cn9k: not in enabled drivers build config 00:01:47.929 ml/cnxk: not in enabled drivers build config 00:01:47.929 vdpa/ifc: not in enabled drivers build config 00:01:47.929 vdpa/mlx5: not in enabled drivers build config 00:01:47.929 vdpa/nfp: not in enabled drivers build config 00:01:47.929 vdpa/sfc: not in enabled drivers build config 00:01:47.929 event/cnxk: not in enabled drivers build config 00:01:47.929 event/dlb2: not in enabled drivers build config 00:01:47.929 event/dpaa: not in enabled drivers build config 00:01:47.929 event/dpaa2: not in enabled drivers build config 00:01:47.929 event/dsw: not in enabled drivers build config 00:01:47.929 event/opdl: not in enabled drivers build config 00:01:47.929 event/skeleton: not in enabled drivers build config 00:01:47.929 event/sw: not in enabled drivers build config 00:01:47.929 event/octeontx: not in enabled drivers build config 00:01:47.929 baseband/acc: not in enabled drivers build config 00:01:47.929 baseband/fpga_5gnr_fec: not in enabled drivers build config 00:01:47.929 baseband/fpga_lte_fec: not in enabled drivers build config 00:01:47.929 baseband/la12xx: not in enabled drivers build config 00:01:47.929 baseband/null: not in enabled drivers build config 00:01:47.929 baseband/turbo_sw: not in enabled drivers build config 00:01:47.929 gpu/cuda: not in enabled drivers build config 00:01:47.929 00:01:47.929 00:01:47.929 Build targets in project: 220 00:01:47.929 00:01:47.929 DPDK 23.11.0 00:01:47.929 00:01:47.929 User defined options 00:01:47.929 libdir : lib 00:01:47.929 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:47.929 c_args : -fPIC -g -fcommon -Werror -Wno-stringop-overflow 00:01:47.929 c_link_args : 00:01:47.929 enable_docs : false 00:01:47.929 enable_drivers: bus,bus/pci,bus/vdev,mempool/ring,net/i40e,net/i40e/base, 00:01:47.929 enable_kmods : false 00:01:47.929 machine : native 00:01:47.929 tests : false 00:01:47.929 00:01:47.929 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:47.929 WARNING: Running the setup command as `meson [options]` instead of `meson setup [options]` is ambiguous and deprecated. 00:01:48.197 22:53:51 -- common/autobuild_common.sh@189 -- $ ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp -j48 00:01:48.197 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp' 00:01:48.197 [1/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:48.197 [2/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:48.197 [3/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:48.462 [4/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:48.462 [5/710] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:01:48.462 [6/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:48.462 [7/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:48.462 [8/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:48.462 [9/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:48.462 [10/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:48.462 [11/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:48.462 [12/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:48.462 [13/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:48.462 [14/710] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:48.462 [15/710] Linking static target lib/librte_kvargs.a 00:01:48.462 [16/710] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:48.462 [17/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:48.462 [18/710] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:48.727 [19/710] Compiling C object lib/librte_log.a.p/log_log.c.o 00:01:48.727 [20/710] Linking static target lib/librte_log.a 00:01:48.727 [21/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:48.727 [22/710] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.300 [23/710] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.300 [24/710] Linking target lib/librte_log.so.24.0 00:01:49.300 [25/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:49.300 [26/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:49.300 [27/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:49.300 [28/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:49.300 [29/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:49.300 [30/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:49.566 [31/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:49.566 [32/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:49.566 [33/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:49.566 [34/710] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:49.566 [35/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:49.566 [36/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:49.566 [37/710] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:49.566 [38/710] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:49.566 [39/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:49.566 [40/710] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:49.566 [41/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:49.566 [42/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:49.566 [43/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:49.566 [44/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:49.566 [45/710] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:49.566 [46/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:49.566 [47/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:49.566 [48/710] Generating symbol file lib/librte_log.so.24.0.p/librte_log.so.24.0.symbols 00:01:49.566 [49/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:49.566 [50/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:49.566 [51/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:49.566 [52/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:49.566 [53/710] Linking target lib/librte_kvargs.so.24.0 00:01:49.566 [54/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:49.566 [55/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:49.566 [56/710] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:49.566 [57/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:49.566 [58/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:49.566 [59/710] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:49.829 [60/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:49.829 [61/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:49.829 [62/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:49.829 [63/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:49.829 [64/710] Generating symbol file lib/librte_kvargs.so.24.0.p/librte_kvargs.so.24.0.symbols 00:01:49.829 [65/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:50.089 [66/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:50.089 [67/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:50.089 [68/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:50.089 [69/710] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:50.089 [70/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:50.089 [71/710] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:50.089 [72/710] Linking static target lib/librte_pci.a 00:01:50.352 [73/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:50.352 [74/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:50.352 [75/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:50.352 [76/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:50.352 [77/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:50.352 [78/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:50.612 [79/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:50.612 [80/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:50.612 [81/710] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:50.612 [82/710] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:50.612 [83/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:50.612 [84/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:50.612 [85/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:50.612 [86/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:50.612 [87/710] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:50.612 [88/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:50.612 [89/710] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:01:50.612 [90/710] Linking static target lib/net/libnet_crc_avx512_lib.a 00:01:50.612 [91/710] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:50.612 [92/710] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:50.612 [93/710] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:50.612 [94/710] Linking static target lib/librte_ring.a 00:01:50.874 [95/710] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:50.874 [96/710] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:50.874 [97/710] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:50.874 [98/710] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:50.874 [99/710] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:50.874 [100/710] Linking static target lib/librte_meter.a 00:01:50.874 [101/710] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:50.874 [102/710] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:50.874 [103/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:50.874 [104/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:50.874 [105/710] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:50.874 [106/710] Linking static target lib/librte_telemetry.a 00:01:50.874 [107/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:51.138 [108/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:51.138 [109/710] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:51.138 [110/710] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:51.138 [111/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:51.138 [112/710] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:51.138 [113/710] Linking static target lib/librte_eal.a 00:01:51.138 [114/710] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:51.138 [115/710] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:51.138 [116/710] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:51.138 [117/710] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:51.138 [118/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:51.138 [119/710] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:51.401 [120/710] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:51.401 [121/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:51.401 [122/710] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:51.401 [123/710] Linking static target lib/librte_net.a 00:01:51.401 [124/710] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:51.401 [125/710] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:51.401 [126/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:51.674 [127/710] Linking static target lib/librte_cmdline.a 00:01:51.674 [128/710] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:51.674 [129/710] Linking static target lib/librte_mempool.a 00:01:51.674 [130/710] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:51.674 [131/710] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:51.674 [132/710] Linking target lib/librte_telemetry.so.24.0 00:01:51.674 [133/710] Compiling C object lib/librte_cfgfile.a.p/cfgfile_rte_cfgfile.c.o 00:01:51.674 [134/710] Linking static target lib/librte_cfgfile.a 00:01:51.674 [135/710] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:51.674 [136/710] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:51.942 [137/710] Compiling C object lib/librte_metrics.a.p/metrics_rte_metrics.c.o 00:01:51.942 [138/710] Compiling C object lib/librte_metrics.a.p/metrics_rte_metrics_telemetry.c.o 00:01:51.942 [139/710] Linking static target lib/librte_metrics.a 00:01:51.942 [140/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:51.942 [141/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:01:51.942 [142/710] Generating symbol file lib/librte_telemetry.so.24.0.p/librte_telemetry.so.24.0.symbols 00:01:51.942 [143/710] Compiling C object lib/librte_acl.a.p/acl_tb_mem.c.o 00:01:51.942 [144/710] Compiling C object lib/librte_acl.a.p/acl_rte_acl.c.o 00:01:52.208 [145/710] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:52.208 [146/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf.c.o 00:01:52.208 [147/710] Linking static target lib/librte_rcu.a 00:01:52.208 [148/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_dump.c.o 00:01:52.208 [149/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_stub.c.o 00:01:52.208 [150/710] Compiling C object lib/librte_bitratestats.a.p/bitratestats_rte_bitrate.c.o 00:01:52.208 [151/710] Linking static target lib/librte_bitratestats.a 00:01:52.208 [152/710] Generating lib/cfgfile.sym_chk with a custom command (wrapped by meson to capture output) 00:01:52.208 [153/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_load.c.o 00:01:52.471 [154/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:52.471 [155/710] Compiling C object lib/librte_acl.a.p/acl_acl_gen.c.o 00:01:52.471 [156/710] Generating lib/metrics.sym_chk with a custom command (wrapped by meson to capture output) 00:01:52.471 [157/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_load_elf.c.o 00:01:52.471 [158/710] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:52.471 [159/710] Compiling C object lib/librte_acl.a.p/acl_acl_run_scalar.c.o 00:01:52.471 [160/710] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:52.471 [161/710] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:52.471 [162/710] Linking static target lib/librte_timer.a 00:01:52.471 [163/710] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:52.471 [164/710] Generating lib/bitratestats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:52.738 [165/710] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:52.738 [166/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_exec.c.o 00:01:52.738 [167/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_convert.c.o 00:01:52.738 [168/710] Compiling C object lib/librte_bbdev.a.p/bbdev_rte_bbdev.c.o 00:01:52.738 [169/710] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:52.738 [170/710] Linking static target lib/librte_bbdev.a 00:01:52.738 [171/710] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:53.003 [172/710] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:53.003 [173/710] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor_match_sse.c.o 00:01:53.003 [174/710] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:01:53.003 [175/710] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:53.003 [176/710] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:53.263 [177/710] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:53.263 [178/710] Linking static target lib/librte_compressdev.a 00:01:53.263 [179/710] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor_single.c.o 00:01:53.263 [180/710] Compiling C object lib/librte_eventdev.a.p/eventdev_eventdev_private.c.o 00:01:53.263 [181/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_pkt.c.o 00:01:53.263 [182/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_validate.c.o 00:01:53.532 [183/710] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:53.532 [184/710] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor.c.o 00:01:53.532 [185/710] Linking static target lib/librte_distributor.a 00:01:53.532 [186/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_ring.c.o 00:01:53.794 [187/710] Generating lib/bbdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:53.794 [188/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_jit_x86.c.o 00:01:53.794 [189/710] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:01:53.794 [190/710] Linking static target lib/librte_dmadev.a 00:01:53.794 [191/710] Linking static target lib/librte_bpf.a 00:01:53.794 [192/710] Compiling C object lib/librte_eventdev.a.p/eventdev_eventdev_trace_points.c.o 00:01:53.794 [193/710] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:53.794 [194/710] Generating lib/distributor.sym_chk with a custom command (wrapped by meson to capture output) 00:01:54.060 [195/710] Compiling C object lib/librte_gso.a.p/gso_gso_tcp4.c.o 00:01:54.060 [196/710] Compiling C object lib/librte_gso.a.p/gso_gso_udp4.c.o 00:01:54.060 [197/710] Compiling C object lib/librte_dispatcher.a.p/dispatcher_rte_dispatcher.c.o 00:01:54.060 [198/710] Linking static target lib/librte_dispatcher.a 00:01:54.060 [199/710] Compiling C object lib/librte_gro.a.p/gro_gro_tcp6.c.o 00:01:54.060 [200/710] Compiling C object lib/librte_gso.a.p/gso_gso_tunnel_udp4.c.o 00:01:54.060 [201/710] Compiling C object lib/librte_gro.a.p/gro_gro_tcp4.c.o 00:01:54.060 [202/710] Compiling C object lib/librte_gso.a.p/gso_gso_tunnel_tcp4.c.o 00:01:54.060 [203/710] Compiling C object lib/librte_gro.a.p/gro_gro_udp4.c.o 00:01:54.060 [204/710] Compiling C object lib/librte_gso.a.p/gso_rte_gso.c.o 00:01:54.060 [205/710] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:54.060 [206/710] Compiling C object lib/librte_gro.a.p/gro_rte_gro.c.o 00:01:54.060 [207/710] Compiling C object lib/librte_gpudev.a.p/gpudev_gpudev.c.o 00:01:54.060 [208/710] Linking static target lib/librte_gpudev.a 00:01:54.326 [209/710] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:54.326 [210/710] Compiling C object lib/librte_gro.a.p/gro_gro_vxlan_tcp4.c.o 00:01:54.326 [211/710] Generating lib/bpf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:54.326 [212/710] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:54.326 [213/710] Compiling C object lib/librte_gro.a.p/gro_gro_vxlan_udp4.c.o 00:01:54.326 [214/710] Linking static target lib/librte_gro.a 00:01:54.326 [215/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv4_reassembly.c.o 00:01:54.326 [216/710] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:54.326 [217/710] Compiling C object lib/librte_jobstats.a.p/jobstats_rte_jobstats.c.o 00:01:54.326 [218/710] Linking static target lib/librte_jobstats.a 00:01:54.590 [219/710] Compiling C object lib/librte_acl.a.p/acl_acl_bld.c.o 00:01:54.590 [220/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv6_reassembly.c.o 00:01:54.590 [221/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_dma_adapter.c.o 00:01:54.590 [222/710] Generating lib/gro.sym_chk with a custom command (wrapped by meson to capture output) 00:01:54.854 [223/710] Generating lib/dispatcher.sym_chk with a custom command (wrapped by meson to capture output) 00:01:54.854 [224/710] Compiling C object lib/librte_latencystats.a.p/latencystats_rte_latencystats.c.o 00:01:54.854 [225/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_ip_frag_internal.c.o 00:01:54.854 [226/710] Linking static target lib/librte_latencystats.a 00:01:54.854 [227/710] Generating lib/jobstats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:54.854 [228/710] Compiling C object lib/member/libsketch_avx512_tmp.a.p/rte_member_sketch_avx512.c.o 00:01:54.854 [229/710] Linking static target lib/member/libsketch_avx512_tmp.a 00:01:54.854 [230/710] Compiling C object lib/librte_acl.a.p/acl_acl_run_sse.c.o 00:01:54.854 [231/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv6_fragmentation.c.o 00:01:55.118 [232/710] Compiling C object lib/librte_member.a.p/member_rte_member.c.o 00:01:55.118 [233/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ip_frag_common.c.o 00:01:55.118 [234/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv4_fragmentation.c.o 00:01:55.118 [235/710] Linking static target lib/librte_ip_frag.a 00:01:55.118 [236/710] Compiling C object lib/librte_lpm.a.p/lpm_rte_lpm.c.o 00:01:55.118 [237/710] Compiling C object lib/librte_sched.a.p/sched_rte_approx.c.o 00:01:55.384 [238/710] Generating lib/latencystats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:55.384 [239/710] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:01:55.384 [240/710] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:01:55.384 [241/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_crypto_adapter.c.o 00:01:55.647 [242/710] Compiling C object lib/librte_mldev.a.p/mldev_rte_mldev_pmd.c.o 00:01:55.647 [243/710] Generating lib/gpudev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:55.647 [244/710] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:55.647 [245/710] Generating lib/ip_frag.sym_chk with a custom command (wrapped by meson to capture output) 00:01:55.647 [246/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_eth_tx_adapter.c.o 00:01:55.647 [247/710] Compiling C object lib/librte_mldev.a.p/mldev_mldev_utils.c.o 00:01:55.647 [248/710] Compiling C object lib/librte_gso.a.p/gso_gso_common.c.o 00:01:55.647 [249/710] Linking static target lib/librte_gso.a 00:01:55.933 [250/710] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:01:55.933 [251/710] Compiling C object lib/librte_regexdev.a.p/regexdev_rte_regexdev.c.o 00:01:55.933 [252/710] Linking static target lib/librte_regexdev.a 00:01:55.933 [253/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_eventdev.c.o 00:01:55.933 [254/710] Compiling C object lib/librte_rawdev.a.p/rawdev_rte_rawdev.c.o 00:01:55.933 [255/710] Linking static target lib/librte_rawdev.a 00:01:55.933 [256/710] Compiling C object lib/librte_mldev.a.p/mldev_mldev_utils_scalar_bfloat16.c.o 00:01:55.933 [257/710] Compiling C object lib/librte_member.a.p/member_rte_member_vbf.c.o 00:01:55.933 [258/710] Compiling C object lib/librte_mldev.a.p/mldev_rte_mldev.c.o 00:01:56.250 [259/710] Generating lib/gso.sym_chk with a custom command (wrapped by meson to capture output) 00:01:56.250 [260/710] Compiling C object lib/librte_sched.a.p/sched_rte_pie.c.o 00:01:56.250 [261/710] Compiling C object lib/librte_mldev.a.p/mldev_mldev_utils_scalar.c.o 00:01:56.250 [262/710] Linking static target lib/librte_mldev.a 00:01:56.250 [263/710] Compiling C object lib/librte_sched.a.p/sched_rte_red.c.o 00:01:56.250 [264/710] Compiling C object lib/librte_pcapng.a.p/pcapng_rte_pcapng.c.o 00:01:56.250 [265/710] Compiling C object lib/librte_efd.a.p/efd_rte_efd.c.o 00:01:56.250 [266/710] Linking static target lib/librte_pcapng.a 00:01:56.250 [267/710] Linking static target lib/librte_efd.a 00:01:56.250 [268/710] Compiling C object lib/librte_stack.a.p/stack_rte_stack.c.o 00:01:56.250 [269/710] Compiling C object lib/librte_stack.a.p/stack_rte_stack_std.c.o 00:01:56.250 [270/710] Compiling C object lib/librte_stack.a.p/stack_rte_stack_lf.c.o 00:01:56.250 [271/710] Linking static target lib/librte_stack.a 00:01:56.568 [272/710] Compiling C object lib/librte_lpm.a.p/lpm_rte_lpm6.c.o 00:01:56.568 [273/710] Compiling C object lib/librte_member.a.p/member_rte_member_ht.c.o 00:01:56.568 [274/710] Linking static target lib/librte_lpm.a 00:01:56.568 [275/710] Compiling C object lib/acl/libavx2_tmp.a.p/acl_run_avx2.c.o 00:01:56.568 [276/710] Linking static target lib/acl/libavx2_tmp.a 00:01:56.568 [277/710] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:01:56.568 [278/710] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:01:56.568 [279/710] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:01:56.568 [280/710] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:01:56.568 [281/710] Generating lib/efd.sym_chk with a custom command (wrapped by meson to capture output) 00:01:56.568 [282/710] Compiling C object lib/librte_rib.a.p/rib_rte_rib.c.o 00:01:56.568 [283/710] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:01:56.568 [284/710] Linking static target lib/librte_hash.a 00:01:56.568 [285/710] Generating lib/rawdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:56.837 [286/710] Generating lib/pcapng.sym_chk with a custom command (wrapped by meson to capture output) 00:01:56.837 [287/710] Generating lib/stack.sym_chk with a custom command (wrapped by meson to capture output) 00:01:56.837 [288/710] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:01:56.837 [289/710] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:01:56.837 [290/710] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:01:56.837 [291/710] Linking static target lib/librte_reorder.a 00:01:56.837 [292/710] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:01:56.837 [293/710] Generating lib/lpm.sym_chk with a custom command (wrapped by meson to capture output) 00:01:56.837 [294/710] Linking static target lib/librte_power.a 00:01:57.101 [295/710] Compiling C object lib/acl/libavx512_tmp.a.p/acl_run_avx512.c.o 00:01:57.101 [296/710] Linking static target lib/acl/libavx512_tmp.a 00:01:57.101 [297/710] Linking static target lib/librte_acl.a 00:01:57.101 [298/710] Generating lib/regexdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.101 [299/710] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:01:57.101 [300/710] Linking static target lib/librte_security.a 00:01:57.101 [301/710] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:01:57.363 [302/710] Compiling C object lib/librte_ipsec.a.p/ipsec_ses.c.o 00:01:57.363 [303/710] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:01:57.363 [304/710] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:01:57.363 [305/710] Linking static target lib/librte_mbuf.a 00:01:57.363 [306/710] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:01:57.363 [307/710] Compiling C object lib/librte_ipsec.a.p/ipsec_ipsec_telemetry.c.o 00:01:57.363 [308/710] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.363 [309/710] Compiling C object lib/librte_rib.a.p/rib_rte_rib6.c.o 00:01:57.624 [310/710] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_crypto.c.o 00:01:57.624 [311/710] Linking static target lib/librte_rib.a 00:01:57.624 [312/710] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_ctrl_pdu.c.o 00:01:57.624 [313/710] Generating lib/acl.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.624 [314/710] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.624 [315/710] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_reorder.c.o 00:01:57.624 [316/710] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_cnt.c.o 00:01:57.624 [317/710] Compiling C object lib/librte_ipsec.a.p/ipsec_sa.c.o 00:01:57.889 [318/710] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.889 [319/710] Compiling C object lib/fib/libdir24_8_avx512_tmp.a.p/dir24_8_avx512.c.o 00:01:57.889 [320/710] Linking static target lib/fib/libdir24_8_avx512_tmp.a 00:01:57.889 [321/710] Compiling C object lib/fib/libtrie_avx512_tmp.a.p/trie_avx512.c.o 00:01:57.889 [322/710] Linking static target lib/fib/libtrie_avx512_tmp.a 00:01:57.889 [323/710] Compiling C object lib/librte_fib.a.p/fib_rte_fib.c.o 00:01:57.889 [324/710] Compiling C object lib/librte_table.a.p/table_rte_swx_keycmp.c.o 00:01:57.889 [325/710] Compiling C object lib/librte_fib.a.p/fib_rte_fib6.c.o 00:01:57.889 [326/710] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.889 [327/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:01:58.155 [328/710] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.155 [329/710] Generating lib/rib.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.419 [330/710] Compiling C object lib/librte_port.a.p/port_rte_port_sched.c.o 00:01:58.419 [331/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_eth_rx_adapter.c.o 00:01:58.419 [332/710] Generating lib/mldev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.419 [333/710] Compiling C object lib/librte_pdcp.a.p/pdcp_rte_pdcp.c.o 00:01:58.684 [334/710] Compiling C object lib/librte_member.a.p/member_rte_member_sketch.c.o 00:01:58.684 [335/710] Linking static target lib/librte_member.a 00:01:58.684 [336/710] Compiling C object lib/librte_ipsec.a.p/ipsec_ipsec_sad.c.o 00:01:58.684 [337/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_timer_adapter.c.o 00:01:58.684 [338/710] Linking static target lib/librte_eventdev.a 00:01:58.684 [339/710] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:01:58.947 [340/710] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:01:58.947 [341/710] Linking static target lib/librte_cryptodev.a 00:01:58.947 [342/710] Compiling C object lib/librte_port.a.p/port_rte_port_frag.c.o 00:01:58.947 [343/710] Compiling C object lib/librte_port.a.p/port_rte_port_fd.c.o 00:01:58.947 [344/710] Compiling C object lib/librte_table.a.p/table_rte_swx_table_selector.c.o 00:01:58.947 [345/710] Compiling C object lib/librte_fib.a.p/fib_trie.c.o 00:01:58.947 [346/710] Compiling C object lib/librte_table.a.p/table_rte_swx_table_wm.c.o 00:01:58.947 [347/710] Compiling C object lib/librte_table.a.p/table_rte_table_array.c.o 00:01:58.947 [348/710] Compiling C object lib/librte_table.a.p/table_rte_swx_table_learner.c.o 00:01:58.947 [349/710] Compiling C object lib/librte_port.a.p/port_rte_port_ethdev.c.o 00:01:59.208 [350/710] Generating lib/member.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.208 [351/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:01:59.208 [352/710] Linking static target lib/librte_ethdev.a 00:01:59.208 [353/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_cuckoo.c.o 00:01:59.208 [354/710] Compiling C object lib/librte_port.a.p/port_rte_port_ras.c.o 00:01:59.208 [355/710] Compiling C object lib/librte_sched.a.p/sched_rte_sched.c.o 00:01:59.208 [356/710] Linking static target lib/librte_sched.a 00:01:59.208 [357/710] Compiling C object lib/librte_table.a.p/table_rte_swx_table_em.c.o 00:01:59.208 [358/710] Compiling C object lib/librte_table.a.p/table_rte_table_acl.c.o 00:01:59.208 [359/710] Compiling C object lib/librte_fib.a.p/fib_dir24_8.c.o 00:01:59.208 [360/710] Linking static target lib/librte_fib.a 00:01:59.470 [361/710] Compiling C object lib/librte_port.a.p/port_rte_swx_port_ethdev.c.o 00:01:59.470 [362/710] Compiling C object lib/librte_port.a.p/port_rte_swx_port_fd.c.o 00:01:59.470 [363/710] Compiling C object lib/librte_table.a.p/table_rte_table_lpm.c.o 00:01:59.470 [364/710] Compiling C object lib/librte_table.a.p/table_rte_table_stub.c.o 00:01:59.470 [365/710] Compiling C object lib/librte_table.a.p/table_rte_table_lpm_ipv6.c.o 00:01:59.738 [366/710] Compiling C object lib/librte_port.a.p/port_rte_port_sym_crypto.c.o 00:01:59.738 [367/710] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:01:59.738 [368/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_port_in_action.c.o 00:01:59.738 [369/710] Compiling C object lib/librte_port.a.p/port_rte_port_eventdev.c.o 00:01:59.738 [370/710] Generating lib/fib.sym_chk with a custom command (wrapped by meson to capture output) 00:02:00.006 [371/710] Generating lib/sched.sym_chk with a custom command (wrapped by meson to capture output) 00:02:00.006 [372/710] Compiling C object lib/librte_ipsec.a.p/ipsec_esp_outb.c.o 00:02:00.006 [373/710] Compiling C object lib/librte_node.a.p/node_null.c.o 00:02:00.006 [374/710] Compiling C object lib/librte_port.a.p/port_rte_swx_port_ring.c.o 00:02:00.274 [375/710] Compiling C object lib/librte_pdump.a.p/pdump_rte_pdump.c.o 00:02:00.274 [376/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key8.c.o 00:02:00.274 [377/710] Linking static target lib/librte_pdump.a 00:02:00.274 [378/710] Compiling C object lib/librte_graph.a.p/graph_rte_graph_worker.c.o 00:02:00.274 [379/710] Compiling C object lib/librte_graph.a.p/graph_graph_debug.c.o 00:02:00.274 [380/710] Compiling C object lib/librte_graph.a.p/graph_graph_ops.c.o 00:02:00.274 [381/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:02:00.274 [382/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_ext.c.o 00:02:00.274 [383/710] Compiling C object lib/librte_graph.a.p/graph_node.c.o 00:02:00.535 [384/710] Compiling C object lib/librte_graph.a.p/graph_graph_populate.c.o 00:02:00.535 [385/710] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:02:00.535 [386/710] Compiling C object lib/librte_graph.a.p/graph_graph_pcap.c.o 00:02:00.535 [387/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key16.c.o 00:02:00.535 [388/710] Compiling C object lib/librte_node.a.p/node_ethdev_ctrl.c.o 00:02:00.535 [389/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_lru.c.o 00:02:00.535 [390/710] Generating lib/pdump.sym_chk with a custom command (wrapped by meson to capture output) 00:02:00.535 [391/710] Compiling C object lib/librte_ipsec.a.p/ipsec_esp_inb.c.o 00:02:00.535 [392/710] Linking static target lib/librte_ipsec.a 00:02:00.797 [393/710] Compiling C object lib/librte_graph.a.p/graph_graph.c.o 00:02:00.797 [394/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key32.c.o 00:02:00.797 [395/710] Linking static target lib/librte_table.a 00:02:00.797 [396/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_pipeline.c.o 00:02:00.797 [397/710] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:01.066 [398/710] Compiling C object lib/librte_node.a.p/node_log.c.o 00:02:01.066 [399/710] Compiling C object lib/librte_node.a.p/node_kernel_tx.c.o 00:02:01.066 [400/710] Compiling C object lib/librte_node.a.p/node_pkt_drop.c.o 00:02:01.066 [401/710] Generating lib/ipsec.sym_chk with a custom command (wrapped by meson to capture output) 00:02:01.327 [402/710] Compiling C object lib/librte_port.a.p/port_rte_swx_port_source_sink.c.o 00:02:01.592 [403/710] Compiling C object lib/librte_graph.a.p/graph_graph_stats.c.o 00:02:01.592 [404/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:02:01.592 [405/710] Compiling C object lib/librte_node.a.p/node_ethdev_tx.c.o 00:02:01.592 [406/710] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:02:01.859 [407/710] Compiling C object lib/librte_node.a.p/node_ethdev_rx.c.o 00:02:01.859 [408/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:02:01.859 [409/710] Linking target lib/librte_eal.so.24.0 00:02:01.859 [410/710] Compiling C object lib/librte_port.a.p/port_rte_port_ring.c.o 00:02:01.859 [411/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:02:01.859 [412/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_diag.c.o 00:02:01.859 [413/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:02:01.859 [414/710] Generating lib/table.sym_chk with a custom command (wrapped by meson to capture output) 00:02:01.859 [415/710] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:02:01.859 [416/710] Linking static target drivers/libtmp_rte_bus_vdev.a 00:02:01.859 [417/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_ipsec.c.o 00:02:01.859 [418/710] Generating lib/eventdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:02.122 [419/710] Generating symbol file lib/librte_eal.so.24.0.p/librte_eal.so.24.0.symbols 00:02:02.122 [420/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_hmc.c.o 00:02:02.122 [421/710] Linking target lib/librte_ring.so.24.0 00:02:02.122 [422/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:02:02.122 [423/710] Linking target lib/librte_meter.so.24.0 00:02:02.123 [424/710] Linking target lib/librte_pci.so.24.0 00:02:02.123 [425/710] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:02:02.385 [426/710] Compiling C object lib/librte_port.a.p/port_rte_port_source_sink.c.o 00:02:02.385 [427/710] Linking target lib/librte_timer.so.24.0 00:02:02.385 [428/710] Generating symbol file lib/librte_ring.so.24.0.p/librte_ring.so.24.0.symbols 00:02:02.385 [429/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_dcb.c.o 00:02:02.385 [430/710] Linking target lib/librte_acl.so.24.0 00:02:02.385 [431/710] Linking target lib/librte_rcu.so.24.0 00:02:02.385 [432/710] Generating symbol file lib/librte_meter.so.24.0.p/librte_meter.so.24.0.symbols 00:02:02.385 [433/710] Linking target lib/librte_mempool.so.24.0 00:02:02.385 [434/710] Linking target lib/librte_cfgfile.so.24.0 00:02:02.385 [435/710] Generating symbol file lib/librte_pci.so.24.0.p/librte_pci.so.24.0.symbols 00:02:02.651 [436/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_ctl.c.o 00:02:02.651 [437/710] Generating symbol file lib/librte_timer.so.24.0.p/librte_timer.so.24.0.symbols 00:02:02.651 [438/710] Linking target lib/librte_dmadev.so.24.0 00:02:02.651 [439/710] Linking target lib/librte_jobstats.so.24.0 00:02:02.651 [440/710] Linking static target lib/librte_port.a 00:02:02.651 [441/710] Generating symbol file lib/librte_acl.so.24.0.p/librte_acl.so.24.0.symbols 00:02:02.651 [442/710] Linking target lib/librte_rawdev.so.24.0 00:02:02.651 [443/710] Compiling C object lib/librte_node.a.p/node_ip4_reassembly.c.o 00:02:02.651 [444/710] Linking static target drivers/libtmp_rte_bus_pci.a 00:02:02.651 [445/710] Linking target lib/librte_stack.so.24.0 00:02:02.651 [446/710] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:02:02.651 [447/710] Compiling C object drivers/librte_bus_vdev.so.24.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:02:02.651 [448/710] Linking static target drivers/librte_bus_vdev.a 00:02:02.651 [449/710] Generating symbol file lib/librte_rcu.so.24.0.p/librte_rcu.so.24.0.symbols 00:02:02.651 [450/710] Compiling C object lib/librte_graph.a.p/graph_rte_graph_model_mcore_dispatch.c.o 00:02:02.651 [451/710] Generating symbol file lib/librte_mempool.so.24.0.p/librte_mempool.so.24.0.symbols 00:02:02.651 [452/710] Linking static target lib/librte_graph.a 00:02:02.651 [453/710] Linking target lib/librte_rib.so.24.0 00:02:02.651 [454/710] Linking target lib/librte_mbuf.so.24.0 00:02:02.651 [455/710] Compiling C object lib/librte_node.a.p/node_kernel_rx.c.o 00:02:02.919 [456/710] Generating symbol file lib/librte_dmadev.so.24.0.p/librte_dmadev.so.24.0.symbols 00:02:02.919 [457/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_lan_hmc.c.o 00:02:02.919 [458/710] Generating symbol file lib/librte_mbuf.so.24.0.p/librte_mbuf.so.24.0.symbols 00:02:02.919 [459/710] Generating symbol file lib/librte_rib.so.24.0.p/librte_rib.so.24.0.symbols 00:02:03.188 [460/710] Compiling C object app/dpdk-graph.p/graph_cli.c.o 00:02:03.188 [461/710] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:03.188 [462/710] Linking target lib/librte_net.so.24.0 00:02:03.188 [463/710] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:02:03.188 [464/710] Linking target lib/librte_bbdev.so.24.0 00:02:03.188 [465/710] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:02:03.188 [466/710] Linking target lib/librte_compressdev.so.24.0 00:02:03.188 [467/710] Compiling C object app/dpdk-graph.p/graph_ethdev_rx.c.o 00:02:03.188 [468/710] Linking target lib/librte_distributor.so.24.0 00:02:03.188 [469/710] Compiling C object app/dpdk-graph.p/graph_conn.c.o 00:02:03.188 [470/710] Linking target lib/librte_cryptodev.so.24.0 00:02:03.188 [471/710] Linking target lib/librte_gpudev.so.24.0 00:02:03.188 [472/710] Linking target lib/librte_regexdev.so.24.0 00:02:03.188 [473/710] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:02:03.188 [474/710] Linking target lib/librte_mldev.so.24.0 00:02:03.188 [475/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_vf_representor.c.o 00:02:03.188 [476/710] Compiling C object drivers/librte_bus_pci.so.24.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:02:03.188 [477/710] Linking static target drivers/librte_bus_pci.a 00:02:03.188 [478/710] Linking target lib/librte_reorder.so.24.0 00:02:03.188 [479/710] Linking static target drivers/libtmp_rte_mempool_ring.a 00:02:03.188 [480/710] Linking target lib/librte_sched.so.24.0 00:02:03.188 [481/710] Linking target lib/librte_fib.so.24.0 00:02:03.188 [482/710] Linking target drivers/librte_bus_vdev.so.24.0 00:02:03.451 [483/710] Generating symbol file lib/librte_net.so.24.0.p/librte_net.so.24.0.symbols 00:02:03.451 [484/710] Generating lib/port.sym_chk with a custom command (wrapped by meson to capture output) 00:02:03.451 [485/710] Generating symbol file lib/librte_cryptodev.so.24.0.p/librte_cryptodev.so.24.0.symbols 00:02:03.451 [486/710] Linking target lib/librte_cmdline.so.24.0 00:02:03.451 [487/710] Generating symbol file lib/librte_sched.so.24.0.p/librte_sched.so.24.0.symbols 00:02:03.451 [488/710] Generating symbol file lib/librte_reorder.so.24.0.p/librte_reorder.so.24.0.symbols 00:02:03.451 [489/710] Linking target lib/librte_hash.so.24.0 00:02:03.451 [490/710] Linking target lib/librte_security.so.24.0 00:02:03.451 [491/710] Compiling C object app/dpdk-graph.p/graph_graph.c.o 00:02:03.451 [492/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_hash.c.o 00:02:03.451 [493/710] Generating symbol file drivers/librte_bus_vdev.so.24.0.p/librte_bus_vdev.so.24.0.symbols 00:02:03.711 [494/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_tm.c.o 00:02:03.711 [495/710] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:02:03.711 [496/710] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:02:03.712 [497/710] Compiling C object app/dpdk-graph.p/graph_ethdev.c.o 00:02:03.712 [498/710] Linking static target drivers/librte_mempool_ring.a 00:02:03.712 [499/710] Compiling C object drivers/librte_mempool_ring.so.24.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:02:03.712 [500/710] Linking target drivers/librte_mempool_ring.so.24.0 00:02:03.712 [501/710] Compiling C object app/dpdk-test-cmdline.p/test-cmdline_commands.c.o 00:02:03.712 [502/710] Generating symbol file lib/librte_hash.so.24.0.p/librte_hash.so.24.0.symbols 00:02:03.712 [503/710] Generating lib/graph.sym_chk with a custom command (wrapped by meson to capture output) 00:02:03.712 [504/710] Generating symbol file lib/librte_security.so.24.0.p/librte_security.so.24.0.symbols 00:02:03.712 [505/710] Linking target lib/librte_lpm.so.24.0 00:02:03.974 [506/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_pf.c.o 00:02:03.974 [507/710] Compiling C object app/dpdk-test-cmdline.p/test-cmdline_cmdline_test.c.o 00:02:03.974 [508/710] Linking target lib/librte_efd.so.24.0 00:02:03.974 [509/710] Compiling C object app/dpdk-dumpcap.p/dumpcap_main.c.o 00:02:03.974 [510/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_recycle_mbufs_vec_common.c.o 00:02:03.974 [511/710] Linking target lib/librte_member.so.24.0 00:02:03.974 [512/710] Compiling C object app/dpdk-graph.p/graph_ip6_route.c.o 00:02:03.974 [513/710] Compiling C object app/dpdk-graph.p/graph_ip4_route.c.o 00:02:03.974 [514/710] Linking target lib/librte_ipsec.so.24.0 00:02:03.974 [515/710] Compiling C object app/dpdk-graph.p/graph_l3fwd.c.o 00:02:03.974 [516/710] Compiling C object lib/librte_node.a.p/node_ip4_local.c.o 00:02:03.974 [517/710] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:02:03.974 [518/710] Generating symbol file lib/librte_lpm.so.24.0.p/librte_lpm.so.24.0.symbols 00:02:04.240 [519/710] Linking target drivers/librte_bus_pci.so.24.0 00:02:04.240 [520/710] Compiling C object app/dpdk-graph.p/graph_main.c.o 00:02:04.240 [521/710] Compiling C object app/dpdk-graph.p/graph_mempool.c.o 00:02:04.240 [522/710] Generating symbol file lib/librte_ipsec.so.24.0.p/librte_ipsec.so.24.0.symbols 00:02:04.240 [523/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_pipeline_spec.c.o 00:02:04.240 [524/710] Generating symbol file drivers/librte_bus_pci.so.24.0.p/librte_bus_pci.so.24.0.symbols 00:02:04.506 [525/710] Compiling C object lib/librte_node.a.p/node_udp4_input.c.o 00:02:04.506 [526/710] Compiling C object app/dpdk-graph.p/graph_utils.c.o 00:02:04.506 [527/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_fdir.c.o 00:02:04.766 [528/710] Compiling C object drivers/net/i40e/libi40e_avx512_lib.a.p/i40e_rxtx_vec_avx512.c.o 00:02:04.766 [529/710] Linking static target drivers/net/i40e/libi40e_avx512_lib.a 00:02:04.766 [530/710] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_main.c.o 00:02:05.028 [531/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_test.c.o 00:02:05.028 [532/710] Compiling C object app/dpdk-graph.p/graph_neigh.c.o 00:02:05.291 [533/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_options_parse.c.o 00:02:05.291 [534/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_parser.c.o 00:02:05.291 [535/710] Compiling C object app/dpdk-test-acl.p/test-acl_main.c.o 00:02:05.291 [536/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_adminq.c.o 00:02:05.291 [537/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_common.c.o 00:02:05.291 [538/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_common.c.o 00:02:05.291 [539/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_main.c.o 00:02:05.554 [540/710] Compiling C object drivers/net/i40e/libi40e_avx2_lib.a.p/i40e_rxtx_vec_avx2.c.o 00:02:05.554 [541/710] Linking static target drivers/net/i40e/libi40e_avx2_lib.a 00:02:05.554 [542/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_vectors.c.o 00:02:05.823 [543/710] Compiling C object lib/librte_node.a.p/node_pkt_cls.c.o 00:02:05.823 [544/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_vector_parsing.c.o 00:02:05.823 [545/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_ops.c.o 00:02:05.823 [546/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_options_parsing.c.o 00:02:05.823 [547/710] Compiling C object app/dpdk-pdump.p/pdump_main.c.o 00:02:05.823 [548/710] Compiling C object lib/librte_node.a.p/node_ip6_lookup.c.o 00:02:06.085 [549/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_nvm.c.o 00:02:06.085 [550/710] Linking static target drivers/net/i40e/base/libi40e_base.a 00:02:06.085 [551/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_main.c.o 00:02:06.085 [552/710] Compiling C object app/dpdk-test-dma-perf.p/test-dma-perf_main.c.o 00:02:06.085 [553/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_ml_test.c.o 00:02:06.085 [554/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_flow.c.o 00:02:06.085 [555/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_main.c.o 00:02:06.349 [556/710] Compiling C object app/dpdk-proc-info.p/proc-info_main.c.o 00:02:06.350 [557/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_parser.c.o 00:02:06.350 [558/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_options.c.o 00:02:06.609 [559/710] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev_vector.c.o 00:02:06.870 [560/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_common.c.o 00:02:07.135 [561/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_rte_pmd_i40e.c.o 00:02:07.135 [562/710] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:07.135 [563/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_atq.c.o 00:02:07.135 [564/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_ml_main.c.o 00:02:07.135 [565/710] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_flow_gen.c.o 00:02:07.135 [566/710] Linking target lib/librte_ethdev.so.24.0 00:02:07.396 [567/710] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_items_gen.c.o 00:02:07.396 [568/710] Compiling C object app/dpdk-test-gpudev.p/test-gpudev_main.c.o 00:02:07.396 [569/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_model_common.c.o 00:02:07.396 [570/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_device_ops.c.o 00:02:07.396 [571/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_ml_options.c.o 00:02:07.396 [572/710] Compiling C object lib/librte_node.a.p/node_ip4_lookup.c.o 00:02:07.663 [573/710] Generating symbol file lib/librte_ethdev.so.24.0.p/librte_ethdev.so.24.0.symbols 00:02:07.663 [574/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_queue.c.o 00:02:07.663 [575/710] Linking target lib/librte_metrics.so.24.0 00:02:07.663 [576/710] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_actions_gen.c.o 00:02:07.663 [577/710] Linking target lib/librte_bpf.so.24.0 00:02:07.663 [578/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_inference_ordered.c.o 00:02:07.663 [579/710] Linking target lib/librte_gro.so.24.0 00:02:07.663 [580/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_model_ops.c.o 00:02:07.663 [581/710] Linking target lib/librte_eventdev.so.24.0 00:02:07.663 [582/710] Compiling C object app/dpdk-test-dma-perf.p/test-dma-perf_benchmark.c.o 00:02:07.663 [583/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_inference_interleave.c.o 00:02:07.663 [584/710] Linking target lib/librte_gso.so.24.0 00:02:07.924 [585/710] Linking target lib/librte_ip_frag.so.24.0 00:02:07.924 [586/710] Linking target lib/librte_pcapng.so.24.0 00:02:07.924 [587/710] Linking target lib/librte_power.so.24.0 00:02:07.924 [588/710] Generating symbol file lib/librte_metrics.so.24.0.p/librte_metrics.so.24.0.symbols 00:02:07.924 [589/710] Generating symbol file lib/librte_bpf.so.24.0.p/librte_bpf.so.24.0.symbols 00:02:07.924 [590/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_atq.c.o 00:02:07.924 [591/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_rxtx_vec_sse.c.o 00:02:07.924 [592/710] Linking target lib/librte_latencystats.so.24.0 00:02:07.924 [593/710] Linking target lib/librte_bitratestats.so.24.0 00:02:07.924 [594/710] Generating symbol file lib/librte_eventdev.so.24.0.p/librte_eventdev.so.24.0.symbols 00:02:07.924 [595/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_queue.c.o 00:02:07.924 [596/710] Compiling C object app/dpdk-test-fib.p/test-fib_main.c.o 00:02:08.189 [597/710] Linking target lib/librte_dispatcher.so.24.0 00:02:08.189 [598/710] Generating symbol file lib/librte_pcapng.so.24.0.p/librte_pcapng.so.24.0.symbols 00:02:08.189 [599/710] Generating symbol file lib/librte_ip_frag.so.24.0.p/librte_ip_frag.so.24.0.symbols 00:02:08.189 [600/710] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_process.c.o 00:02:08.189 [601/710] Linking static target lib/librte_pdcp.a 00:02:08.189 [602/710] Linking target lib/librte_pdump.so.24.0 00:02:08.189 [603/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_common.c.o 00:02:08.189 [604/710] Linking target lib/librte_port.so.24.0 00:02:08.189 [605/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_stats.c.o 00:02:08.189 [606/710] Linking target lib/librte_graph.so.24.0 00:02:08.455 [607/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_config.c.o 00:02:08.455 [608/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_common.c.o 00:02:08.455 [609/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_init.c.o 00:02:08.455 [610/710] Generating symbol file lib/librte_graph.so.24.0.p/librte_graph.so.24.0.symbols 00:02:08.455 [611/710] Generating symbol file lib/librte_port.so.24.0.p/librte_port.so.24.0.symbols 00:02:08.455 [612/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_main.c.o 00:02:08.721 [613/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_acl.c.o 00:02:08.721 [614/710] Linking target lib/librte_table.so.24.0 00:02:08.721 [615/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_lpm.c.o 00:02:08.721 [616/710] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev.c.o 00:02:08.721 [617/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_stub.c.o 00:02:08.721 [618/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_lpm_ipv6.c.o 00:02:08.721 [619/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_verify.c.o 00:02:08.721 [620/710] Generating lib/pdcp.sym_chk with a custom command (wrapped by meson to capture output) 00:02:08.979 [621/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_throughput.c.o 00:02:08.979 [622/710] Linking target lib/librte_pdcp.so.24.0 00:02:08.979 [623/710] Generating symbol file lib/librte_table.so.24.0.p/librte_table.so.24.0.symbols 00:02:08.979 [624/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_hash.c.o 00:02:08.980 [625/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_pmd_cyclecount.c.o 00:02:08.980 [626/710] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_main.c.o 00:02:09.240 [627/710] Compiling C object app/dpdk-testpmd.p/test-pmd_5tswap.c.o 00:02:09.240 [628/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_cman.c.o 00:02:09.500 [629/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmd_flex_item.c.o 00:02:09.500 [630/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_rxtx.c.o 00:02:09.762 [631/710] Compiling C object app/dpdk-testpmd.p/test-pmd_flowgen.c.o 00:02:09.762 [632/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_runtime.c.o 00:02:09.762 [633/710] Compiling C object app/dpdk-testpmd.p/test-pmd_rxonly.c.o 00:02:09.762 [634/710] Compiling C object app/dpdk-testpmd.p/test-pmd_iofwd.c.o 00:02:09.762 [635/710] Compiling C object app/dpdk-testpmd.p/test-pmd_macfwd.c.o 00:02:10.021 [636/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_mtr.c.o 00:02:10.021 [637/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_throughput.c.o 00:02:10.021 [638/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_tm.c.o 00:02:10.021 [639/710] Compiling C object app/dpdk-testpmd.p/test-pmd_recycle_mbufs.c.o 00:02:10.021 [640/710] Compiling C object app/dpdk-testpmd.p/test-pmd_macswap.c.o 00:02:10.021 [641/710] Compiling C object app/dpdk-testpmd.p/test-pmd_bpf_cmd.c.o 00:02:10.021 [642/710] Compiling C object app/dpdk-testpmd.p/test-pmd_icmpecho.c.o 00:02:10.021 [643/710] Compiling C object app/dpdk-testpmd.p/test-pmd_shared_rxq_fwd.c.o 00:02:10.280 [644/710] Compiling C object app/dpdk-testpmd.p/test-pmd_ieee1588fwd.c.o 00:02:10.280 [645/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_latency.c.o 00:02:10.539 [646/710] Compiling C object app/dpdk-test-security-perf.p/test-security-perf_test_security_perf.c.o 00:02:10.539 [647/710] Compiling C object app/dpdk-testpmd.p/test-pmd_util.c.o 00:02:10.539 [648/710] Compiling C object app/dpdk-test-sad.p/test-sad_main.c.o 00:02:10.539 [649/710] Compiling C object app/dpdk-testpmd.p/test-pmd_parameters.c.o 00:02:10.798 [650/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_queue.c.o 00:02:10.798 [651/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_atq.c.o 00:02:10.798 [652/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_ethdev.c.o 00:02:10.798 [653/710] Linking static target drivers/libtmp_rte_net_i40e.a 00:02:10.798 [654/710] Compiling C object app/dpdk-test-regex.p/test-regex_main.c.o 00:02:10.798 [655/710] Compiling C object app/dpdk-testpmd.p/.._drivers_net_i40e_i40e_testpmd.c.o 00:02:11.056 [656/710] Compiling C object app/dpdk-testpmd.p/test-pmd_csumonly.c.o 00:02:11.315 [657/710] Compiling C object app/dpdk-test-security-perf.p/test_test_cryptodev_security_ipsec.c.o 00:02:11.315 [658/710] Generating drivers/rte_net_i40e.pmd.c with a custom command 00:02:11.315 [659/710] Compiling C object drivers/librte_net_i40e.a.p/meson-generated_.._rte_net_i40e.pmd.c.o 00:02:11.315 [660/710] Compiling C object drivers/librte_net_i40e.so.24.0.p/meson-generated_.._rte_net_i40e.pmd.c.o 00:02:11.315 [661/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_cyclecount.c.o 00:02:11.315 [662/710] Linking static target drivers/librte_net_i40e.a 00:02:11.315 [663/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_common.c.o 00:02:11.574 [664/710] Compiling C object app/dpdk-testpmd.p/test-pmd_testpmd.c.o 00:02:11.574 [665/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_verify.c.o 00:02:11.831 [666/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_pipeline.c.o 00:02:11.831 [667/710] Generating drivers/rte_net_i40e.sym_chk with a custom command (wrapped by meson to capture output) 00:02:12.089 [668/710] Linking target drivers/librte_net_i40e.so.24.0 00:02:12.089 [669/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline.c.o 00:02:12.089 [670/710] Compiling C object app/dpdk-testpmd.p/test-pmd_noisy_vnf.c.o 00:02:12.348 [671/710] Compiling C object lib/librte_node.a.p/node_ip6_rewrite.c.o 00:02:12.914 [672/710] Compiling C object lib/librte_node.a.p/node_ip4_rewrite.c.o 00:02:12.914 [673/710] Compiling C object app/dpdk-testpmd.p/test-pmd_txonly.c.o 00:02:12.914 [674/710] Linking static target lib/librte_node.a 00:02:13.173 [675/710] Generating lib/node.sym_chk with a custom command (wrapped by meson to capture output) 00:02:13.173 [676/710] Linking target lib/librte_node.so.24.0 00:02:14.108 [677/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_inference_common.c.o 00:02:14.367 [678/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_common.c.o 00:02:14.627 [679/710] Compiling C object app/dpdk-testpmd.p/test-pmd_config.c.o 00:02:16.001 [680/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_flow.c.o 00:02:16.567 [681/710] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev_perf.c.o 00:02:21.834 [682/710] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:02:53.932 [683/710] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:02:53.932 [684/710] Linking static target lib/librte_vhost.a 00:02:54.867 [685/710] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:02:55.126 [686/710] Linking target lib/librte_vhost.so.24.0 00:03:07.327 [687/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_table_action.c.o 00:03:07.327 [688/710] Linking static target lib/librte_pipeline.a 00:03:07.327 [689/710] Linking target app/dpdk-dumpcap 00:03:07.327 [690/710] Linking target app/dpdk-proc-info 00:03:07.327 [691/710] Linking target app/dpdk-pdump 00:03:07.327 [692/710] Linking target app/dpdk-test-cmdline 00:03:07.327 [693/710] Linking target app/dpdk-test-dma-perf 00:03:07.327 [694/710] Linking target app/dpdk-test-flow-perf 00:03:07.327 [695/710] Linking target app/dpdk-test-crypto-perf 00:03:07.327 [696/710] Linking target app/dpdk-test-compress-perf 00:03:07.327 [697/710] Linking target app/dpdk-test-gpudev 00:03:07.327 [698/710] Linking target app/dpdk-test-sad 00:03:07.327 [699/710] Linking target app/dpdk-test-pipeline 00:03:07.327 [700/710] Linking target app/dpdk-test-regex 00:03:07.327 [701/710] Linking target app/dpdk-test-acl 00:03:07.327 [702/710] Linking target app/dpdk-graph 00:03:07.327 [703/710] Linking target app/dpdk-test-fib 00:03:07.327 [704/710] Linking target app/dpdk-test-security-perf 00:03:07.327 [705/710] Linking target app/dpdk-test-mldev 00:03:07.327 [706/710] Linking target app/dpdk-test-bbdev 00:03:07.327 [707/710] Linking target app/dpdk-test-eventdev 00:03:07.327 [708/710] Linking target app/dpdk-testpmd 00:03:09.225 [709/710] Generating lib/pipeline.sym_chk with a custom command (wrapped by meson to capture output) 00:03:09.225 [710/710] Linking target lib/librte_pipeline.so.24.0 00:03:09.225 22:55:12 -- common/autobuild_common.sh@190 -- $ ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp -j48 install 00:03:09.225 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp' 00:03:09.225 [0/1] Installing files. 00:03:09.489 Installing subdir /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples 00:03:09.489 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:09.489 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:09.489 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_default_v4.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:09.489 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:09.489 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:09.489 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_route.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:09.489 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:09.489 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:09.489 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:09.489 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:09.489 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:09.489 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:09.489 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:09.489 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_route_parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:09.489 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:09.489 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:09.489 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:09.489 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_fib.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:09.489 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:09.489 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_default_v6.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:09.489 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event_internal_port.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:09.489 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_sequential.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:09.489 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:09.489 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:09.489 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:09.489 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:09.489 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_route_parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:09.489 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_default_v4.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:09.489 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:09.489 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:09.489 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_default_v6.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:09.489 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl_scalar.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:09.489 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:09.489 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq_dcb/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq_dcb 00:03:09.489 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq_dcb/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq_dcb 00:03:09.489 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/flow_blocks.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event_internal_port.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_poll.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_common.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_poll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/parse_obj_list.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/parse_obj_list.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/pkt_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/neon/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/neon 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/altivec/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/altivec 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/sse/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/sse 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ptpclient/ptpclient.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ptpclient 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ptpclient/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ptpclient 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/helloworld/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/helloworld 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/helloworld/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/helloworld 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/rxtx_callbacks/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/rxtx_callbacks 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/rxtx_callbacks/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/rxtx_callbacks 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor_x86.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/vm_power_cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_manager.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_monitor.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_monitor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor_nop.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_manager.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/vm_power_cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/power_manager.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/power_manager.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/vm_power_cli_guest.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/vm_power_cli_guest.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/app_thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_ov.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cfg_file.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cmdline.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cfg_file.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/stats.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_red.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_pie.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/l2fwd-cat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/cat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/cat.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:03:09.490 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/perf_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/perf_core.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/vdpa_blk_compact.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/virtio_net.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/blk_spec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk_compat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/blk.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_ecdsa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_aes.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_sha.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_tdes.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_dev_self_test.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_rsa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_dev_self_test.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_gcm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_cmac.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_xts.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_hmac.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_ccm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/dma/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/dma 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/dma/dmafwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/dma 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/mp_commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/mp_commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/symmetric_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/symmetric_mp 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/symmetric_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/symmetric_mp 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/args.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/init.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_client/client.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_client 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_client/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_client 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/shared/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/shared 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-graph/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-graph 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-graph/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-graph 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-jobstats/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-jobstats 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-jobstats/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-jobstats 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_fragmentation/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_fragmentation 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_fragmentation/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_fragmentation 00:03:09.491 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/packet_ordering/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/packet_ordering 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/packet_ordering/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/packet_ordering 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-crypto/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-crypto 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-crypto/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-crypto 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/shm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/shm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/ka-agent/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive/ka-agent 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/ka-agent/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive/ka-agent 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/skeleton/basicfwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/skeleton 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/skeleton/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/skeleton 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-macsec/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-macsec 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-macsec/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-macsec 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/service_cores/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/service_cores 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/service_cores/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/service_cores 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/distributor/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/distributor 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/distributor/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/distributor 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_worker_tx.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_worker_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/esp.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/event_helper.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_worker.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipip.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ep1.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sp4.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/flow.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_process.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/flow.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/rt.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_worker.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/event_helper.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sad.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sad.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/esp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec-secgw.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sp6.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/parser.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ep0.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/parser.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec-secgw.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_3descbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_3descbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aescbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/load_env.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesctr_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_null_header_reconstruct.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/run_test.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesgcm_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/common_defs_secgw.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_3descbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesctr_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesctr_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/data_rxtx.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/bypass_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_ipv6opts.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesgcm_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesgcm_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesctr_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:09.492 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/pkttest.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesgcm_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aescbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/pkttest.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_3descbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/linux_test.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aescbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aescbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipv4_multicast/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipv4_multicast 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipv4_multicast/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipv4_multicast 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_node/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_node 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_node/node.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_node 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/args.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/init.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/shared/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/shared 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tap.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tmgr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/swq.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/pipeline.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/swq.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/action.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/conn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tap.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/link.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cryptodev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/mempool.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/conn.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/parser.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/link.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cryptodev.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/parser.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/mempool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tmgr.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/route_ecmp.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/rss.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/flow.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/firewall.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/tap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/l2fwd.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/route.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/flow_crypto.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t1.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t3.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/README to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/dummy.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:03:09.493 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t2.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/link_status_interrupt/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/link_status_interrupt 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/link_status_interrupt/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/link_status_interrupt 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_reassembly/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_reassembly 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_reassembly/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_reassembly 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bbdev_app/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bbdev_app 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bbdev_app/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bbdev_app 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/conn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/obj.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/conn.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/obj.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/rss.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/hash_func.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/mirroring.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ipsec.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ethdev.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/mirroring.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/varbit.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/recirculation.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/recirculation.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/rss.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ipsec.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/varbit.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_routing_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_nexthop_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/learner.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/registers.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_nexthop_group_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/registers.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/packet.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/meter.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/hash_func.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/pcap.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ipsec.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_table.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ipsec_sa.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/learner.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/meter.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/rte_policer.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/rte_policer.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/ethapp.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:03:09.494 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/ethapp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:03:09.495 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:03:09.495 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:03:09.495 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:03:09.495 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/rte_ethtool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:03:09.495 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/rte_ethtool.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:03:09.495 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:03:09.495 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:03:09.495 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/ntb_fwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:03:09.495 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_crypto/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_crypto 00:03:09.495 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_crypto/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_crypto 00:03:09.495 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/timer/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/timer 00:03:09.495 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/timer/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/timer 00:03:09.495 Installing lib/librte_log.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_log.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_kvargs.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_kvargs.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_telemetry.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_telemetry.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_eal.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_eal.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_ring.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_ring.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_rcu.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_rcu.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_mempool.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_mempool.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_mbuf.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_mbuf.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_net.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_net.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_meter.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_meter.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_ethdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_ethdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_pci.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_pci.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_cmdline.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_cmdline.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_metrics.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_metrics.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_hash.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_hash.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_timer.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_timer.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_acl.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_acl.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_bbdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_bbdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_bitratestats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_bitratestats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_bpf.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_bpf.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_cfgfile.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_cfgfile.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_compressdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_compressdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_cryptodev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_cryptodev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_distributor.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_distributor.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_dmadev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_dmadev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_efd.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_efd.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_eventdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_eventdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_dispatcher.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_dispatcher.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_gpudev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_gpudev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_gro.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_gro.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_gso.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_gso.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_ip_frag.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_ip_frag.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_jobstats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_jobstats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_latencystats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_latencystats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_lpm.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_lpm.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_member.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_member.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_pcapng.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_pcapng.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_power.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_power.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_rawdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_rawdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_regexdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_regexdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_mldev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_mldev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_rib.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_rib.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:09.495 Installing lib/librte_reorder.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:10.066 Installing lib/librte_reorder.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:10.066 Installing lib/librte_sched.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:10.066 Installing lib/librte_sched.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:10.066 Installing lib/librte_security.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:10.066 Installing lib/librte_security.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:10.066 Installing lib/librte_stack.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:10.066 Installing lib/librte_stack.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:10.066 Installing lib/librte_vhost.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:10.066 Installing lib/librte_vhost.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:10.066 Installing lib/librte_ipsec.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:10.066 Installing lib/librte_ipsec.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:10.066 Installing lib/librte_pdcp.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:10.066 Installing lib/librte_pdcp.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:10.066 Installing lib/librte_fib.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:10.066 Installing lib/librte_fib.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:10.066 Installing lib/librte_port.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:10.066 Installing lib/librte_port.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:10.066 Installing lib/librte_pdump.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:10.066 Installing lib/librte_pdump.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:10.066 Installing lib/librte_table.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:10.066 Installing lib/librte_table.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:10.066 Installing lib/librte_pipeline.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:10.066 Installing lib/librte_pipeline.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:10.066 Installing lib/librte_graph.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:10.066 Installing lib/librte_graph.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:10.066 Installing lib/librte_node.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:10.066 Installing lib/librte_node.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:10.066 Installing drivers/librte_bus_pci.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:10.066 Installing drivers/librte_bus_pci.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0 00:03:10.066 Installing drivers/librte_bus_vdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:10.066 Installing drivers/librte_bus_vdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0 00:03:10.066 Installing drivers/librte_mempool_ring.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:10.066 Installing drivers/librte_mempool_ring.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0 00:03:10.066 Installing drivers/librte_net_i40e.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:10.066 Installing drivers/librte_net_i40e.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0 00:03:10.066 Installing app/dpdk-dumpcap to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:10.066 Installing app/dpdk-graph to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:10.066 Installing app/dpdk-pdump to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:10.066 Installing app/dpdk-proc-info to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:10.066 Installing app/dpdk-test-acl to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:10.066 Installing app/dpdk-test-bbdev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:10.066 Installing app/dpdk-test-cmdline to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:10.066 Installing app/dpdk-test-compress-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:10.066 Installing app/dpdk-test-crypto-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:10.066 Installing app/dpdk-test-dma-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:10.066 Installing app/dpdk-test-eventdev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:10.066 Installing app/dpdk-test-fib to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:10.066 Installing app/dpdk-test-flow-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:10.066 Installing app/dpdk-test-gpudev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:10.066 Installing app/dpdk-test-mldev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:10.066 Installing app/dpdk-test-pipeline to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:10.066 Installing app/dpdk-testpmd to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:10.066 Installing app/dpdk-test-regex to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:10.066 Installing app/dpdk-test-sad to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:10.066 Installing app/dpdk-test-security-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:10.066 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/config/rte_config.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.066 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/log/rte_log.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.066 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/kvargs/rte_kvargs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.066 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/telemetry/rte_telemetry.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.066 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_atomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:10.066 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_byteorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:10.066 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_cpuflags.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:10.066 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_cycles.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:10.066 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_io.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:10.066 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_memcpy.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_pause.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_power_intrinsics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_prefetch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_rwlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_spinlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_vect.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_cpuflags.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_cycles.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_io.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_memcpy.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_pause.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_power_intrinsics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_prefetch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_rtm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_rwlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_spinlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_vect.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic_32.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic_64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder_32.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder_64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_alarm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bitmap.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bitops.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_branch_prediction.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bus.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_class.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_compat.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_debug.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_dev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_devargs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal_memconfig.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_errno.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_epoll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_fbarray.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_hexdump.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_hypervisor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_interrupts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_keepalive.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_launch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_lcore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_lock_annotations.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_malloc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_mcslock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_memory.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_memzone.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pci_dev_feature_defs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pci_dev_features.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_per_lcore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pflock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_random.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_reciprocal.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_seqcount.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_seqlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_service.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_service_component.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_stdatomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_string_fns.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_tailq.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_ticketlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_time.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace_point.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace_point_register.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_uuid.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_version.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_vfio.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/linux/include/rte_os.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_elem.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_c11_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.067 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_generic_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_hts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_hts_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek_zc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_rts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_rts_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rcu/rte_rcu_qsbr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_ptype.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_pool_ops.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_dyn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ip.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_tcp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_udp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_tls.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_dtls.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_esp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_sctp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_icmp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_arp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ether.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_macsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_vxlan.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_gre.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_gtp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_net.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_net_crc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_mpls.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_higig.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ecpri.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_pdcp_hdr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_geneve.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_l2tpv2.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ppp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/meter/rte_meter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_cman.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_dev_info.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_flow.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_flow_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_mtr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_mtr_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_tm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_tm_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_eth_ctrl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pci/rte_pci.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_num.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_ipaddr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_etheraddr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_string.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_rdline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_vt100.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_socket.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_cirbuf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_portlist.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/metrics/rte_metrics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/metrics/rte_metrics_telemetry.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_fbk_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_hash_crc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_jhash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash_gfni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_generic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_sw.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_x86.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash_x86_gfni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/timer/rte_timer.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/acl/rte_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/acl/rte_acl_osdep.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev_pmd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev_op.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.068 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bitratestats/rte_bitrate.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/bpf_def.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/rte_bpf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/rte_bpf_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cfgfile/rte_cfgfile.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/compressdev/rte_compressdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/compressdev/rte_comp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto_sym.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto_asym.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/distributor/rte_distributor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dmadev/rte_dmadev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dmadev/rte_dmadev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/efd/rte_efd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_crypto_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_dma_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_eth_rx_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_eth_tx_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_timer_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dispatcher/rte_dispatcher.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gpudev/rte_gpudev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gro/rte_gro.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gso/rte_gso.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ip_frag/rte_ip_frag.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/jobstats/rte_jobstats.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/latencystats/rte_latencystats.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_scalar.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_sve.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/member/rte_member.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pcapng/rte_pcapng.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_guest_channel.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_pmd_mgmt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_uncore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rawdev/rte_rawdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rawdev/rte_rawdev_pmd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mldev/rte_mldev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mldev/rte_mldev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rib/rte_rib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rib/rte_rib6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/reorder/rte_reorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_approx.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_red.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_sched.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_sched_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_pie.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/security/rte_security.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/security/rte_security_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_std.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_generic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_c11.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_stubs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vdpa.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost_async.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_sa.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_sad.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pdcp/rte_pdcp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pdcp/rte_pdcp_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/fib/rte_fib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/fib/rte_fib6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_fd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.069 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_frag.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ras.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_sched.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_source_sink.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_sym_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_eventdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_fd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_source_sink.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pdump/rte_pdump.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_hash_func.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_em.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_learner.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_selector.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_wm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_array.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_cuckoo.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_func.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_lpm_ipv6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_stub.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru_x86.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_func_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_port_in_action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_table_action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_extern.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_ctl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_worker.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_model_mcore_dispatch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_model_rtc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_worker_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_eth_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_ip4_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_ip6_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_udp4_input_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/bus/pci/rte_bus_pci.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/bus/vdev/rte_bus_vdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/net/i40e/rte_pmd_i40e.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/dpdk-cmdline-gen.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-devbind.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-pmdinfo.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-telemetry.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-hugepages.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-rss-flows.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/rte_build_config.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/meson-private/libdpdk-libs.pc to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig 00:03:10.070 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/meson-private/libdpdk.pc to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig 00:03:10.070 Installing symlink pointing to librte_log.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_log.so.24 00:03:10.070 Installing symlink pointing to librte_log.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_log.so 00:03:10.070 Installing symlink pointing to librte_kvargs.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_kvargs.so.24 00:03:10.070 Installing symlink pointing to librte_kvargs.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_kvargs.so 00:03:10.070 Installing symlink pointing to librte_telemetry.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_telemetry.so.24 00:03:10.070 Installing symlink pointing to librte_telemetry.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_telemetry.so 00:03:10.070 Installing symlink pointing to librte_eal.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eal.so.24 00:03:10.071 Installing symlink pointing to librte_eal.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eal.so 00:03:10.071 Installing symlink pointing to librte_ring.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ring.so.24 00:03:10.071 Installing symlink pointing to librte_ring.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ring.so 00:03:10.071 Installing symlink pointing to librte_rcu.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rcu.so.24 00:03:10.071 Installing symlink pointing to librte_rcu.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rcu.so 00:03:10.071 Installing symlink pointing to librte_mempool.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mempool.so.24 00:03:10.071 Installing symlink pointing to librte_mempool.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mempool.so 00:03:10.071 Installing symlink pointing to librte_mbuf.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mbuf.so.24 00:03:10.330 Installing symlink pointing to librte_mbuf.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mbuf.so 00:03:10.330 Installing symlink pointing to librte_net.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_net.so.24 00:03:10.330 Installing symlink pointing to librte_net.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_net.so 00:03:10.330 Installing symlink pointing to librte_meter.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_meter.so.24 00:03:10.330 Installing symlink pointing to librte_meter.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_meter.so 00:03:10.330 Installing symlink pointing to librte_ethdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ethdev.so.24 00:03:10.330 Installing symlink pointing to librte_ethdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ethdev.so 00:03:10.330 Installing symlink pointing to librte_pci.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pci.so.24 00:03:10.330 Installing symlink pointing to librte_pci.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pci.so 00:03:10.330 Installing symlink pointing to librte_cmdline.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cmdline.so.24 00:03:10.330 Installing symlink pointing to librte_cmdline.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cmdline.so 00:03:10.330 Installing symlink pointing to librte_metrics.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_metrics.so.24 00:03:10.330 Installing symlink pointing to librte_metrics.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_metrics.so 00:03:10.330 Installing symlink pointing to librte_hash.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_hash.so.24 00:03:10.330 Installing symlink pointing to librte_hash.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_hash.so 00:03:10.330 Installing symlink pointing to librte_timer.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_timer.so.24 00:03:10.330 Installing symlink pointing to librte_timer.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_timer.so 00:03:10.330 Installing symlink pointing to librte_acl.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_acl.so.24 00:03:10.330 Installing symlink pointing to librte_acl.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_acl.so 00:03:10.330 Installing symlink pointing to librte_bbdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bbdev.so.24 00:03:10.330 Installing symlink pointing to librte_bbdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bbdev.so 00:03:10.330 Installing symlink pointing to librte_bitratestats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bitratestats.so.24 00:03:10.330 Installing symlink pointing to librte_bitratestats.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bitratestats.so 00:03:10.330 Installing symlink pointing to librte_bpf.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bpf.so.24 00:03:10.330 Installing symlink pointing to librte_bpf.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bpf.so 00:03:10.330 Installing symlink pointing to librte_cfgfile.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cfgfile.so.24 00:03:10.330 Installing symlink pointing to librte_cfgfile.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cfgfile.so 00:03:10.330 Installing symlink pointing to librte_compressdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_compressdev.so.24 00:03:10.330 Installing symlink pointing to librte_compressdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_compressdev.so 00:03:10.330 Installing symlink pointing to librte_cryptodev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cryptodev.so.24 00:03:10.330 Installing symlink pointing to librte_cryptodev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cryptodev.so 00:03:10.330 Installing symlink pointing to librte_distributor.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_distributor.so.24 00:03:10.330 Installing symlink pointing to librte_distributor.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_distributor.so 00:03:10.330 Installing symlink pointing to librte_dmadev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dmadev.so.24 00:03:10.330 Installing symlink pointing to librte_dmadev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dmadev.so 00:03:10.330 Installing symlink pointing to librte_efd.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_efd.so.24 00:03:10.330 Installing symlink pointing to librte_efd.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_efd.so 00:03:10.330 Installing symlink pointing to librte_eventdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eventdev.so.24 00:03:10.330 Installing symlink pointing to librte_eventdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eventdev.so 00:03:10.330 Installing symlink pointing to librte_dispatcher.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dispatcher.so.24 00:03:10.330 Installing symlink pointing to librte_dispatcher.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dispatcher.so 00:03:10.330 Installing symlink pointing to librte_gpudev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gpudev.so.24 00:03:10.330 Installing symlink pointing to librte_gpudev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gpudev.so 00:03:10.330 Installing symlink pointing to librte_gro.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gro.so.24 00:03:10.330 Installing symlink pointing to librte_gro.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gro.so 00:03:10.330 Installing symlink pointing to librte_gso.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gso.so.24 00:03:10.330 Installing symlink pointing to librte_gso.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gso.so 00:03:10.330 Installing symlink pointing to librte_ip_frag.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ip_frag.so.24 00:03:10.330 Installing symlink pointing to librte_ip_frag.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ip_frag.so 00:03:10.330 Installing symlink pointing to librte_jobstats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_jobstats.so.24 00:03:10.330 Installing symlink pointing to librte_jobstats.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_jobstats.so 00:03:10.330 Installing symlink pointing to librte_latencystats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_latencystats.so.24 00:03:10.330 Installing symlink pointing to librte_latencystats.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_latencystats.so 00:03:10.330 Installing symlink pointing to librte_lpm.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_lpm.so.24 00:03:10.330 Installing symlink pointing to librte_lpm.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_lpm.so 00:03:10.330 Installing symlink pointing to librte_member.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_member.so.24 00:03:10.330 Installing symlink pointing to librte_member.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_member.so 00:03:10.330 Installing symlink pointing to librte_pcapng.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pcapng.so.24 00:03:10.330 Installing symlink pointing to librte_pcapng.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pcapng.so 00:03:10.330 Installing symlink pointing to librte_power.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_power.so.24 00:03:10.330 Installing symlink pointing to librte_power.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_power.so 00:03:10.330 './librte_bus_pci.so' -> 'dpdk/pmds-24.0/librte_bus_pci.so' 00:03:10.330 './librte_bus_pci.so.24' -> 'dpdk/pmds-24.0/librte_bus_pci.so.24' 00:03:10.330 './librte_bus_pci.so.24.0' -> 'dpdk/pmds-24.0/librte_bus_pci.so.24.0' 00:03:10.330 './librte_bus_vdev.so' -> 'dpdk/pmds-24.0/librte_bus_vdev.so' 00:03:10.330 './librte_bus_vdev.so.24' -> 'dpdk/pmds-24.0/librte_bus_vdev.so.24' 00:03:10.330 './librte_bus_vdev.so.24.0' -> 'dpdk/pmds-24.0/librte_bus_vdev.so.24.0' 00:03:10.330 './librte_mempool_ring.so' -> 'dpdk/pmds-24.0/librte_mempool_ring.so' 00:03:10.330 './librte_mempool_ring.so.24' -> 'dpdk/pmds-24.0/librte_mempool_ring.so.24' 00:03:10.330 './librte_mempool_ring.so.24.0' -> 'dpdk/pmds-24.0/librte_mempool_ring.so.24.0' 00:03:10.330 './librte_net_i40e.so' -> 'dpdk/pmds-24.0/librte_net_i40e.so' 00:03:10.330 './librte_net_i40e.so.24' -> 'dpdk/pmds-24.0/librte_net_i40e.so.24' 00:03:10.331 './librte_net_i40e.so.24.0' -> 'dpdk/pmds-24.0/librte_net_i40e.so.24.0' 00:03:10.331 Installing symlink pointing to librte_rawdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rawdev.so.24 00:03:10.331 Installing symlink pointing to librte_rawdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rawdev.so 00:03:10.331 Installing symlink pointing to librte_regexdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_regexdev.so.24 00:03:10.331 Installing symlink pointing to librte_regexdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_regexdev.so 00:03:10.331 Installing symlink pointing to librte_mldev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mldev.so.24 00:03:10.331 Installing symlink pointing to librte_mldev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mldev.so 00:03:10.331 Installing symlink pointing to librte_rib.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rib.so.24 00:03:10.331 Installing symlink pointing to librte_rib.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rib.so 00:03:10.331 Installing symlink pointing to librte_reorder.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_reorder.so.24 00:03:10.331 Installing symlink pointing to librte_reorder.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_reorder.so 00:03:10.331 Installing symlink pointing to librte_sched.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_sched.so.24 00:03:10.331 Installing symlink pointing to librte_sched.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_sched.so 00:03:10.331 Installing symlink pointing to librte_security.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_security.so.24 00:03:10.331 Installing symlink pointing to librte_security.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_security.so 00:03:10.331 Installing symlink pointing to librte_stack.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_stack.so.24 00:03:10.331 Installing symlink pointing to librte_stack.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_stack.so 00:03:10.331 Installing symlink pointing to librte_vhost.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_vhost.so.24 00:03:10.331 Installing symlink pointing to librte_vhost.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_vhost.so 00:03:10.331 Installing symlink pointing to librte_ipsec.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ipsec.so.24 00:03:10.331 Installing symlink pointing to librte_ipsec.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ipsec.so 00:03:10.331 Installing symlink pointing to librte_pdcp.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdcp.so.24 00:03:10.331 Installing symlink pointing to librte_pdcp.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdcp.so 00:03:10.331 Installing symlink pointing to librte_fib.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_fib.so.24 00:03:10.331 Installing symlink pointing to librte_fib.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_fib.so 00:03:10.331 Installing symlink pointing to librte_port.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_port.so.24 00:03:10.331 Installing symlink pointing to librte_port.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_port.so 00:03:10.331 Installing symlink pointing to librte_pdump.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdump.so.24 00:03:10.331 Installing symlink pointing to librte_pdump.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdump.so 00:03:10.331 Installing symlink pointing to librte_table.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_table.so.24 00:03:10.331 Installing symlink pointing to librte_table.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_table.so 00:03:10.331 Installing symlink pointing to librte_pipeline.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pipeline.so.24 00:03:10.331 Installing symlink pointing to librte_pipeline.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pipeline.so 00:03:10.331 Installing symlink pointing to librte_graph.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_graph.so.24 00:03:10.331 Installing symlink pointing to librte_graph.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_graph.so 00:03:10.331 Installing symlink pointing to librte_node.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_node.so.24 00:03:10.331 Installing symlink pointing to librte_node.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_node.so 00:03:10.331 Installing symlink pointing to librte_bus_pci.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_pci.so.24 00:03:10.331 Installing symlink pointing to librte_bus_pci.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_pci.so 00:03:10.331 Installing symlink pointing to librte_bus_vdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_vdev.so.24 00:03:10.331 Installing symlink pointing to librte_bus_vdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_vdev.so 00:03:10.331 Installing symlink pointing to librte_mempool_ring.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_mempool_ring.so.24 00:03:10.331 Installing symlink pointing to librte_mempool_ring.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_mempool_ring.so 00:03:10.331 Installing symlink pointing to librte_net_i40e.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_net_i40e.so.24 00:03:10.331 Installing symlink pointing to librte_net_i40e.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_net_i40e.so 00:03:10.331 Running custom install script '/bin/sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/config/../buildtools/symlink-drivers-solibs.sh lib dpdk/pmds-24.0' 00:03:10.331 22:55:13 -- common/autobuild_common.sh@192 -- $ uname -s 00:03:10.331 22:55:13 -- common/autobuild_common.sh@192 -- $ [[ Linux == \F\r\e\e\B\S\D ]] 00:03:10.331 22:55:13 -- common/autobuild_common.sh@203 -- $ cat 00:03:10.331 22:55:13 -- common/autobuild_common.sh@208 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:10.331 00:03:10.331 real 1m28.507s 00:03:10.331 user 18m5.753s 00:03:10.331 sys 2m9.093s 00:03:10.331 22:55:13 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:03:10.331 22:55:13 -- common/autotest_common.sh@10 -- $ set +x 00:03:10.331 ************************************ 00:03:10.331 END TEST build_native_dpdk 00:03:10.331 ************************************ 00:03:10.331 22:55:13 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:03:10.331 22:55:13 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:03:10.331 22:55:13 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:03:10.331 22:55:13 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:03:10.331 22:55:13 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:03:10.331 22:55:13 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:03:10.331 22:55:13 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:03:10.331 22:55:13 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build --with-shared 00:03:10.331 Using /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig for additional libs... 00:03:10.331 DPDK libraries: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:10.331 DPDK includes: //var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:10.589 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:03:10.847 Using 'verbs' RDMA provider 00:03:21.083 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l/spdk-isal.log)...done. 00:03:29.199 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l-crypto/spdk-isal-crypto.log)...done. 00:03:29.458 Creating mk/config.mk...done. 00:03:29.458 Creating mk/cc.flags.mk...done. 00:03:29.458 Type 'make' to build. 00:03:29.458 22:55:32 -- spdk/autobuild.sh@69 -- $ run_test make make -j48 00:03:29.458 22:55:32 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:03:29.458 22:55:32 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:03:29.458 22:55:32 -- common/autotest_common.sh@10 -- $ set +x 00:03:29.458 ************************************ 00:03:29.458 START TEST make 00:03:29.458 ************************************ 00:03:29.458 22:55:32 -- common/autotest_common.sh@1114 -- $ make -j48 00:03:29.458 make[1]: Nothing to be done for 'all'. 00:03:31.373 The Meson build system 00:03:31.373 Version: 1.5.0 00:03:31.373 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user 00:03:31.373 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:03:31.373 Build type: native build 00:03:31.373 Project name: libvfio-user 00:03:31.373 Project version: 0.0.1 00:03:31.373 C compiler for the host machine: gcc (gcc 13.3.1 "gcc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:03:31.373 C linker for the host machine: gcc ld.bfd 2.40-14 00:03:31.373 Host machine cpu family: x86_64 00:03:31.373 Host machine cpu: x86_64 00:03:31.373 Run-time dependency threads found: YES 00:03:31.373 Library dl found: YES 00:03:31.373 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:03:31.373 Run-time dependency json-c found: YES 0.17 00:03:31.373 Run-time dependency cmocka found: YES 1.1.7 00:03:31.373 Program pytest-3 found: NO 00:03:31.373 Program flake8 found: NO 00:03:31.373 Program misspell-fixer found: NO 00:03:31.373 Program restructuredtext-lint found: NO 00:03:31.373 Program valgrind found: YES (/usr/bin/valgrind) 00:03:31.373 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:03:31.373 Compiler for C supports arguments -Wmissing-declarations: YES 00:03:31.373 Compiler for C supports arguments -Wwrite-strings: YES 00:03:31.373 ../libvfio-user/test/meson.build:20: WARNING: Project targets '>= 0.53.0' but uses feature introduced in '0.57.0': exclude_suites arg in add_test_setup. 00:03:31.373 Program test-lspci.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user/test/test-lspci.sh) 00:03:31.373 Program test-linkage.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user/test/test-linkage.sh) 00:03:31.373 ../libvfio-user/test/py/meson.build:16: WARNING: Project targets '>= 0.53.0' but uses feature introduced in '0.57.0': exclude_suites arg in add_test_setup. 00:03:31.373 Build targets in project: 8 00:03:31.373 WARNING: Project specifies a minimum meson_version '>= 0.53.0' but uses features which were added in newer versions: 00:03:31.373 * 0.57.0: {'exclude_suites arg in add_test_setup'} 00:03:31.373 00:03:31.373 libvfio-user 0.0.1 00:03:31.373 00:03:31.373 User defined options 00:03:31.373 buildtype : debug 00:03:31.373 default_library: shared 00:03:31.373 libdir : /usr/local/lib 00:03:31.373 00:03:31.373 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:03:32.322 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug' 00:03:32.322 [1/37] Compiling C object lib/libvfio-user.so.0.0.1.p/irq.c.o 00:03:32.322 [2/37] Compiling C object samples/client.p/.._lib_tran.c.o 00:03:32.322 [3/37] Compiling C object samples/client.p/.._lib_tran_sock.c.o 00:03:32.322 [4/37] Compiling C object lib/libvfio-user.so.0.0.1.p/migration.c.o 00:03:32.322 [5/37] Compiling C object lib/libvfio-user.so.0.0.1.p/tran.c.o 00:03:32.322 [6/37] Compiling C object samples/lspci.p/lspci.c.o 00:03:32.322 [7/37] Compiling C object samples/null.p/null.c.o 00:03:32.322 [8/37] Compiling C object samples/shadow_ioeventfd_server.p/shadow_ioeventfd_server.c.o 00:03:32.322 [9/37] Compiling C object samples/gpio-pci-idio-16.p/gpio-pci-idio-16.c.o 00:03:32.322 [10/37] Compiling C object lib/libvfio-user.so.0.0.1.p/pci.c.o 00:03:32.322 [11/37] Compiling C object lib/libvfio-user.so.0.0.1.p/tran_sock.c.o 00:03:32.322 [12/37] Compiling C object samples/client.p/.._lib_migration.c.o 00:03:32.322 [13/37] Compiling C object lib/libvfio-user.so.0.0.1.p/dma.c.o 00:03:32.322 [14/37] Compiling C object test/unit_tests.p/.._lib_irq.c.o 00:03:32.322 [15/37] Compiling C object test/unit_tests.p/.._lib_pci.c.o 00:03:32.585 [16/37] Compiling C object test/unit_tests.p/mocks.c.o 00:03:32.585 [17/37] Compiling C object test/unit_tests.p/.._lib_tran.c.o 00:03:32.585 [18/37] Compiling C object test/unit_tests.p/.._lib_migration.c.o 00:03:32.585 [19/37] Compiling C object test/unit_tests.p/.._lib_dma.c.o 00:03:32.585 [20/37] Compiling C object lib/libvfio-user.so.0.0.1.p/pci_caps.c.o 00:03:32.585 [21/37] Compiling C object test/unit_tests.p/.._lib_tran_pipe.c.o 00:03:32.585 [22/37] Compiling C object test/unit_tests.p/.._lib_pci_caps.c.o 00:03:32.585 [23/37] Compiling C object samples/server.p/server.c.o 00:03:32.585 [24/37] Compiling C object test/unit_tests.p/.._lib_tran_sock.c.o 00:03:32.585 [25/37] Compiling C object samples/client.p/client.c.o 00:03:32.585 [26/37] Compiling C object test/unit_tests.p/unit-tests.c.o 00:03:32.585 [27/37] Linking target samples/client 00:03:32.585 [28/37] Compiling C object test/unit_tests.p/.._lib_libvfio-user.c.o 00:03:32.585 [29/37] Linking target test/unit_tests 00:03:32.846 [30/37] Compiling C object lib/libvfio-user.so.0.0.1.p/libvfio-user.c.o 00:03:32.846 [31/37] Linking target lib/libvfio-user.so.0.0.1 00:03:33.110 [32/37] Generating symbol file lib/libvfio-user.so.0.0.1.p/libvfio-user.so.0.0.1.symbols 00:03:33.110 [33/37] Linking target samples/server 00:03:33.110 [34/37] Linking target samples/null 00:03:33.110 [35/37] Linking target samples/lspci 00:03:33.110 [36/37] Linking target samples/gpio-pci-idio-16 00:03:33.110 [37/37] Linking target samples/shadow_ioeventfd_server 00:03:33.110 INFO: autodetecting backend as ninja 00:03:33.110 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:03:33.110 DESTDIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user meson install --quiet -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:03:34.049 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug' 00:03:34.049 ninja: no work to do. 00:03:44.147 CC lib/ut_mock/mock.o 00:03:44.147 CC lib/log/log.o 00:03:44.147 CC lib/log/log_flags.o 00:03:44.147 CC lib/log/log_deprecated.o 00:03:44.147 CC lib/ut/ut.o 00:03:44.405 LIB libspdk_ut_mock.a 00:03:44.405 SO libspdk_ut_mock.so.5.0 00:03:44.405 LIB libspdk_log.a 00:03:44.405 LIB libspdk_ut.a 00:03:44.405 SO libspdk_log.so.6.1 00:03:44.405 SO libspdk_ut.so.1.0 00:03:44.405 SYMLINK libspdk_ut_mock.so 00:03:44.405 SYMLINK libspdk_log.so 00:03:44.405 SYMLINK libspdk_ut.so 00:03:44.662 CC lib/ioat/ioat.o 00:03:44.662 CC lib/dma/dma.o 00:03:44.662 CXX lib/trace_parser/trace.o 00:03:44.662 CC lib/util/base64.o 00:03:44.662 CC lib/util/bit_array.o 00:03:44.662 CC lib/util/cpuset.o 00:03:44.662 CC lib/util/crc16.o 00:03:44.662 CC lib/util/crc32.o 00:03:44.662 CC lib/util/crc32c.o 00:03:44.662 CC lib/util/crc32_ieee.o 00:03:44.662 CC lib/util/crc64.o 00:03:44.662 CC lib/util/dif.o 00:03:44.662 CC lib/util/fd.o 00:03:44.662 CC lib/util/file.o 00:03:44.662 CC lib/util/hexlify.o 00:03:44.662 CC lib/util/iov.o 00:03:44.662 CC lib/util/math.o 00:03:44.662 CC lib/util/pipe.o 00:03:44.662 CC lib/util/strerror_tls.o 00:03:44.662 CC lib/util/string.o 00:03:44.662 CC lib/util/uuid.o 00:03:44.662 CC lib/util/fd_group.o 00:03:44.662 CC lib/util/xor.o 00:03:44.662 CC lib/util/zipf.o 00:03:44.662 CC lib/vfio_user/host/vfio_user_pci.o 00:03:44.662 CC lib/vfio_user/host/vfio_user.o 00:03:44.922 LIB libspdk_dma.a 00:03:44.922 SO libspdk_dma.so.3.0 00:03:44.922 SYMLINK libspdk_dma.so 00:03:44.922 LIB libspdk_ioat.a 00:03:44.922 SO libspdk_ioat.so.6.0 00:03:44.922 LIB libspdk_vfio_user.a 00:03:44.922 SO libspdk_vfio_user.so.4.0 00:03:44.922 SYMLINK libspdk_ioat.so 00:03:44.922 SYMLINK libspdk_vfio_user.so 00:03:45.180 LIB libspdk_util.a 00:03:45.180 SO libspdk_util.so.8.0 00:03:45.180 SYMLINK libspdk_util.so 00:03:45.439 CC lib/json/json_parse.o 00:03:45.439 CC lib/rdma/common.o 00:03:45.439 CC lib/vmd/vmd.o 00:03:45.439 CC lib/json/json_util.o 00:03:45.439 CC lib/rdma/rdma_verbs.o 00:03:45.439 CC lib/env_dpdk/env.o 00:03:45.439 CC lib/env_dpdk/memory.o 00:03:45.439 CC lib/vmd/led.o 00:03:45.439 CC lib/json/json_write.o 00:03:45.439 CC lib/env_dpdk/pci.o 00:03:45.439 CC lib/env_dpdk/init.o 00:03:45.439 CC lib/env_dpdk/threads.o 00:03:45.439 CC lib/idxd/idxd.o 00:03:45.439 CC lib/conf/conf.o 00:03:45.439 CC lib/env_dpdk/pci_ioat.o 00:03:45.439 CC lib/idxd/idxd_user.o 00:03:45.439 CC lib/env_dpdk/pci_virtio.o 00:03:45.439 CC lib/idxd/idxd_kernel.o 00:03:45.439 CC lib/env_dpdk/pci_vmd.o 00:03:45.439 CC lib/env_dpdk/pci_idxd.o 00:03:45.439 CC lib/env_dpdk/pci_event.o 00:03:45.439 CC lib/env_dpdk/sigbus_handler.o 00:03:45.439 CC lib/env_dpdk/pci_dpdk.o 00:03:45.439 CC lib/env_dpdk/pci_dpdk_2207.o 00:03:45.439 CC lib/env_dpdk/pci_dpdk_2211.o 00:03:45.697 LIB libspdk_trace_parser.a 00:03:45.697 SO libspdk_trace_parser.so.4.0 00:03:45.697 LIB libspdk_conf.a 00:03:45.697 SO libspdk_conf.so.5.0 00:03:45.697 SYMLINK libspdk_trace_parser.so 00:03:45.697 LIB libspdk_rdma.a 00:03:45.697 LIB libspdk_json.a 00:03:45.697 SYMLINK libspdk_conf.so 00:03:45.697 SO libspdk_rdma.so.5.0 00:03:45.697 SO libspdk_json.so.5.1 00:03:45.697 SYMLINK libspdk_rdma.so 00:03:45.697 SYMLINK libspdk_json.so 00:03:45.956 CC lib/jsonrpc/jsonrpc_server.o 00:03:45.956 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:03:45.956 CC lib/jsonrpc/jsonrpc_client.o 00:03:45.956 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:03:45.956 LIB libspdk_idxd.a 00:03:45.956 SO libspdk_idxd.so.11.0 00:03:45.956 SYMLINK libspdk_idxd.so 00:03:46.214 LIB libspdk_vmd.a 00:03:46.214 SO libspdk_vmd.so.5.0 00:03:46.214 SYMLINK libspdk_vmd.so 00:03:46.214 LIB libspdk_jsonrpc.a 00:03:46.214 SO libspdk_jsonrpc.so.5.1 00:03:46.214 SYMLINK libspdk_jsonrpc.so 00:03:46.472 CC lib/rpc/rpc.o 00:03:46.473 LIB libspdk_rpc.a 00:03:46.730 SO libspdk_rpc.so.5.0 00:03:46.730 SYMLINK libspdk_rpc.so 00:03:46.730 CC lib/sock/sock.o 00:03:46.730 CC lib/sock/sock_rpc.o 00:03:46.730 CC lib/trace/trace.o 00:03:46.730 CC lib/notify/notify.o 00:03:46.730 CC lib/notify/notify_rpc.o 00:03:46.730 CC lib/trace/trace_flags.o 00:03:46.730 CC lib/trace/trace_rpc.o 00:03:46.988 LIB libspdk_notify.a 00:03:46.988 SO libspdk_notify.so.5.0 00:03:46.988 SYMLINK libspdk_notify.so 00:03:46.988 LIB libspdk_trace.a 00:03:46.988 SO libspdk_trace.so.9.0 00:03:46.988 SYMLINK libspdk_trace.so 00:03:47.246 LIB libspdk_sock.a 00:03:47.247 SO libspdk_sock.so.8.0 00:03:47.247 CC lib/thread/thread.o 00:03:47.247 CC lib/thread/iobuf.o 00:03:47.247 SYMLINK libspdk_sock.so 00:03:47.247 CC lib/nvme/nvme_ctrlr_cmd.o 00:03:47.247 CC lib/nvme/nvme_ctrlr.o 00:03:47.247 CC lib/nvme/nvme_fabric.o 00:03:47.247 CC lib/nvme/nvme_ns_cmd.o 00:03:47.247 CC lib/nvme/nvme_ns.o 00:03:47.247 CC lib/nvme/nvme_pcie_common.o 00:03:47.247 CC lib/nvme/nvme_pcie.o 00:03:47.247 CC lib/nvme/nvme_qpair.o 00:03:47.247 CC lib/nvme/nvme.o 00:03:47.247 CC lib/nvme/nvme_quirks.o 00:03:47.247 CC lib/nvme/nvme_transport.o 00:03:47.247 CC lib/nvme/nvme_discovery.o 00:03:47.247 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:03:47.247 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:03:47.247 CC lib/nvme/nvme_tcp.o 00:03:47.247 CC lib/nvme/nvme_opal.o 00:03:47.247 CC lib/nvme/nvme_io_msg.o 00:03:47.247 CC lib/nvme/nvme_poll_group.o 00:03:47.247 CC lib/nvme/nvme_zns.o 00:03:47.247 CC lib/nvme/nvme_cuse.o 00:03:47.247 CC lib/nvme/nvme_vfio_user.o 00:03:47.247 CC lib/nvme/nvme_rdma.o 00:03:47.506 LIB libspdk_env_dpdk.a 00:03:47.506 SO libspdk_env_dpdk.so.13.0 00:03:47.764 SYMLINK libspdk_env_dpdk.so 00:03:48.700 LIB libspdk_thread.a 00:03:48.958 SO libspdk_thread.so.9.0 00:03:48.958 SYMLINK libspdk_thread.so 00:03:48.958 CC lib/vfu_tgt/tgt_endpoint.o 00:03:48.958 CC lib/blob/blobstore.o 00:03:48.958 CC lib/init/json_config.o 00:03:48.958 CC lib/accel/accel.o 00:03:48.958 CC lib/vfu_tgt/tgt_rpc.o 00:03:48.958 CC lib/virtio/virtio.o 00:03:48.958 CC lib/blob/request.o 00:03:48.958 CC lib/init/subsystem.o 00:03:48.958 CC lib/virtio/virtio_vhost_user.o 00:03:48.958 CC lib/accel/accel_rpc.o 00:03:48.958 CC lib/virtio/virtio_vfio_user.o 00:03:48.958 CC lib/init/subsystem_rpc.o 00:03:48.958 CC lib/blob/zeroes.o 00:03:48.958 CC lib/init/rpc.o 00:03:48.958 CC lib/virtio/virtio_pci.o 00:03:48.958 CC lib/accel/accel_sw.o 00:03:48.958 CC lib/blob/blob_bs_dev.o 00:03:49.217 LIB libspdk_init.a 00:03:49.217 SO libspdk_init.so.4.0 00:03:49.475 SYMLINK libspdk_init.so 00:03:49.475 LIB libspdk_vfu_tgt.a 00:03:49.475 LIB libspdk_virtio.a 00:03:49.475 SO libspdk_vfu_tgt.so.2.0 00:03:49.475 SO libspdk_virtio.so.6.0 00:03:49.475 SYMLINK libspdk_vfu_tgt.so 00:03:49.475 SYMLINK libspdk_virtio.so 00:03:49.475 CC lib/event/app.o 00:03:49.475 CC lib/event/reactor.o 00:03:49.475 CC lib/event/log_rpc.o 00:03:49.475 CC lib/event/app_rpc.o 00:03:49.475 CC lib/event/scheduler_static.o 00:03:49.733 LIB libspdk_nvme.a 00:03:49.733 SO libspdk_nvme.so.12.0 00:03:49.733 LIB libspdk_event.a 00:03:49.992 SO libspdk_event.so.12.0 00:03:49.992 SYMLINK libspdk_event.so 00:03:49.992 SYMLINK libspdk_nvme.so 00:03:49.992 LIB libspdk_accel.a 00:03:49.992 SO libspdk_accel.so.14.0 00:03:50.250 SYMLINK libspdk_accel.so 00:03:50.250 CC lib/bdev/bdev.o 00:03:50.250 CC lib/bdev/bdev_rpc.o 00:03:50.250 CC lib/bdev/bdev_zone.o 00:03:50.250 CC lib/bdev/part.o 00:03:50.250 CC lib/bdev/scsi_nvme.o 00:03:52.148 LIB libspdk_blob.a 00:03:52.148 SO libspdk_blob.so.10.1 00:03:52.148 SYMLINK libspdk_blob.so 00:03:52.148 CC lib/lvol/lvol.o 00:03:52.148 CC lib/blobfs/blobfs.o 00:03:52.148 CC lib/blobfs/tree.o 00:03:52.714 LIB libspdk_bdev.a 00:03:52.714 LIB libspdk_blobfs.a 00:03:52.714 SO libspdk_bdev.so.14.0 00:03:52.714 SO libspdk_blobfs.so.9.0 00:03:52.714 LIB libspdk_lvol.a 00:03:52.714 SO libspdk_lvol.so.9.1 00:03:52.978 SYMLINK libspdk_blobfs.so 00:03:52.978 SYMLINK libspdk_bdev.so 00:03:52.978 SYMLINK libspdk_lvol.so 00:03:52.978 CC lib/ublk/ublk.o 00:03:52.978 CC lib/nbd/nbd.o 00:03:52.978 CC lib/ublk/ublk_rpc.o 00:03:52.978 CC lib/scsi/dev.o 00:03:52.978 CC lib/nbd/nbd_rpc.o 00:03:52.978 CC lib/scsi/lun.o 00:03:52.978 CC lib/nvmf/ctrlr.o 00:03:52.978 CC lib/scsi/port.o 00:03:52.978 CC lib/scsi/scsi.o 00:03:52.978 CC lib/nvmf/ctrlr_discovery.o 00:03:52.978 CC lib/ftl/ftl_core.o 00:03:52.978 CC lib/scsi/scsi_bdev.o 00:03:52.978 CC lib/ftl/ftl_init.o 00:03:52.978 CC lib/nvmf/ctrlr_bdev.o 00:03:52.978 CC lib/scsi/scsi_pr.o 00:03:52.978 CC lib/ftl/ftl_layout.o 00:03:52.978 CC lib/nvmf/subsystem.o 00:03:52.978 CC lib/scsi/scsi_rpc.o 00:03:52.978 CC lib/ftl/ftl_debug.o 00:03:52.978 CC lib/nvmf/nvmf.o 00:03:52.978 CC lib/scsi/task.o 00:03:52.978 CC lib/ftl/ftl_io.o 00:03:52.978 CC lib/nvmf/nvmf_rpc.o 00:03:52.978 CC lib/nvmf/transport.o 00:03:52.978 CC lib/ftl/ftl_sb.o 00:03:52.978 CC lib/ftl/ftl_l2p.o 00:03:52.978 CC lib/nvmf/tcp.o 00:03:52.978 CC lib/ftl/ftl_l2p_flat.o 00:03:52.978 CC lib/ftl/ftl_nv_cache.o 00:03:52.978 CC lib/ftl/ftl_band.o 00:03:52.978 CC lib/nvmf/vfio_user.o 00:03:52.978 CC lib/ftl/ftl_writer.o 00:03:52.978 CC lib/ftl/ftl_band_ops.o 00:03:52.978 CC lib/nvmf/rdma.o 00:03:52.978 CC lib/ftl/ftl_rq.o 00:03:52.978 CC lib/ftl/ftl_reloc.o 00:03:52.978 CC lib/ftl/ftl_l2p_cache.o 00:03:52.978 CC lib/ftl/ftl_p2l.o 00:03:52.978 CC lib/ftl/mngt/ftl_mngt.o 00:03:52.978 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:03:52.978 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:03:52.978 CC lib/ftl/mngt/ftl_mngt_startup.o 00:03:52.978 CC lib/ftl/mngt/ftl_mngt_md.o 00:03:52.978 CC lib/ftl/mngt/ftl_mngt_misc.o 00:03:52.978 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:03:52.978 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:03:52.978 CC lib/ftl/mngt/ftl_mngt_band.o 00:03:52.978 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:03:53.242 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:03:53.242 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:03:53.242 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:03:53.242 CC lib/ftl/utils/ftl_conf.o 00:03:53.242 CC lib/ftl/utils/ftl_md.o 00:03:53.502 CC lib/ftl/utils/ftl_mempool.o 00:03:53.502 CC lib/ftl/utils/ftl_bitmap.o 00:03:53.502 CC lib/ftl/utils/ftl_property.o 00:03:53.502 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:03:53.502 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:03:53.502 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:03:53.502 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:03:53.502 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:03:53.502 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:03:53.502 CC lib/ftl/upgrade/ftl_sb_v3.o 00:03:53.502 CC lib/ftl/upgrade/ftl_sb_v5.o 00:03:53.502 CC lib/ftl/nvc/ftl_nvc_dev.o 00:03:53.502 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:03:53.502 CC lib/ftl/base/ftl_base_dev.o 00:03:53.502 CC lib/ftl/base/ftl_base_bdev.o 00:03:53.502 CC lib/ftl/ftl_trace.o 00:03:53.761 LIB libspdk_nbd.a 00:03:53.761 SO libspdk_nbd.so.6.0 00:03:53.761 SYMLINK libspdk_nbd.so 00:03:53.761 LIB libspdk_scsi.a 00:03:54.020 SO libspdk_scsi.so.8.0 00:03:54.020 SYMLINK libspdk_scsi.so 00:03:54.020 LIB libspdk_ublk.a 00:03:54.020 SO libspdk_ublk.so.2.0 00:03:54.020 CC lib/iscsi/conn.o 00:03:54.020 CC lib/vhost/vhost.o 00:03:54.020 CC lib/iscsi/init_grp.o 00:03:54.020 CC lib/vhost/vhost_rpc.o 00:03:54.020 CC lib/iscsi/iscsi.o 00:03:54.020 CC lib/vhost/vhost_scsi.o 00:03:54.020 CC lib/iscsi/md5.o 00:03:54.020 CC lib/vhost/vhost_blk.o 00:03:54.020 CC lib/iscsi/param.o 00:03:54.020 CC lib/vhost/rte_vhost_user.o 00:03:54.020 CC lib/iscsi/portal_grp.o 00:03:54.020 CC lib/iscsi/tgt_node.o 00:03:54.020 CC lib/iscsi/iscsi_subsystem.o 00:03:54.020 CC lib/iscsi/iscsi_rpc.o 00:03:54.020 CC lib/iscsi/task.o 00:03:54.020 SYMLINK libspdk_ublk.so 00:03:54.278 LIB libspdk_ftl.a 00:03:54.536 SO libspdk_ftl.so.8.0 00:03:54.794 SYMLINK libspdk_ftl.so 00:03:55.360 LIB libspdk_vhost.a 00:03:55.360 SO libspdk_vhost.so.7.1 00:03:55.360 SYMLINK libspdk_vhost.so 00:03:55.619 LIB libspdk_nvmf.a 00:03:55.619 LIB libspdk_iscsi.a 00:03:55.619 SO libspdk_nvmf.so.17.0 00:03:55.619 SO libspdk_iscsi.so.7.0 00:03:55.619 SYMLINK libspdk_iscsi.so 00:03:55.878 SYMLINK libspdk_nvmf.so 00:03:55.878 CC module/env_dpdk/env_dpdk_rpc.o 00:03:55.878 CC module/vfu_device/vfu_virtio.o 00:03:55.878 CC module/vfu_device/vfu_virtio_blk.o 00:03:55.878 CC module/vfu_device/vfu_virtio_scsi.o 00:03:55.878 CC module/vfu_device/vfu_virtio_rpc.o 00:03:55.878 CC module/sock/posix/posix.o 00:03:55.878 CC module/accel/iaa/accel_iaa.o 00:03:55.878 CC module/scheduler/dynamic/scheduler_dynamic.o 00:03:55.878 CC module/scheduler/gscheduler/gscheduler.o 00:03:55.878 CC module/accel/error/accel_error.o 00:03:55.878 CC module/accel/iaa/accel_iaa_rpc.o 00:03:55.878 CC module/accel/ioat/accel_ioat.o 00:03:55.878 CC module/accel/ioat/accel_ioat_rpc.o 00:03:55.878 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:03:55.878 CC module/accel/error/accel_error_rpc.o 00:03:55.878 CC module/blob/bdev/blob_bdev.o 00:03:55.878 CC module/accel/dsa/accel_dsa.o 00:03:55.878 CC module/accel/dsa/accel_dsa_rpc.o 00:03:56.136 LIB libspdk_env_dpdk_rpc.a 00:03:56.136 SO libspdk_env_dpdk_rpc.so.5.0 00:03:56.136 SYMLINK libspdk_env_dpdk_rpc.so 00:03:56.136 LIB libspdk_scheduler_gscheduler.a 00:03:56.136 LIB libspdk_scheduler_dpdk_governor.a 00:03:56.136 SO libspdk_scheduler_dpdk_governor.so.3.0 00:03:56.136 SO libspdk_scheduler_gscheduler.so.3.0 00:03:56.136 LIB libspdk_accel_error.a 00:03:56.136 LIB libspdk_accel_ioat.a 00:03:56.136 LIB libspdk_scheduler_dynamic.a 00:03:56.136 SO libspdk_accel_ioat.so.5.0 00:03:56.136 SO libspdk_accel_error.so.1.0 00:03:56.136 LIB libspdk_accel_iaa.a 00:03:56.136 SO libspdk_scheduler_dynamic.so.3.0 00:03:56.136 SYMLINK libspdk_scheduler_dpdk_governor.so 00:03:56.136 SYMLINK libspdk_scheduler_gscheduler.so 00:03:56.136 SO libspdk_accel_iaa.so.2.0 00:03:56.136 LIB libspdk_accel_dsa.a 00:03:56.399 SYMLINK libspdk_accel_ioat.so 00:03:56.399 SYMLINK libspdk_accel_error.so 00:03:56.399 SYMLINK libspdk_scheduler_dynamic.so 00:03:56.399 SO libspdk_accel_dsa.so.4.0 00:03:56.399 LIB libspdk_blob_bdev.a 00:03:56.399 SYMLINK libspdk_accel_iaa.so 00:03:56.399 SO libspdk_blob_bdev.so.10.1 00:03:56.399 SYMLINK libspdk_accel_dsa.so 00:03:56.399 SYMLINK libspdk_blob_bdev.so 00:03:56.399 CC module/bdev/split/vbdev_split.o 00:03:56.399 CC module/bdev/gpt/gpt.o 00:03:56.399 CC module/bdev/malloc/bdev_malloc.o 00:03:56.399 CC module/bdev/null/bdev_null.o 00:03:56.399 CC module/bdev/error/vbdev_error.o 00:03:56.399 CC module/bdev/lvol/vbdev_lvol.o 00:03:56.399 CC module/bdev/malloc/bdev_malloc_rpc.o 00:03:56.399 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:03:56.399 CC module/bdev/delay/vbdev_delay.o 00:03:56.399 CC module/bdev/null/bdev_null_rpc.o 00:03:56.399 CC module/bdev/gpt/vbdev_gpt.o 00:03:56.399 CC module/bdev/split/vbdev_split_rpc.o 00:03:56.399 CC module/bdev/error/vbdev_error_rpc.o 00:03:56.399 CC module/bdev/raid/bdev_raid.o 00:03:56.399 CC module/bdev/zone_block/vbdev_zone_block.o 00:03:56.399 CC module/bdev/passthru/vbdev_passthru.o 00:03:56.399 CC module/bdev/nvme/bdev_nvme.o 00:03:56.399 CC module/bdev/raid/bdev_raid_rpc.o 00:03:56.399 CC module/bdev/iscsi/bdev_iscsi.o 00:03:56.399 CC module/bdev/delay/vbdev_delay_rpc.o 00:03:56.399 CC module/blobfs/bdev/blobfs_bdev.o 00:03:56.399 CC module/bdev/nvme/bdev_nvme_rpc.o 00:03:56.399 CC module/bdev/aio/bdev_aio.o 00:03:56.399 CC module/bdev/raid/bdev_raid_sb.o 00:03:56.399 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:03:56.399 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:03:56.399 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:03:56.399 CC module/bdev/ftl/bdev_ftl.o 00:03:56.399 CC module/bdev/aio/bdev_aio_rpc.o 00:03:56.399 CC module/bdev/nvme/nvme_rpc.o 00:03:56.399 CC module/bdev/raid/raid0.o 00:03:56.399 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:03:56.399 CC module/bdev/virtio/bdev_virtio_scsi.o 00:03:56.399 CC module/bdev/nvme/bdev_mdns_client.o 00:03:56.399 CC module/bdev/raid/raid1.o 00:03:56.399 CC module/bdev/ftl/bdev_ftl_rpc.o 00:03:56.399 CC module/bdev/virtio/bdev_virtio_blk.o 00:03:56.399 CC module/bdev/raid/concat.o 00:03:56.399 CC module/bdev/virtio/bdev_virtio_rpc.o 00:03:56.399 CC module/bdev/nvme/vbdev_opal.o 00:03:56.399 CC module/bdev/nvme/vbdev_opal_rpc.o 00:03:56.659 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:03:56.659 LIB libspdk_vfu_device.a 00:03:56.659 SO libspdk_vfu_device.so.2.0 00:03:56.917 LIB libspdk_sock_posix.a 00:03:56.917 SO libspdk_sock_posix.so.5.0 00:03:56.917 SYMLINK libspdk_vfu_device.so 00:03:56.917 LIB libspdk_blobfs_bdev.a 00:03:56.917 SYMLINK libspdk_sock_posix.so 00:03:56.917 SO libspdk_blobfs_bdev.so.5.0 00:03:56.917 LIB libspdk_bdev_gpt.a 00:03:56.917 LIB libspdk_bdev_split.a 00:03:56.917 SO libspdk_bdev_gpt.so.5.0 00:03:56.917 SO libspdk_bdev_split.so.5.0 00:03:56.917 LIB libspdk_bdev_null.a 00:03:56.917 SYMLINK libspdk_blobfs_bdev.so 00:03:56.917 SO libspdk_bdev_null.so.5.0 00:03:56.917 LIB libspdk_bdev_error.a 00:03:56.917 LIB libspdk_bdev_ftl.a 00:03:56.917 SYMLINK libspdk_bdev_gpt.so 00:03:56.917 SYMLINK libspdk_bdev_split.so 00:03:56.917 SO libspdk_bdev_error.so.5.0 00:03:56.917 SO libspdk_bdev_ftl.so.5.0 00:03:57.176 SYMLINK libspdk_bdev_null.so 00:03:57.176 LIB libspdk_bdev_zone_block.a 00:03:57.176 LIB libspdk_bdev_malloc.a 00:03:57.176 SO libspdk_bdev_zone_block.so.5.0 00:03:57.176 LIB libspdk_bdev_delay.a 00:03:57.176 SYMLINK libspdk_bdev_error.so 00:03:57.176 LIB libspdk_bdev_passthru.a 00:03:57.176 SO libspdk_bdev_malloc.so.5.0 00:03:57.176 LIB libspdk_bdev_iscsi.a 00:03:57.176 SYMLINK libspdk_bdev_ftl.so 00:03:57.176 SO libspdk_bdev_delay.so.5.0 00:03:57.176 LIB libspdk_bdev_aio.a 00:03:57.176 SO libspdk_bdev_passthru.so.5.0 00:03:57.176 SO libspdk_bdev_iscsi.so.5.0 00:03:57.176 SO libspdk_bdev_aio.so.5.0 00:03:57.176 SYMLINK libspdk_bdev_zone_block.so 00:03:57.176 SYMLINK libspdk_bdev_malloc.so 00:03:57.176 SYMLINK libspdk_bdev_delay.so 00:03:57.176 SYMLINK libspdk_bdev_passthru.so 00:03:57.176 SYMLINK libspdk_bdev_iscsi.so 00:03:57.176 SYMLINK libspdk_bdev_aio.so 00:03:57.176 LIB libspdk_bdev_lvol.a 00:03:57.176 SO libspdk_bdev_lvol.so.5.0 00:03:57.176 LIB libspdk_bdev_virtio.a 00:03:57.176 SO libspdk_bdev_virtio.so.5.0 00:03:57.176 SYMLINK libspdk_bdev_lvol.so 00:03:57.433 SYMLINK libspdk_bdev_virtio.so 00:03:57.692 LIB libspdk_bdev_raid.a 00:03:57.692 SO libspdk_bdev_raid.so.5.0 00:03:57.692 SYMLINK libspdk_bdev_raid.so 00:03:59.067 LIB libspdk_bdev_nvme.a 00:03:59.067 SO libspdk_bdev_nvme.so.6.0 00:03:59.067 SYMLINK libspdk_bdev_nvme.so 00:03:59.067 CC module/event/subsystems/scheduler/scheduler.o 00:03:59.067 CC module/event/subsystems/iobuf/iobuf.o 00:03:59.067 CC module/event/subsystems/sock/sock.o 00:03:59.067 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:03:59.067 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:03:59.067 CC module/event/subsystems/vfu_tgt/vfu_tgt.o 00:03:59.067 CC module/event/subsystems/vmd/vmd.o 00:03:59.067 CC module/event/subsystems/vmd/vmd_rpc.o 00:03:59.327 LIB libspdk_event_sock.a 00:03:59.327 LIB libspdk_event_vhost_blk.a 00:03:59.327 LIB libspdk_event_scheduler.a 00:03:59.327 LIB libspdk_event_vfu_tgt.a 00:03:59.327 LIB libspdk_event_vmd.a 00:03:59.327 SO libspdk_event_sock.so.4.0 00:03:59.327 LIB libspdk_event_iobuf.a 00:03:59.327 SO libspdk_event_vhost_blk.so.2.0 00:03:59.327 SO libspdk_event_scheduler.so.3.0 00:03:59.327 SO libspdk_event_vfu_tgt.so.2.0 00:03:59.327 SO libspdk_event_vmd.so.5.0 00:03:59.327 SO libspdk_event_iobuf.so.2.0 00:03:59.327 SYMLINK libspdk_event_sock.so 00:03:59.327 SYMLINK libspdk_event_vhost_blk.so 00:03:59.327 SYMLINK libspdk_event_scheduler.so 00:03:59.327 SYMLINK libspdk_event_vfu_tgt.so 00:03:59.327 SYMLINK libspdk_event_vmd.so 00:03:59.327 SYMLINK libspdk_event_iobuf.so 00:03:59.586 CC module/event/subsystems/accel/accel.o 00:03:59.586 LIB libspdk_event_accel.a 00:03:59.844 SO libspdk_event_accel.so.5.0 00:03:59.844 SYMLINK libspdk_event_accel.so 00:03:59.844 CC module/event/subsystems/bdev/bdev.o 00:04:00.103 LIB libspdk_event_bdev.a 00:04:00.103 SO libspdk_event_bdev.so.5.0 00:04:00.103 SYMLINK libspdk_event_bdev.so 00:04:00.362 CC module/event/subsystems/scsi/scsi.o 00:04:00.362 CC module/event/subsystems/nbd/nbd.o 00:04:00.362 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:04:00.362 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:04:00.362 CC module/event/subsystems/ublk/ublk.o 00:04:00.362 LIB libspdk_event_nbd.a 00:04:00.362 LIB libspdk_event_ublk.a 00:04:00.362 LIB libspdk_event_scsi.a 00:04:00.362 SO libspdk_event_ublk.so.2.0 00:04:00.362 SO libspdk_event_nbd.so.5.0 00:04:00.362 SO libspdk_event_scsi.so.5.0 00:04:00.362 SYMLINK libspdk_event_ublk.so 00:04:00.362 SYMLINK libspdk_event_nbd.so 00:04:00.362 SYMLINK libspdk_event_scsi.so 00:04:00.362 LIB libspdk_event_nvmf.a 00:04:00.620 SO libspdk_event_nvmf.so.5.0 00:04:00.620 SYMLINK libspdk_event_nvmf.so 00:04:00.620 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:04:00.620 CC module/event/subsystems/iscsi/iscsi.o 00:04:00.620 LIB libspdk_event_vhost_scsi.a 00:04:00.620 SO libspdk_event_vhost_scsi.so.2.0 00:04:00.620 LIB libspdk_event_iscsi.a 00:04:00.877 SO libspdk_event_iscsi.so.5.0 00:04:00.877 SYMLINK libspdk_event_vhost_scsi.so 00:04:00.877 SYMLINK libspdk_event_iscsi.so 00:04:00.877 SO libspdk.so.5.0 00:04:00.877 SYMLINK libspdk.so 00:04:01.140 CXX app/trace/trace.o 00:04:01.140 CC test/rpc_client/rpc_client_test.o 00:04:01.140 CC app/spdk_nvme_perf/perf.o 00:04:01.140 TEST_HEADER include/spdk/accel.h 00:04:01.140 CC app/trace_record/trace_record.o 00:04:01.140 CC app/spdk_nvme_discover/discovery_aer.o 00:04:01.140 CC app/spdk_lspci/spdk_lspci.o 00:04:01.140 TEST_HEADER include/spdk/accel_module.h 00:04:01.140 CC app/spdk_nvme_identify/identify.o 00:04:01.140 TEST_HEADER include/spdk/assert.h 00:04:01.140 CC app/spdk_top/spdk_top.o 00:04:01.140 TEST_HEADER include/spdk/barrier.h 00:04:01.140 TEST_HEADER include/spdk/base64.h 00:04:01.140 TEST_HEADER include/spdk/bdev.h 00:04:01.140 TEST_HEADER include/spdk/bdev_module.h 00:04:01.140 TEST_HEADER include/spdk/bdev_zone.h 00:04:01.140 TEST_HEADER include/spdk/bit_array.h 00:04:01.140 TEST_HEADER include/spdk/bit_pool.h 00:04:01.140 TEST_HEADER include/spdk/blob_bdev.h 00:04:01.140 TEST_HEADER include/spdk/blobfs_bdev.h 00:04:01.140 TEST_HEADER include/spdk/blobfs.h 00:04:01.140 CC examples/interrupt_tgt/interrupt_tgt.o 00:04:01.140 TEST_HEADER include/spdk/blob.h 00:04:01.140 TEST_HEADER include/spdk/conf.h 00:04:01.140 TEST_HEADER include/spdk/config.h 00:04:01.140 TEST_HEADER include/spdk/cpuset.h 00:04:01.140 TEST_HEADER include/spdk/crc16.h 00:04:01.140 CC app/spdk_dd/spdk_dd.o 00:04:01.140 TEST_HEADER include/spdk/crc32.h 00:04:01.140 TEST_HEADER include/spdk/crc64.h 00:04:01.140 CC examples/nvme/reconnect/reconnect.o 00:04:01.140 CC app/iscsi_tgt/iscsi_tgt.o 00:04:01.140 TEST_HEADER include/spdk/dif.h 00:04:01.140 CC app/nvmf_tgt/nvmf_main.o 00:04:01.140 CC examples/nvme/hotplug/hotplug.o 00:04:01.140 CC examples/nvme/abort/abort.o 00:04:01.140 CC examples/util/zipf/zipf.o 00:04:01.140 TEST_HEADER include/spdk/dma.h 00:04:01.140 CC examples/accel/perf/accel_perf.o 00:04:01.140 CC examples/nvme/hello_world/hello_world.o 00:04:01.140 CC examples/ioat/perf/perf.o 00:04:01.140 CC examples/nvme/cmb_copy/cmb_copy.o 00:04:01.140 TEST_HEADER include/spdk/endian.h 00:04:01.140 CC examples/nvme/arbitration/arbitration.o 00:04:01.140 TEST_HEADER include/spdk/env_dpdk.h 00:04:01.140 CC examples/ioat/verify/verify.o 00:04:01.140 CC examples/sock/hello_world/hello_sock.o 00:04:01.140 CC examples/nvme/nvme_manage/nvme_manage.o 00:04:01.140 CC examples/vmd/lsvmd/lsvmd.o 00:04:01.140 CC app/vhost/vhost.o 00:04:01.140 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:04:01.140 TEST_HEADER include/spdk/env.h 00:04:01.140 CC test/event/event_perf/event_perf.o 00:04:01.140 TEST_HEADER include/spdk/event.h 00:04:01.140 CC examples/idxd/perf/perf.o 00:04:01.140 CC app/fio/nvme/fio_plugin.o 00:04:01.140 CC examples/vmd/led/led.o 00:04:01.140 TEST_HEADER include/spdk/fd_group.h 00:04:01.140 TEST_HEADER include/spdk/fd.h 00:04:01.140 TEST_HEADER include/spdk/file.h 00:04:01.140 CC test/thread/poller_perf/poller_perf.o 00:04:01.140 TEST_HEADER include/spdk/ftl.h 00:04:01.140 TEST_HEADER include/spdk/gpt_spec.h 00:04:01.140 CC test/nvme/aer/aer.o 00:04:01.140 TEST_HEADER include/spdk/hexlify.h 00:04:01.140 TEST_HEADER include/spdk/histogram_data.h 00:04:01.140 TEST_HEADER include/spdk/idxd.h 00:04:01.140 TEST_HEADER include/spdk/idxd_spec.h 00:04:01.140 CC app/spdk_tgt/spdk_tgt.o 00:04:01.140 TEST_HEADER include/spdk/init.h 00:04:01.140 TEST_HEADER include/spdk/ioat.h 00:04:01.140 TEST_HEADER include/spdk/ioat_spec.h 00:04:01.140 TEST_HEADER include/spdk/iscsi_spec.h 00:04:01.140 CC test/bdev/bdevio/bdevio.o 00:04:01.140 CC examples/bdev/hello_world/hello_bdev.o 00:04:01.140 TEST_HEADER include/spdk/json.h 00:04:01.140 CC examples/blob/cli/blobcli.o 00:04:01.140 TEST_HEADER include/spdk/jsonrpc.h 00:04:01.140 CC examples/thread/thread/thread_ex.o 00:04:01.140 TEST_HEADER include/spdk/likely.h 00:04:01.140 CC test/dma/test_dma/test_dma.o 00:04:01.140 CC test/blobfs/mkfs/mkfs.o 00:04:01.140 TEST_HEADER include/spdk/log.h 00:04:01.140 TEST_HEADER include/spdk/lvol.h 00:04:01.140 CC examples/blob/hello_world/hello_blob.o 00:04:01.140 TEST_HEADER include/spdk/memory.h 00:04:01.140 CC examples/bdev/bdevperf/bdevperf.o 00:04:01.140 TEST_HEADER include/spdk/mmio.h 00:04:01.140 CC test/accel/dif/dif.o 00:04:01.140 TEST_HEADER include/spdk/nbd.h 00:04:01.140 CC examples/nvmf/nvmf/nvmf.o 00:04:01.140 TEST_HEADER include/spdk/notify.h 00:04:01.140 TEST_HEADER include/spdk/nvme.h 00:04:01.140 TEST_HEADER include/spdk/nvme_intel.h 00:04:01.140 CC test/env/mem_callbacks/mem_callbacks.o 00:04:01.140 CC test/app/bdev_svc/bdev_svc.o 00:04:01.140 TEST_HEADER include/spdk/nvme_ocssd.h 00:04:01.140 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:04:01.140 TEST_HEADER include/spdk/nvme_spec.h 00:04:01.140 TEST_HEADER include/spdk/nvme_zns.h 00:04:01.140 TEST_HEADER include/spdk/nvmf_cmd.h 00:04:01.140 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:04:01.140 CC test/lvol/esnap/esnap.o 00:04:01.140 TEST_HEADER include/spdk/nvmf.h 00:04:01.140 TEST_HEADER include/spdk/nvmf_spec.h 00:04:01.403 TEST_HEADER include/spdk/nvmf_transport.h 00:04:01.403 TEST_HEADER include/spdk/opal.h 00:04:01.403 TEST_HEADER include/spdk/opal_spec.h 00:04:01.403 TEST_HEADER include/spdk/pci_ids.h 00:04:01.403 TEST_HEADER include/spdk/pipe.h 00:04:01.403 TEST_HEADER include/spdk/queue.h 00:04:01.403 TEST_HEADER include/spdk/reduce.h 00:04:01.403 TEST_HEADER include/spdk/rpc.h 00:04:01.403 TEST_HEADER include/spdk/scheduler.h 00:04:01.403 TEST_HEADER include/spdk/scsi.h 00:04:01.403 TEST_HEADER include/spdk/scsi_spec.h 00:04:01.403 TEST_HEADER include/spdk/sock.h 00:04:01.403 TEST_HEADER include/spdk/stdinc.h 00:04:01.403 TEST_HEADER include/spdk/string.h 00:04:01.403 TEST_HEADER include/spdk/thread.h 00:04:01.403 TEST_HEADER include/spdk/trace.h 00:04:01.403 TEST_HEADER include/spdk/trace_parser.h 00:04:01.403 TEST_HEADER include/spdk/tree.h 00:04:01.403 LINK spdk_lspci 00:04:01.403 TEST_HEADER include/spdk/ublk.h 00:04:01.403 TEST_HEADER include/spdk/util.h 00:04:01.403 TEST_HEADER include/spdk/uuid.h 00:04:01.403 TEST_HEADER include/spdk/version.h 00:04:01.403 TEST_HEADER include/spdk/vfio_user_pci.h 00:04:01.403 TEST_HEADER include/spdk/vfio_user_spec.h 00:04:01.403 TEST_HEADER include/spdk/vhost.h 00:04:01.403 TEST_HEADER include/spdk/vmd.h 00:04:01.403 TEST_HEADER include/spdk/xor.h 00:04:01.403 TEST_HEADER include/spdk/zipf.h 00:04:01.403 CXX test/cpp_headers/accel.o 00:04:01.403 LINK rpc_client_test 00:04:01.403 LINK lsvmd 00:04:01.403 LINK spdk_nvme_discover 00:04:01.403 LINK event_perf 00:04:01.403 LINK led 00:04:01.403 LINK zipf 00:04:01.403 LINK poller_perf 00:04:01.403 LINK interrupt_tgt 00:04:01.403 LINK cmb_copy 00:04:01.403 LINK nvmf_tgt 00:04:01.403 LINK pmr_persistence 00:04:01.403 LINK vhost 00:04:01.691 LINK spdk_trace_record 00:04:01.691 LINK iscsi_tgt 00:04:01.691 LINK ioat_perf 00:04:01.691 LINK verify 00:04:01.691 LINK hello_world 00:04:01.691 LINK mkfs 00:04:01.691 LINK hotplug 00:04:01.691 LINK bdev_svc 00:04:01.691 LINK spdk_tgt 00:04:01.691 LINK hello_sock 00:04:01.691 CXX test/cpp_headers/accel_module.o 00:04:01.691 LINK hello_blob 00:04:01.691 LINK thread 00:04:01.691 LINK hello_bdev 00:04:01.691 LINK aer 00:04:01.691 LINK arbitration 00:04:01.691 LINK reconnect 00:04:01.691 LINK nvmf 00:04:01.691 LINK idxd_perf 00:04:01.954 LINK spdk_dd 00:04:01.954 CC test/nvme/reset/reset.o 00:04:01.954 CC test/env/vtophys/vtophys.o 00:04:01.954 CXX test/cpp_headers/assert.o 00:04:01.954 CC test/nvme/sgl/sgl.o 00:04:01.954 CC test/event/reactor/reactor.o 00:04:01.954 CC test/event/reactor_perf/reactor_perf.o 00:04:01.954 LINK abort 00:04:01.954 CC test/event/app_repeat/app_repeat.o 00:04:01.954 CXX test/cpp_headers/barrier.o 00:04:01.954 LINK bdevio 00:04:01.954 LINK spdk_trace 00:04:01.954 LINK dif 00:04:01.954 LINK test_dma 00:04:01.954 CC test/nvme/e2edp/nvme_dp.o 00:04:01.954 CC test/app/histogram_perf/histogram_perf.o 00:04:01.954 CC app/fio/bdev/fio_plugin.o 00:04:01.954 CC test/nvme/overhead/overhead.o 00:04:01.954 CC test/nvme/err_injection/err_injection.o 00:04:01.954 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:04:01.954 LINK accel_perf 00:04:01.954 CC test/app/jsoncat/jsoncat.o 00:04:01.954 CC test/nvme/startup/startup.o 00:04:01.954 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:04:01.954 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:04:01.954 CC test/event/scheduler/scheduler.o 00:04:01.954 CC test/app/stub/stub.o 00:04:02.219 CXX test/cpp_headers/base64.o 00:04:02.219 CXX test/cpp_headers/bdev.o 00:04:02.219 CC test/env/pci/pci_ut.o 00:04:02.219 CC test/env/memory/memory_ut.o 00:04:02.219 LINK nvme_manage 00:04:02.219 CC test/nvme/reserve/reserve.o 00:04:02.219 CC test/nvme/simple_copy/simple_copy.o 00:04:02.219 CC test/nvme/connect_stress/connect_stress.o 00:04:02.219 LINK reactor 00:04:02.219 LINK vtophys 00:04:02.219 LINK spdk_nvme 00:04:02.219 LINK blobcli 00:04:02.219 CC test/nvme/boot_partition/boot_partition.o 00:04:02.219 LINK reactor_perf 00:04:02.219 CXX test/cpp_headers/bdev_module.o 00:04:02.219 CXX test/cpp_headers/bdev_zone.o 00:04:02.219 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:04:02.219 CXX test/cpp_headers/bit_array.o 00:04:02.219 CC test/nvme/compliance/nvme_compliance.o 00:04:02.219 CC test/nvme/fused_ordering/fused_ordering.o 00:04:02.219 LINK histogram_perf 00:04:02.219 LINK app_repeat 00:04:02.219 CXX test/cpp_headers/bit_pool.o 00:04:02.219 CC test/nvme/doorbell_aers/doorbell_aers.o 00:04:02.219 LINK reset 00:04:02.219 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:04:02.219 CXX test/cpp_headers/blobfs_bdev.o 00:04:02.219 CXX test/cpp_headers/blob_bdev.o 00:04:02.219 LINK jsoncat 00:04:02.219 LINK err_injection 00:04:02.480 LINK env_dpdk_post_init 00:04:02.480 CXX test/cpp_headers/blobfs.o 00:04:02.480 LINK sgl 00:04:02.480 LINK startup 00:04:02.480 CC test/nvme/fdp/fdp.o 00:04:02.480 CC test/nvme/cuse/cuse.o 00:04:02.480 LINK stub 00:04:02.480 CXX test/cpp_headers/blob.o 00:04:02.480 CXX test/cpp_headers/conf.o 00:04:02.480 CXX test/cpp_headers/config.o 00:04:02.480 CXX test/cpp_headers/cpuset.o 00:04:02.480 LINK mem_callbacks 00:04:02.480 CXX test/cpp_headers/crc16.o 00:04:02.480 CXX test/cpp_headers/crc32.o 00:04:02.480 CXX test/cpp_headers/crc64.o 00:04:02.480 LINK scheduler 00:04:02.480 LINK nvme_dp 00:04:02.480 LINK connect_stress 00:04:02.480 LINK boot_partition 00:04:02.480 LINK overhead 00:04:02.480 CXX test/cpp_headers/dif.o 00:04:02.480 LINK reserve 00:04:02.480 CXX test/cpp_headers/dma.o 00:04:02.480 CXX test/cpp_headers/endian.o 00:04:02.480 CXX test/cpp_headers/env_dpdk.o 00:04:02.480 CXX test/cpp_headers/env.o 00:04:02.480 LINK spdk_nvme_perf 00:04:02.480 CXX test/cpp_headers/event.o 00:04:02.480 LINK simple_copy 00:04:02.480 LINK spdk_nvme_identify 00:04:02.747 CXX test/cpp_headers/fd_group.o 00:04:02.747 CXX test/cpp_headers/fd.o 00:04:02.747 CXX test/cpp_headers/file.o 00:04:02.747 LINK fused_ordering 00:04:02.747 CXX test/cpp_headers/ftl.o 00:04:02.747 CXX test/cpp_headers/gpt_spec.o 00:04:02.748 CXX test/cpp_headers/hexlify.o 00:04:02.748 CXX test/cpp_headers/histogram_data.o 00:04:02.748 LINK doorbell_aers 00:04:02.748 CXX test/cpp_headers/idxd.o 00:04:02.748 LINK spdk_top 00:04:02.748 CXX test/cpp_headers/idxd_spec.o 00:04:02.748 CXX test/cpp_headers/init.o 00:04:02.748 LINK bdevperf 00:04:02.748 CXX test/cpp_headers/ioat.o 00:04:02.748 CXX test/cpp_headers/ioat_spec.o 00:04:02.748 CXX test/cpp_headers/iscsi_spec.o 00:04:02.748 CXX test/cpp_headers/json.o 00:04:02.748 CXX test/cpp_headers/jsonrpc.o 00:04:02.748 CXX test/cpp_headers/likely.o 00:04:02.748 CXX test/cpp_headers/log.o 00:04:02.748 LINK nvme_fuzz 00:04:02.748 CXX test/cpp_headers/lvol.o 00:04:02.748 CXX test/cpp_headers/memory.o 00:04:02.748 CXX test/cpp_headers/mmio.o 00:04:02.748 CXX test/cpp_headers/nbd.o 00:04:02.748 CXX test/cpp_headers/notify.o 00:04:02.748 LINK pci_ut 00:04:02.748 CXX test/cpp_headers/nvme.o 00:04:02.748 LINK nvme_compliance 00:04:03.013 CXX test/cpp_headers/nvme_intel.o 00:04:03.013 CXX test/cpp_headers/nvme_ocssd.o 00:04:03.013 CXX test/cpp_headers/nvme_ocssd_spec.o 00:04:03.013 CXX test/cpp_headers/nvme_spec.o 00:04:03.013 CXX test/cpp_headers/nvme_zns.o 00:04:03.013 CXX test/cpp_headers/nvmf_cmd.o 00:04:03.013 CXX test/cpp_headers/nvmf_fc_spec.o 00:04:03.013 LINK spdk_bdev 00:04:03.013 CXX test/cpp_headers/nvmf.o 00:04:03.013 CXX test/cpp_headers/nvmf_spec.o 00:04:03.013 CXX test/cpp_headers/nvmf_transport.o 00:04:03.013 CXX test/cpp_headers/opal.o 00:04:03.013 CXX test/cpp_headers/opal_spec.o 00:04:03.013 CXX test/cpp_headers/pci_ids.o 00:04:03.013 CXX test/cpp_headers/pipe.o 00:04:03.013 CXX test/cpp_headers/queue.o 00:04:03.013 CXX test/cpp_headers/reduce.o 00:04:03.013 CXX test/cpp_headers/rpc.o 00:04:03.013 CXX test/cpp_headers/scheduler.o 00:04:03.013 CXX test/cpp_headers/scsi.o 00:04:03.013 LINK fdp 00:04:03.013 CXX test/cpp_headers/scsi_spec.o 00:04:03.013 CXX test/cpp_headers/sock.o 00:04:03.013 CXX test/cpp_headers/stdinc.o 00:04:03.013 CXX test/cpp_headers/string.o 00:04:03.013 CXX test/cpp_headers/thread.o 00:04:03.013 CXX test/cpp_headers/trace.o 00:04:03.013 CXX test/cpp_headers/trace_parser.o 00:04:03.013 CXX test/cpp_headers/tree.o 00:04:03.013 CXX test/cpp_headers/ublk.o 00:04:03.013 CXX test/cpp_headers/util.o 00:04:03.013 CXX test/cpp_headers/uuid.o 00:04:03.275 CXX test/cpp_headers/version.o 00:04:03.275 CXX test/cpp_headers/vfio_user_pci.o 00:04:03.275 CXX test/cpp_headers/vfio_user_spec.o 00:04:03.275 LINK vhost_fuzz 00:04:03.275 CXX test/cpp_headers/vhost.o 00:04:03.275 CXX test/cpp_headers/xor.o 00:04:03.275 CXX test/cpp_headers/vmd.o 00:04:03.275 CXX test/cpp_headers/zipf.o 00:04:03.533 LINK memory_ut 00:04:04.100 LINK cuse 00:04:04.359 LINK iscsi_fuzz 00:04:06.893 LINK esnap 00:04:06.893 00:04:06.893 real 0m37.577s 00:04:06.893 user 7m15.437s 00:04:06.893 sys 1m36.772s 00:04:06.893 22:56:10 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:04:06.893 22:56:10 -- common/autotest_common.sh@10 -- $ set +x 00:04:06.893 ************************************ 00:04:06.893 END TEST make 00:04:06.893 ************************************ 00:04:06.893 22:56:10 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:06.893 22:56:10 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:06.893 22:56:10 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:07.154 22:56:10 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:07.154 22:56:10 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:07.154 22:56:10 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:07.154 22:56:10 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:07.154 22:56:10 -- scripts/common.sh@335 -- # IFS=.-: 00:04:07.154 22:56:10 -- scripts/common.sh@335 -- # read -ra ver1 00:04:07.154 22:56:10 -- scripts/common.sh@336 -- # IFS=.-: 00:04:07.154 22:56:10 -- scripts/common.sh@336 -- # read -ra ver2 00:04:07.154 22:56:10 -- scripts/common.sh@337 -- # local 'op=<' 00:04:07.154 22:56:10 -- scripts/common.sh@339 -- # ver1_l=2 00:04:07.154 22:56:10 -- scripts/common.sh@340 -- # ver2_l=1 00:04:07.154 22:56:10 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:07.154 22:56:10 -- scripts/common.sh@343 -- # case "$op" in 00:04:07.154 22:56:10 -- scripts/common.sh@344 -- # : 1 00:04:07.154 22:56:10 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:07.154 22:56:10 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:07.154 22:56:10 -- scripts/common.sh@364 -- # decimal 1 00:04:07.154 22:56:10 -- scripts/common.sh@352 -- # local d=1 00:04:07.154 22:56:10 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:07.154 22:56:10 -- scripts/common.sh@354 -- # echo 1 00:04:07.154 22:56:10 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:07.154 22:56:10 -- scripts/common.sh@365 -- # decimal 2 00:04:07.154 22:56:10 -- scripts/common.sh@352 -- # local d=2 00:04:07.154 22:56:10 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:07.154 22:56:10 -- scripts/common.sh@354 -- # echo 2 00:04:07.154 22:56:10 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:07.154 22:56:10 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:07.154 22:56:10 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:07.154 22:56:10 -- scripts/common.sh@367 -- # return 0 00:04:07.154 22:56:10 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:07.154 22:56:10 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:07.154 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:07.154 --rc genhtml_branch_coverage=1 00:04:07.154 --rc genhtml_function_coverage=1 00:04:07.154 --rc genhtml_legend=1 00:04:07.154 --rc geninfo_all_blocks=1 00:04:07.154 --rc geninfo_unexecuted_blocks=1 00:04:07.154 00:04:07.154 ' 00:04:07.154 22:56:10 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:07.154 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:07.154 --rc genhtml_branch_coverage=1 00:04:07.154 --rc genhtml_function_coverage=1 00:04:07.154 --rc genhtml_legend=1 00:04:07.154 --rc geninfo_all_blocks=1 00:04:07.154 --rc geninfo_unexecuted_blocks=1 00:04:07.154 00:04:07.154 ' 00:04:07.154 22:56:10 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:07.154 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:07.154 --rc genhtml_branch_coverage=1 00:04:07.154 --rc genhtml_function_coverage=1 00:04:07.154 --rc genhtml_legend=1 00:04:07.154 --rc geninfo_all_blocks=1 00:04:07.154 --rc geninfo_unexecuted_blocks=1 00:04:07.154 00:04:07.154 ' 00:04:07.154 22:56:10 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:07.154 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:07.154 --rc genhtml_branch_coverage=1 00:04:07.154 --rc genhtml_function_coverage=1 00:04:07.154 --rc genhtml_legend=1 00:04:07.154 --rc geninfo_all_blocks=1 00:04:07.154 --rc geninfo_unexecuted_blocks=1 00:04:07.154 00:04:07.154 ' 00:04:07.154 22:56:10 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:04:07.154 22:56:10 -- nvmf/common.sh@7 -- # uname -s 00:04:07.154 22:56:10 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:07.154 22:56:10 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:07.154 22:56:10 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:07.155 22:56:10 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:07.155 22:56:10 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:07.155 22:56:10 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:07.155 22:56:10 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:07.155 22:56:10 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:07.155 22:56:10 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:07.155 22:56:10 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:07.155 22:56:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:04:07.155 22:56:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:04:07.155 22:56:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:07.155 22:56:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:07.155 22:56:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:04:07.155 22:56:10 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:04:07.155 22:56:10 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:07.155 22:56:10 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:07.155 22:56:10 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:07.155 22:56:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:07.155 22:56:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:07.155 22:56:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:07.155 22:56:10 -- paths/export.sh@5 -- # export PATH 00:04:07.155 22:56:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:07.155 22:56:10 -- nvmf/common.sh@46 -- # : 0 00:04:07.155 22:56:10 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:04:07.155 22:56:10 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:04:07.155 22:56:10 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:04:07.155 22:56:10 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:07.155 22:56:10 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:07.155 22:56:10 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:04:07.155 22:56:10 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:04:07.155 22:56:10 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:04:07.155 22:56:10 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:04:07.155 22:56:10 -- spdk/autotest.sh@32 -- # uname -s 00:04:07.155 22:56:10 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:04:07.155 22:56:10 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:04:07.155 22:56:10 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:04:07.155 22:56:10 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:04:07.155 22:56:10 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:04:07.155 22:56:10 -- spdk/autotest.sh@44 -- # modprobe nbd 00:04:07.155 22:56:10 -- spdk/autotest.sh@46 -- # type -P udevadm 00:04:07.155 22:56:10 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:04:07.155 22:56:10 -- spdk/autotest.sh@48 -- # udevadm_pid=2294038 00:04:07.155 22:56:10 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:04:07.155 22:56:10 -- spdk/autotest.sh@51 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:04:07.155 22:56:10 -- spdk/autotest.sh@54 -- # echo 2294040 00:04:07.155 22:56:10 -- spdk/autotest.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:04:07.155 22:56:10 -- spdk/autotest.sh@56 -- # echo 2294041 00:04:07.155 22:56:10 -- spdk/autotest.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:04:07.155 22:56:10 -- spdk/autotest.sh@58 -- # [[ ............................... != QEMU ]] 00:04:07.155 22:56:10 -- spdk/autotest.sh@60 -- # echo 2294042 00:04:07.155 22:56:10 -- spdk/autotest.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:04:07.155 22:56:10 -- spdk/autotest.sh@62 -- # echo 2294043 00:04:07.155 22:56:10 -- spdk/autotest.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:04:07.155 22:56:10 -- spdk/autotest.sh@66 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:04:07.155 22:56:10 -- spdk/autotest.sh@68 -- # timing_enter autotest 00:04:07.155 22:56:10 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:07.155 22:56:10 -- common/autotest_common.sh@10 -- # set +x 00:04:07.155 22:56:10 -- spdk/autotest.sh@70 -- # create_test_list 00:04:07.155 22:56:10 -- common/autotest_common.sh@746 -- # xtrace_disable 00:04:07.155 22:56:10 -- common/autotest_common.sh@10 -- # set +x 00:04:07.155 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.bmc.pm.log 00:04:07.155 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pm.log 00:04:07.155 22:56:10 -- spdk/autotest.sh@72 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:04:07.155 22:56:10 -- spdk/autotest.sh@72 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:07.155 22:56:10 -- spdk/autotest.sh@72 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:07.155 22:56:10 -- spdk/autotest.sh@73 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:04:07.155 22:56:10 -- spdk/autotest.sh@74 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:07.155 22:56:10 -- spdk/autotest.sh@76 -- # freebsd_update_contigmem_mod 00:04:07.155 22:56:10 -- common/autotest_common.sh@1450 -- # uname 00:04:07.155 22:56:10 -- common/autotest_common.sh@1450 -- # '[' Linux = FreeBSD ']' 00:04:07.155 22:56:10 -- spdk/autotest.sh@77 -- # freebsd_set_maxsock_buf 00:04:07.155 22:56:10 -- common/autotest_common.sh@1470 -- # uname 00:04:07.155 22:56:10 -- common/autotest_common.sh@1470 -- # [[ Linux = FreeBSD ]] 00:04:07.155 22:56:10 -- spdk/autotest.sh@79 -- # [[ y == y ]] 00:04:07.155 22:56:10 -- spdk/autotest.sh@81 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 --version 00:04:07.155 lcov: LCOV version 1.15 00:04:07.155 22:56:10 -- spdk/autotest.sh@83 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:04:25.331 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:04:25.331 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:04:25.331 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:04:25.331 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:04:25.331 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:04:25.331 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:04:43.438 22:56:44 -- spdk/autotest.sh@87 -- # timing_enter pre_cleanup 00:04:43.438 22:56:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:43.438 22:56:44 -- common/autotest_common.sh@10 -- # set +x 00:04:43.438 22:56:44 -- spdk/autotest.sh@89 -- # rm -f 00:04:43.438 22:56:44 -- spdk/autotest.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:43.438 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:04:43.438 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:04:43.438 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:04:43.438 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:04:43.438 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:04:43.438 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:04:43.438 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:04:43.438 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:04:43.438 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:04:43.438 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:04:43.438 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:04:43.438 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:04:43.438 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:04:43.438 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:04:43.438 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:04:43.438 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:04:43.438 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:04:43.438 22:56:45 -- spdk/autotest.sh@94 -- # get_zoned_devs 00:04:43.438 22:56:45 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:04:43.438 22:56:45 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:04:43.438 22:56:45 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:04:43.438 22:56:45 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:04:43.438 22:56:45 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:04:43.438 22:56:45 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:04:43.438 22:56:45 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:43.438 22:56:45 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:04:43.438 22:56:45 -- spdk/autotest.sh@96 -- # (( 0 > 0 )) 00:04:43.438 22:56:45 -- spdk/autotest.sh@108 -- # ls /dev/nvme0n1 00:04:43.438 22:56:45 -- spdk/autotest.sh@108 -- # grep -v p 00:04:43.438 22:56:45 -- spdk/autotest.sh@108 -- # for dev in $(ls /dev/nvme*n* | grep -v p || true) 00:04:43.438 22:56:45 -- spdk/autotest.sh@110 -- # [[ -z '' ]] 00:04:43.438 22:56:45 -- spdk/autotest.sh@111 -- # block_in_use /dev/nvme0n1 00:04:43.439 22:56:45 -- scripts/common.sh@380 -- # local block=/dev/nvme0n1 pt 00:04:43.439 22:56:45 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:04:43.439 No valid GPT data, bailing 00:04:43.439 22:56:46 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:04:43.439 22:56:46 -- scripts/common.sh@393 -- # pt= 00:04:43.439 22:56:46 -- scripts/common.sh@394 -- # return 1 00:04:43.439 22:56:46 -- spdk/autotest.sh@112 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:04:43.439 1+0 records in 00:04:43.439 1+0 records out 00:04:43.439 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00209786 s, 500 MB/s 00:04:43.439 22:56:46 -- spdk/autotest.sh@116 -- # sync 00:04:43.439 22:56:46 -- spdk/autotest.sh@118 -- # xtrace_disable_per_cmd reap_spdk_processes 00:04:43.439 22:56:46 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:04:43.439 22:56:46 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:04:44.374 22:56:47 -- spdk/autotest.sh@122 -- # uname -s 00:04:44.374 22:56:47 -- spdk/autotest.sh@122 -- # '[' Linux = Linux ']' 00:04:44.374 22:56:47 -- spdk/autotest.sh@123 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:04:44.374 22:56:47 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:44.374 22:56:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:44.374 22:56:47 -- common/autotest_common.sh@10 -- # set +x 00:04:44.374 ************************************ 00:04:44.374 START TEST setup.sh 00:04:44.374 ************************************ 00:04:44.374 22:56:47 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:04:44.374 * Looking for test storage... 00:04:44.374 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:44.374 22:56:47 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:44.374 22:56:47 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:44.374 22:56:47 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:44.634 22:56:47 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:44.634 22:56:47 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:44.634 22:56:47 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:44.634 22:56:47 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:44.634 22:56:47 -- scripts/common.sh@335 -- # IFS=.-: 00:04:44.634 22:56:47 -- scripts/common.sh@335 -- # read -ra ver1 00:04:44.634 22:56:47 -- scripts/common.sh@336 -- # IFS=.-: 00:04:44.634 22:56:47 -- scripts/common.sh@336 -- # read -ra ver2 00:04:44.634 22:56:47 -- scripts/common.sh@337 -- # local 'op=<' 00:04:44.634 22:56:47 -- scripts/common.sh@339 -- # ver1_l=2 00:04:44.634 22:56:47 -- scripts/common.sh@340 -- # ver2_l=1 00:04:44.634 22:56:47 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:44.634 22:56:47 -- scripts/common.sh@343 -- # case "$op" in 00:04:44.634 22:56:47 -- scripts/common.sh@344 -- # : 1 00:04:44.634 22:56:47 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:44.634 22:56:47 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:44.634 22:56:47 -- scripts/common.sh@364 -- # decimal 1 00:04:44.634 22:56:47 -- scripts/common.sh@352 -- # local d=1 00:04:44.634 22:56:47 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:44.634 22:56:48 -- scripts/common.sh@354 -- # echo 1 00:04:44.634 22:56:48 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:44.634 22:56:48 -- scripts/common.sh@365 -- # decimal 2 00:04:44.634 22:56:48 -- scripts/common.sh@352 -- # local d=2 00:04:44.634 22:56:48 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:44.634 22:56:48 -- scripts/common.sh@354 -- # echo 2 00:04:44.634 22:56:48 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:44.634 22:56:48 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:44.634 22:56:48 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:44.634 22:56:48 -- scripts/common.sh@367 -- # return 0 00:04:44.634 22:56:48 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:44.634 22:56:48 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:44.634 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:44.634 --rc genhtml_branch_coverage=1 00:04:44.634 --rc genhtml_function_coverage=1 00:04:44.634 --rc genhtml_legend=1 00:04:44.634 --rc geninfo_all_blocks=1 00:04:44.634 --rc geninfo_unexecuted_blocks=1 00:04:44.634 00:04:44.634 ' 00:04:44.634 22:56:48 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:44.634 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:44.634 --rc genhtml_branch_coverage=1 00:04:44.634 --rc genhtml_function_coverage=1 00:04:44.634 --rc genhtml_legend=1 00:04:44.634 --rc geninfo_all_blocks=1 00:04:44.634 --rc geninfo_unexecuted_blocks=1 00:04:44.634 00:04:44.634 ' 00:04:44.634 22:56:48 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:44.634 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:44.634 --rc genhtml_branch_coverage=1 00:04:44.634 --rc genhtml_function_coverage=1 00:04:44.634 --rc genhtml_legend=1 00:04:44.634 --rc geninfo_all_blocks=1 00:04:44.634 --rc geninfo_unexecuted_blocks=1 00:04:44.634 00:04:44.634 ' 00:04:44.634 22:56:48 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:44.634 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:44.634 --rc genhtml_branch_coverage=1 00:04:44.634 --rc genhtml_function_coverage=1 00:04:44.634 --rc genhtml_legend=1 00:04:44.634 --rc geninfo_all_blocks=1 00:04:44.634 --rc geninfo_unexecuted_blocks=1 00:04:44.634 00:04:44.634 ' 00:04:44.634 22:56:48 -- setup/test-setup.sh@10 -- # uname -s 00:04:44.634 22:56:48 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:04:44.634 22:56:48 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:04:44.634 22:56:48 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:44.634 22:56:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:44.634 22:56:48 -- common/autotest_common.sh@10 -- # set +x 00:04:44.634 ************************************ 00:04:44.634 START TEST acl 00:04:44.634 ************************************ 00:04:44.634 22:56:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:04:44.634 * Looking for test storage... 00:04:44.634 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:44.634 22:56:48 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:44.634 22:56:48 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:44.634 22:56:48 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:44.634 22:56:48 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:44.634 22:56:48 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:44.634 22:56:48 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:44.634 22:56:48 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:44.634 22:56:48 -- scripts/common.sh@335 -- # IFS=.-: 00:04:44.634 22:56:48 -- scripts/common.sh@335 -- # read -ra ver1 00:04:44.634 22:56:48 -- scripts/common.sh@336 -- # IFS=.-: 00:04:44.634 22:56:48 -- scripts/common.sh@336 -- # read -ra ver2 00:04:44.634 22:56:48 -- scripts/common.sh@337 -- # local 'op=<' 00:04:44.634 22:56:48 -- scripts/common.sh@339 -- # ver1_l=2 00:04:44.634 22:56:48 -- scripts/common.sh@340 -- # ver2_l=1 00:04:44.634 22:56:48 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:44.634 22:56:48 -- scripts/common.sh@343 -- # case "$op" in 00:04:44.634 22:56:48 -- scripts/common.sh@344 -- # : 1 00:04:44.634 22:56:48 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:44.634 22:56:48 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:44.634 22:56:48 -- scripts/common.sh@364 -- # decimal 1 00:04:44.634 22:56:48 -- scripts/common.sh@352 -- # local d=1 00:04:44.634 22:56:48 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:44.634 22:56:48 -- scripts/common.sh@354 -- # echo 1 00:04:44.634 22:56:48 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:44.634 22:56:48 -- scripts/common.sh@365 -- # decimal 2 00:04:44.634 22:56:48 -- scripts/common.sh@352 -- # local d=2 00:04:44.634 22:56:48 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:44.634 22:56:48 -- scripts/common.sh@354 -- # echo 2 00:04:44.634 22:56:48 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:44.634 22:56:48 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:44.634 22:56:48 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:44.634 22:56:48 -- scripts/common.sh@367 -- # return 0 00:04:44.634 22:56:48 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:44.634 22:56:48 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:44.634 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:44.634 --rc genhtml_branch_coverage=1 00:04:44.634 --rc genhtml_function_coverage=1 00:04:44.634 --rc genhtml_legend=1 00:04:44.634 --rc geninfo_all_blocks=1 00:04:44.634 --rc geninfo_unexecuted_blocks=1 00:04:44.634 00:04:44.634 ' 00:04:44.634 22:56:48 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:44.634 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:44.634 --rc genhtml_branch_coverage=1 00:04:44.634 --rc genhtml_function_coverage=1 00:04:44.634 --rc genhtml_legend=1 00:04:44.634 --rc geninfo_all_blocks=1 00:04:44.634 --rc geninfo_unexecuted_blocks=1 00:04:44.634 00:04:44.634 ' 00:04:44.634 22:56:48 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:44.634 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:44.634 --rc genhtml_branch_coverage=1 00:04:44.634 --rc genhtml_function_coverage=1 00:04:44.634 --rc genhtml_legend=1 00:04:44.634 --rc geninfo_all_blocks=1 00:04:44.634 --rc geninfo_unexecuted_blocks=1 00:04:44.634 00:04:44.634 ' 00:04:44.634 22:56:48 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:44.634 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:44.634 --rc genhtml_branch_coverage=1 00:04:44.634 --rc genhtml_function_coverage=1 00:04:44.634 --rc genhtml_legend=1 00:04:44.634 --rc geninfo_all_blocks=1 00:04:44.635 --rc geninfo_unexecuted_blocks=1 00:04:44.635 00:04:44.635 ' 00:04:44.635 22:56:48 -- setup/acl.sh@10 -- # get_zoned_devs 00:04:44.635 22:56:48 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:04:44.635 22:56:48 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:04:44.635 22:56:48 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:04:44.635 22:56:48 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:04:44.635 22:56:48 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:04:44.635 22:56:48 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:04:44.635 22:56:48 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:44.635 22:56:48 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:04:44.635 22:56:48 -- setup/acl.sh@12 -- # devs=() 00:04:44.635 22:56:48 -- setup/acl.sh@12 -- # declare -a devs 00:04:44.635 22:56:48 -- setup/acl.sh@13 -- # drivers=() 00:04:44.635 22:56:48 -- setup/acl.sh@13 -- # declare -A drivers 00:04:44.635 22:56:48 -- setup/acl.sh@51 -- # setup reset 00:04:44.635 22:56:48 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:44.635 22:56:48 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:46.536 22:56:49 -- setup/acl.sh@52 -- # collect_setup_devs 00:04:46.536 22:56:49 -- setup/acl.sh@16 -- # local dev driver 00:04:46.536 22:56:49 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:46.536 22:56:49 -- setup/acl.sh@15 -- # setup output status 00:04:46.536 22:56:49 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:46.536 22:56:49 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:04:47.103 Hugepages 00:04:47.103 node hugesize free / total 00:04:47.103 22:56:50 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:04:47.103 22:56:50 -- setup/acl.sh@19 -- # continue 00:04:47.103 22:56:50 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:47.103 22:56:50 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:04:47.103 22:56:50 -- setup/acl.sh@19 -- # continue 00:04:47.103 22:56:50 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:47.103 22:56:50 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:04:47.103 22:56:50 -- setup/acl.sh@19 -- # continue 00:04:47.103 22:56:50 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:47.103 00:04:47.103 Type BDF Vendor Device NUMA Driver Device Block devices 00:04:47.103 22:56:50 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:04:47.103 22:56:50 -- setup/acl.sh@19 -- # continue 00:04:47.103 22:56:50 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:47.103 22:56:50 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:04:47.103 22:56:50 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:47.103 22:56:50 -- setup/acl.sh@20 -- # continue 00:04:47.103 22:56:50 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:47.103 22:56:50 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:04:47.103 22:56:50 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:47.103 22:56:50 -- setup/acl.sh@20 -- # continue 00:04:47.103 22:56:50 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:47.103 22:56:50 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:04:47.103 22:56:50 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:47.103 22:56:50 -- setup/acl.sh@20 -- # continue 00:04:47.103 22:56:50 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:47.103 22:56:50 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:04:47.103 22:56:50 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:47.103 22:56:50 -- setup/acl.sh@20 -- # continue 00:04:47.103 22:56:50 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:47.103 22:56:50 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:04:47.103 22:56:50 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:47.103 22:56:50 -- setup/acl.sh@20 -- # continue 00:04:47.103 22:56:50 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:47.103 22:56:50 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:04:47.103 22:56:50 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:47.103 22:56:50 -- setup/acl.sh@20 -- # continue 00:04:47.103 22:56:50 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:47.103 22:56:50 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:04:47.103 22:56:50 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:47.103 22:56:50 -- setup/acl.sh@20 -- # continue 00:04:47.103 22:56:50 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:47.103 22:56:50 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:04:47.103 22:56:50 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:47.103 22:56:50 -- setup/acl.sh@20 -- # continue 00:04:47.103 22:56:50 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:47.103 22:56:50 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:04:47.103 22:56:50 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:47.103 22:56:50 -- setup/acl.sh@20 -- # continue 00:04:47.103 22:56:50 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:47.103 22:56:50 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:04:47.103 22:56:50 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:47.103 22:56:50 -- setup/acl.sh@20 -- # continue 00:04:47.103 22:56:50 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:47.103 22:56:50 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:04:47.103 22:56:50 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:47.103 22:56:50 -- setup/acl.sh@20 -- # continue 00:04:47.103 22:56:50 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:47.103 22:56:50 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:04:47.103 22:56:50 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:47.103 22:56:50 -- setup/acl.sh@20 -- # continue 00:04:47.103 22:56:50 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:47.103 22:56:50 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:04:47.103 22:56:50 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:47.103 22:56:50 -- setup/acl.sh@20 -- # continue 00:04:47.103 22:56:50 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:47.103 22:56:50 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:04:47.103 22:56:50 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:47.103 22:56:50 -- setup/acl.sh@20 -- # continue 00:04:47.103 22:56:50 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:47.103 22:56:50 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:04:47.103 22:56:50 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:47.103 22:56:50 -- setup/acl.sh@20 -- # continue 00:04:47.103 22:56:50 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:47.362 22:56:50 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:04:47.362 22:56:50 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:47.362 22:56:50 -- setup/acl.sh@20 -- # continue 00:04:47.362 22:56:50 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:47.362 22:56:50 -- setup/acl.sh@19 -- # [[ 0000:88:00.0 == *:*:*.* ]] 00:04:47.362 22:56:50 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:04:47.362 22:56:50 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:04:47.362 22:56:50 -- setup/acl.sh@22 -- # devs+=("$dev") 00:04:47.362 22:56:50 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:04:47.362 22:56:50 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:47.362 22:56:50 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:04:47.362 22:56:50 -- setup/acl.sh@54 -- # run_test denied denied 00:04:47.362 22:56:50 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:47.362 22:56:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:47.362 22:56:50 -- common/autotest_common.sh@10 -- # set +x 00:04:47.362 ************************************ 00:04:47.362 START TEST denied 00:04:47.362 ************************************ 00:04:47.362 22:56:50 -- common/autotest_common.sh@1114 -- # denied 00:04:47.362 22:56:50 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:88:00.0' 00:04:47.362 22:56:50 -- setup/acl.sh@38 -- # setup output config 00:04:47.362 22:56:50 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:88:00.0' 00:04:47.362 22:56:50 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:47.362 22:56:50 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:48.738 0000:88:00.0 (8086 0a54): Skipping denied controller at 0000:88:00.0 00:04:48.738 22:56:52 -- setup/acl.sh@40 -- # verify 0000:88:00.0 00:04:48.738 22:56:52 -- setup/acl.sh@28 -- # local dev driver 00:04:48.738 22:56:52 -- setup/acl.sh@30 -- # for dev in "$@" 00:04:48.738 22:56:52 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:88:00.0 ]] 00:04:48.738 22:56:52 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:88:00.0/driver 00:04:48.738 22:56:52 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:04:48.738 22:56:52 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:04:48.738 22:56:52 -- setup/acl.sh@41 -- # setup reset 00:04:48.738 22:56:52 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:48.738 22:56:52 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:51.271 00:04:51.271 real 0m3.915s 00:04:51.271 user 0m1.103s 00:04:51.271 sys 0m1.914s 00:04:51.271 22:56:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:51.271 22:56:54 -- common/autotest_common.sh@10 -- # set +x 00:04:51.271 ************************************ 00:04:51.271 END TEST denied 00:04:51.271 ************************************ 00:04:51.271 22:56:54 -- setup/acl.sh@55 -- # run_test allowed allowed 00:04:51.271 22:56:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:51.271 22:56:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:51.271 22:56:54 -- common/autotest_common.sh@10 -- # set +x 00:04:51.271 ************************************ 00:04:51.271 START TEST allowed 00:04:51.271 ************************************ 00:04:51.271 22:56:54 -- common/autotest_common.sh@1114 -- # allowed 00:04:51.271 22:56:54 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:88:00.0 00:04:51.271 22:56:54 -- setup/acl.sh@45 -- # setup output config 00:04:51.271 22:56:54 -- setup/acl.sh@46 -- # grep -E '0000:88:00.0 .*: nvme -> .*' 00:04:51.271 22:56:54 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:51.271 22:56:54 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:53.803 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:53.803 22:56:56 -- setup/acl.sh@47 -- # verify 00:04:53.803 22:56:56 -- setup/acl.sh@28 -- # local dev driver 00:04:53.803 22:56:56 -- setup/acl.sh@48 -- # setup reset 00:04:53.803 22:56:56 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:53.803 22:56:56 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:55.180 00:04:55.180 real 0m3.895s 00:04:55.180 user 0m1.046s 00:04:55.180 sys 0m1.731s 00:04:55.180 22:56:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:55.180 22:56:58 -- common/autotest_common.sh@10 -- # set +x 00:04:55.180 ************************************ 00:04:55.180 END TEST allowed 00:04:55.180 ************************************ 00:04:55.180 00:04:55.180 real 0m10.624s 00:04:55.180 user 0m3.274s 00:04:55.180 sys 0m5.424s 00:04:55.180 22:56:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:55.180 22:56:58 -- common/autotest_common.sh@10 -- # set +x 00:04:55.180 ************************************ 00:04:55.180 END TEST acl 00:04:55.180 ************************************ 00:04:55.180 22:56:58 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:04:55.180 22:56:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:55.180 22:56:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:55.180 22:56:58 -- common/autotest_common.sh@10 -- # set +x 00:04:55.180 ************************************ 00:04:55.180 START TEST hugepages 00:04:55.180 ************************************ 00:04:55.180 22:56:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:04:55.180 * Looking for test storage... 00:04:55.180 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:55.180 22:56:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:55.180 22:56:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:55.180 22:56:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:55.180 22:56:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:55.180 22:56:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:55.180 22:56:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:55.180 22:56:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:55.180 22:56:58 -- scripts/common.sh@335 -- # IFS=.-: 00:04:55.180 22:56:58 -- scripts/common.sh@335 -- # read -ra ver1 00:04:55.180 22:56:58 -- scripts/common.sh@336 -- # IFS=.-: 00:04:55.180 22:56:58 -- scripts/common.sh@336 -- # read -ra ver2 00:04:55.180 22:56:58 -- scripts/common.sh@337 -- # local 'op=<' 00:04:55.180 22:56:58 -- scripts/common.sh@339 -- # ver1_l=2 00:04:55.180 22:56:58 -- scripts/common.sh@340 -- # ver2_l=1 00:04:55.180 22:56:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:55.180 22:56:58 -- scripts/common.sh@343 -- # case "$op" in 00:04:55.180 22:56:58 -- scripts/common.sh@344 -- # : 1 00:04:55.180 22:56:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:55.180 22:56:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:55.440 22:56:58 -- scripts/common.sh@364 -- # decimal 1 00:04:55.440 22:56:58 -- scripts/common.sh@352 -- # local d=1 00:04:55.440 22:56:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:55.440 22:56:58 -- scripts/common.sh@354 -- # echo 1 00:04:55.440 22:56:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:55.440 22:56:58 -- scripts/common.sh@365 -- # decimal 2 00:04:55.440 22:56:58 -- scripts/common.sh@352 -- # local d=2 00:04:55.440 22:56:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:55.440 22:56:58 -- scripts/common.sh@354 -- # echo 2 00:04:55.440 22:56:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:55.440 22:56:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:55.440 22:56:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:55.440 22:56:58 -- scripts/common.sh@367 -- # return 0 00:04:55.440 22:56:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:55.440 22:56:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:55.440 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:55.440 --rc genhtml_branch_coverage=1 00:04:55.440 --rc genhtml_function_coverage=1 00:04:55.440 --rc genhtml_legend=1 00:04:55.440 --rc geninfo_all_blocks=1 00:04:55.440 --rc geninfo_unexecuted_blocks=1 00:04:55.440 00:04:55.440 ' 00:04:55.440 22:56:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:55.440 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:55.440 --rc genhtml_branch_coverage=1 00:04:55.440 --rc genhtml_function_coverage=1 00:04:55.440 --rc genhtml_legend=1 00:04:55.440 --rc geninfo_all_blocks=1 00:04:55.440 --rc geninfo_unexecuted_blocks=1 00:04:55.440 00:04:55.440 ' 00:04:55.440 22:56:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:55.440 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:55.440 --rc genhtml_branch_coverage=1 00:04:55.440 --rc genhtml_function_coverage=1 00:04:55.440 --rc genhtml_legend=1 00:04:55.440 --rc geninfo_all_blocks=1 00:04:55.440 --rc geninfo_unexecuted_blocks=1 00:04:55.440 00:04:55.440 ' 00:04:55.440 22:56:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:55.440 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:55.440 --rc genhtml_branch_coverage=1 00:04:55.440 --rc genhtml_function_coverage=1 00:04:55.440 --rc genhtml_legend=1 00:04:55.440 --rc geninfo_all_blocks=1 00:04:55.440 --rc geninfo_unexecuted_blocks=1 00:04:55.440 00:04:55.440 ' 00:04:55.440 22:56:58 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:04:55.440 22:56:58 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:04:55.440 22:56:58 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:04:55.440 22:56:58 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:04:55.440 22:56:58 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:04:55.440 22:56:58 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:04:55.440 22:56:58 -- setup/common.sh@17 -- # local get=Hugepagesize 00:04:55.440 22:56:58 -- setup/common.sh@18 -- # local node= 00:04:55.440 22:56:58 -- setup/common.sh@19 -- # local var val 00:04:55.440 22:56:58 -- setup/common.sh@20 -- # local mem_f mem 00:04:55.440 22:56:58 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:55.440 22:56:58 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:55.440 22:56:58 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:55.440 22:56:58 -- setup/common.sh@28 -- # mapfile -t mem 00:04:55.440 22:56:58 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:55.440 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.440 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.440 22:56:58 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 41270520 kB' 'MemAvailable: 45012344 kB' 'Buffers: 2708 kB' 'Cached: 12630356 kB' 'SwapCached: 0 kB' 'Active: 9322876 kB' 'Inactive: 3743224 kB' 'Active(anon): 8930212 kB' 'Inactive(anon): 0 kB' 'Active(file): 392664 kB' 'Inactive(file): 3743224 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 436032 kB' 'Mapped: 231848 kB' 'Shmem: 8497176 kB' 'KReclaimable: 199028 kB' 'Slab: 700232 kB' 'SReclaimable: 199028 kB' 'SUnreclaim: 501204 kB' 'KernelStack: 12800 kB' 'PageTables: 8388 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36559284 kB' 'Committed_AS: 10009228 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198216 kB' 'VmallocChunk: 0 kB' 'Percpu: 33792 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 1777244 kB' 'DirectMap2M: 13871104 kB' 'DirectMap1G: 54525952 kB' 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.441 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.441 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.442 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.442 22:56:58 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.442 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.442 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.442 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.442 22:56:58 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.442 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.442 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.442 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.442 22:56:58 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.442 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.442 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.442 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.442 22:56:58 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.442 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.442 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.442 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.442 22:56:58 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.442 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.442 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.442 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.442 22:56:58 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.442 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.442 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.442 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.442 22:56:58 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.442 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.442 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.442 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.442 22:56:58 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.442 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.442 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.442 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.442 22:56:58 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.442 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.442 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.442 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.442 22:56:58 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.442 22:56:58 -- setup/common.sh@32 -- # continue 00:04:55.442 22:56:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.442 22:56:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.442 22:56:58 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:55.442 22:56:58 -- setup/common.sh@33 -- # echo 2048 00:04:55.442 22:56:58 -- setup/common.sh@33 -- # return 0 00:04:55.442 22:56:58 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:04:55.442 22:56:58 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:04:55.442 22:56:58 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:04:55.442 22:56:58 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:04:55.442 22:56:58 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:04:55.442 22:56:58 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:04:55.442 22:56:58 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:04:55.442 22:56:58 -- setup/hugepages.sh@207 -- # get_nodes 00:04:55.442 22:56:58 -- setup/hugepages.sh@27 -- # local node 00:04:55.442 22:56:58 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:55.442 22:56:58 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:04:55.442 22:56:58 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:55.442 22:56:58 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:55.442 22:56:58 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:55.442 22:56:58 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:55.442 22:56:58 -- setup/hugepages.sh@208 -- # clear_hp 00:04:55.442 22:56:58 -- setup/hugepages.sh@37 -- # local node hp 00:04:55.442 22:56:58 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:55.442 22:56:58 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:55.442 22:56:58 -- setup/hugepages.sh@41 -- # echo 0 00:04:55.442 22:56:58 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:55.442 22:56:58 -- setup/hugepages.sh@41 -- # echo 0 00:04:55.442 22:56:58 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:55.442 22:56:58 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:55.442 22:56:58 -- setup/hugepages.sh@41 -- # echo 0 00:04:55.442 22:56:58 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:55.442 22:56:58 -- setup/hugepages.sh@41 -- # echo 0 00:04:55.442 22:56:58 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:04:55.442 22:56:58 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:04:55.442 22:56:58 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:04:55.442 22:56:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:55.442 22:56:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:55.442 22:56:58 -- common/autotest_common.sh@10 -- # set +x 00:04:55.442 ************************************ 00:04:55.442 START TEST default_setup 00:04:55.442 ************************************ 00:04:55.442 22:56:58 -- common/autotest_common.sh@1114 -- # default_setup 00:04:55.442 22:56:58 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:04:55.442 22:56:58 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:55.442 22:56:58 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:04:55.442 22:56:58 -- setup/hugepages.sh@51 -- # shift 00:04:55.442 22:56:58 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:04:55.442 22:56:58 -- setup/hugepages.sh@52 -- # local node_ids 00:04:55.442 22:56:58 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:55.442 22:56:58 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:55.442 22:56:58 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:04:55.442 22:56:58 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:04:55.442 22:56:58 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:55.442 22:56:58 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:55.442 22:56:58 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:55.442 22:56:58 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:55.442 22:56:58 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:55.442 22:56:58 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:04:55.442 22:56:58 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:55.442 22:56:58 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:04:55.442 22:56:58 -- setup/hugepages.sh@73 -- # return 0 00:04:55.442 22:56:58 -- setup/hugepages.sh@137 -- # setup output 00:04:55.442 22:56:58 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:55.442 22:56:58 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:56.853 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:56.853 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:56.853 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:56.853 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:56.853 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:56.853 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:56.853 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:56.853 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:56.853 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:56.853 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:56.853 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:56.853 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:56.853 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:56.853 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:56.853 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:56.853 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:57.421 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:57.686 22:57:01 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:04:57.686 22:57:01 -- setup/hugepages.sh@89 -- # local node 00:04:57.686 22:57:01 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:57.686 22:57:01 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:57.686 22:57:01 -- setup/hugepages.sh@92 -- # local surp 00:04:57.686 22:57:01 -- setup/hugepages.sh@93 -- # local resv 00:04:57.686 22:57:01 -- setup/hugepages.sh@94 -- # local anon 00:04:57.686 22:57:01 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:57.686 22:57:01 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:57.686 22:57:01 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:57.686 22:57:01 -- setup/common.sh@18 -- # local node= 00:04:57.686 22:57:01 -- setup/common.sh@19 -- # local var val 00:04:57.686 22:57:01 -- setup/common.sh@20 -- # local mem_f mem 00:04:57.686 22:57:01 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:57.686 22:57:01 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:57.686 22:57:01 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:57.686 22:57:01 -- setup/common.sh@28 -- # mapfile -t mem 00:04:57.686 22:57:01 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:57.686 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.686 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.686 22:57:01 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43350064 kB' 'MemAvailable: 47091920 kB' 'Buffers: 2708 kB' 'Cached: 12630452 kB' 'SwapCached: 0 kB' 'Active: 9330440 kB' 'Inactive: 3743224 kB' 'Active(anon): 8937776 kB' 'Inactive(anon): 0 kB' 'Active(file): 392664 kB' 'Inactive(file): 3743224 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 443856 kB' 'Mapped: 232088 kB' 'Shmem: 8497272 kB' 'KReclaimable: 199092 kB' 'Slab: 700148 kB' 'SReclaimable: 199092 kB' 'SUnreclaim: 501056 kB' 'KernelStack: 12816 kB' 'PageTables: 8356 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10023080 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198428 kB' 'VmallocChunk: 0 kB' 'Percpu: 33792 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1777244 kB' 'DirectMap2M: 13871104 kB' 'DirectMap1G: 54525952 kB' 00:04:57.686 22:57:01 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.686 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.686 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.686 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.686 22:57:01 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.686 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.686 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.686 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.686 22:57:01 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.686 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.686 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.686 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.686 22:57:01 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.686 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.686 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.686 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.686 22:57:01 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.686 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.686 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.686 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.686 22:57:01 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.686 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.686 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.686 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.686 22:57:01 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.686 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.686 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.686 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.686 22:57:01 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.686 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.686 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.686 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.686 22:57:01 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.686 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.686 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.686 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.686 22:57:01 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.686 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.686 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.686 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.686 22:57:01 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.686 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.686 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.686 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.686 22:57:01 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.686 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.686 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.686 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.686 22:57:01 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.686 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.686 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.686 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.686 22:57:01 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.686 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.686 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.686 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.686 22:57:01 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.686 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.686 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.686 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.686 22:57:01 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.686 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.686 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.686 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.686 22:57:01 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.686 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.686 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.686 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.686 22:57:01 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.686 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.686 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.686 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.686 22:57:01 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:57.687 22:57:01 -- setup/common.sh@33 -- # echo 0 00:04:57.687 22:57:01 -- setup/common.sh@33 -- # return 0 00:04:57.687 22:57:01 -- setup/hugepages.sh@97 -- # anon=0 00:04:57.687 22:57:01 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:57.687 22:57:01 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:57.687 22:57:01 -- setup/common.sh@18 -- # local node= 00:04:57.687 22:57:01 -- setup/common.sh@19 -- # local var val 00:04:57.687 22:57:01 -- setup/common.sh@20 -- # local mem_f mem 00:04:57.687 22:57:01 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:57.687 22:57:01 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:57.687 22:57:01 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:57.687 22:57:01 -- setup/common.sh@28 -- # mapfile -t mem 00:04:57.687 22:57:01 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.687 22:57:01 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43351808 kB' 'MemAvailable: 47093664 kB' 'Buffers: 2708 kB' 'Cached: 12630456 kB' 'SwapCached: 0 kB' 'Active: 9326736 kB' 'Inactive: 3743224 kB' 'Active(anon): 8934072 kB' 'Inactive(anon): 0 kB' 'Active(file): 392664 kB' 'Inactive(file): 3743224 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 440300 kB' 'Mapped: 232088 kB' 'Shmem: 8497276 kB' 'KReclaimable: 199092 kB' 'Slab: 700120 kB' 'SReclaimable: 199092 kB' 'SUnreclaim: 501028 kB' 'KernelStack: 12848 kB' 'PageTables: 8432 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10018856 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 33792 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1777244 kB' 'DirectMap2M: 13871104 kB' 'DirectMap1G: 54525952 kB' 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.687 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.687 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.688 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.688 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.689 22:57:01 -- setup/common.sh@33 -- # echo 0 00:04:57.689 22:57:01 -- setup/common.sh@33 -- # return 0 00:04:57.689 22:57:01 -- setup/hugepages.sh@99 -- # surp=0 00:04:57.689 22:57:01 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:57.689 22:57:01 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:57.689 22:57:01 -- setup/common.sh@18 -- # local node= 00:04:57.689 22:57:01 -- setup/common.sh@19 -- # local var val 00:04:57.689 22:57:01 -- setup/common.sh@20 -- # local mem_f mem 00:04:57.689 22:57:01 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:57.689 22:57:01 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:57.689 22:57:01 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:57.689 22:57:01 -- setup/common.sh@28 -- # mapfile -t mem 00:04:57.689 22:57:01 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.689 22:57:01 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43347968 kB' 'MemAvailable: 47089824 kB' 'Buffers: 2708 kB' 'Cached: 12630468 kB' 'SwapCached: 0 kB' 'Active: 9330352 kB' 'Inactive: 3743224 kB' 'Active(anon): 8937688 kB' 'Inactive(anon): 0 kB' 'Active(file): 392664 kB' 'Inactive(file): 3743224 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 443908 kB' 'Mapped: 231556 kB' 'Shmem: 8497288 kB' 'KReclaimable: 199092 kB' 'Slab: 700120 kB' 'SReclaimable: 199092 kB' 'SUnreclaim: 501028 kB' 'KernelStack: 12880 kB' 'PageTables: 8504 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10023104 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 33792 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1777244 kB' 'DirectMap2M: 13871104 kB' 'DirectMap1G: 54525952 kB' 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.689 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.689 22:57:01 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:57.690 22:57:01 -- setup/common.sh@33 -- # echo 0 00:04:57.690 22:57:01 -- setup/common.sh@33 -- # return 0 00:04:57.690 22:57:01 -- setup/hugepages.sh@100 -- # resv=0 00:04:57.690 22:57:01 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:57.690 nr_hugepages=1024 00:04:57.690 22:57:01 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:57.690 resv_hugepages=0 00:04:57.690 22:57:01 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:57.690 surplus_hugepages=0 00:04:57.690 22:57:01 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:57.690 anon_hugepages=0 00:04:57.690 22:57:01 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:57.690 22:57:01 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:57.690 22:57:01 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:57.690 22:57:01 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:57.690 22:57:01 -- setup/common.sh@18 -- # local node= 00:04:57.690 22:57:01 -- setup/common.sh@19 -- # local var val 00:04:57.690 22:57:01 -- setup/common.sh@20 -- # local mem_f mem 00:04:57.690 22:57:01 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:57.690 22:57:01 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:57.690 22:57:01 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:57.690 22:57:01 -- setup/common.sh@28 -- # mapfile -t mem 00:04:57.690 22:57:01 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.690 22:57:01 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43353116 kB' 'MemAvailable: 47094972 kB' 'Buffers: 2708 kB' 'Cached: 12630484 kB' 'SwapCached: 0 kB' 'Active: 9324604 kB' 'Inactive: 3743224 kB' 'Active(anon): 8931940 kB' 'Inactive(anon): 0 kB' 'Active(file): 392664 kB' 'Inactive(file): 3743224 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 437660 kB' 'Mapped: 231580 kB' 'Shmem: 8497304 kB' 'KReclaimable: 199092 kB' 'Slab: 700264 kB' 'SReclaimable: 199092 kB' 'SUnreclaim: 501172 kB' 'KernelStack: 12832 kB' 'PageTables: 8344 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10022184 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 33792 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1777244 kB' 'DirectMap2M: 13871104 kB' 'DirectMap1G: 54525952 kB' 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.690 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.690 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.691 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.691 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:57.692 22:57:01 -- setup/common.sh@33 -- # echo 1024 00:04:57.692 22:57:01 -- setup/common.sh@33 -- # return 0 00:04:57.692 22:57:01 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:57.692 22:57:01 -- setup/hugepages.sh@112 -- # get_nodes 00:04:57.692 22:57:01 -- setup/hugepages.sh@27 -- # local node 00:04:57.692 22:57:01 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:57.692 22:57:01 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:57.692 22:57:01 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:57.692 22:57:01 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:57.692 22:57:01 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:57.692 22:57:01 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:57.692 22:57:01 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:57.692 22:57:01 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:57.692 22:57:01 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:57.692 22:57:01 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:57.692 22:57:01 -- setup/common.sh@18 -- # local node=0 00:04:57.692 22:57:01 -- setup/common.sh@19 -- # local var val 00:04:57.692 22:57:01 -- setup/common.sh@20 -- # local mem_f mem 00:04:57.692 22:57:01 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:57.692 22:57:01 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:57.692 22:57:01 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:57.692 22:57:01 -- setup/common.sh@28 -- # mapfile -t mem 00:04:57.692 22:57:01 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.692 22:57:01 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 27548472 kB' 'MemUsed: 5277384 kB' 'SwapCached: 0 kB' 'Active: 2001952 kB' 'Inactive: 142888 kB' 'Active(anon): 1859964 kB' 'Inactive(anon): 0 kB' 'Active(file): 141988 kB' 'Inactive(file): 142888 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2043968 kB' 'Mapped: 140544 kB' 'AnonPages: 103760 kB' 'Shmem: 1759092 kB' 'KernelStack: 6184 kB' 'PageTables: 4224 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 62372 kB' 'Slab: 340880 kB' 'SReclaimable: 62372 kB' 'SUnreclaim: 278508 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.692 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.692 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.693 22:57:01 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.693 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.693 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.693 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.693 22:57:01 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.693 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.693 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.693 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.693 22:57:01 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.693 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.693 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.693 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.693 22:57:01 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.693 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.693 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.693 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.693 22:57:01 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.693 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.693 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.693 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.693 22:57:01 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.693 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.693 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.693 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.693 22:57:01 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.693 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.953 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.953 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.953 22:57:01 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.953 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.953 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.953 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.953 22:57:01 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.953 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.953 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.953 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.953 22:57:01 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.953 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.953 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.953 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.953 22:57:01 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.953 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.953 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.953 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.953 22:57:01 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.953 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.953 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.953 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.953 22:57:01 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.953 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.953 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.953 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.953 22:57:01 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.953 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.954 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.954 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.954 22:57:01 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.954 22:57:01 -- setup/common.sh@32 -- # continue 00:04:57.954 22:57:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:57.954 22:57:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:57.954 22:57:01 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:57.954 22:57:01 -- setup/common.sh@33 -- # echo 0 00:04:57.954 22:57:01 -- setup/common.sh@33 -- # return 0 00:04:57.954 22:57:01 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:57.954 22:57:01 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:57.954 22:57:01 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:57.954 22:57:01 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:57.954 22:57:01 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:57.954 node0=1024 expecting 1024 00:04:57.954 22:57:01 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:57.954 00:04:57.954 real 0m2.437s 00:04:57.954 user 0m0.686s 00:04:57.954 sys 0m0.874s 00:04:57.954 22:57:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:57.954 22:57:01 -- common/autotest_common.sh@10 -- # set +x 00:04:57.954 ************************************ 00:04:57.954 END TEST default_setup 00:04:57.954 ************************************ 00:04:57.954 22:57:01 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:04:57.954 22:57:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:57.954 22:57:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:57.954 22:57:01 -- common/autotest_common.sh@10 -- # set +x 00:04:57.954 ************************************ 00:04:57.954 START TEST per_node_1G_alloc 00:04:57.954 ************************************ 00:04:57.954 22:57:01 -- common/autotest_common.sh@1114 -- # per_node_1G_alloc 00:04:57.954 22:57:01 -- setup/hugepages.sh@143 -- # local IFS=, 00:04:57.954 22:57:01 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:04:57.954 22:57:01 -- setup/hugepages.sh@49 -- # local size=1048576 00:04:57.954 22:57:01 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:04:57.954 22:57:01 -- setup/hugepages.sh@51 -- # shift 00:04:57.954 22:57:01 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:04:57.954 22:57:01 -- setup/hugepages.sh@52 -- # local node_ids 00:04:57.954 22:57:01 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:57.954 22:57:01 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:04:57.954 22:57:01 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:04:57.954 22:57:01 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:04:57.954 22:57:01 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:57.954 22:57:01 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:04:57.954 22:57:01 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:57.954 22:57:01 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:57.954 22:57:01 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:57.954 22:57:01 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:04:57.954 22:57:01 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:57.954 22:57:01 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:04:57.954 22:57:01 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:57.954 22:57:01 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:04:57.954 22:57:01 -- setup/hugepages.sh@73 -- # return 0 00:04:57.954 22:57:01 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:04:57.954 22:57:01 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:04:57.954 22:57:01 -- setup/hugepages.sh@146 -- # setup output 00:04:57.954 22:57:01 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:57.954 22:57:01 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:58.891 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:58.891 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:58.891 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:58.891 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:58.891 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:58.891 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:58.891 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:58.891 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:58.891 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:59.154 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:59.154 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:59.155 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:59.155 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:59.155 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:59.155 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:59.155 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:59.155 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:59.155 22:57:02 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:04:59.155 22:57:02 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:04:59.155 22:57:02 -- setup/hugepages.sh@89 -- # local node 00:04:59.155 22:57:02 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:59.155 22:57:02 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:59.155 22:57:02 -- setup/hugepages.sh@92 -- # local surp 00:04:59.155 22:57:02 -- setup/hugepages.sh@93 -- # local resv 00:04:59.155 22:57:02 -- setup/hugepages.sh@94 -- # local anon 00:04:59.155 22:57:02 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:59.155 22:57:02 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:59.155 22:57:02 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:59.155 22:57:02 -- setup/common.sh@18 -- # local node= 00:04:59.155 22:57:02 -- setup/common.sh@19 -- # local var val 00:04:59.155 22:57:02 -- setup/common.sh@20 -- # local mem_f mem 00:04:59.155 22:57:02 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:59.155 22:57:02 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:59.155 22:57:02 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:59.155 22:57:02 -- setup/common.sh@28 -- # mapfile -t mem 00:04:59.155 22:57:02 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.155 22:57:02 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43376420 kB' 'MemAvailable: 47118276 kB' 'Buffers: 2708 kB' 'Cached: 12630536 kB' 'SwapCached: 0 kB' 'Active: 9330544 kB' 'Inactive: 3743224 kB' 'Active(anon): 8937880 kB' 'Inactive(anon): 0 kB' 'Active(file): 392664 kB' 'Inactive(file): 3743224 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 443836 kB' 'Mapped: 232196 kB' 'Shmem: 8497356 kB' 'KReclaimable: 199092 kB' 'Slab: 700172 kB' 'SReclaimable: 199092 kB' 'SUnreclaim: 501080 kB' 'KernelStack: 12848 kB' 'PageTables: 8352 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10021820 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198396 kB' 'VmallocChunk: 0 kB' 'Percpu: 33792 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1777244 kB' 'DirectMap2M: 13871104 kB' 'DirectMap1G: 54525952 kB' 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:59.155 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.155 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:59.156 22:57:02 -- setup/common.sh@33 -- # echo 0 00:04:59.156 22:57:02 -- setup/common.sh@33 -- # return 0 00:04:59.156 22:57:02 -- setup/hugepages.sh@97 -- # anon=0 00:04:59.156 22:57:02 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:59.156 22:57:02 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:59.156 22:57:02 -- setup/common.sh@18 -- # local node= 00:04:59.156 22:57:02 -- setup/common.sh@19 -- # local var val 00:04:59.156 22:57:02 -- setup/common.sh@20 -- # local mem_f mem 00:04:59.156 22:57:02 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:59.156 22:57:02 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:59.156 22:57:02 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:59.156 22:57:02 -- setup/common.sh@28 -- # mapfile -t mem 00:04:59.156 22:57:02 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.156 22:57:02 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43377172 kB' 'MemAvailable: 47119024 kB' 'Buffers: 2708 kB' 'Cached: 12630540 kB' 'SwapCached: 0 kB' 'Active: 9330096 kB' 'Inactive: 3743224 kB' 'Active(anon): 8937432 kB' 'Inactive(anon): 0 kB' 'Active(file): 392664 kB' 'Inactive(file): 3743224 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 443404 kB' 'Mapped: 232240 kB' 'Shmem: 8497360 kB' 'KReclaimable: 199084 kB' 'Slab: 700228 kB' 'SReclaimable: 199084 kB' 'SUnreclaim: 501144 kB' 'KernelStack: 12848 kB' 'PageTables: 8340 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10021832 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198380 kB' 'VmallocChunk: 0 kB' 'Percpu: 33792 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1777244 kB' 'DirectMap2M: 13871104 kB' 'DirectMap1G: 54525952 kB' 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.156 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.156 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.157 22:57:02 -- setup/common.sh@33 -- # echo 0 00:04:59.157 22:57:02 -- setup/common.sh@33 -- # return 0 00:04:59.157 22:57:02 -- setup/hugepages.sh@99 -- # surp=0 00:04:59.157 22:57:02 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:59.157 22:57:02 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:59.157 22:57:02 -- setup/common.sh@18 -- # local node= 00:04:59.157 22:57:02 -- setup/common.sh@19 -- # local var val 00:04:59.157 22:57:02 -- setup/common.sh@20 -- # local mem_f mem 00:04:59.157 22:57:02 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:59.157 22:57:02 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:59.157 22:57:02 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:59.157 22:57:02 -- setup/common.sh@28 -- # mapfile -t mem 00:04:59.157 22:57:02 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.157 22:57:02 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43377240 kB' 'MemAvailable: 47119092 kB' 'Buffers: 2708 kB' 'Cached: 12630540 kB' 'SwapCached: 0 kB' 'Active: 9330012 kB' 'Inactive: 3743224 kB' 'Active(anon): 8937348 kB' 'Inactive(anon): 0 kB' 'Active(file): 392664 kB' 'Inactive(file): 3743224 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 443328 kB' 'Mapped: 232164 kB' 'Shmem: 8497360 kB' 'KReclaimable: 199084 kB' 'Slab: 700216 kB' 'SReclaimable: 199084 kB' 'SUnreclaim: 501132 kB' 'KernelStack: 12880 kB' 'PageTables: 8432 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10021848 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198380 kB' 'VmallocChunk: 0 kB' 'Percpu: 33792 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1777244 kB' 'DirectMap2M: 13871104 kB' 'DirectMap1G: 54525952 kB' 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.157 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.157 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.158 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.158 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:59.159 22:57:02 -- setup/common.sh@33 -- # echo 0 00:04:59.159 22:57:02 -- setup/common.sh@33 -- # return 0 00:04:59.159 22:57:02 -- setup/hugepages.sh@100 -- # resv=0 00:04:59.159 22:57:02 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:59.159 nr_hugepages=1024 00:04:59.159 22:57:02 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:59.159 resv_hugepages=0 00:04:59.159 22:57:02 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:59.159 surplus_hugepages=0 00:04:59.159 22:57:02 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:59.159 anon_hugepages=0 00:04:59.159 22:57:02 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:59.159 22:57:02 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:59.159 22:57:02 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:59.159 22:57:02 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:59.159 22:57:02 -- setup/common.sh@18 -- # local node= 00:04:59.159 22:57:02 -- setup/common.sh@19 -- # local var val 00:04:59.159 22:57:02 -- setup/common.sh@20 -- # local mem_f mem 00:04:59.159 22:57:02 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:59.159 22:57:02 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:59.159 22:57:02 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:59.159 22:57:02 -- setup/common.sh@28 -- # mapfile -t mem 00:04:59.159 22:57:02 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.159 22:57:02 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43377660 kB' 'MemAvailable: 47119512 kB' 'Buffers: 2708 kB' 'Cached: 12630544 kB' 'SwapCached: 0 kB' 'Active: 9329812 kB' 'Inactive: 3743224 kB' 'Active(anon): 8937148 kB' 'Inactive(anon): 0 kB' 'Active(file): 392664 kB' 'Inactive(file): 3743224 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 443124 kB' 'Mapped: 232164 kB' 'Shmem: 8497364 kB' 'KReclaimable: 199084 kB' 'Slab: 700216 kB' 'SReclaimable: 199084 kB' 'SUnreclaim: 501132 kB' 'KernelStack: 12848 kB' 'PageTables: 8336 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10021860 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198380 kB' 'VmallocChunk: 0 kB' 'Percpu: 33792 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1777244 kB' 'DirectMap2M: 13871104 kB' 'DirectMap1G: 54525952 kB' 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.159 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.159 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.160 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.160 22:57:02 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.160 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.160 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.160 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.160 22:57:02 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.160 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.422 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.422 22:57:02 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:59.422 22:57:02 -- setup/common.sh@33 -- # echo 1024 00:04:59.422 22:57:02 -- setup/common.sh@33 -- # return 0 00:04:59.422 22:57:02 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:59.422 22:57:02 -- setup/hugepages.sh@112 -- # get_nodes 00:04:59.422 22:57:02 -- setup/hugepages.sh@27 -- # local node 00:04:59.422 22:57:02 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:59.422 22:57:02 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:59.422 22:57:02 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:59.422 22:57:02 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:59.422 22:57:02 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:59.422 22:57:02 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:59.422 22:57:02 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:59.422 22:57:02 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:59.422 22:57:02 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:59.422 22:57:02 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:59.422 22:57:02 -- setup/common.sh@18 -- # local node=0 00:04:59.423 22:57:02 -- setup/common.sh@19 -- # local var val 00:04:59.423 22:57:02 -- setup/common.sh@20 -- # local mem_f mem 00:04:59.423 22:57:02 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:59.423 22:57:02 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:59.423 22:57:02 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:59.423 22:57:02 -- setup/common.sh@28 -- # mapfile -t mem 00:04:59.423 22:57:02 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.423 22:57:02 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 28613904 kB' 'MemUsed: 4211952 kB' 'SwapCached: 0 kB' 'Active: 2003944 kB' 'Inactive: 142888 kB' 'Active(anon): 1861956 kB' 'Inactive(anon): 0 kB' 'Active(file): 141988 kB' 'Inactive(file): 142888 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2044024 kB' 'Mapped: 140552 kB' 'AnonPages: 105956 kB' 'Shmem: 1759148 kB' 'KernelStack: 6200 kB' 'PageTables: 4076 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 62364 kB' 'Slab: 340812 kB' 'SReclaimable: 62364 kB' 'SUnreclaim: 278448 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.423 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.423 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.424 22:57:02 -- setup/common.sh@33 -- # echo 0 00:04:59.424 22:57:02 -- setup/common.sh@33 -- # return 0 00:04:59.424 22:57:02 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:59.424 22:57:02 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:59.424 22:57:02 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:59.424 22:57:02 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:59.424 22:57:02 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:59.424 22:57:02 -- setup/common.sh@18 -- # local node=1 00:04:59.424 22:57:02 -- setup/common.sh@19 -- # local var val 00:04:59.424 22:57:02 -- setup/common.sh@20 -- # local mem_f mem 00:04:59.424 22:57:02 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:59.424 22:57:02 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:59.424 22:57:02 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:59.424 22:57:02 -- setup/common.sh@28 -- # mapfile -t mem 00:04:59.424 22:57:02 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.424 22:57:02 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709808 kB' 'MemFree: 14763280 kB' 'MemUsed: 12946528 kB' 'SwapCached: 0 kB' 'Active: 7326084 kB' 'Inactive: 3600336 kB' 'Active(anon): 7075408 kB' 'Inactive(anon): 0 kB' 'Active(file): 250676 kB' 'Inactive(file): 3600336 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 10589264 kB' 'Mapped: 91612 kB' 'AnonPages: 337340 kB' 'Shmem: 6738252 kB' 'KernelStack: 6664 kB' 'PageTables: 4308 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 136720 kB' 'Slab: 359404 kB' 'SReclaimable: 136720 kB' 'SUnreclaim: 222684 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.424 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.424 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.425 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.425 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.425 22:57:02 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.425 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.425 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.425 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.425 22:57:02 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.425 22:57:02 -- setup/common.sh@32 -- # continue 00:04:59.425 22:57:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:59.425 22:57:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:59.425 22:57:02 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:59.425 22:57:02 -- setup/common.sh@33 -- # echo 0 00:04:59.425 22:57:02 -- setup/common.sh@33 -- # return 0 00:04:59.425 22:57:02 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:59.425 22:57:02 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:59.425 22:57:02 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:59.425 22:57:02 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:59.425 22:57:02 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:59.425 node0=512 expecting 512 00:04:59.425 22:57:02 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:59.425 22:57:02 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:59.425 22:57:02 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:59.425 22:57:02 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:04:59.425 node1=512 expecting 512 00:04:59.425 22:57:02 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:04:59.425 00:04:59.425 real 0m1.494s 00:04:59.425 user 0m0.626s 00:04:59.425 sys 0m0.835s 00:04:59.425 22:57:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:59.425 22:57:02 -- common/autotest_common.sh@10 -- # set +x 00:04:59.425 ************************************ 00:04:59.425 END TEST per_node_1G_alloc 00:04:59.425 ************************************ 00:04:59.425 22:57:02 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:04:59.425 22:57:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:59.425 22:57:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:59.425 22:57:02 -- common/autotest_common.sh@10 -- # set +x 00:04:59.425 ************************************ 00:04:59.425 START TEST even_2G_alloc 00:04:59.425 ************************************ 00:04:59.425 22:57:02 -- common/autotest_common.sh@1114 -- # even_2G_alloc 00:04:59.425 22:57:02 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:04:59.425 22:57:02 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:59.425 22:57:02 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:59.425 22:57:02 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:59.425 22:57:02 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:59.425 22:57:02 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:59.425 22:57:02 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:59.425 22:57:02 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:59.425 22:57:02 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:59.425 22:57:02 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:59.425 22:57:02 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:59.425 22:57:02 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:59.425 22:57:02 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:59.425 22:57:02 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:59.425 22:57:02 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:59.425 22:57:02 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:59.425 22:57:02 -- setup/hugepages.sh@83 -- # : 512 00:04:59.425 22:57:02 -- setup/hugepages.sh@84 -- # : 1 00:04:59.425 22:57:02 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:59.425 22:57:02 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:59.425 22:57:02 -- setup/hugepages.sh@83 -- # : 0 00:04:59.425 22:57:02 -- setup/hugepages.sh@84 -- # : 0 00:04:59.425 22:57:02 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:59.425 22:57:02 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:04:59.425 22:57:02 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:04:59.425 22:57:02 -- setup/hugepages.sh@153 -- # setup output 00:04:59.425 22:57:02 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:59.425 22:57:02 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:00.360 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:05:00.360 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:05:00.360 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:05:00.360 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:05:00.360 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:05:00.360 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:05:00.360 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:05:00.360 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:05:00.360 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:05:00.360 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:05:00.361 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:05:00.361 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:05:00.361 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:05:00.361 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:05:00.361 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:05:00.361 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:05:00.624 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:05:00.624 22:57:04 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:05:00.624 22:57:04 -- setup/hugepages.sh@89 -- # local node 00:05:00.624 22:57:04 -- setup/hugepages.sh@90 -- # local sorted_t 00:05:00.624 22:57:04 -- setup/hugepages.sh@91 -- # local sorted_s 00:05:00.624 22:57:04 -- setup/hugepages.sh@92 -- # local surp 00:05:00.624 22:57:04 -- setup/hugepages.sh@93 -- # local resv 00:05:00.624 22:57:04 -- setup/hugepages.sh@94 -- # local anon 00:05:00.624 22:57:04 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:05:00.624 22:57:04 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:05:00.624 22:57:04 -- setup/common.sh@17 -- # local get=AnonHugePages 00:05:00.624 22:57:04 -- setup/common.sh@18 -- # local node= 00:05:00.624 22:57:04 -- setup/common.sh@19 -- # local var val 00:05:00.624 22:57:04 -- setup/common.sh@20 -- # local mem_f mem 00:05:00.624 22:57:04 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:00.624 22:57:04 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:00.624 22:57:04 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:00.624 22:57:04 -- setup/common.sh@28 -- # mapfile -t mem 00:05:00.624 22:57:04 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:00.624 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.624 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.624 22:57:04 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43369224 kB' 'MemAvailable: 47111076 kB' 'Buffers: 2708 kB' 'Cached: 12630624 kB' 'SwapCached: 0 kB' 'Active: 9330108 kB' 'Inactive: 3743224 kB' 'Active(anon): 8937444 kB' 'Inactive(anon): 0 kB' 'Active(file): 392664 kB' 'Inactive(file): 3743224 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 443184 kB' 'Mapped: 232280 kB' 'Shmem: 8497444 kB' 'KReclaimable: 199084 kB' 'Slab: 700612 kB' 'SReclaimable: 199084 kB' 'SUnreclaim: 501528 kB' 'KernelStack: 12832 kB' 'PageTables: 8324 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10021908 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198556 kB' 'VmallocChunk: 0 kB' 'Percpu: 33792 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1777244 kB' 'DirectMap2M: 13871104 kB' 'DirectMap1G: 54525952 kB' 00:05:00.624 22:57:04 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.624 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.624 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.624 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.624 22:57:04 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.624 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.624 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.624 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.624 22:57:04 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.624 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.624 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.624 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.624 22:57:04 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.624 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.624 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.624 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.624 22:57:04 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.624 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.624 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.624 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.624 22:57:04 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.624 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.624 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.624 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.624 22:57:04 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.624 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.624 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.624 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.624 22:57:04 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.625 22:57:04 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:00.625 22:57:04 -- setup/common.sh@33 -- # echo 0 00:05:00.625 22:57:04 -- setup/common.sh@33 -- # return 0 00:05:00.625 22:57:04 -- setup/hugepages.sh@97 -- # anon=0 00:05:00.625 22:57:04 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:05:00.625 22:57:04 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:00.625 22:57:04 -- setup/common.sh@18 -- # local node= 00:05:00.625 22:57:04 -- setup/common.sh@19 -- # local var val 00:05:00.625 22:57:04 -- setup/common.sh@20 -- # local mem_f mem 00:05:00.625 22:57:04 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:00.625 22:57:04 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:00.625 22:57:04 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:00.625 22:57:04 -- setup/common.sh@28 -- # mapfile -t mem 00:05:00.625 22:57:04 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.625 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.625 22:57:04 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43369120 kB' 'MemAvailable: 47110972 kB' 'Buffers: 2708 kB' 'Cached: 12630624 kB' 'SwapCached: 0 kB' 'Active: 9330992 kB' 'Inactive: 3743224 kB' 'Active(anon): 8938328 kB' 'Inactive(anon): 0 kB' 'Active(file): 392664 kB' 'Inactive(file): 3743224 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 444064 kB' 'Mapped: 232292 kB' 'Shmem: 8497444 kB' 'KReclaimable: 199084 kB' 'Slab: 700592 kB' 'SReclaimable: 199084 kB' 'SUnreclaim: 501508 kB' 'KernelStack: 12864 kB' 'PageTables: 8408 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10021920 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198508 kB' 'VmallocChunk: 0 kB' 'Percpu: 33792 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1777244 kB' 'DirectMap2M: 13871104 kB' 'DirectMap1G: 54525952 kB' 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.626 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.626 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.627 22:57:04 -- setup/common.sh@33 -- # echo 0 00:05:00.627 22:57:04 -- setup/common.sh@33 -- # return 0 00:05:00.627 22:57:04 -- setup/hugepages.sh@99 -- # surp=0 00:05:00.627 22:57:04 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:05:00.627 22:57:04 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:05:00.627 22:57:04 -- setup/common.sh@18 -- # local node= 00:05:00.627 22:57:04 -- setup/common.sh@19 -- # local var val 00:05:00.627 22:57:04 -- setup/common.sh@20 -- # local mem_f mem 00:05:00.627 22:57:04 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:00.627 22:57:04 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:00.627 22:57:04 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:00.627 22:57:04 -- setup/common.sh@28 -- # mapfile -t mem 00:05:00.627 22:57:04 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.627 22:57:04 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43369380 kB' 'MemAvailable: 47111232 kB' 'Buffers: 2708 kB' 'Cached: 12630640 kB' 'SwapCached: 0 kB' 'Active: 9330208 kB' 'Inactive: 3743224 kB' 'Active(anon): 8937544 kB' 'Inactive(anon): 0 kB' 'Active(file): 392664 kB' 'Inactive(file): 3743224 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 443236 kB' 'Mapped: 232252 kB' 'Shmem: 8497460 kB' 'KReclaimable: 199084 kB' 'Slab: 700592 kB' 'SReclaimable: 199084 kB' 'SUnreclaim: 501508 kB' 'KernelStack: 12816 kB' 'PageTables: 8256 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10021936 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198492 kB' 'VmallocChunk: 0 kB' 'Percpu: 33792 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1777244 kB' 'DirectMap2M: 13871104 kB' 'DirectMap1G: 54525952 kB' 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.627 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.627 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:00.628 22:57:04 -- setup/common.sh@33 -- # echo 0 00:05:00.628 22:57:04 -- setup/common.sh@33 -- # return 0 00:05:00.628 22:57:04 -- setup/hugepages.sh@100 -- # resv=0 00:05:00.628 22:57:04 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:05:00.628 nr_hugepages=1024 00:05:00.628 22:57:04 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:05:00.628 resv_hugepages=0 00:05:00.628 22:57:04 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:05:00.628 surplus_hugepages=0 00:05:00.628 22:57:04 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:05:00.628 anon_hugepages=0 00:05:00.628 22:57:04 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:05:00.628 22:57:04 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:05:00.628 22:57:04 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:05:00.628 22:57:04 -- setup/common.sh@17 -- # local get=HugePages_Total 00:05:00.628 22:57:04 -- setup/common.sh@18 -- # local node= 00:05:00.628 22:57:04 -- setup/common.sh@19 -- # local var val 00:05:00.628 22:57:04 -- setup/common.sh@20 -- # local mem_f mem 00:05:00.628 22:57:04 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:00.628 22:57:04 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:00.628 22:57:04 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:00.628 22:57:04 -- setup/common.sh@28 -- # mapfile -t mem 00:05:00.628 22:57:04 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.628 22:57:04 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43370000 kB' 'MemAvailable: 47111852 kB' 'Buffers: 2708 kB' 'Cached: 12630652 kB' 'SwapCached: 0 kB' 'Active: 9330408 kB' 'Inactive: 3743224 kB' 'Active(anon): 8937744 kB' 'Inactive(anon): 0 kB' 'Active(file): 392664 kB' 'Inactive(file): 3743224 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 443396 kB' 'Mapped: 232176 kB' 'Shmem: 8497472 kB' 'KReclaimable: 199084 kB' 'Slab: 700612 kB' 'SReclaimable: 199084 kB' 'SUnreclaim: 501528 kB' 'KernelStack: 12864 kB' 'PageTables: 8384 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10021952 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198492 kB' 'VmallocChunk: 0 kB' 'Percpu: 33792 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1777244 kB' 'DirectMap2M: 13871104 kB' 'DirectMap1G: 54525952 kB' 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.628 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.628 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.629 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.629 22:57:04 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:00.630 22:57:04 -- setup/common.sh@33 -- # echo 1024 00:05:00.630 22:57:04 -- setup/common.sh@33 -- # return 0 00:05:00.630 22:57:04 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:05:00.630 22:57:04 -- setup/hugepages.sh@112 -- # get_nodes 00:05:00.630 22:57:04 -- setup/hugepages.sh@27 -- # local node 00:05:00.630 22:57:04 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:00.630 22:57:04 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:05:00.630 22:57:04 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:00.630 22:57:04 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:05:00.630 22:57:04 -- setup/hugepages.sh@32 -- # no_nodes=2 00:05:00.630 22:57:04 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:05:00.630 22:57:04 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:05:00.630 22:57:04 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:05:00.630 22:57:04 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:05:00.630 22:57:04 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:00.630 22:57:04 -- setup/common.sh@18 -- # local node=0 00:05:00.630 22:57:04 -- setup/common.sh@19 -- # local var val 00:05:00.630 22:57:04 -- setup/common.sh@20 -- # local mem_f mem 00:05:00.630 22:57:04 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:00.630 22:57:04 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:05:00.630 22:57:04 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:05:00.630 22:57:04 -- setup/common.sh@28 -- # mapfile -t mem 00:05:00.630 22:57:04 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.630 22:57:04 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 28595200 kB' 'MemUsed: 4230656 kB' 'SwapCached: 0 kB' 'Active: 2004332 kB' 'Inactive: 142888 kB' 'Active(anon): 1862344 kB' 'Inactive(anon): 0 kB' 'Active(file): 141988 kB' 'Inactive(file): 142888 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2044080 kB' 'Mapped: 140564 kB' 'AnonPages: 106224 kB' 'Shmem: 1759204 kB' 'KernelStack: 6232 kB' 'PageTables: 4116 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 62364 kB' 'Slab: 341068 kB' 'SReclaimable: 62364 kB' 'SUnreclaim: 278704 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.630 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.630 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.892 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.892 22:57:04 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.892 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.892 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.892 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.892 22:57:04 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.892 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.892 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.892 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.892 22:57:04 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.892 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.892 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.892 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.892 22:57:04 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.892 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.892 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.892 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.892 22:57:04 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.892 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.892 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.892 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.892 22:57:04 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.892 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.892 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.892 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.892 22:57:04 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.892 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.892 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.892 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.892 22:57:04 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.892 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.892 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.892 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.892 22:57:04 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.892 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.892 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.892 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.892 22:57:04 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.892 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.892 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.892 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.892 22:57:04 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.892 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.892 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.892 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.892 22:57:04 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.892 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.892 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.892 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.892 22:57:04 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.892 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.892 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.892 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.892 22:57:04 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.892 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.892 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.892 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.892 22:57:04 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.892 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.892 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.893 22:57:04 -- setup/common.sh@33 -- # echo 0 00:05:00.893 22:57:04 -- setup/common.sh@33 -- # return 0 00:05:00.893 22:57:04 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:05:00.893 22:57:04 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:05:00.893 22:57:04 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:05:00.893 22:57:04 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:05:00.893 22:57:04 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:00.893 22:57:04 -- setup/common.sh@18 -- # local node=1 00:05:00.893 22:57:04 -- setup/common.sh@19 -- # local var val 00:05:00.893 22:57:04 -- setup/common.sh@20 -- # local mem_f mem 00:05:00.893 22:57:04 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:00.893 22:57:04 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:05:00.893 22:57:04 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:05:00.893 22:57:04 -- setup/common.sh@28 -- # mapfile -t mem 00:05:00.893 22:57:04 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.893 22:57:04 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709808 kB' 'MemFree: 14775144 kB' 'MemUsed: 12934664 kB' 'SwapCached: 0 kB' 'Active: 7326048 kB' 'Inactive: 3600336 kB' 'Active(anon): 7075372 kB' 'Inactive(anon): 0 kB' 'Active(file): 250676 kB' 'Inactive(file): 3600336 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 10589308 kB' 'Mapped: 91612 kB' 'AnonPages: 337092 kB' 'Shmem: 6738296 kB' 'KernelStack: 6600 kB' 'PageTables: 4172 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 136720 kB' 'Slab: 359544 kB' 'SReclaimable: 136720 kB' 'SUnreclaim: 222824 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.893 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.893 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.894 22:57:04 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.894 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.894 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.894 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.894 22:57:04 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.894 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.894 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.894 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.894 22:57:04 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.894 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.894 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.894 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.894 22:57:04 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.894 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.894 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.894 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.894 22:57:04 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.894 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.894 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.894 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.894 22:57:04 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.894 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.894 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.894 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.894 22:57:04 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.894 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.894 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.894 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.894 22:57:04 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.894 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.894 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.894 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.894 22:57:04 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.894 22:57:04 -- setup/common.sh@32 -- # continue 00:05:00.894 22:57:04 -- setup/common.sh@31 -- # IFS=': ' 00:05:00.894 22:57:04 -- setup/common.sh@31 -- # read -r var val _ 00:05:00.894 22:57:04 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:00.894 22:57:04 -- setup/common.sh@33 -- # echo 0 00:05:00.894 22:57:04 -- setup/common.sh@33 -- # return 0 00:05:00.894 22:57:04 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:05:00.894 22:57:04 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:05:00.894 22:57:04 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:05:00.894 22:57:04 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:05:00.894 22:57:04 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:05:00.894 node0=512 expecting 512 00:05:00.894 22:57:04 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:05:00.894 22:57:04 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:05:00.894 22:57:04 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:05:00.894 22:57:04 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:05:00.894 node1=512 expecting 512 00:05:00.894 22:57:04 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:05:00.894 00:05:00.894 real 0m1.432s 00:05:00.894 user 0m0.625s 00:05:00.894 sys 0m0.773s 00:05:00.894 22:57:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:00.894 22:57:04 -- common/autotest_common.sh@10 -- # set +x 00:05:00.894 ************************************ 00:05:00.894 END TEST even_2G_alloc 00:05:00.894 ************************************ 00:05:00.894 22:57:04 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:05:00.894 22:57:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:00.894 22:57:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:00.894 22:57:04 -- common/autotest_common.sh@10 -- # set +x 00:05:00.894 ************************************ 00:05:00.894 START TEST odd_alloc 00:05:00.894 ************************************ 00:05:00.894 22:57:04 -- common/autotest_common.sh@1114 -- # odd_alloc 00:05:00.894 22:57:04 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:05:00.894 22:57:04 -- setup/hugepages.sh@49 -- # local size=2098176 00:05:00.894 22:57:04 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:05:00.894 22:57:04 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:05:00.894 22:57:04 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:05:00.894 22:57:04 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:05:00.894 22:57:04 -- setup/hugepages.sh@62 -- # user_nodes=() 00:05:00.894 22:57:04 -- setup/hugepages.sh@62 -- # local user_nodes 00:05:00.894 22:57:04 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:05:00.894 22:57:04 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:05:00.894 22:57:04 -- setup/hugepages.sh@67 -- # nodes_test=() 00:05:00.894 22:57:04 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:05:00.894 22:57:04 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:05:00.894 22:57:04 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:05:00.894 22:57:04 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:05:00.894 22:57:04 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:05:00.894 22:57:04 -- setup/hugepages.sh@83 -- # : 513 00:05:00.894 22:57:04 -- setup/hugepages.sh@84 -- # : 1 00:05:00.894 22:57:04 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:05:00.894 22:57:04 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:05:00.894 22:57:04 -- setup/hugepages.sh@83 -- # : 0 00:05:00.894 22:57:04 -- setup/hugepages.sh@84 -- # : 0 00:05:00.894 22:57:04 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:05:00.894 22:57:04 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:05:00.894 22:57:04 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:05:00.894 22:57:04 -- setup/hugepages.sh@160 -- # setup output 00:05:00.894 22:57:04 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:00.894 22:57:04 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:01.829 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:05:01.829 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:05:01.829 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:05:01.829 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:05:01.829 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:05:01.829 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:05:01.829 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:05:01.829 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:05:01.829 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:05:01.829 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:05:01.829 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:05:01.829 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:05:01.829 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:05:01.829 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:05:01.829 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:05:01.829 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:05:01.829 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:05:02.092 22:57:05 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:05:02.092 22:57:05 -- setup/hugepages.sh@89 -- # local node 00:05:02.092 22:57:05 -- setup/hugepages.sh@90 -- # local sorted_t 00:05:02.092 22:57:05 -- setup/hugepages.sh@91 -- # local sorted_s 00:05:02.092 22:57:05 -- setup/hugepages.sh@92 -- # local surp 00:05:02.092 22:57:05 -- setup/hugepages.sh@93 -- # local resv 00:05:02.092 22:57:05 -- setup/hugepages.sh@94 -- # local anon 00:05:02.092 22:57:05 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:05:02.092 22:57:05 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:05:02.092 22:57:05 -- setup/common.sh@17 -- # local get=AnonHugePages 00:05:02.092 22:57:05 -- setup/common.sh@18 -- # local node= 00:05:02.092 22:57:05 -- setup/common.sh@19 -- # local var val 00:05:02.092 22:57:05 -- setup/common.sh@20 -- # local mem_f mem 00:05:02.092 22:57:05 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:02.092 22:57:05 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:02.092 22:57:05 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:02.092 22:57:05 -- setup/common.sh@28 -- # mapfile -t mem 00:05:02.092 22:57:05 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.092 22:57:05 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43377408 kB' 'MemAvailable: 47119260 kB' 'Buffers: 2708 kB' 'Cached: 12630716 kB' 'SwapCached: 0 kB' 'Active: 9331044 kB' 'Inactive: 3743224 kB' 'Active(anon): 8938380 kB' 'Inactive(anon): 0 kB' 'Active(file): 392664 kB' 'Inactive(file): 3743224 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 444120 kB' 'Mapped: 231160 kB' 'Shmem: 8497536 kB' 'KReclaimable: 199084 kB' 'Slab: 700432 kB' 'SReclaimable: 199084 kB' 'SUnreclaim: 501348 kB' 'KernelStack: 12784 kB' 'PageTables: 8000 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606836 kB' 'Committed_AS: 10014964 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198412 kB' 'VmallocChunk: 0 kB' 'Percpu: 33792 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1777244 kB' 'DirectMap2M: 13871104 kB' 'DirectMap1G: 54525952 kB' 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:02.092 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.092 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:02.093 22:57:05 -- setup/common.sh@33 -- # echo 0 00:05:02.093 22:57:05 -- setup/common.sh@33 -- # return 0 00:05:02.093 22:57:05 -- setup/hugepages.sh@97 -- # anon=0 00:05:02.093 22:57:05 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:05:02.093 22:57:05 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:02.093 22:57:05 -- setup/common.sh@18 -- # local node= 00:05:02.093 22:57:05 -- setup/common.sh@19 -- # local var val 00:05:02.093 22:57:05 -- setup/common.sh@20 -- # local mem_f mem 00:05:02.093 22:57:05 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:02.093 22:57:05 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:02.093 22:57:05 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:02.093 22:57:05 -- setup/common.sh@28 -- # mapfile -t mem 00:05:02.093 22:57:05 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.093 22:57:05 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43373628 kB' 'MemAvailable: 47115480 kB' 'Buffers: 2708 kB' 'Cached: 12630720 kB' 'SwapCached: 0 kB' 'Active: 9334560 kB' 'Inactive: 3743224 kB' 'Active(anon): 8941896 kB' 'Inactive(anon): 0 kB' 'Active(file): 392664 kB' 'Inactive(file): 3743224 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 447692 kB' 'Mapped: 231160 kB' 'Shmem: 8497540 kB' 'KReclaimable: 199084 kB' 'Slab: 700440 kB' 'SReclaimable: 199084 kB' 'SUnreclaim: 501356 kB' 'KernelStack: 13104 kB' 'PageTables: 8720 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606836 kB' 'Committed_AS: 10016956 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198496 kB' 'VmallocChunk: 0 kB' 'Percpu: 33792 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1777244 kB' 'DirectMap2M: 13871104 kB' 'DirectMap1G: 54525952 kB' 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.093 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.093 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.094 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.094 22:57:05 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.094 22:57:05 -- setup/common.sh@33 -- # echo 0 00:05:02.094 22:57:05 -- setup/common.sh@33 -- # return 0 00:05:02.094 22:57:05 -- setup/hugepages.sh@99 -- # surp=0 00:05:02.094 22:57:05 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:05:02.094 22:57:05 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:05:02.095 22:57:05 -- setup/common.sh@18 -- # local node= 00:05:02.095 22:57:05 -- setup/common.sh@19 -- # local var val 00:05:02.095 22:57:05 -- setup/common.sh@20 -- # local mem_f mem 00:05:02.095 22:57:05 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:02.095 22:57:05 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:02.095 22:57:05 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:02.095 22:57:05 -- setup/common.sh@28 -- # mapfile -t mem 00:05:02.095 22:57:05 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.095 22:57:05 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43374064 kB' 'MemAvailable: 47115916 kB' 'Buffers: 2708 kB' 'Cached: 12630732 kB' 'SwapCached: 0 kB' 'Active: 9335924 kB' 'Inactive: 3743224 kB' 'Active(anon): 8943260 kB' 'Inactive(anon): 0 kB' 'Active(file): 392664 kB' 'Inactive(file): 3743224 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 449020 kB' 'Mapped: 231180 kB' 'Shmem: 8497552 kB' 'KReclaimable: 199084 kB' 'Slab: 700440 kB' 'SReclaimable: 199084 kB' 'SUnreclaim: 501356 kB' 'KernelStack: 13152 kB' 'PageTables: 9876 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606836 kB' 'Committed_AS: 10015588 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198560 kB' 'VmallocChunk: 0 kB' 'Percpu: 33792 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1777244 kB' 'DirectMap2M: 13871104 kB' 'DirectMap1G: 54525952 kB' 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.095 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.095 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:02.096 22:57:05 -- setup/common.sh@33 -- # echo 0 00:05:02.096 22:57:05 -- setup/common.sh@33 -- # return 0 00:05:02.096 22:57:05 -- setup/hugepages.sh@100 -- # resv=0 00:05:02.096 22:57:05 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:05:02.096 nr_hugepages=1025 00:05:02.096 22:57:05 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:05:02.096 resv_hugepages=0 00:05:02.096 22:57:05 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:05:02.096 surplus_hugepages=0 00:05:02.096 22:57:05 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:05:02.096 anon_hugepages=0 00:05:02.096 22:57:05 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:05:02.096 22:57:05 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:05:02.096 22:57:05 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:05:02.096 22:57:05 -- setup/common.sh@17 -- # local get=HugePages_Total 00:05:02.096 22:57:05 -- setup/common.sh@18 -- # local node= 00:05:02.096 22:57:05 -- setup/common.sh@19 -- # local var val 00:05:02.096 22:57:05 -- setup/common.sh@20 -- # local mem_f mem 00:05:02.096 22:57:05 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:02.096 22:57:05 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:02.096 22:57:05 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:02.096 22:57:05 -- setup/common.sh@28 -- # mapfile -t mem 00:05:02.096 22:57:05 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.096 22:57:05 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43373868 kB' 'MemAvailable: 47115720 kB' 'Buffers: 2708 kB' 'Cached: 12630736 kB' 'SwapCached: 0 kB' 'Active: 9330924 kB' 'Inactive: 3743224 kB' 'Active(anon): 8938260 kB' 'Inactive(anon): 0 kB' 'Active(file): 392664 kB' 'Inactive(file): 3743224 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 443548 kB' 'Mapped: 231180 kB' 'Shmem: 8497556 kB' 'KReclaimable: 199084 kB' 'Slab: 700424 kB' 'SReclaimable: 199084 kB' 'SUnreclaim: 501340 kB' 'KernelStack: 13168 kB' 'PageTables: 9104 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606836 kB' 'Committed_AS: 10012620 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198556 kB' 'VmallocChunk: 0 kB' 'Percpu: 33792 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1777244 kB' 'DirectMap2M: 13871104 kB' 'DirectMap1G: 54525952 kB' 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.096 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.096 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.097 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.097 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:02.098 22:57:05 -- setup/common.sh@33 -- # echo 1025 00:05:02.098 22:57:05 -- setup/common.sh@33 -- # return 0 00:05:02.098 22:57:05 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:05:02.098 22:57:05 -- setup/hugepages.sh@112 -- # get_nodes 00:05:02.098 22:57:05 -- setup/hugepages.sh@27 -- # local node 00:05:02.098 22:57:05 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:02.098 22:57:05 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:05:02.098 22:57:05 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:02.098 22:57:05 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:05:02.098 22:57:05 -- setup/hugepages.sh@32 -- # no_nodes=2 00:05:02.098 22:57:05 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:05:02.098 22:57:05 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:05:02.098 22:57:05 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:05:02.098 22:57:05 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:05:02.098 22:57:05 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:02.098 22:57:05 -- setup/common.sh@18 -- # local node=0 00:05:02.098 22:57:05 -- setup/common.sh@19 -- # local var val 00:05:02.098 22:57:05 -- setup/common.sh@20 -- # local mem_f mem 00:05:02.098 22:57:05 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:02.098 22:57:05 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:05:02.098 22:57:05 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:05:02.098 22:57:05 -- setup/common.sh@28 -- # mapfile -t mem 00:05:02.098 22:57:05 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.098 22:57:05 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 28598072 kB' 'MemUsed: 4227784 kB' 'SwapCached: 0 kB' 'Active: 2007260 kB' 'Inactive: 142888 kB' 'Active(anon): 1865272 kB' 'Inactive(anon): 0 kB' 'Active(file): 141988 kB' 'Inactive(file): 142888 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2044100 kB' 'Mapped: 140172 kB' 'AnonPages: 109220 kB' 'Shmem: 1759224 kB' 'KernelStack: 6152 kB' 'PageTables: 3772 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 62364 kB' 'Slab: 340904 kB' 'SReclaimable: 62364 kB' 'SUnreclaim: 278540 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.098 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.098 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.099 22:57:05 -- setup/common.sh@33 -- # echo 0 00:05:02.099 22:57:05 -- setup/common.sh@33 -- # return 0 00:05:02.099 22:57:05 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:05:02.099 22:57:05 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:05:02.099 22:57:05 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:05:02.099 22:57:05 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:05:02.099 22:57:05 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:02.099 22:57:05 -- setup/common.sh@18 -- # local node=1 00:05:02.099 22:57:05 -- setup/common.sh@19 -- # local var val 00:05:02.099 22:57:05 -- setup/common.sh@20 -- # local mem_f mem 00:05:02.099 22:57:05 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:02.099 22:57:05 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:05:02.099 22:57:05 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:05:02.099 22:57:05 -- setup/common.sh@28 -- # mapfile -t mem 00:05:02.099 22:57:05 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.099 22:57:05 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709808 kB' 'MemFree: 14772200 kB' 'MemUsed: 12937608 kB' 'SwapCached: 0 kB' 'Active: 7326556 kB' 'Inactive: 3600336 kB' 'Active(anon): 7075880 kB' 'Inactive(anon): 0 kB' 'Active(file): 250676 kB' 'Inactive(file): 3600336 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 10589344 kB' 'Mapped: 91000 kB' 'AnonPages: 337640 kB' 'Shmem: 6738332 kB' 'KernelStack: 7192 kB' 'PageTables: 5664 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 136720 kB' 'Slab: 359660 kB' 'SReclaimable: 136720 kB' 'SUnreclaim: 222940 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.099 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.099 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.100 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.100 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.100 22:57:05 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.100 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.100 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.100 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.100 22:57:05 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.100 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.100 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.100 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.100 22:57:05 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.100 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.100 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.100 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.100 22:57:05 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.100 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.100 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.100 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.100 22:57:05 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.100 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.100 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.100 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.100 22:57:05 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.100 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.100 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.100 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.100 22:57:05 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.100 22:57:05 -- setup/common.sh@32 -- # continue 00:05:02.100 22:57:05 -- setup/common.sh@31 -- # IFS=': ' 00:05:02.100 22:57:05 -- setup/common.sh@31 -- # read -r var val _ 00:05:02.100 22:57:05 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:02.100 22:57:05 -- setup/common.sh@33 -- # echo 0 00:05:02.100 22:57:05 -- setup/common.sh@33 -- # return 0 00:05:02.100 22:57:05 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:05:02.100 22:57:05 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:05:02.100 22:57:05 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:05:02.100 22:57:05 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:05:02.100 22:57:05 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:05:02.100 node0=512 expecting 513 00:05:02.100 22:57:05 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:05:02.100 22:57:05 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:05:02.100 22:57:05 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:05:02.100 22:57:05 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:05:02.100 node1=513 expecting 512 00:05:02.100 22:57:05 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:05:02.100 00:05:02.100 real 0m1.404s 00:05:02.100 user 0m0.569s 00:05:02.100 sys 0m0.797s 00:05:02.100 22:57:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:02.100 22:57:05 -- common/autotest_common.sh@10 -- # set +x 00:05:02.100 ************************************ 00:05:02.100 END TEST odd_alloc 00:05:02.100 ************************************ 00:05:02.358 22:57:05 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:05:02.358 22:57:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:02.358 22:57:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:02.358 22:57:05 -- common/autotest_common.sh@10 -- # set +x 00:05:02.358 ************************************ 00:05:02.358 START TEST custom_alloc 00:05:02.358 ************************************ 00:05:02.358 22:57:05 -- common/autotest_common.sh@1114 -- # custom_alloc 00:05:02.358 22:57:05 -- setup/hugepages.sh@167 -- # local IFS=, 00:05:02.358 22:57:05 -- setup/hugepages.sh@169 -- # local node 00:05:02.358 22:57:05 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:05:02.358 22:57:05 -- setup/hugepages.sh@170 -- # local nodes_hp 00:05:02.358 22:57:05 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:05:02.358 22:57:05 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:05:02.358 22:57:05 -- setup/hugepages.sh@49 -- # local size=1048576 00:05:02.358 22:57:05 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:05:02.358 22:57:05 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:05:02.358 22:57:05 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:05:02.358 22:57:05 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:05:02.358 22:57:05 -- setup/hugepages.sh@62 -- # user_nodes=() 00:05:02.358 22:57:05 -- setup/hugepages.sh@62 -- # local user_nodes 00:05:02.358 22:57:05 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:05:02.358 22:57:05 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:05:02.358 22:57:05 -- setup/hugepages.sh@67 -- # nodes_test=() 00:05:02.358 22:57:05 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:05:02.358 22:57:05 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:05:02.358 22:57:05 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:05:02.358 22:57:05 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:05:02.358 22:57:05 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:05:02.358 22:57:05 -- setup/hugepages.sh@83 -- # : 256 00:05:02.358 22:57:05 -- setup/hugepages.sh@84 -- # : 1 00:05:02.358 22:57:05 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:05:02.358 22:57:05 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:05:02.358 22:57:05 -- setup/hugepages.sh@83 -- # : 0 00:05:02.358 22:57:05 -- setup/hugepages.sh@84 -- # : 0 00:05:02.358 22:57:05 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:05:02.358 22:57:05 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:05:02.358 22:57:05 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:05:02.358 22:57:05 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:05:02.358 22:57:05 -- setup/hugepages.sh@49 -- # local size=2097152 00:05:02.358 22:57:05 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:05:02.358 22:57:05 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:05:02.358 22:57:05 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:05:02.358 22:57:05 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:05:02.358 22:57:05 -- setup/hugepages.sh@62 -- # user_nodes=() 00:05:02.358 22:57:05 -- setup/hugepages.sh@62 -- # local user_nodes 00:05:02.358 22:57:05 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:05:02.358 22:57:05 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:05:02.358 22:57:05 -- setup/hugepages.sh@67 -- # nodes_test=() 00:05:02.358 22:57:05 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:05:02.358 22:57:05 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:05:02.358 22:57:05 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:05:02.358 22:57:05 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:05:02.358 22:57:05 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:05:02.358 22:57:05 -- setup/hugepages.sh@78 -- # return 0 00:05:02.358 22:57:05 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:05:02.358 22:57:05 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:05:02.358 22:57:05 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:05:02.358 22:57:05 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:05:02.358 22:57:05 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:05:02.358 22:57:05 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:05:02.358 22:57:05 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:05:02.358 22:57:05 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:05:02.358 22:57:05 -- setup/hugepages.sh@62 -- # user_nodes=() 00:05:02.358 22:57:05 -- setup/hugepages.sh@62 -- # local user_nodes 00:05:02.358 22:57:05 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:05:02.358 22:57:05 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:05:02.358 22:57:05 -- setup/hugepages.sh@67 -- # nodes_test=() 00:05:02.358 22:57:05 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:05:02.358 22:57:05 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:05:02.358 22:57:05 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:05:02.358 22:57:05 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:05:02.358 22:57:05 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:05:02.358 22:57:05 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:05:02.358 22:57:05 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:05:02.358 22:57:05 -- setup/hugepages.sh@78 -- # return 0 00:05:02.358 22:57:05 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:05:02.358 22:57:05 -- setup/hugepages.sh@187 -- # setup output 00:05:02.358 22:57:05 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:02.359 22:57:05 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:03.325 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:05:03.325 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:05:03.325 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:05:03.325 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:05:03.325 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:05:03.325 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:05:03.325 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:05:03.325 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:05:03.325 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:05:03.325 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:05:03.325 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:05:03.325 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:05:03.325 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:05:03.325 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:05:03.325 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:05:03.325 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:05:03.325 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:05:03.587 22:57:07 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:05:03.587 22:57:07 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:05:03.587 22:57:07 -- setup/hugepages.sh@89 -- # local node 00:05:03.587 22:57:07 -- setup/hugepages.sh@90 -- # local sorted_t 00:05:03.587 22:57:07 -- setup/hugepages.sh@91 -- # local sorted_s 00:05:03.587 22:57:07 -- setup/hugepages.sh@92 -- # local surp 00:05:03.587 22:57:07 -- setup/hugepages.sh@93 -- # local resv 00:05:03.587 22:57:07 -- setup/hugepages.sh@94 -- # local anon 00:05:03.587 22:57:07 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:05:03.587 22:57:07 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:05:03.587 22:57:07 -- setup/common.sh@17 -- # local get=AnonHugePages 00:05:03.587 22:57:07 -- setup/common.sh@18 -- # local node= 00:05:03.587 22:57:07 -- setup/common.sh@19 -- # local var val 00:05:03.587 22:57:07 -- setup/common.sh@20 -- # local mem_f mem 00:05:03.587 22:57:07 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:03.587 22:57:07 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:03.587 22:57:07 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:03.587 22:57:07 -- setup/common.sh@28 -- # mapfile -t mem 00:05:03.587 22:57:07 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:03.587 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.587 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.587 22:57:07 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 42317740 kB' 'MemAvailable: 46059592 kB' 'Buffers: 2708 kB' 'Cached: 12630820 kB' 'SwapCached: 0 kB' 'Active: 9329492 kB' 'Inactive: 3743224 kB' 'Active(anon): 8936828 kB' 'Inactive(anon): 0 kB' 'Active(file): 392664 kB' 'Inactive(file): 3743224 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 442440 kB' 'Mapped: 231248 kB' 'Shmem: 8497640 kB' 'KReclaimable: 199084 kB' 'Slab: 700560 kB' 'SReclaimable: 199084 kB' 'SUnreclaim: 501476 kB' 'KernelStack: 12848 kB' 'PageTables: 8152 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083572 kB' 'Committed_AS: 10007024 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198428 kB' 'VmallocChunk: 0 kB' 'Percpu: 33792 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1777244 kB' 'DirectMap2M: 13871104 kB' 'DirectMap1G: 54525952 kB' 00:05:03.587 22:57:07 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:03.587 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.587 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.587 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.587 22:57:07 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:03.587 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.587 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.587 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.587 22:57:07 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:03.587 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.587 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.587 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.587 22:57:07 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:03.587 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.587 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.587 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.587 22:57:07 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:03.587 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.587 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.587 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.587 22:57:07 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:03.587 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.587 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.587 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.587 22:57:07 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:03.587 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.587 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.587 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.587 22:57:07 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:03.587 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.587 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.587 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.587 22:57:07 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:03.587 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.587 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.587 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.587 22:57:07 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:03.587 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.587 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.587 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.587 22:57:07 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:03.587 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.587 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.587 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.587 22:57:07 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:03.587 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.587 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.587 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.587 22:57:07 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:03.587 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.587 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.587 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.587 22:57:07 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:03.587 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.587 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.587 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.587 22:57:07 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:03.587 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.587 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.587 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.587 22:57:07 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:03.587 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.587 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:03.588 22:57:07 -- setup/common.sh@33 -- # echo 0 00:05:03.588 22:57:07 -- setup/common.sh@33 -- # return 0 00:05:03.588 22:57:07 -- setup/hugepages.sh@97 -- # anon=0 00:05:03.588 22:57:07 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:05:03.588 22:57:07 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:03.588 22:57:07 -- setup/common.sh@18 -- # local node= 00:05:03.588 22:57:07 -- setup/common.sh@19 -- # local var val 00:05:03.588 22:57:07 -- setup/common.sh@20 -- # local mem_f mem 00:05:03.588 22:57:07 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:03.588 22:57:07 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:03.588 22:57:07 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:03.588 22:57:07 -- setup/common.sh@28 -- # mapfile -t mem 00:05:03.588 22:57:07 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.588 22:57:07 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 42319920 kB' 'MemAvailable: 46061772 kB' 'Buffers: 2708 kB' 'Cached: 12630820 kB' 'SwapCached: 0 kB' 'Active: 9329876 kB' 'Inactive: 3743224 kB' 'Active(anon): 8937212 kB' 'Inactive(anon): 0 kB' 'Active(file): 392664 kB' 'Inactive(file): 3743224 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 442816 kB' 'Mapped: 231196 kB' 'Shmem: 8497640 kB' 'KReclaimable: 199084 kB' 'Slab: 700556 kB' 'SReclaimable: 199084 kB' 'SUnreclaim: 501472 kB' 'KernelStack: 12816 kB' 'PageTables: 8048 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083572 kB' 'Committed_AS: 10007036 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198396 kB' 'VmallocChunk: 0 kB' 'Percpu: 33792 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1777244 kB' 'DirectMap2M: 13871104 kB' 'DirectMap1G: 54525952 kB' 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.588 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.588 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.589 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.589 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.590 22:57:07 -- setup/common.sh@33 -- # echo 0 00:05:03.590 22:57:07 -- setup/common.sh@33 -- # return 0 00:05:03.590 22:57:07 -- setup/hugepages.sh@99 -- # surp=0 00:05:03.590 22:57:07 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:05:03.590 22:57:07 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:05:03.590 22:57:07 -- setup/common.sh@18 -- # local node= 00:05:03.590 22:57:07 -- setup/common.sh@19 -- # local var val 00:05:03.590 22:57:07 -- setup/common.sh@20 -- # local mem_f mem 00:05:03.590 22:57:07 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:03.590 22:57:07 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:03.590 22:57:07 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:03.590 22:57:07 -- setup/common.sh@28 -- # mapfile -t mem 00:05:03.590 22:57:07 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.590 22:57:07 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 42319940 kB' 'MemAvailable: 46061792 kB' 'Buffers: 2708 kB' 'Cached: 12630832 kB' 'SwapCached: 0 kB' 'Active: 9328884 kB' 'Inactive: 3743224 kB' 'Active(anon): 8936220 kB' 'Inactive(anon): 0 kB' 'Active(file): 392664 kB' 'Inactive(file): 3743224 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 441824 kB' 'Mapped: 231176 kB' 'Shmem: 8497652 kB' 'KReclaimable: 199084 kB' 'Slab: 700596 kB' 'SReclaimable: 199084 kB' 'SUnreclaim: 501512 kB' 'KernelStack: 12816 kB' 'PageTables: 8040 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083572 kB' 'Committed_AS: 10007052 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198396 kB' 'VmallocChunk: 0 kB' 'Percpu: 33792 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1777244 kB' 'DirectMap2M: 13871104 kB' 'DirectMap1G: 54525952 kB' 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.590 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.590 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:03.591 22:57:07 -- setup/common.sh@33 -- # echo 0 00:05:03.591 22:57:07 -- setup/common.sh@33 -- # return 0 00:05:03.591 22:57:07 -- setup/hugepages.sh@100 -- # resv=0 00:05:03.591 22:57:07 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:05:03.591 nr_hugepages=1536 00:05:03.591 22:57:07 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:05:03.591 resv_hugepages=0 00:05:03.591 22:57:07 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:05:03.591 surplus_hugepages=0 00:05:03.591 22:57:07 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:05:03.591 anon_hugepages=0 00:05:03.591 22:57:07 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:05:03.591 22:57:07 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:05:03.591 22:57:07 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:05:03.591 22:57:07 -- setup/common.sh@17 -- # local get=HugePages_Total 00:05:03.591 22:57:07 -- setup/common.sh@18 -- # local node= 00:05:03.591 22:57:07 -- setup/common.sh@19 -- # local var val 00:05:03.591 22:57:07 -- setup/common.sh@20 -- # local mem_f mem 00:05:03.591 22:57:07 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:03.591 22:57:07 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:03.591 22:57:07 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:03.591 22:57:07 -- setup/common.sh@28 -- # mapfile -t mem 00:05:03.591 22:57:07 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.591 22:57:07 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 42319992 kB' 'MemAvailable: 46061844 kB' 'Buffers: 2708 kB' 'Cached: 12630832 kB' 'SwapCached: 0 kB' 'Active: 9323456 kB' 'Inactive: 3743224 kB' 'Active(anon): 8930792 kB' 'Inactive(anon): 0 kB' 'Active(file): 392664 kB' 'Inactive(file): 3743224 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 436472 kB' 'Mapped: 230740 kB' 'Shmem: 8497652 kB' 'KReclaimable: 199084 kB' 'Slab: 700596 kB' 'SReclaimable: 199084 kB' 'SUnreclaim: 501512 kB' 'KernelStack: 12848 kB' 'PageTables: 8132 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083572 kB' 'Committed_AS: 10002980 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198440 kB' 'VmallocChunk: 0 kB' 'Percpu: 33792 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1777244 kB' 'DirectMap2M: 13871104 kB' 'DirectMap1G: 54525952 kB' 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.591 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.591 22:57:07 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.592 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.592 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.593 22:57:07 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.593 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.593 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.593 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.593 22:57:07 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:03.593 22:57:07 -- setup/common.sh@33 -- # echo 1536 00:05:03.593 22:57:07 -- setup/common.sh@33 -- # return 0 00:05:03.593 22:57:07 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:05:03.593 22:57:07 -- setup/hugepages.sh@112 -- # get_nodes 00:05:03.593 22:57:07 -- setup/hugepages.sh@27 -- # local node 00:05:03.593 22:57:07 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:03.593 22:57:07 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:05:03.593 22:57:07 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:03.593 22:57:07 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:05:03.593 22:57:07 -- setup/hugepages.sh@32 -- # no_nodes=2 00:05:03.593 22:57:07 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:05:03.593 22:57:07 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:05:03.593 22:57:07 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:05:03.593 22:57:07 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:05:03.593 22:57:07 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:03.593 22:57:07 -- setup/common.sh@18 -- # local node=0 00:05:03.593 22:57:07 -- setup/common.sh@19 -- # local var val 00:05:03.593 22:57:07 -- setup/common.sh@20 -- # local mem_f mem 00:05:03.593 22:57:07 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:03.593 22:57:07 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:05:03.593 22:57:07 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:05:03.593 22:57:07 -- setup/common.sh@28 -- # mapfile -t mem 00:05:03.593 22:57:07 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:03.593 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.593 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.593 22:57:07 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 28602992 kB' 'MemUsed: 4222864 kB' 'SwapCached: 0 kB' 'Active: 1997572 kB' 'Inactive: 142888 kB' 'Active(anon): 1855584 kB' 'Inactive(anon): 0 kB' 'Active(file): 141988 kB' 'Inactive(file): 142888 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2044208 kB' 'Mapped: 140176 kB' 'AnonPages: 99444 kB' 'Shmem: 1759332 kB' 'KernelStack: 6104 kB' 'PageTables: 3640 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 62364 kB' 'Slab: 340956 kB' 'SReclaimable: 62364 kB' 'SUnreclaim: 278592 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:05:03.593 22:57:07 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.593 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.593 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.593 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.593 22:57:07 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.593 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.593 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.593 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.593 22:57:07 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.593 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.593 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.593 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.593 22:57:07 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.593 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.593 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.593 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.593 22:57:07 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.593 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.593 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.593 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.593 22:57:07 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.593 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.593 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.593 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.593 22:57:07 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.593 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.593 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.593 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.593 22:57:07 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.593 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.593 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.593 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.593 22:57:07 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.593 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.593 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.593 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.593 22:57:07 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.593 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.593 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.593 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.593 22:57:07 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.593 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.593 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.593 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.593 22:57:07 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.593 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.593 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.593 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.593 22:57:07 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.593 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.593 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.593 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.593 22:57:07 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.593 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.593 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.593 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.593 22:57:07 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.853 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.853 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.853 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.853 22:57:07 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.853 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.853 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.853 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.853 22:57:07 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.853 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.853 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.853 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.853 22:57:07 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.853 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.853 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.853 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.853 22:57:07 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.853 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.853 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.853 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.853 22:57:07 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.853 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.853 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.853 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.853 22:57:07 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.853 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.853 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.853 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.853 22:57:07 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.853 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.853 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.853 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.853 22:57:07 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.853 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.853 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.853 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.853 22:57:07 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.853 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.853 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.853 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.853 22:57:07 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.853 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.853 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.853 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.853 22:57:07 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.853 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.853 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.853 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.853 22:57:07 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.853 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.853 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.853 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.853 22:57:07 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.853 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.853 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.853 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.853 22:57:07 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.853 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.853 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.853 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.853 22:57:07 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.853 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.853 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.853 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.853 22:57:07 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.853 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.853 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.853 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.853 22:57:07 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.853 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.853 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.853 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.853 22:57:07 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.853 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.853 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.853 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.853 22:57:07 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.853 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.853 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.853 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.853 22:57:07 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.853 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.853 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.853 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.853 22:57:07 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.853 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.853 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.853 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.853 22:57:07 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.853 22:57:07 -- setup/common.sh@33 -- # echo 0 00:05:03.853 22:57:07 -- setup/common.sh@33 -- # return 0 00:05:03.853 22:57:07 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:05:03.853 22:57:07 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:05:03.853 22:57:07 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:05:03.853 22:57:07 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:05:03.853 22:57:07 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:03.853 22:57:07 -- setup/common.sh@18 -- # local node=1 00:05:03.853 22:57:07 -- setup/common.sh@19 -- # local var val 00:05:03.853 22:57:07 -- setup/common.sh@20 -- # local mem_f mem 00:05:03.853 22:57:07 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:03.853 22:57:07 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:05:03.853 22:57:07 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:05:03.853 22:57:07 -- setup/common.sh@28 -- # mapfile -t mem 00:05:03.853 22:57:07 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.854 22:57:07 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709808 kB' 'MemFree: 13717660 kB' 'MemUsed: 13992148 kB' 'SwapCached: 0 kB' 'Active: 7326500 kB' 'Inactive: 3600336 kB' 'Active(anon): 7075824 kB' 'Inactive(anon): 0 kB' 'Active(file): 250676 kB' 'Inactive(file): 3600336 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 10589360 kB' 'Mapped: 90564 kB' 'AnonPages: 337684 kB' 'Shmem: 6738348 kB' 'KernelStack: 6888 kB' 'PageTables: 4640 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 136720 kB' 'Slab: 359640 kB' 'SReclaimable: 136720 kB' 'SUnreclaim: 222920 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # continue 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # IFS=': ' 00:05:03.854 22:57:07 -- setup/common.sh@31 -- # read -r var val _ 00:05:03.854 22:57:07 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:03.854 22:57:07 -- setup/common.sh@33 -- # echo 0 00:05:03.854 22:57:07 -- setup/common.sh@33 -- # return 0 00:05:03.854 22:57:07 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:05:03.854 22:57:07 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:05:03.854 22:57:07 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:05:03.855 22:57:07 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:05:03.855 22:57:07 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:05:03.855 node0=512 expecting 512 00:05:03.855 22:57:07 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:05:03.855 22:57:07 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:05:03.855 22:57:07 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:05:03.855 22:57:07 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:05:03.855 node1=1024 expecting 1024 00:05:03.855 22:57:07 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:05:03.855 00:05:03.855 real 0m1.507s 00:05:03.855 user 0m0.617s 00:05:03.855 sys 0m0.855s 00:05:03.855 22:57:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:03.855 22:57:07 -- common/autotest_common.sh@10 -- # set +x 00:05:03.855 ************************************ 00:05:03.855 END TEST custom_alloc 00:05:03.855 ************************************ 00:05:03.855 22:57:07 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:05:03.855 22:57:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:03.855 22:57:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:03.855 22:57:07 -- common/autotest_common.sh@10 -- # set +x 00:05:03.855 ************************************ 00:05:03.855 START TEST no_shrink_alloc 00:05:03.855 ************************************ 00:05:03.855 22:57:07 -- common/autotest_common.sh@1114 -- # no_shrink_alloc 00:05:03.855 22:57:07 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:05:03.855 22:57:07 -- setup/hugepages.sh@49 -- # local size=2097152 00:05:03.855 22:57:07 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:05:03.855 22:57:07 -- setup/hugepages.sh@51 -- # shift 00:05:03.855 22:57:07 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:05:03.855 22:57:07 -- setup/hugepages.sh@52 -- # local node_ids 00:05:03.855 22:57:07 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:05:03.855 22:57:07 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:05:03.855 22:57:07 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:05:03.855 22:57:07 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:05:03.855 22:57:07 -- setup/hugepages.sh@62 -- # local user_nodes 00:05:03.855 22:57:07 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:05:03.855 22:57:07 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:05:03.855 22:57:07 -- setup/hugepages.sh@67 -- # nodes_test=() 00:05:03.855 22:57:07 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:05:03.855 22:57:07 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:05:03.855 22:57:07 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:05:03.855 22:57:07 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:05:03.855 22:57:07 -- setup/hugepages.sh@73 -- # return 0 00:05:03.855 22:57:07 -- setup/hugepages.sh@198 -- # setup output 00:05:03.855 22:57:07 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:03.855 22:57:07 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:04.790 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:05:04.790 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:05:04.790 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:05:04.790 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:05:04.790 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:05:04.790 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:05:04.790 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:05:04.790 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:05:04.790 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:05:04.790 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:05:04.790 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:05:04.790 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:05:04.790 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:05:04.790 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:05:04.790 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:05:04.790 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:05:04.790 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:05:05.052 22:57:08 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:05:05.052 22:57:08 -- setup/hugepages.sh@89 -- # local node 00:05:05.052 22:57:08 -- setup/hugepages.sh@90 -- # local sorted_t 00:05:05.052 22:57:08 -- setup/hugepages.sh@91 -- # local sorted_s 00:05:05.052 22:57:08 -- setup/hugepages.sh@92 -- # local surp 00:05:05.052 22:57:08 -- setup/hugepages.sh@93 -- # local resv 00:05:05.052 22:57:08 -- setup/hugepages.sh@94 -- # local anon 00:05:05.052 22:57:08 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:05:05.052 22:57:08 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:05:05.052 22:57:08 -- setup/common.sh@17 -- # local get=AnonHugePages 00:05:05.052 22:57:08 -- setup/common.sh@18 -- # local node= 00:05:05.052 22:57:08 -- setup/common.sh@19 -- # local var val 00:05:05.052 22:57:08 -- setup/common.sh@20 -- # local mem_f mem 00:05:05.052 22:57:08 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:05.052 22:57:08 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:05.052 22:57:08 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:05.052 22:57:08 -- setup/common.sh@28 -- # mapfile -t mem 00:05:05.052 22:57:08 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.052 22:57:08 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43306004 kB' 'MemAvailable: 47047856 kB' 'Buffers: 2708 kB' 'Cached: 12630904 kB' 'SwapCached: 0 kB' 'Active: 9329792 kB' 'Inactive: 3743224 kB' 'Active(anon): 8937128 kB' 'Inactive(anon): 0 kB' 'Active(file): 392664 kB' 'Inactive(file): 3743224 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 442632 kB' 'Mapped: 231200 kB' 'Shmem: 8497724 kB' 'KReclaimable: 199084 kB' 'Slab: 700600 kB' 'SReclaimable: 199084 kB' 'SUnreclaim: 501516 kB' 'KernelStack: 12720 kB' 'PageTables: 7708 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10007760 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198444 kB' 'VmallocChunk: 0 kB' 'Percpu: 33792 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1777244 kB' 'DirectMap2M: 13871104 kB' 'DirectMap1G: 54525952 kB' 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.052 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.052 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.053 22:57:08 -- setup/common.sh@33 -- # echo 0 00:05:05.053 22:57:08 -- setup/common.sh@33 -- # return 0 00:05:05.053 22:57:08 -- setup/hugepages.sh@97 -- # anon=0 00:05:05.053 22:57:08 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:05:05.053 22:57:08 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:05.053 22:57:08 -- setup/common.sh@18 -- # local node= 00:05:05.053 22:57:08 -- setup/common.sh@19 -- # local var val 00:05:05.053 22:57:08 -- setup/common.sh@20 -- # local mem_f mem 00:05:05.053 22:57:08 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:05.053 22:57:08 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:05.053 22:57:08 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:05.053 22:57:08 -- setup/common.sh@28 -- # mapfile -t mem 00:05:05.053 22:57:08 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.053 22:57:08 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43307312 kB' 'MemAvailable: 47049164 kB' 'Buffers: 2708 kB' 'Cached: 12630908 kB' 'SwapCached: 0 kB' 'Active: 9330688 kB' 'Inactive: 3743224 kB' 'Active(anon): 8938024 kB' 'Inactive(anon): 0 kB' 'Active(file): 392664 kB' 'Inactive(file): 3743224 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 443484 kB' 'Mapped: 231212 kB' 'Shmem: 8497728 kB' 'KReclaimable: 199084 kB' 'Slab: 700600 kB' 'SReclaimable: 199084 kB' 'SUnreclaim: 501516 kB' 'KernelStack: 12880 kB' 'PageTables: 8188 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10007768 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198412 kB' 'VmallocChunk: 0 kB' 'Percpu: 33792 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1777244 kB' 'DirectMap2M: 13871104 kB' 'DirectMap1G: 54525952 kB' 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.053 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.053 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.054 22:57:08 -- setup/common.sh@33 -- # echo 0 00:05:05.054 22:57:08 -- setup/common.sh@33 -- # return 0 00:05:05.054 22:57:08 -- setup/hugepages.sh@99 -- # surp=0 00:05:05.054 22:57:08 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:05:05.054 22:57:08 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:05:05.054 22:57:08 -- setup/common.sh@18 -- # local node= 00:05:05.054 22:57:08 -- setup/common.sh@19 -- # local var val 00:05:05.054 22:57:08 -- setup/common.sh@20 -- # local mem_f mem 00:05:05.054 22:57:08 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:05.054 22:57:08 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:05.054 22:57:08 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:05.054 22:57:08 -- setup/common.sh@28 -- # mapfile -t mem 00:05:05.054 22:57:08 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.054 22:57:08 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43307240 kB' 'MemAvailable: 47049092 kB' 'Buffers: 2708 kB' 'Cached: 12630912 kB' 'SwapCached: 0 kB' 'Active: 9325760 kB' 'Inactive: 3743224 kB' 'Active(anon): 8933096 kB' 'Inactive(anon): 0 kB' 'Active(file): 392664 kB' 'Inactive(file): 3743224 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 438704 kB' 'Mapped: 230760 kB' 'Shmem: 8497732 kB' 'KReclaimable: 199084 kB' 'Slab: 700580 kB' 'SReclaimable: 199084 kB' 'SUnreclaim: 501496 kB' 'KernelStack: 12976 kB' 'PageTables: 8420 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10005452 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198472 kB' 'VmallocChunk: 0 kB' 'Percpu: 33792 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1777244 kB' 'DirectMap2M: 13871104 kB' 'DirectMap1G: 54525952 kB' 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.054 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.054 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.055 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.055 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.056 22:57:08 -- setup/common.sh@33 -- # echo 0 00:05:05.056 22:57:08 -- setup/common.sh@33 -- # return 0 00:05:05.056 22:57:08 -- setup/hugepages.sh@100 -- # resv=0 00:05:05.056 22:57:08 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:05:05.056 nr_hugepages=1024 00:05:05.056 22:57:08 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:05:05.056 resv_hugepages=0 00:05:05.056 22:57:08 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:05:05.056 surplus_hugepages=0 00:05:05.056 22:57:08 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:05:05.056 anon_hugepages=0 00:05:05.056 22:57:08 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:05:05.056 22:57:08 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:05:05.056 22:57:08 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:05:05.056 22:57:08 -- setup/common.sh@17 -- # local get=HugePages_Total 00:05:05.056 22:57:08 -- setup/common.sh@18 -- # local node= 00:05:05.056 22:57:08 -- setup/common.sh@19 -- # local var val 00:05:05.056 22:57:08 -- setup/common.sh@20 -- # local mem_f mem 00:05:05.056 22:57:08 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:05.056 22:57:08 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:05.056 22:57:08 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:05.056 22:57:08 -- setup/common.sh@28 -- # mapfile -t mem 00:05:05.056 22:57:08 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.056 22:57:08 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43303752 kB' 'MemAvailable: 47045604 kB' 'Buffers: 2708 kB' 'Cached: 12630916 kB' 'SwapCached: 0 kB' 'Active: 9328292 kB' 'Inactive: 3743224 kB' 'Active(anon): 8935628 kB' 'Inactive(anon): 0 kB' 'Active(file): 392664 kB' 'Inactive(file): 3743224 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 440792 kB' 'Mapped: 230704 kB' 'Shmem: 8497736 kB' 'KReclaimable: 199084 kB' 'Slab: 700596 kB' 'SReclaimable: 199084 kB' 'SUnreclaim: 501512 kB' 'KernelStack: 12976 kB' 'PageTables: 8388 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10005280 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198440 kB' 'VmallocChunk: 0 kB' 'Percpu: 33792 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1777244 kB' 'DirectMap2M: 13871104 kB' 'DirectMap1G: 54525952 kB' 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.056 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.056 22:57:08 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.057 22:57:08 -- setup/common.sh@33 -- # echo 1024 00:05:05.057 22:57:08 -- setup/common.sh@33 -- # return 0 00:05:05.057 22:57:08 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:05:05.057 22:57:08 -- setup/hugepages.sh@112 -- # get_nodes 00:05:05.057 22:57:08 -- setup/hugepages.sh@27 -- # local node 00:05:05.057 22:57:08 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:05.057 22:57:08 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:05:05.057 22:57:08 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:05.057 22:57:08 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:05:05.057 22:57:08 -- setup/hugepages.sh@32 -- # no_nodes=2 00:05:05.057 22:57:08 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:05:05.057 22:57:08 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:05:05.057 22:57:08 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:05:05.057 22:57:08 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:05:05.057 22:57:08 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:05.057 22:57:08 -- setup/common.sh@18 -- # local node=0 00:05:05.057 22:57:08 -- setup/common.sh@19 -- # local var val 00:05:05.057 22:57:08 -- setup/common.sh@20 -- # local mem_f mem 00:05:05.057 22:57:08 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:05.057 22:57:08 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:05:05.057 22:57:08 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:05:05.057 22:57:08 -- setup/common.sh@28 -- # mapfile -t mem 00:05:05.057 22:57:08 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.057 22:57:08 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 27530720 kB' 'MemUsed: 5295136 kB' 'SwapCached: 0 kB' 'Active: 1998040 kB' 'Inactive: 142888 kB' 'Active(anon): 1856052 kB' 'Inactive(anon): 0 kB' 'Active(file): 141988 kB' 'Inactive(file): 142888 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2044292 kB' 'Mapped: 140032 kB' 'AnonPages: 99776 kB' 'Shmem: 1759416 kB' 'KernelStack: 6152 kB' 'PageTables: 3752 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 62364 kB' 'Slab: 340920 kB' 'SReclaimable: 62364 kB' 'SUnreclaim: 278556 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.057 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.057 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # continue 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.058 22:57:08 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.058 22:57:08 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.058 22:57:08 -- setup/common.sh@33 -- # echo 0 00:05:05.058 22:57:08 -- setup/common.sh@33 -- # return 0 00:05:05.058 22:57:08 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:05:05.058 22:57:08 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:05:05.058 22:57:08 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:05:05.058 22:57:08 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:05:05.058 22:57:08 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:05:05.058 node0=1024 expecting 1024 00:05:05.058 22:57:08 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:05:05.058 22:57:08 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:05:05.058 22:57:08 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:05:05.058 22:57:08 -- setup/hugepages.sh@202 -- # setup output 00:05:05.058 22:57:08 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:05.058 22:57:08 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:06.438 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:05:06.438 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:05:06.438 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:05:06.438 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:05:06.438 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:05:06.438 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:05:06.438 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:05:06.438 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:05:06.438 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:05:06.438 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:05:06.438 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:05:06.438 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:05:06.438 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:05:06.438 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:05:06.438 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:05:06.438 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:05:06.438 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:05:06.438 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:05:06.438 22:57:09 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:05:06.438 22:57:09 -- setup/hugepages.sh@89 -- # local node 00:05:06.438 22:57:09 -- setup/hugepages.sh@90 -- # local sorted_t 00:05:06.438 22:57:09 -- setup/hugepages.sh@91 -- # local sorted_s 00:05:06.438 22:57:09 -- setup/hugepages.sh@92 -- # local surp 00:05:06.438 22:57:09 -- setup/hugepages.sh@93 -- # local resv 00:05:06.438 22:57:09 -- setup/hugepages.sh@94 -- # local anon 00:05:06.438 22:57:09 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:05:06.438 22:57:09 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:05:06.438 22:57:09 -- setup/common.sh@17 -- # local get=AnonHugePages 00:05:06.438 22:57:09 -- setup/common.sh@18 -- # local node= 00:05:06.438 22:57:09 -- setup/common.sh@19 -- # local var val 00:05:06.438 22:57:09 -- setup/common.sh@20 -- # local mem_f mem 00:05:06.438 22:57:09 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:06.438 22:57:09 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:06.438 22:57:09 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:06.438 22:57:09 -- setup/common.sh@28 -- # mapfile -t mem 00:05:06.438 22:57:09 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:06.438 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.438 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.438 22:57:09 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43305508 kB' 'MemAvailable: 47047356 kB' 'Buffers: 2708 kB' 'Cached: 12630988 kB' 'SwapCached: 0 kB' 'Active: 9322724 kB' 'Inactive: 3743224 kB' 'Active(anon): 8930060 kB' 'Inactive(anon): 0 kB' 'Active(file): 392664 kB' 'Inactive(file): 3743224 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 435460 kB' 'Mapped: 230440 kB' 'Shmem: 8497808 kB' 'KReclaimable: 199076 kB' 'Slab: 700176 kB' 'SReclaimable: 199076 kB' 'SUnreclaim: 501100 kB' 'KernelStack: 12752 kB' 'PageTables: 7744 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 9998296 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198424 kB' 'VmallocChunk: 0 kB' 'Percpu: 33792 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1777244 kB' 'DirectMap2M: 13871104 kB' 'DirectMap1G: 54525952 kB' 00:05:06.438 22:57:09 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.438 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.438 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.438 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.438 22:57:09 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.438 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.438 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.438 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.438 22:57:09 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.438 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.438 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.438 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.438 22:57:09 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.438 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.438 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.438 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.438 22:57:09 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.438 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.438 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.438 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.438 22:57:09 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.438 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.438 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.438 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.438 22:57:09 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.438 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.438 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.438 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.438 22:57:09 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.438 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.438 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.438 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.438 22:57:09 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.438 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.438 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.438 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.438 22:57:09 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.438 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.438 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.438 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.438 22:57:09 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.438 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.438 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.438 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.438 22:57:09 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.438 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.438 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.438 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.438 22:57:09 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.438 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.438 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.438 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.438 22:57:09 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.438 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.438 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.438 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.438 22:57:09 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.438 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.438 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.438 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.438 22:57:09 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.438 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.438 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.438 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.438 22:57:09 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.438 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.438 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.438 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.438 22:57:09 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.438 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.438 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.438 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.438 22:57:09 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.438 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.438 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.438 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.438 22:57:09 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.438 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.438 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.438 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.438 22:57:09 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.438 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.438 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.438 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.438 22:57:09 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.438 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.439 22:57:09 -- setup/common.sh@33 -- # echo 0 00:05:06.439 22:57:09 -- setup/common.sh@33 -- # return 0 00:05:06.439 22:57:09 -- setup/hugepages.sh@97 -- # anon=0 00:05:06.439 22:57:09 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:05:06.439 22:57:09 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:06.439 22:57:09 -- setup/common.sh@18 -- # local node= 00:05:06.439 22:57:09 -- setup/common.sh@19 -- # local var val 00:05:06.439 22:57:09 -- setup/common.sh@20 -- # local mem_f mem 00:05:06.439 22:57:09 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:06.439 22:57:09 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:06.439 22:57:09 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:06.439 22:57:09 -- setup/common.sh@28 -- # mapfile -t mem 00:05:06.439 22:57:09 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.439 22:57:09 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43310348 kB' 'MemAvailable: 47052196 kB' 'Buffers: 2708 kB' 'Cached: 12630992 kB' 'SwapCached: 0 kB' 'Active: 9323440 kB' 'Inactive: 3743224 kB' 'Active(anon): 8930776 kB' 'Inactive(anon): 0 kB' 'Active(file): 392664 kB' 'Inactive(file): 3743224 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 436172 kB' 'Mapped: 230440 kB' 'Shmem: 8497812 kB' 'KReclaimable: 199076 kB' 'Slab: 700176 kB' 'SReclaimable: 199076 kB' 'SUnreclaim: 501100 kB' 'KernelStack: 12768 kB' 'PageTables: 7792 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 9998308 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 33792 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1777244 kB' 'DirectMap2M: 13871104 kB' 'DirectMap1G: 54525952 kB' 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.439 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.439 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.440 22:57:09 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.440 22:57:09 -- setup/common.sh@33 -- # echo 0 00:05:06.440 22:57:09 -- setup/common.sh@33 -- # return 0 00:05:06.440 22:57:09 -- setup/hugepages.sh@99 -- # surp=0 00:05:06.440 22:57:09 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:05:06.440 22:57:09 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:05:06.440 22:57:09 -- setup/common.sh@18 -- # local node= 00:05:06.440 22:57:09 -- setup/common.sh@19 -- # local var val 00:05:06.440 22:57:09 -- setup/common.sh@20 -- # local mem_f mem 00:05:06.440 22:57:09 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:06.440 22:57:09 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:06.440 22:57:09 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:06.440 22:57:09 -- setup/common.sh@28 -- # mapfile -t mem 00:05:06.440 22:57:09 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.440 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.441 22:57:09 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43310392 kB' 'MemAvailable: 47052240 kB' 'Buffers: 2708 kB' 'Cached: 12630996 kB' 'SwapCached: 0 kB' 'Active: 9322872 kB' 'Inactive: 3743224 kB' 'Active(anon): 8930208 kB' 'Inactive(anon): 0 kB' 'Active(file): 392664 kB' 'Inactive(file): 3743224 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 435532 kB' 'Mapped: 230276 kB' 'Shmem: 8497816 kB' 'KReclaimable: 199076 kB' 'Slab: 700168 kB' 'SReclaimable: 199076 kB' 'SUnreclaim: 501092 kB' 'KernelStack: 12768 kB' 'PageTables: 7780 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 9998320 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 33792 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1777244 kB' 'DirectMap2M: 13871104 kB' 'DirectMap1G: 54525952 kB' 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.441 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.441 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.442 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.442 22:57:09 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.442 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.442 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.442 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.442 22:57:09 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.442 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.442 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.442 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.442 22:57:09 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.442 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.442 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.442 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.442 22:57:09 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.442 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.442 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.442 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.442 22:57:09 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.442 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.442 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.442 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.442 22:57:09 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.442 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.442 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.442 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.442 22:57:09 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.442 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.442 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.442 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.442 22:57:09 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.442 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.442 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.442 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.442 22:57:09 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.442 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.442 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.442 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.442 22:57:09 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.442 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.442 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.442 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.442 22:57:09 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.442 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.442 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.442 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.442 22:57:09 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.442 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.442 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.442 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.442 22:57:09 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.442 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.442 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.442 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.442 22:57:09 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.442 22:57:09 -- setup/common.sh@33 -- # echo 0 00:05:06.442 22:57:09 -- setup/common.sh@33 -- # return 0 00:05:06.442 22:57:09 -- setup/hugepages.sh@100 -- # resv=0 00:05:06.442 22:57:09 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:05:06.442 nr_hugepages=1024 00:05:06.442 22:57:09 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:05:06.442 resv_hugepages=0 00:05:06.442 22:57:09 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:05:06.442 surplus_hugepages=0 00:05:06.442 22:57:09 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:05:06.442 anon_hugepages=0 00:05:06.442 22:57:09 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:05:06.442 22:57:09 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:05:06.442 22:57:09 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:05:06.442 22:57:09 -- setup/common.sh@17 -- # local get=HugePages_Total 00:05:06.442 22:57:09 -- setup/common.sh@18 -- # local node= 00:05:06.442 22:57:09 -- setup/common.sh@19 -- # local var val 00:05:06.442 22:57:09 -- setup/common.sh@20 -- # local mem_f mem 00:05:06.442 22:57:09 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:06.442 22:57:09 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:06.442 22:57:09 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:06.442 22:57:09 -- setup/common.sh@28 -- # mapfile -t mem 00:05:06.442 22:57:09 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:06.442 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.442 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.442 22:57:09 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43312392 kB' 'MemAvailable: 47054240 kB' 'Buffers: 2708 kB' 'Cached: 12631020 kB' 'SwapCached: 0 kB' 'Active: 9322220 kB' 'Inactive: 3743224 kB' 'Active(anon): 8929556 kB' 'Inactive(anon): 0 kB' 'Active(file): 392664 kB' 'Inactive(file): 3743224 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 434836 kB' 'Mapped: 230276 kB' 'Shmem: 8497840 kB' 'KReclaimable: 199076 kB' 'Slab: 700184 kB' 'SReclaimable: 199076 kB' 'SUnreclaim: 501108 kB' 'KernelStack: 12784 kB' 'PageTables: 7808 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 9998336 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 33792 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1777244 kB' 'DirectMap2M: 13871104 kB' 'DirectMap1G: 54525952 kB' 00:05:06.442 22:57:09 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.442 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.442 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.442 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.442 22:57:09 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.442 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.442 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.442 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.442 22:57:09 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.442 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.442 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.442 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.442 22:57:09 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.442 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.442 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.442 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.442 22:57:09 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.442 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.442 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.442 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.442 22:57:09 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.442 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.442 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.442 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.442 22:57:09 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.442 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.442 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.442 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.442 22:57:09 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.442 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.442 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.442 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.443 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.443 22:57:09 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.443 22:57:09 -- setup/common.sh@33 -- # echo 1024 00:05:06.443 22:57:09 -- setup/common.sh@33 -- # return 0 00:05:06.443 22:57:09 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:05:06.444 22:57:09 -- setup/hugepages.sh@112 -- # get_nodes 00:05:06.444 22:57:09 -- setup/hugepages.sh@27 -- # local node 00:05:06.444 22:57:09 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:06.444 22:57:09 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:05:06.444 22:57:09 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:06.444 22:57:09 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:05:06.444 22:57:09 -- setup/hugepages.sh@32 -- # no_nodes=2 00:05:06.444 22:57:09 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:05:06.444 22:57:09 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:05:06.444 22:57:09 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:05:06.444 22:57:09 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:05:06.444 22:57:09 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:06.444 22:57:09 -- setup/common.sh@18 -- # local node=0 00:05:06.444 22:57:09 -- setup/common.sh@19 -- # local var val 00:05:06.444 22:57:09 -- setup/common.sh@20 -- # local mem_f mem 00:05:06.444 22:57:09 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:06.444 22:57:09 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:05:06.444 22:57:09 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:05:06.444 22:57:09 -- setup/common.sh@28 -- # mapfile -t mem 00:05:06.444 22:57:09 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.444 22:57:09 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 27531264 kB' 'MemUsed: 5294592 kB' 'SwapCached: 0 kB' 'Active: 1998052 kB' 'Inactive: 142888 kB' 'Active(anon): 1856064 kB' 'Inactive(anon): 0 kB' 'Active(file): 141988 kB' 'Inactive(file): 142888 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2044364 kB' 'Mapped: 140036 kB' 'AnonPages: 99696 kB' 'Shmem: 1759488 kB' 'KernelStack: 6152 kB' 'PageTables: 3704 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 62364 kB' 'Slab: 340728 kB' 'SReclaimable: 62364 kB' 'SUnreclaim: 278364 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.444 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.444 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.445 22:57:09 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.445 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.445 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.445 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.445 22:57:09 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.445 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.445 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.445 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.445 22:57:09 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.445 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.445 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.445 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.445 22:57:09 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.445 22:57:09 -- setup/common.sh@32 -- # continue 00:05:06.445 22:57:09 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.445 22:57:09 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.445 22:57:09 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.445 22:57:09 -- setup/common.sh@33 -- # echo 0 00:05:06.445 22:57:09 -- setup/common.sh@33 -- # return 0 00:05:06.445 22:57:09 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:05:06.445 22:57:09 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:05:06.445 22:57:09 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:05:06.445 22:57:09 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:05:06.445 22:57:09 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:05:06.445 node0=1024 expecting 1024 00:05:06.445 22:57:09 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:05:06.445 00:05:06.445 real 0m2.700s 00:05:06.445 user 0m1.071s 00:05:06.445 sys 0m1.550s 00:05:06.445 22:57:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:06.445 22:57:09 -- common/autotest_common.sh@10 -- # set +x 00:05:06.445 ************************************ 00:05:06.445 END TEST no_shrink_alloc 00:05:06.445 ************************************ 00:05:06.445 22:57:09 -- setup/hugepages.sh@217 -- # clear_hp 00:05:06.445 22:57:09 -- setup/hugepages.sh@37 -- # local node hp 00:05:06.445 22:57:09 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:05:06.445 22:57:09 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:05:06.445 22:57:09 -- setup/hugepages.sh@41 -- # echo 0 00:05:06.445 22:57:09 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:05:06.445 22:57:09 -- setup/hugepages.sh@41 -- # echo 0 00:05:06.445 22:57:09 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:05:06.445 22:57:09 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:05:06.445 22:57:09 -- setup/hugepages.sh@41 -- # echo 0 00:05:06.445 22:57:09 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:05:06.445 22:57:09 -- setup/hugepages.sh@41 -- # echo 0 00:05:06.445 22:57:09 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:05:06.445 22:57:09 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:05:06.445 00:05:06.445 real 0m11.316s 00:05:06.445 user 0m4.397s 00:05:06.445 sys 0m5.859s 00:05:06.445 22:57:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:06.445 22:57:09 -- common/autotest_common.sh@10 -- # set +x 00:05:06.445 ************************************ 00:05:06.445 END TEST hugepages 00:05:06.445 ************************************ 00:05:06.445 22:57:09 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:05:06.445 22:57:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:06.445 22:57:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:06.445 22:57:09 -- common/autotest_common.sh@10 -- # set +x 00:05:06.445 ************************************ 00:05:06.445 START TEST driver 00:05:06.445 ************************************ 00:05:06.445 22:57:10 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:05:06.704 * Looking for test storage... 00:05:06.704 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:05:06.704 22:57:10 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:06.704 22:57:10 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:06.704 22:57:10 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:06.704 22:57:10 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:06.704 22:57:10 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:06.704 22:57:10 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:06.704 22:57:10 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:06.704 22:57:10 -- scripts/common.sh@335 -- # IFS=.-: 00:05:06.704 22:57:10 -- scripts/common.sh@335 -- # read -ra ver1 00:05:06.704 22:57:10 -- scripts/common.sh@336 -- # IFS=.-: 00:05:06.704 22:57:10 -- scripts/common.sh@336 -- # read -ra ver2 00:05:06.704 22:57:10 -- scripts/common.sh@337 -- # local 'op=<' 00:05:06.704 22:57:10 -- scripts/common.sh@339 -- # ver1_l=2 00:05:06.704 22:57:10 -- scripts/common.sh@340 -- # ver2_l=1 00:05:06.704 22:57:10 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:06.704 22:57:10 -- scripts/common.sh@343 -- # case "$op" in 00:05:06.704 22:57:10 -- scripts/common.sh@344 -- # : 1 00:05:06.704 22:57:10 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:06.704 22:57:10 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:06.704 22:57:10 -- scripts/common.sh@364 -- # decimal 1 00:05:06.704 22:57:10 -- scripts/common.sh@352 -- # local d=1 00:05:06.704 22:57:10 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:06.704 22:57:10 -- scripts/common.sh@354 -- # echo 1 00:05:06.704 22:57:10 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:06.704 22:57:10 -- scripts/common.sh@365 -- # decimal 2 00:05:06.704 22:57:10 -- scripts/common.sh@352 -- # local d=2 00:05:06.704 22:57:10 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:06.704 22:57:10 -- scripts/common.sh@354 -- # echo 2 00:05:06.704 22:57:10 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:06.704 22:57:10 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:06.704 22:57:10 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:06.704 22:57:10 -- scripts/common.sh@367 -- # return 0 00:05:06.704 22:57:10 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:06.704 22:57:10 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:06.704 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:06.704 --rc genhtml_branch_coverage=1 00:05:06.704 --rc genhtml_function_coverage=1 00:05:06.704 --rc genhtml_legend=1 00:05:06.704 --rc geninfo_all_blocks=1 00:05:06.704 --rc geninfo_unexecuted_blocks=1 00:05:06.704 00:05:06.704 ' 00:05:06.704 22:57:10 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:06.704 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:06.704 --rc genhtml_branch_coverage=1 00:05:06.704 --rc genhtml_function_coverage=1 00:05:06.704 --rc genhtml_legend=1 00:05:06.704 --rc geninfo_all_blocks=1 00:05:06.704 --rc geninfo_unexecuted_blocks=1 00:05:06.704 00:05:06.704 ' 00:05:06.704 22:57:10 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:06.704 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:06.704 --rc genhtml_branch_coverage=1 00:05:06.704 --rc genhtml_function_coverage=1 00:05:06.704 --rc genhtml_legend=1 00:05:06.704 --rc geninfo_all_blocks=1 00:05:06.704 --rc geninfo_unexecuted_blocks=1 00:05:06.704 00:05:06.704 ' 00:05:06.704 22:57:10 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:06.704 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:06.704 --rc genhtml_branch_coverage=1 00:05:06.704 --rc genhtml_function_coverage=1 00:05:06.704 --rc genhtml_legend=1 00:05:06.704 --rc geninfo_all_blocks=1 00:05:06.704 --rc geninfo_unexecuted_blocks=1 00:05:06.704 00:05:06.704 ' 00:05:06.704 22:57:10 -- setup/driver.sh@68 -- # setup reset 00:05:06.704 22:57:10 -- setup/common.sh@9 -- # [[ reset == output ]] 00:05:06.704 22:57:10 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:05:09.237 22:57:12 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:05:09.237 22:57:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:09.237 22:57:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:09.237 22:57:12 -- common/autotest_common.sh@10 -- # set +x 00:05:09.237 ************************************ 00:05:09.237 START TEST guess_driver 00:05:09.237 ************************************ 00:05:09.237 22:57:12 -- common/autotest_common.sh@1114 -- # guess_driver 00:05:09.237 22:57:12 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:05:09.237 22:57:12 -- setup/driver.sh@47 -- # local fail=0 00:05:09.237 22:57:12 -- setup/driver.sh@49 -- # pick_driver 00:05:09.237 22:57:12 -- setup/driver.sh@36 -- # vfio 00:05:09.237 22:57:12 -- setup/driver.sh@21 -- # local iommu_grups 00:05:09.237 22:57:12 -- setup/driver.sh@22 -- # local unsafe_vfio 00:05:09.237 22:57:12 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:05:09.237 22:57:12 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:05:09.237 22:57:12 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:05:09.237 22:57:12 -- setup/driver.sh@29 -- # (( 141 > 0 )) 00:05:09.237 22:57:12 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:05:09.237 22:57:12 -- setup/driver.sh@14 -- # mod vfio_pci 00:05:09.237 22:57:12 -- setup/driver.sh@12 -- # dep vfio_pci 00:05:09.237 22:57:12 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:05:09.237 22:57:12 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:05:09.237 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:05:09.237 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:05:09.237 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:05:09.237 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:05:09.237 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:05:09.237 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:05:09.237 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:05:09.237 22:57:12 -- setup/driver.sh@30 -- # return 0 00:05:09.237 22:57:12 -- setup/driver.sh@37 -- # echo vfio-pci 00:05:09.237 22:57:12 -- setup/driver.sh@49 -- # driver=vfio-pci 00:05:09.237 22:57:12 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:05:09.237 22:57:12 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:05:09.237 Looking for driver=vfio-pci 00:05:09.237 22:57:12 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:09.237 22:57:12 -- setup/driver.sh@45 -- # setup output config 00:05:09.237 22:57:12 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:09.237 22:57:12 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:10.624 22:57:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:10.624 22:57:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:10.624 22:57:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:10.624 22:57:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:10.624 22:57:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:10.624 22:57:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:10.624 22:57:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:10.624 22:57:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:10.624 22:57:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:10.624 22:57:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:10.624 22:57:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:10.624 22:57:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:10.624 22:57:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:10.624 22:57:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:10.624 22:57:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:10.624 22:57:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:10.624 22:57:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:10.624 22:57:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:10.624 22:57:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:10.624 22:57:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:10.624 22:57:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:10.624 22:57:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:10.624 22:57:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:10.624 22:57:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:10.624 22:57:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:10.624 22:57:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:10.624 22:57:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:10.624 22:57:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:10.624 22:57:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:10.624 22:57:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:10.624 22:57:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:10.624 22:57:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:10.624 22:57:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:10.624 22:57:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:10.624 22:57:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:10.624 22:57:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:10.624 22:57:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:10.624 22:57:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:10.624 22:57:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:10.624 22:57:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:10.624 22:57:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:10.624 22:57:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:10.624 22:57:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:10.624 22:57:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:10.624 22:57:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:10.624 22:57:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:10.624 22:57:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:10.624 22:57:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:11.561 22:57:14 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:11.561 22:57:14 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:11.561 22:57:14 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:11.561 22:57:14 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:05:11.561 22:57:14 -- setup/driver.sh@65 -- # setup reset 00:05:11.561 22:57:14 -- setup/common.sh@9 -- # [[ reset == output ]] 00:05:11.561 22:57:14 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:05:14.093 00:05:14.093 real 0m4.830s 00:05:14.093 user 0m1.128s 00:05:14.093 sys 0m1.899s 00:05:14.093 22:57:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:14.093 22:57:17 -- common/autotest_common.sh@10 -- # set +x 00:05:14.093 ************************************ 00:05:14.093 END TEST guess_driver 00:05:14.093 ************************************ 00:05:14.093 00:05:14.093 real 0m7.459s 00:05:14.093 user 0m1.774s 00:05:14.093 sys 0m2.948s 00:05:14.093 22:57:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:14.093 22:57:17 -- common/autotest_common.sh@10 -- # set +x 00:05:14.093 ************************************ 00:05:14.093 END TEST driver 00:05:14.093 ************************************ 00:05:14.093 22:57:17 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:05:14.093 22:57:17 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:14.093 22:57:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:14.093 22:57:17 -- common/autotest_common.sh@10 -- # set +x 00:05:14.093 ************************************ 00:05:14.093 START TEST devices 00:05:14.093 ************************************ 00:05:14.093 22:57:17 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:05:14.093 * Looking for test storage... 00:05:14.093 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:05:14.093 22:57:17 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:14.093 22:57:17 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:14.093 22:57:17 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:14.093 22:57:17 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:14.093 22:57:17 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:14.093 22:57:17 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:14.093 22:57:17 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:14.093 22:57:17 -- scripts/common.sh@335 -- # IFS=.-: 00:05:14.093 22:57:17 -- scripts/common.sh@335 -- # read -ra ver1 00:05:14.093 22:57:17 -- scripts/common.sh@336 -- # IFS=.-: 00:05:14.093 22:57:17 -- scripts/common.sh@336 -- # read -ra ver2 00:05:14.093 22:57:17 -- scripts/common.sh@337 -- # local 'op=<' 00:05:14.093 22:57:17 -- scripts/common.sh@339 -- # ver1_l=2 00:05:14.093 22:57:17 -- scripts/common.sh@340 -- # ver2_l=1 00:05:14.093 22:57:17 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:14.093 22:57:17 -- scripts/common.sh@343 -- # case "$op" in 00:05:14.094 22:57:17 -- scripts/common.sh@344 -- # : 1 00:05:14.094 22:57:17 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:14.094 22:57:17 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:14.094 22:57:17 -- scripts/common.sh@364 -- # decimal 1 00:05:14.094 22:57:17 -- scripts/common.sh@352 -- # local d=1 00:05:14.094 22:57:17 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:14.094 22:57:17 -- scripts/common.sh@354 -- # echo 1 00:05:14.094 22:57:17 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:14.094 22:57:17 -- scripts/common.sh@365 -- # decimal 2 00:05:14.094 22:57:17 -- scripts/common.sh@352 -- # local d=2 00:05:14.094 22:57:17 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:14.094 22:57:17 -- scripts/common.sh@354 -- # echo 2 00:05:14.094 22:57:17 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:14.094 22:57:17 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:14.094 22:57:17 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:14.094 22:57:17 -- scripts/common.sh@367 -- # return 0 00:05:14.094 22:57:17 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:14.094 22:57:17 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:14.094 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:14.094 --rc genhtml_branch_coverage=1 00:05:14.094 --rc genhtml_function_coverage=1 00:05:14.094 --rc genhtml_legend=1 00:05:14.094 --rc geninfo_all_blocks=1 00:05:14.094 --rc geninfo_unexecuted_blocks=1 00:05:14.094 00:05:14.094 ' 00:05:14.094 22:57:17 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:14.094 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:14.094 --rc genhtml_branch_coverage=1 00:05:14.094 --rc genhtml_function_coverage=1 00:05:14.094 --rc genhtml_legend=1 00:05:14.094 --rc geninfo_all_blocks=1 00:05:14.094 --rc geninfo_unexecuted_blocks=1 00:05:14.094 00:05:14.094 ' 00:05:14.094 22:57:17 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:14.094 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:14.094 --rc genhtml_branch_coverage=1 00:05:14.094 --rc genhtml_function_coverage=1 00:05:14.094 --rc genhtml_legend=1 00:05:14.094 --rc geninfo_all_blocks=1 00:05:14.094 --rc geninfo_unexecuted_blocks=1 00:05:14.094 00:05:14.094 ' 00:05:14.094 22:57:17 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:14.094 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:14.094 --rc genhtml_branch_coverage=1 00:05:14.094 --rc genhtml_function_coverage=1 00:05:14.094 --rc genhtml_legend=1 00:05:14.094 --rc geninfo_all_blocks=1 00:05:14.094 --rc geninfo_unexecuted_blocks=1 00:05:14.094 00:05:14.094 ' 00:05:14.094 22:57:17 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:05:14.094 22:57:17 -- setup/devices.sh@192 -- # setup reset 00:05:14.094 22:57:17 -- setup/common.sh@9 -- # [[ reset == output ]] 00:05:14.094 22:57:17 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:05:15.999 22:57:19 -- setup/devices.sh@194 -- # get_zoned_devs 00:05:15.999 22:57:19 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:05:15.999 22:57:19 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:05:15.999 22:57:19 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:05:15.999 22:57:19 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:05:15.999 22:57:19 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:05:15.999 22:57:19 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:05:15.999 22:57:19 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:05:15.999 22:57:19 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:05:15.999 22:57:19 -- setup/devices.sh@196 -- # blocks=() 00:05:15.999 22:57:19 -- setup/devices.sh@196 -- # declare -a blocks 00:05:15.999 22:57:19 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:05:15.999 22:57:19 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:05:15.999 22:57:19 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:05:15.999 22:57:19 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:05:15.999 22:57:19 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:05:15.999 22:57:19 -- setup/devices.sh@201 -- # ctrl=nvme0 00:05:15.999 22:57:19 -- setup/devices.sh@202 -- # pci=0000:88:00.0 00:05:15.999 22:57:19 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:05:15.999 22:57:19 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:05:15.999 22:57:19 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:05:15.999 22:57:19 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:05:15.999 No valid GPT data, bailing 00:05:15.999 22:57:19 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:05:15.999 22:57:19 -- scripts/common.sh@393 -- # pt= 00:05:15.999 22:57:19 -- scripts/common.sh@394 -- # return 1 00:05:15.999 22:57:19 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:05:15.999 22:57:19 -- setup/common.sh@76 -- # local dev=nvme0n1 00:05:15.999 22:57:19 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:05:15.999 22:57:19 -- setup/common.sh@80 -- # echo 1000204886016 00:05:15.999 22:57:19 -- setup/devices.sh@204 -- # (( 1000204886016 >= min_disk_size )) 00:05:15.999 22:57:19 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:05:15.999 22:57:19 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:88:00.0 00:05:15.999 22:57:19 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:05:15.999 22:57:19 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:05:15.999 22:57:19 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:05:15.999 22:57:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:15.999 22:57:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:15.999 22:57:19 -- common/autotest_common.sh@10 -- # set +x 00:05:15.999 ************************************ 00:05:15.999 START TEST nvme_mount 00:05:15.999 ************************************ 00:05:15.999 22:57:19 -- common/autotest_common.sh@1114 -- # nvme_mount 00:05:15.999 22:57:19 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:05:15.999 22:57:19 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:05:15.999 22:57:19 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:15.999 22:57:19 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:15.999 22:57:19 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:05:15.999 22:57:19 -- setup/common.sh@39 -- # local disk=nvme0n1 00:05:15.999 22:57:19 -- setup/common.sh@40 -- # local part_no=1 00:05:15.999 22:57:19 -- setup/common.sh@41 -- # local size=1073741824 00:05:15.999 22:57:19 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:05:15.999 22:57:19 -- setup/common.sh@44 -- # parts=() 00:05:15.999 22:57:19 -- setup/common.sh@44 -- # local parts 00:05:15.999 22:57:19 -- setup/common.sh@46 -- # (( part = 1 )) 00:05:15.999 22:57:19 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:15.999 22:57:19 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:05:15.999 22:57:19 -- setup/common.sh@46 -- # (( part++ )) 00:05:15.999 22:57:19 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:15.999 22:57:19 -- setup/common.sh@51 -- # (( size /= 512 )) 00:05:15.999 22:57:19 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:05:15.999 22:57:19 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:05:16.937 Creating new GPT entries in memory. 00:05:16.937 GPT data structures destroyed! You may now partition the disk using fdisk or 00:05:16.937 other utilities. 00:05:16.937 22:57:20 -- setup/common.sh@57 -- # (( part = 1 )) 00:05:16.937 22:57:20 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:16.937 22:57:20 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:05:16.937 22:57:20 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:05:16.937 22:57:20 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:05:17.873 Creating new GPT entries in memory. 00:05:17.873 The operation has completed successfully. 00:05:17.873 22:57:21 -- setup/common.sh@57 -- # (( part++ )) 00:05:17.873 22:57:21 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:17.873 22:57:21 -- setup/common.sh@62 -- # wait 2314712 00:05:17.873 22:57:21 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:17.873 22:57:21 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:05:17.873 22:57:21 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:17.873 22:57:21 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:05:17.873 22:57:21 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:05:17.873 22:57:21 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:17.873 22:57:21 -- setup/devices.sh@105 -- # verify 0000:88:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:17.873 22:57:21 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:17.873 22:57:21 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:05:17.873 22:57:21 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:17.873 22:57:21 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:17.873 22:57:21 -- setup/devices.sh@53 -- # local found=0 00:05:17.873 22:57:21 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:17.873 22:57:21 -- setup/devices.sh@56 -- # : 00:05:17.873 22:57:21 -- setup/devices.sh@59 -- # local pci status 00:05:17.873 22:57:21 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:17.873 22:57:21 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:17.873 22:57:21 -- setup/devices.sh@47 -- # setup output config 00:05:17.873 22:57:21 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:17.873 22:57:21 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:18.809 22:57:22 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:18.809 22:57:22 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:05:18.809 22:57:22 -- setup/devices.sh@63 -- # found=1 00:05:18.809 22:57:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:18.809 22:57:22 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:18.809 22:57:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:18.809 22:57:22 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:18.809 22:57:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:18.809 22:57:22 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:18.809 22:57:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:18.809 22:57:22 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:18.809 22:57:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:18.809 22:57:22 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:18.809 22:57:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:18.809 22:57:22 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:18.809 22:57:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:18.809 22:57:22 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:18.809 22:57:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:18.809 22:57:22 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:18.809 22:57:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:18.809 22:57:22 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:18.809 22:57:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:18.809 22:57:22 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:18.809 22:57:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:18.809 22:57:22 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:18.809 22:57:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:18.809 22:57:22 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:18.809 22:57:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:18.809 22:57:22 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:18.809 22:57:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:18.809 22:57:22 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:18.809 22:57:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:18.809 22:57:22 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:18.809 22:57:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:18.809 22:57:22 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:18.809 22:57:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:19.069 22:57:22 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:19.069 22:57:22 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:05:19.069 22:57:22 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:19.069 22:57:22 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:19.069 22:57:22 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:19.069 22:57:22 -- setup/devices.sh@110 -- # cleanup_nvme 00:05:19.069 22:57:22 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:19.069 22:57:22 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:19.069 22:57:22 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:19.069 22:57:22 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:05:19.069 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:05:19.069 22:57:22 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:05:19.069 22:57:22 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:05:19.328 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:05:19.328 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:05:19.328 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:05:19.328 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:05:19.328 22:57:22 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:05:19.328 22:57:22 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:05:19.328 22:57:22 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:19.328 22:57:22 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:05:19.328 22:57:22 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:05:19.328 22:57:22 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:19.587 22:57:22 -- setup/devices.sh@116 -- # verify 0000:88:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:19.587 22:57:22 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:19.587 22:57:22 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:05:19.587 22:57:22 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:19.587 22:57:22 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:19.587 22:57:22 -- setup/devices.sh@53 -- # local found=0 00:05:19.587 22:57:22 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:19.587 22:57:22 -- setup/devices.sh@56 -- # : 00:05:19.587 22:57:22 -- setup/devices.sh@59 -- # local pci status 00:05:19.587 22:57:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:19.587 22:57:22 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:19.587 22:57:22 -- setup/devices.sh@47 -- # setup output config 00:05:19.587 22:57:22 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:19.587 22:57:22 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:20.525 22:57:23 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:20.525 22:57:23 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:05:20.525 22:57:23 -- setup/devices.sh@63 -- # found=1 00:05:20.525 22:57:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:20.525 22:57:23 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:20.525 22:57:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:20.525 22:57:23 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:20.525 22:57:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:20.525 22:57:23 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:20.525 22:57:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:20.525 22:57:23 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:20.525 22:57:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:20.525 22:57:23 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:20.525 22:57:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:20.525 22:57:23 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:20.525 22:57:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:20.525 22:57:23 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:20.525 22:57:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:20.525 22:57:23 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:20.525 22:57:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:20.525 22:57:23 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:20.525 22:57:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:20.525 22:57:23 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:20.525 22:57:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:20.525 22:57:23 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:20.525 22:57:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:20.525 22:57:23 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:20.525 22:57:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:20.525 22:57:23 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:20.525 22:57:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:20.525 22:57:23 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:20.525 22:57:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:20.525 22:57:23 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:20.526 22:57:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:20.526 22:57:24 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:20.526 22:57:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:20.785 22:57:24 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:20.785 22:57:24 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:05:20.785 22:57:24 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:20.785 22:57:24 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:20.785 22:57:24 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:20.785 22:57:24 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:20.785 22:57:24 -- setup/devices.sh@125 -- # verify 0000:88:00.0 data@nvme0n1 '' '' 00:05:20.785 22:57:24 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:20.785 22:57:24 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:05:20.785 22:57:24 -- setup/devices.sh@50 -- # local mount_point= 00:05:20.785 22:57:24 -- setup/devices.sh@51 -- # local test_file= 00:05:20.785 22:57:24 -- setup/devices.sh@53 -- # local found=0 00:05:20.785 22:57:24 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:05:20.785 22:57:24 -- setup/devices.sh@59 -- # local pci status 00:05:20.785 22:57:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:20.785 22:57:24 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:20.785 22:57:24 -- setup/devices.sh@47 -- # setup output config 00:05:20.785 22:57:24 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:20.785 22:57:24 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:21.725 22:57:25 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:21.726 22:57:25 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:05:21.726 22:57:25 -- setup/devices.sh@63 -- # found=1 00:05:21.726 22:57:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:21.726 22:57:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:21.726 22:57:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:21.726 22:57:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:21.726 22:57:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:21.726 22:57:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:21.726 22:57:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:21.726 22:57:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:21.726 22:57:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:21.726 22:57:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:21.726 22:57:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:21.726 22:57:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:21.726 22:57:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:21.726 22:57:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:21.726 22:57:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:21.726 22:57:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:21.726 22:57:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:21.726 22:57:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:21.726 22:57:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:21.726 22:57:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:21.726 22:57:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:21.726 22:57:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:21.726 22:57:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:21.726 22:57:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:21.726 22:57:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:21.726 22:57:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:21.726 22:57:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:21.726 22:57:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:21.726 22:57:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:21.726 22:57:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:21.726 22:57:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:21.726 22:57:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:21.726 22:57:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:21.986 22:57:25 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:21.986 22:57:25 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:05:21.986 22:57:25 -- setup/devices.sh@68 -- # return 0 00:05:21.986 22:57:25 -- setup/devices.sh@128 -- # cleanup_nvme 00:05:21.986 22:57:25 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:21.986 22:57:25 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:21.986 22:57:25 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:05:21.986 22:57:25 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:05:21.986 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:05:21.986 00:05:21.986 real 0m6.286s 00:05:21.986 user 0m1.450s 00:05:21.986 sys 0m2.391s 00:05:21.986 22:57:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:21.986 22:57:25 -- common/autotest_common.sh@10 -- # set +x 00:05:21.986 ************************************ 00:05:21.986 END TEST nvme_mount 00:05:21.986 ************************************ 00:05:21.986 22:57:25 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:05:21.986 22:57:25 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:21.986 22:57:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:21.986 22:57:25 -- common/autotest_common.sh@10 -- # set +x 00:05:21.986 ************************************ 00:05:21.986 START TEST dm_mount 00:05:21.986 ************************************ 00:05:21.986 22:57:25 -- common/autotest_common.sh@1114 -- # dm_mount 00:05:21.986 22:57:25 -- setup/devices.sh@144 -- # pv=nvme0n1 00:05:21.986 22:57:25 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:05:21.986 22:57:25 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:05:21.986 22:57:25 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:05:21.986 22:57:25 -- setup/common.sh@39 -- # local disk=nvme0n1 00:05:21.986 22:57:25 -- setup/common.sh@40 -- # local part_no=2 00:05:21.986 22:57:25 -- setup/common.sh@41 -- # local size=1073741824 00:05:21.986 22:57:25 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:05:21.986 22:57:25 -- setup/common.sh@44 -- # parts=() 00:05:21.986 22:57:25 -- setup/common.sh@44 -- # local parts 00:05:21.986 22:57:25 -- setup/common.sh@46 -- # (( part = 1 )) 00:05:21.986 22:57:25 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:21.986 22:57:25 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:05:21.986 22:57:25 -- setup/common.sh@46 -- # (( part++ )) 00:05:21.986 22:57:25 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:21.986 22:57:25 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:05:21.986 22:57:25 -- setup/common.sh@46 -- # (( part++ )) 00:05:21.986 22:57:25 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:21.986 22:57:25 -- setup/common.sh@51 -- # (( size /= 512 )) 00:05:21.986 22:57:25 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:05:21.986 22:57:25 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:05:22.923 Creating new GPT entries in memory. 00:05:22.923 GPT data structures destroyed! You may now partition the disk using fdisk or 00:05:22.923 other utilities. 00:05:22.923 22:57:26 -- setup/common.sh@57 -- # (( part = 1 )) 00:05:22.923 22:57:26 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:22.923 22:57:26 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:05:22.923 22:57:26 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:05:22.923 22:57:26 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:05:24.299 Creating new GPT entries in memory. 00:05:24.299 The operation has completed successfully. 00:05:24.299 22:57:27 -- setup/common.sh@57 -- # (( part++ )) 00:05:24.299 22:57:27 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:24.299 22:57:27 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:05:24.299 22:57:27 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:05:24.299 22:57:27 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:05:25.237 The operation has completed successfully. 00:05:25.237 22:57:28 -- setup/common.sh@57 -- # (( part++ )) 00:05:25.237 22:57:28 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:25.237 22:57:28 -- setup/common.sh@62 -- # wait 2317172 00:05:25.237 22:57:28 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:05:25.237 22:57:28 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:25.237 22:57:28 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:25.237 22:57:28 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:05:25.237 22:57:28 -- setup/devices.sh@160 -- # for t in {1..5} 00:05:25.237 22:57:28 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:25.237 22:57:28 -- setup/devices.sh@161 -- # break 00:05:25.237 22:57:28 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:25.237 22:57:28 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:05:25.237 22:57:28 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:05:25.237 22:57:28 -- setup/devices.sh@166 -- # dm=dm-0 00:05:25.237 22:57:28 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:05:25.237 22:57:28 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:05:25.237 22:57:28 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:25.237 22:57:28 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:05:25.237 22:57:28 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:25.237 22:57:28 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:25.237 22:57:28 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:05:25.237 22:57:28 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:25.237 22:57:28 -- setup/devices.sh@174 -- # verify 0000:88:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:25.237 22:57:28 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:25.237 22:57:28 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:05:25.237 22:57:28 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:25.237 22:57:28 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:25.237 22:57:28 -- setup/devices.sh@53 -- # local found=0 00:05:25.237 22:57:28 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:05:25.237 22:57:28 -- setup/devices.sh@56 -- # : 00:05:25.237 22:57:28 -- setup/devices.sh@59 -- # local pci status 00:05:25.237 22:57:28 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:25.237 22:57:28 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:25.237 22:57:28 -- setup/devices.sh@47 -- # setup output config 00:05:25.237 22:57:28 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:25.237 22:57:28 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:26.170 22:57:29 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:26.170 22:57:29 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:05:26.170 22:57:29 -- setup/devices.sh@63 -- # found=1 00:05:26.170 22:57:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:26.170 22:57:29 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:26.170 22:57:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:26.170 22:57:29 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:26.170 22:57:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:26.170 22:57:29 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:26.170 22:57:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:26.170 22:57:29 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:26.170 22:57:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:26.170 22:57:29 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:26.170 22:57:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:26.170 22:57:29 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:26.170 22:57:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:26.170 22:57:29 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:26.170 22:57:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:26.170 22:57:29 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:26.170 22:57:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:26.170 22:57:29 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:26.170 22:57:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:26.170 22:57:29 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:26.170 22:57:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:26.170 22:57:29 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:26.170 22:57:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:26.170 22:57:29 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:26.170 22:57:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:26.170 22:57:29 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:26.170 22:57:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:26.170 22:57:29 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:26.170 22:57:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:26.170 22:57:29 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:26.170 22:57:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:26.170 22:57:29 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:26.170 22:57:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:26.429 22:57:29 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:26.429 22:57:29 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:05:26.429 22:57:29 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:26.429 22:57:29 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:05:26.429 22:57:29 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:26.429 22:57:29 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:26.429 22:57:29 -- setup/devices.sh@184 -- # verify 0000:88:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:05:26.429 22:57:29 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:26.429 22:57:29 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:05:26.429 22:57:29 -- setup/devices.sh@50 -- # local mount_point= 00:05:26.429 22:57:29 -- setup/devices.sh@51 -- # local test_file= 00:05:26.430 22:57:29 -- setup/devices.sh@53 -- # local found=0 00:05:26.430 22:57:29 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:05:26.430 22:57:29 -- setup/devices.sh@59 -- # local pci status 00:05:26.430 22:57:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:26.430 22:57:29 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:26.430 22:57:29 -- setup/devices.sh@47 -- # setup output config 00:05:26.430 22:57:29 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:26.430 22:57:29 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:27.364 22:57:30 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:27.364 22:57:30 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:05:27.364 22:57:30 -- setup/devices.sh@63 -- # found=1 00:05:27.364 22:57:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:27.623 22:57:30 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:27.623 22:57:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:27.623 22:57:30 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:27.623 22:57:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:27.623 22:57:30 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:27.623 22:57:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:27.623 22:57:30 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:27.623 22:57:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:27.623 22:57:30 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:27.623 22:57:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:27.623 22:57:30 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:27.623 22:57:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:27.623 22:57:30 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:27.623 22:57:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:27.623 22:57:30 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:27.623 22:57:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:27.623 22:57:30 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:27.623 22:57:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:27.623 22:57:30 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:27.623 22:57:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:27.623 22:57:30 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:27.623 22:57:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:27.623 22:57:30 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:27.623 22:57:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:27.623 22:57:31 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:27.623 22:57:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:27.623 22:57:31 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:27.623 22:57:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:27.623 22:57:31 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:27.623 22:57:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:27.623 22:57:31 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:27.623 22:57:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:27.623 22:57:31 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:27.623 22:57:31 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:05:27.623 22:57:31 -- setup/devices.sh@68 -- # return 0 00:05:27.623 22:57:31 -- setup/devices.sh@187 -- # cleanup_dm 00:05:27.623 22:57:31 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:27.623 22:57:31 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:05:27.623 22:57:31 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:05:27.882 22:57:31 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:27.882 22:57:31 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:05:27.882 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:05:27.882 22:57:31 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:05:27.882 22:57:31 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:05:27.882 00:05:27.882 real 0m5.764s 00:05:27.882 user 0m0.922s 00:05:27.882 sys 0m1.680s 00:05:27.882 22:57:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:27.882 22:57:31 -- common/autotest_common.sh@10 -- # set +x 00:05:27.882 ************************************ 00:05:27.882 END TEST dm_mount 00:05:27.882 ************************************ 00:05:27.882 22:57:31 -- setup/devices.sh@1 -- # cleanup 00:05:27.882 22:57:31 -- setup/devices.sh@11 -- # cleanup_nvme 00:05:27.882 22:57:31 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:27.882 22:57:31 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:27.882 22:57:31 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:05:27.882 22:57:31 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:05:27.882 22:57:31 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:05:28.141 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:05:28.141 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:05:28.141 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:05:28.141 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:05:28.141 22:57:31 -- setup/devices.sh@12 -- # cleanup_dm 00:05:28.141 22:57:31 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:28.141 22:57:31 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:05:28.141 22:57:31 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:28.141 22:57:31 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:05:28.141 22:57:31 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:05:28.141 22:57:31 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:05:28.141 00:05:28.141 real 0m14.059s 00:05:28.141 user 0m3.092s 00:05:28.141 sys 0m5.130s 00:05:28.141 22:57:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:28.141 22:57:31 -- common/autotest_common.sh@10 -- # set +x 00:05:28.141 ************************************ 00:05:28.141 END TEST devices 00:05:28.141 ************************************ 00:05:28.141 00:05:28.141 real 0m43.710s 00:05:28.141 user 0m12.679s 00:05:28.141 sys 0m19.497s 00:05:28.141 22:57:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:28.141 22:57:31 -- common/autotest_common.sh@10 -- # set +x 00:05:28.141 ************************************ 00:05:28.141 END TEST setup.sh 00:05:28.141 ************************************ 00:05:28.141 22:57:31 -- spdk/autotest.sh@126 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:05:29.075 Hugepages 00:05:29.075 node hugesize free / total 00:05:29.075 node0 1048576kB 0 / 0 00:05:29.075 node0 2048kB 2048 / 2048 00:05:29.075 node1 1048576kB 0 / 0 00:05:29.075 node1 2048kB 0 / 0 00:05:29.075 00:05:29.075 Type BDF Vendor Device NUMA Driver Device Block devices 00:05:29.075 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:05:29.075 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:05:29.075 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:05:29.075 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:05:29.075 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:05:29.075 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:05:29.075 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:05:29.075 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:05:29.075 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:05:29.075 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:05:29.075 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:05:29.075 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:05:29.075 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:05:29.075 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:05:29.075 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:05:29.075 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:05:29.334 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:05:29.334 22:57:32 -- spdk/autotest.sh@128 -- # uname -s 00:05:29.334 22:57:32 -- spdk/autotest.sh@128 -- # [[ Linux == Linux ]] 00:05:29.334 22:57:32 -- spdk/autotest.sh@130 -- # nvme_namespace_revert 00:05:29.334 22:57:32 -- common/autotest_common.sh@1526 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:30.710 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:30.710 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:30.710 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:30.710 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:30.710 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:30.710 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:30.710 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:30.710 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:30.710 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:30.710 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:30.710 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:30.710 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:30.710 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:30.710 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:30.710 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:30.710 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:31.655 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:05:31.655 22:57:35 -- common/autotest_common.sh@1527 -- # sleep 1 00:05:32.626 22:57:36 -- common/autotest_common.sh@1528 -- # bdfs=() 00:05:32.626 22:57:36 -- common/autotest_common.sh@1528 -- # local bdfs 00:05:32.626 22:57:36 -- common/autotest_common.sh@1529 -- # bdfs=($(get_nvme_bdfs)) 00:05:32.626 22:57:36 -- common/autotest_common.sh@1529 -- # get_nvme_bdfs 00:05:32.626 22:57:36 -- common/autotest_common.sh@1508 -- # bdfs=() 00:05:32.626 22:57:36 -- common/autotest_common.sh@1508 -- # local bdfs 00:05:32.626 22:57:36 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:05:32.626 22:57:36 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:05:32.626 22:57:36 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:05:32.884 22:57:36 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:05:32.884 22:57:36 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:05:32.884 22:57:36 -- common/autotest_common.sh@1531 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:05:33.822 Waiting for block devices as requested 00:05:33.822 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:05:34.081 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:05:34.081 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:05:34.341 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:05:34.341 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:05:34.341 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:05:34.341 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:05:34.599 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:05:34.599 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:05:34.599 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:05:34.599 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:05:34.857 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:05:34.857 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:05:34.857 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:05:34.857 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:05:35.116 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:05:35.116 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:05:35.116 22:57:38 -- common/autotest_common.sh@1533 -- # for bdf in "${bdfs[@]}" 00:05:35.116 22:57:38 -- common/autotest_common.sh@1534 -- # get_nvme_ctrlr_from_bdf 0000:88:00.0 00:05:35.116 22:57:38 -- common/autotest_common.sh@1497 -- # readlink -f /sys/class/nvme/nvme0 00:05:35.116 22:57:38 -- common/autotest_common.sh@1497 -- # grep 0000:88:00.0/nvme/nvme 00:05:35.116 22:57:38 -- common/autotest_common.sh@1497 -- # bdf_sysfs_path=/sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:05:35.116 22:57:38 -- common/autotest_common.sh@1498 -- # [[ -z /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 ]] 00:05:35.116 22:57:38 -- common/autotest_common.sh@1502 -- # basename /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:05:35.116 22:57:38 -- common/autotest_common.sh@1502 -- # printf '%s\n' nvme0 00:05:35.116 22:57:38 -- common/autotest_common.sh@1534 -- # nvme_ctrlr=/dev/nvme0 00:05:35.116 22:57:38 -- common/autotest_common.sh@1535 -- # [[ -z /dev/nvme0 ]] 00:05:35.116 22:57:38 -- common/autotest_common.sh@1540 -- # nvme id-ctrl /dev/nvme0 00:05:35.116 22:57:38 -- common/autotest_common.sh@1540 -- # grep oacs 00:05:35.116 22:57:38 -- common/autotest_common.sh@1540 -- # cut -d: -f2 00:05:35.116 22:57:38 -- common/autotest_common.sh@1540 -- # oacs=' 0xf' 00:05:35.116 22:57:38 -- common/autotest_common.sh@1541 -- # oacs_ns_manage=8 00:05:35.116 22:57:38 -- common/autotest_common.sh@1543 -- # [[ 8 -ne 0 ]] 00:05:35.116 22:57:38 -- common/autotest_common.sh@1549 -- # nvme id-ctrl /dev/nvme0 00:05:35.116 22:57:38 -- common/autotest_common.sh@1549 -- # grep unvmcap 00:05:35.116 22:57:38 -- common/autotest_common.sh@1549 -- # cut -d: -f2 00:05:35.375 22:57:38 -- common/autotest_common.sh@1549 -- # unvmcap=' 0' 00:05:35.375 22:57:38 -- common/autotest_common.sh@1550 -- # [[ 0 -eq 0 ]] 00:05:35.375 22:57:38 -- common/autotest_common.sh@1552 -- # continue 00:05:35.375 22:57:38 -- spdk/autotest.sh@133 -- # timing_exit pre_cleanup 00:05:35.375 22:57:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:35.375 22:57:38 -- common/autotest_common.sh@10 -- # set +x 00:05:35.375 22:57:38 -- spdk/autotest.sh@136 -- # timing_enter afterboot 00:05:35.375 22:57:38 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:35.375 22:57:38 -- common/autotest_common.sh@10 -- # set +x 00:05:35.375 22:57:38 -- spdk/autotest.sh@137 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:36.752 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:36.752 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:36.752 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:36.752 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:36.752 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:36.752 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:36.752 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:36.752 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:36.752 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:36.752 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:36.752 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:36.752 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:36.752 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:36.752 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:36.752 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:36.752 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:37.687 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:05:37.687 22:57:41 -- spdk/autotest.sh@138 -- # timing_exit afterboot 00:05:37.687 22:57:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:37.687 22:57:41 -- common/autotest_common.sh@10 -- # set +x 00:05:37.687 22:57:41 -- spdk/autotest.sh@142 -- # opal_revert_cleanup 00:05:37.687 22:57:41 -- common/autotest_common.sh@1586 -- # mapfile -t bdfs 00:05:37.687 22:57:41 -- common/autotest_common.sh@1586 -- # get_nvme_bdfs_by_id 0x0a54 00:05:37.687 22:57:41 -- common/autotest_common.sh@1572 -- # bdfs=() 00:05:37.687 22:57:41 -- common/autotest_common.sh@1572 -- # local bdfs 00:05:37.687 22:57:41 -- common/autotest_common.sh@1574 -- # get_nvme_bdfs 00:05:37.687 22:57:41 -- common/autotest_common.sh@1508 -- # bdfs=() 00:05:37.687 22:57:41 -- common/autotest_common.sh@1508 -- # local bdfs 00:05:37.687 22:57:41 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:05:37.687 22:57:41 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:05:37.687 22:57:41 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:05:37.687 22:57:41 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:05:37.687 22:57:41 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:05:37.687 22:57:41 -- common/autotest_common.sh@1574 -- # for bdf in $(get_nvme_bdfs) 00:05:37.687 22:57:41 -- common/autotest_common.sh@1575 -- # cat /sys/bus/pci/devices/0000:88:00.0/device 00:05:37.687 22:57:41 -- common/autotest_common.sh@1575 -- # device=0x0a54 00:05:37.687 22:57:41 -- common/autotest_common.sh@1576 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:05:37.687 22:57:41 -- common/autotest_common.sh@1577 -- # bdfs+=($bdf) 00:05:37.687 22:57:41 -- common/autotest_common.sh@1581 -- # printf '%s\n' 0000:88:00.0 00:05:37.687 22:57:41 -- common/autotest_common.sh@1587 -- # [[ -z 0000:88:00.0 ]] 00:05:37.687 22:57:41 -- common/autotest_common.sh@1592 -- # spdk_tgt_pid=2322479 00:05:37.687 22:57:41 -- common/autotest_common.sh@1591 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:37.687 22:57:41 -- common/autotest_common.sh@1593 -- # waitforlisten 2322479 00:05:37.687 22:57:41 -- common/autotest_common.sh@829 -- # '[' -z 2322479 ']' 00:05:37.687 22:57:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:37.687 22:57:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:37.687 22:57:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:37.687 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:37.687 22:57:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:37.687 22:57:41 -- common/autotest_common.sh@10 -- # set +x 00:05:37.946 [2024-11-28 22:57:41.298287] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:37.946 [2024-11-28 22:57:41.298376] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2322479 ] 00:05:37.946 EAL: No free 2048 kB hugepages reported on node 1 00:05:37.946 [2024-11-28 22:57:41.356768] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:37.946 [2024-11-28 22:57:41.442107] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:37.946 [2024-11-28 22:57:41.442268] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:38.880 22:57:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:38.880 22:57:42 -- common/autotest_common.sh@862 -- # return 0 00:05:38.880 22:57:42 -- common/autotest_common.sh@1595 -- # bdf_id=0 00:05:38.880 22:57:42 -- common/autotest_common.sh@1596 -- # for bdf in "${bdfs[@]}" 00:05:38.880 22:57:42 -- common/autotest_common.sh@1597 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:88:00.0 00:05:42.163 nvme0n1 00:05:42.163 22:57:45 -- common/autotest_common.sh@1599 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:05:42.163 [2024-11-28 22:57:45.574434] nvme_opal.c:2059:spdk_opal_cmd_revert_tper: *ERROR*: Error on starting admin SP session with error 18 00:05:42.163 [2024-11-28 22:57:45.574476] vbdev_opal_rpc.c: 134:rpc_bdev_nvme_opal_revert: *ERROR*: Revert TPer failure: 18 00:05:42.163 request: 00:05:42.163 { 00:05:42.163 "nvme_ctrlr_name": "nvme0", 00:05:42.163 "password": "test", 00:05:42.163 "method": "bdev_nvme_opal_revert", 00:05:42.163 "req_id": 1 00:05:42.163 } 00:05:42.163 Got JSON-RPC error response 00:05:42.163 response: 00:05:42.163 { 00:05:42.163 "code": -32603, 00:05:42.163 "message": "Internal error" 00:05:42.163 } 00:05:42.163 22:57:45 -- common/autotest_common.sh@1599 -- # true 00:05:42.163 22:57:45 -- common/autotest_common.sh@1600 -- # (( ++bdf_id )) 00:05:42.164 22:57:45 -- common/autotest_common.sh@1603 -- # killprocess 2322479 00:05:42.164 22:57:45 -- common/autotest_common.sh@936 -- # '[' -z 2322479 ']' 00:05:42.164 22:57:45 -- common/autotest_common.sh@940 -- # kill -0 2322479 00:05:42.164 22:57:45 -- common/autotest_common.sh@941 -- # uname 00:05:42.164 22:57:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:42.164 22:57:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2322479 00:05:42.164 22:57:45 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:42.164 22:57:45 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:42.164 22:57:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2322479' 00:05:42.164 killing process with pid 2322479 00:05:42.164 22:57:45 -- common/autotest_common.sh@955 -- # kill 2322479 00:05:42.164 22:57:45 -- common/autotest_common.sh@960 -- # wait 2322479 00:05:44.064 22:57:47 -- spdk/autotest.sh@148 -- # '[' 0 -eq 1 ']' 00:05:44.064 22:57:47 -- spdk/autotest.sh@152 -- # '[' 1 -eq 1 ']' 00:05:44.064 22:57:47 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:05:44.064 22:57:47 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:05:44.064 22:57:47 -- spdk/autotest.sh@160 -- # timing_enter lib 00:05:44.064 22:57:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:44.064 22:57:47 -- common/autotest_common.sh@10 -- # set +x 00:05:44.064 22:57:47 -- spdk/autotest.sh@162 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:05:44.064 22:57:47 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:44.064 22:57:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:44.064 22:57:47 -- common/autotest_common.sh@10 -- # set +x 00:05:44.064 ************************************ 00:05:44.064 START TEST env 00:05:44.064 ************************************ 00:05:44.064 22:57:47 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:05:44.064 * Looking for test storage... 00:05:44.064 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:05:44.064 22:57:47 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:44.064 22:57:47 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:44.064 22:57:47 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:44.064 22:57:47 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:44.064 22:57:47 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:44.064 22:57:47 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:44.064 22:57:47 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:44.064 22:57:47 -- scripts/common.sh@335 -- # IFS=.-: 00:05:44.064 22:57:47 -- scripts/common.sh@335 -- # read -ra ver1 00:05:44.064 22:57:47 -- scripts/common.sh@336 -- # IFS=.-: 00:05:44.065 22:57:47 -- scripts/common.sh@336 -- # read -ra ver2 00:05:44.065 22:57:47 -- scripts/common.sh@337 -- # local 'op=<' 00:05:44.065 22:57:47 -- scripts/common.sh@339 -- # ver1_l=2 00:05:44.065 22:57:47 -- scripts/common.sh@340 -- # ver2_l=1 00:05:44.065 22:57:47 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:44.065 22:57:47 -- scripts/common.sh@343 -- # case "$op" in 00:05:44.065 22:57:47 -- scripts/common.sh@344 -- # : 1 00:05:44.065 22:57:47 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:44.065 22:57:47 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:44.065 22:57:47 -- scripts/common.sh@364 -- # decimal 1 00:05:44.065 22:57:47 -- scripts/common.sh@352 -- # local d=1 00:05:44.065 22:57:47 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:44.065 22:57:47 -- scripts/common.sh@354 -- # echo 1 00:05:44.065 22:57:47 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:44.065 22:57:47 -- scripts/common.sh@365 -- # decimal 2 00:05:44.065 22:57:47 -- scripts/common.sh@352 -- # local d=2 00:05:44.065 22:57:47 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:44.065 22:57:47 -- scripts/common.sh@354 -- # echo 2 00:05:44.065 22:57:47 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:44.065 22:57:47 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:44.065 22:57:47 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:44.065 22:57:47 -- scripts/common.sh@367 -- # return 0 00:05:44.065 22:57:47 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:44.065 22:57:47 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:44.065 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:44.065 --rc genhtml_branch_coverage=1 00:05:44.065 --rc genhtml_function_coverage=1 00:05:44.065 --rc genhtml_legend=1 00:05:44.065 --rc geninfo_all_blocks=1 00:05:44.065 --rc geninfo_unexecuted_blocks=1 00:05:44.065 00:05:44.065 ' 00:05:44.065 22:57:47 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:44.065 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:44.065 --rc genhtml_branch_coverage=1 00:05:44.065 --rc genhtml_function_coverage=1 00:05:44.065 --rc genhtml_legend=1 00:05:44.065 --rc geninfo_all_blocks=1 00:05:44.065 --rc geninfo_unexecuted_blocks=1 00:05:44.065 00:05:44.065 ' 00:05:44.065 22:57:47 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:44.065 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:44.065 --rc genhtml_branch_coverage=1 00:05:44.065 --rc genhtml_function_coverage=1 00:05:44.065 --rc genhtml_legend=1 00:05:44.065 --rc geninfo_all_blocks=1 00:05:44.065 --rc geninfo_unexecuted_blocks=1 00:05:44.065 00:05:44.065 ' 00:05:44.065 22:57:47 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:44.065 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:44.065 --rc genhtml_branch_coverage=1 00:05:44.065 --rc genhtml_function_coverage=1 00:05:44.065 --rc genhtml_legend=1 00:05:44.065 --rc geninfo_all_blocks=1 00:05:44.065 --rc geninfo_unexecuted_blocks=1 00:05:44.065 00:05:44.065 ' 00:05:44.065 22:57:47 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:05:44.065 22:57:47 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:44.065 22:57:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:44.065 22:57:47 -- common/autotest_common.sh@10 -- # set +x 00:05:44.065 ************************************ 00:05:44.065 START TEST env_memory 00:05:44.065 ************************************ 00:05:44.065 22:57:47 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:05:44.065 00:05:44.065 00:05:44.065 CUnit - A unit testing framework for C - Version 2.1-3 00:05:44.065 http://cunit.sourceforge.net/ 00:05:44.065 00:05:44.065 00:05:44.065 Suite: memory 00:05:44.065 Test: alloc and free memory map ...[2024-11-28 22:57:47.552584] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:05:44.065 passed 00:05:44.065 Test: mem map translation ...[2024-11-28 22:57:47.572807] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:05:44.065 [2024-11-28 22:57:47.572829] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:05:44.065 [2024-11-28 22:57:47.572878] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:05:44.065 [2024-11-28 22:57:47.572891] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:05:44.065 passed 00:05:44.065 Test: mem map registration ...[2024-11-28 22:57:47.613627] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:05:44.065 [2024-11-28 22:57:47.613647] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:05:44.065 passed 00:05:44.065 Test: mem map adjacent registrations ...passed 00:05:44.065 00:05:44.065 Run Summary: Type Total Ran Passed Failed Inactive 00:05:44.065 suites 1 1 n/a 0 0 00:05:44.065 tests 4 4 4 0 0 00:05:44.065 asserts 152 152 152 0 n/a 00:05:44.065 00:05:44.065 Elapsed time = 0.143 seconds 00:05:44.324 00:05:44.324 real 0m0.152s 00:05:44.324 user 0m0.144s 00:05:44.324 sys 0m0.007s 00:05:44.324 22:57:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:44.324 22:57:47 -- common/autotest_common.sh@10 -- # set +x 00:05:44.324 ************************************ 00:05:44.324 END TEST env_memory 00:05:44.324 ************************************ 00:05:44.324 22:57:47 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:44.324 22:57:47 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:44.324 22:57:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:44.324 22:57:47 -- common/autotest_common.sh@10 -- # set +x 00:05:44.324 ************************************ 00:05:44.324 START TEST env_vtophys 00:05:44.324 ************************************ 00:05:44.324 22:57:47 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:44.324 EAL: lib.eal log level changed from notice to debug 00:05:44.324 EAL: Detected lcore 0 as core 0 on socket 0 00:05:44.324 EAL: Detected lcore 1 as core 1 on socket 0 00:05:44.324 EAL: Detected lcore 2 as core 2 on socket 0 00:05:44.324 EAL: Detected lcore 3 as core 3 on socket 0 00:05:44.324 EAL: Detected lcore 4 as core 4 on socket 0 00:05:44.324 EAL: Detected lcore 5 as core 5 on socket 0 00:05:44.324 EAL: Detected lcore 6 as core 8 on socket 0 00:05:44.324 EAL: Detected lcore 7 as core 9 on socket 0 00:05:44.324 EAL: Detected lcore 8 as core 10 on socket 0 00:05:44.324 EAL: Detected lcore 9 as core 11 on socket 0 00:05:44.324 EAL: Detected lcore 10 as core 12 on socket 0 00:05:44.324 EAL: Detected lcore 11 as core 13 on socket 0 00:05:44.324 EAL: Detected lcore 12 as core 0 on socket 1 00:05:44.324 EAL: Detected lcore 13 as core 1 on socket 1 00:05:44.324 EAL: Detected lcore 14 as core 2 on socket 1 00:05:44.324 EAL: Detected lcore 15 as core 3 on socket 1 00:05:44.324 EAL: Detected lcore 16 as core 4 on socket 1 00:05:44.324 EAL: Detected lcore 17 as core 5 on socket 1 00:05:44.324 EAL: Detected lcore 18 as core 8 on socket 1 00:05:44.324 EAL: Detected lcore 19 as core 9 on socket 1 00:05:44.324 EAL: Detected lcore 20 as core 10 on socket 1 00:05:44.324 EAL: Detected lcore 21 as core 11 on socket 1 00:05:44.324 EAL: Detected lcore 22 as core 12 on socket 1 00:05:44.324 EAL: Detected lcore 23 as core 13 on socket 1 00:05:44.324 EAL: Detected lcore 24 as core 0 on socket 0 00:05:44.324 EAL: Detected lcore 25 as core 1 on socket 0 00:05:44.324 EAL: Detected lcore 26 as core 2 on socket 0 00:05:44.324 EAL: Detected lcore 27 as core 3 on socket 0 00:05:44.324 EAL: Detected lcore 28 as core 4 on socket 0 00:05:44.324 EAL: Detected lcore 29 as core 5 on socket 0 00:05:44.324 EAL: Detected lcore 30 as core 8 on socket 0 00:05:44.324 EAL: Detected lcore 31 as core 9 on socket 0 00:05:44.324 EAL: Detected lcore 32 as core 10 on socket 0 00:05:44.324 EAL: Detected lcore 33 as core 11 on socket 0 00:05:44.324 EAL: Detected lcore 34 as core 12 on socket 0 00:05:44.324 EAL: Detected lcore 35 as core 13 on socket 0 00:05:44.324 EAL: Detected lcore 36 as core 0 on socket 1 00:05:44.324 EAL: Detected lcore 37 as core 1 on socket 1 00:05:44.324 EAL: Detected lcore 38 as core 2 on socket 1 00:05:44.324 EAL: Detected lcore 39 as core 3 on socket 1 00:05:44.324 EAL: Detected lcore 40 as core 4 on socket 1 00:05:44.324 EAL: Detected lcore 41 as core 5 on socket 1 00:05:44.324 EAL: Detected lcore 42 as core 8 on socket 1 00:05:44.324 EAL: Detected lcore 43 as core 9 on socket 1 00:05:44.324 EAL: Detected lcore 44 as core 10 on socket 1 00:05:44.324 EAL: Detected lcore 45 as core 11 on socket 1 00:05:44.324 EAL: Detected lcore 46 as core 12 on socket 1 00:05:44.324 EAL: Detected lcore 47 as core 13 on socket 1 00:05:44.324 EAL: Maximum logical cores by configuration: 128 00:05:44.324 EAL: Detected CPU lcores: 48 00:05:44.324 EAL: Detected NUMA nodes: 2 00:05:44.324 EAL: Checking presence of .so 'librte_eal.so.24.0' 00:05:44.324 EAL: Detected shared linkage of DPDK 00:05:44.324 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_pci.so.24.0 00:05:44.324 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_vdev.so.24.0 00:05:44.324 EAL: Registered [vdev] bus. 00:05:44.324 EAL: bus.vdev log level changed from disabled to notice 00:05:44.324 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_mempool_ring.so.24.0 00:05:44.324 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_net_i40e.so.24.0 00:05:44.324 EAL: pmd.net.i40e.init log level changed from disabled to notice 00:05:44.324 EAL: pmd.net.i40e.driver log level changed from disabled to notice 00:05:44.324 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_pci.so 00:05:44.324 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_vdev.so 00:05:44.324 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_mempool_ring.so 00:05:44.324 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_net_i40e.so 00:05:44.324 EAL: No shared files mode enabled, IPC will be disabled 00:05:44.324 EAL: No shared files mode enabled, IPC is disabled 00:05:44.324 EAL: Bus pci wants IOVA as 'DC' 00:05:44.324 EAL: Bus vdev wants IOVA as 'DC' 00:05:44.324 EAL: Buses did not request a specific IOVA mode. 00:05:44.324 EAL: IOMMU is available, selecting IOVA as VA mode. 00:05:44.324 EAL: Selected IOVA mode 'VA' 00:05:44.324 EAL: No free 2048 kB hugepages reported on node 1 00:05:44.324 EAL: Probing VFIO support... 00:05:44.324 EAL: IOMMU type 1 (Type 1) is supported 00:05:44.324 EAL: IOMMU type 7 (sPAPR) is not supported 00:05:44.324 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:05:44.324 EAL: VFIO support initialized 00:05:44.324 EAL: Ask a virtual area of 0x2e000 bytes 00:05:44.324 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:05:44.324 EAL: Setting up physically contiguous memory... 00:05:44.324 EAL: Setting maximum number of open files to 524288 00:05:44.324 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:05:44.324 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:05:44.324 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:05:44.324 EAL: Ask a virtual area of 0x61000 bytes 00:05:44.324 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:05:44.324 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:44.324 EAL: Ask a virtual area of 0x400000000 bytes 00:05:44.324 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:05:44.324 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:05:44.324 EAL: Ask a virtual area of 0x61000 bytes 00:05:44.324 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:05:44.324 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:44.324 EAL: Ask a virtual area of 0x400000000 bytes 00:05:44.324 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:05:44.324 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:05:44.324 EAL: Ask a virtual area of 0x61000 bytes 00:05:44.324 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:05:44.324 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:44.324 EAL: Ask a virtual area of 0x400000000 bytes 00:05:44.324 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:05:44.324 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:05:44.324 EAL: Ask a virtual area of 0x61000 bytes 00:05:44.324 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:05:44.324 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:44.324 EAL: Ask a virtual area of 0x400000000 bytes 00:05:44.324 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:05:44.324 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:05:44.324 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:05:44.324 EAL: Ask a virtual area of 0x61000 bytes 00:05:44.324 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:05:44.324 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:44.324 EAL: Ask a virtual area of 0x400000000 bytes 00:05:44.324 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:05:44.324 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:05:44.324 EAL: Ask a virtual area of 0x61000 bytes 00:05:44.324 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:05:44.324 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:44.324 EAL: Ask a virtual area of 0x400000000 bytes 00:05:44.324 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:05:44.324 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:05:44.324 EAL: Ask a virtual area of 0x61000 bytes 00:05:44.324 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:05:44.324 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:44.324 EAL: Ask a virtual area of 0x400000000 bytes 00:05:44.324 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:05:44.324 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:05:44.324 EAL: Ask a virtual area of 0x61000 bytes 00:05:44.324 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:05:44.324 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:44.324 EAL: Ask a virtual area of 0x400000000 bytes 00:05:44.324 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:05:44.324 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:05:44.324 EAL: Hugepages will be freed exactly as allocated. 00:05:44.324 EAL: No shared files mode enabled, IPC is disabled 00:05:44.324 EAL: No shared files mode enabled, IPC is disabled 00:05:44.324 EAL: TSC frequency is ~2700000 KHz 00:05:44.324 EAL: Main lcore 0 is ready (tid=7f119fb03a00;cpuset=[0]) 00:05:44.324 EAL: Trying to obtain current memory policy. 00:05:44.324 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:44.324 EAL: Restoring previous memory policy: 0 00:05:44.324 EAL: request: mp_malloc_sync 00:05:44.324 EAL: No shared files mode enabled, IPC is disabled 00:05:44.324 EAL: Heap on socket 0 was expanded by 2MB 00:05:44.324 EAL: No shared files mode enabled, IPC is disabled 00:05:44.324 EAL: No shared files mode enabled, IPC is disabled 00:05:44.324 EAL: No PCI address specified using 'addr=' in: bus=pci 00:05:44.324 EAL: Mem event callback 'spdk:(nil)' registered 00:05:44.324 00:05:44.324 00:05:44.324 CUnit - A unit testing framework for C - Version 2.1-3 00:05:44.324 http://cunit.sourceforge.net/ 00:05:44.324 00:05:44.324 00:05:44.324 Suite: components_suite 00:05:44.324 Test: vtophys_malloc_test ...passed 00:05:44.324 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:05:44.324 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:44.324 EAL: Restoring previous memory policy: 4 00:05:44.325 EAL: Calling mem event callback 'spdk:(nil)' 00:05:44.325 EAL: request: mp_malloc_sync 00:05:44.325 EAL: No shared files mode enabled, IPC is disabled 00:05:44.325 EAL: Heap on socket 0 was expanded by 4MB 00:05:44.325 EAL: Calling mem event callback 'spdk:(nil)' 00:05:44.325 EAL: request: mp_malloc_sync 00:05:44.325 EAL: No shared files mode enabled, IPC is disabled 00:05:44.325 EAL: Heap on socket 0 was shrunk by 4MB 00:05:44.325 EAL: Trying to obtain current memory policy. 00:05:44.325 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:44.325 EAL: Restoring previous memory policy: 4 00:05:44.325 EAL: Calling mem event callback 'spdk:(nil)' 00:05:44.325 EAL: request: mp_malloc_sync 00:05:44.325 EAL: No shared files mode enabled, IPC is disabled 00:05:44.325 EAL: Heap on socket 0 was expanded by 6MB 00:05:44.325 EAL: Calling mem event callback 'spdk:(nil)' 00:05:44.325 EAL: request: mp_malloc_sync 00:05:44.325 EAL: No shared files mode enabled, IPC is disabled 00:05:44.325 EAL: Heap on socket 0 was shrunk by 6MB 00:05:44.325 EAL: Trying to obtain current memory policy. 00:05:44.325 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:44.325 EAL: Restoring previous memory policy: 4 00:05:44.325 EAL: Calling mem event callback 'spdk:(nil)' 00:05:44.325 EAL: request: mp_malloc_sync 00:05:44.325 EAL: No shared files mode enabled, IPC is disabled 00:05:44.325 EAL: Heap on socket 0 was expanded by 10MB 00:05:44.325 EAL: Calling mem event callback 'spdk:(nil)' 00:05:44.325 EAL: request: mp_malloc_sync 00:05:44.325 EAL: No shared files mode enabled, IPC is disabled 00:05:44.325 EAL: Heap on socket 0 was shrunk by 10MB 00:05:44.325 EAL: Trying to obtain current memory policy. 00:05:44.325 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:44.325 EAL: Restoring previous memory policy: 4 00:05:44.325 EAL: Calling mem event callback 'spdk:(nil)' 00:05:44.325 EAL: request: mp_malloc_sync 00:05:44.325 EAL: No shared files mode enabled, IPC is disabled 00:05:44.325 EAL: Heap on socket 0 was expanded by 18MB 00:05:44.325 EAL: Calling mem event callback 'spdk:(nil)' 00:05:44.325 EAL: request: mp_malloc_sync 00:05:44.325 EAL: No shared files mode enabled, IPC is disabled 00:05:44.325 EAL: Heap on socket 0 was shrunk by 18MB 00:05:44.325 EAL: Trying to obtain current memory policy. 00:05:44.325 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:44.325 EAL: Restoring previous memory policy: 4 00:05:44.325 EAL: Calling mem event callback 'spdk:(nil)' 00:05:44.325 EAL: request: mp_malloc_sync 00:05:44.325 EAL: No shared files mode enabled, IPC is disabled 00:05:44.325 EAL: Heap on socket 0 was expanded by 34MB 00:05:44.325 EAL: Calling mem event callback 'spdk:(nil)' 00:05:44.325 EAL: request: mp_malloc_sync 00:05:44.325 EAL: No shared files mode enabled, IPC is disabled 00:05:44.325 EAL: Heap on socket 0 was shrunk by 34MB 00:05:44.325 EAL: Trying to obtain current memory policy. 00:05:44.325 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:44.325 EAL: Restoring previous memory policy: 4 00:05:44.325 EAL: Calling mem event callback 'spdk:(nil)' 00:05:44.325 EAL: request: mp_malloc_sync 00:05:44.325 EAL: No shared files mode enabled, IPC is disabled 00:05:44.325 EAL: Heap on socket 0 was expanded by 66MB 00:05:44.325 EAL: Calling mem event callback 'spdk:(nil)' 00:05:44.325 EAL: request: mp_malloc_sync 00:05:44.325 EAL: No shared files mode enabled, IPC is disabled 00:05:44.325 EAL: Heap on socket 0 was shrunk by 66MB 00:05:44.325 EAL: Trying to obtain current memory policy. 00:05:44.325 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:44.325 EAL: Restoring previous memory policy: 4 00:05:44.325 EAL: Calling mem event callback 'spdk:(nil)' 00:05:44.325 EAL: request: mp_malloc_sync 00:05:44.325 EAL: No shared files mode enabled, IPC is disabled 00:05:44.325 EAL: Heap on socket 0 was expanded by 130MB 00:05:44.325 EAL: Calling mem event callback 'spdk:(nil)' 00:05:44.325 EAL: request: mp_malloc_sync 00:05:44.325 EAL: No shared files mode enabled, IPC is disabled 00:05:44.325 EAL: Heap on socket 0 was shrunk by 130MB 00:05:44.325 EAL: Trying to obtain current memory policy. 00:05:44.325 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:44.583 EAL: Restoring previous memory policy: 4 00:05:44.583 EAL: Calling mem event callback 'spdk:(nil)' 00:05:44.583 EAL: request: mp_malloc_sync 00:05:44.583 EAL: No shared files mode enabled, IPC is disabled 00:05:44.583 EAL: Heap on socket 0 was expanded by 258MB 00:05:44.583 EAL: Calling mem event callback 'spdk:(nil)' 00:05:44.583 EAL: request: mp_malloc_sync 00:05:44.583 EAL: No shared files mode enabled, IPC is disabled 00:05:44.583 EAL: Heap on socket 0 was shrunk by 258MB 00:05:44.583 EAL: Trying to obtain current memory policy. 00:05:44.583 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:44.841 EAL: Restoring previous memory policy: 4 00:05:44.841 EAL: Calling mem event callback 'spdk:(nil)' 00:05:44.841 EAL: request: mp_malloc_sync 00:05:44.841 EAL: No shared files mode enabled, IPC is disabled 00:05:44.841 EAL: Heap on socket 0 was expanded by 514MB 00:05:44.841 EAL: Calling mem event callback 'spdk:(nil)' 00:05:45.099 EAL: request: mp_malloc_sync 00:05:45.099 EAL: No shared files mode enabled, IPC is disabled 00:05:45.099 EAL: Heap on socket 0 was shrunk by 514MB 00:05:45.099 EAL: Trying to obtain current memory policy. 00:05:45.099 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:45.356 EAL: Restoring previous memory policy: 4 00:05:45.356 EAL: Calling mem event callback 'spdk:(nil)' 00:05:45.356 EAL: request: mp_malloc_sync 00:05:45.356 EAL: No shared files mode enabled, IPC is disabled 00:05:45.356 EAL: Heap on socket 0 was expanded by 1026MB 00:05:45.615 EAL: Calling mem event callback 'spdk:(nil)' 00:05:45.615 EAL: request: mp_malloc_sync 00:05:45.615 EAL: No shared files mode enabled, IPC is disabled 00:05:45.615 EAL: Heap on socket 0 was shrunk by 1026MB 00:05:45.615 passed 00:05:45.615 00:05:45.615 Run Summary: Type Total Ran Passed Failed Inactive 00:05:45.615 suites 1 1 n/a 0 0 00:05:45.615 tests 2 2 2 0 0 00:05:45.616 asserts 497 497 497 0 n/a 00:05:45.616 00:05:45.616 Elapsed time = 1.371 seconds 00:05:45.616 EAL: Calling mem event callback 'spdk:(nil)' 00:05:45.616 EAL: request: mp_malloc_sync 00:05:45.616 EAL: No shared files mode enabled, IPC is disabled 00:05:45.616 EAL: Heap on socket 0 was shrunk by 2MB 00:05:45.616 EAL: No shared files mode enabled, IPC is disabled 00:05:45.616 EAL: No shared files mode enabled, IPC is disabled 00:05:45.616 EAL: No shared files mode enabled, IPC is disabled 00:05:45.616 00:05:45.616 real 0m1.485s 00:05:45.616 user 0m0.856s 00:05:45.616 sys 0m0.600s 00:05:45.616 22:57:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:45.616 22:57:49 -- common/autotest_common.sh@10 -- # set +x 00:05:45.616 ************************************ 00:05:45.616 END TEST env_vtophys 00:05:45.616 ************************************ 00:05:45.616 22:57:49 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:05:45.616 22:57:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:45.616 22:57:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:45.616 22:57:49 -- common/autotest_common.sh@10 -- # set +x 00:05:45.616 ************************************ 00:05:45.616 START TEST env_pci 00:05:45.616 ************************************ 00:05:45.616 22:57:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:05:45.616 00:05:45.616 00:05:45.616 CUnit - A unit testing framework for C - Version 2.1-3 00:05:45.616 http://cunit.sourceforge.net/ 00:05:45.616 00:05:45.616 00:05:45.616 Suite: pci 00:05:45.616 Test: pci_hook ...[2024-11-28 22:57:49.220940] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 2323525 has claimed it 00:05:45.875 EAL: Cannot find device (10000:00:01.0) 00:05:45.875 EAL: Failed to attach device on primary process 00:05:45.875 passed 00:05:45.875 00:05:45.875 Run Summary: Type Total Ran Passed Failed Inactive 00:05:45.875 suites 1 1 n/a 0 0 00:05:45.875 tests 1 1 1 0 0 00:05:45.875 asserts 25 25 25 0 n/a 00:05:45.875 00:05:45.875 Elapsed time = 0.021 seconds 00:05:45.875 00:05:45.875 real 0m0.035s 00:05:45.875 user 0m0.013s 00:05:45.875 sys 0m0.021s 00:05:45.875 22:57:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:45.875 22:57:49 -- common/autotest_common.sh@10 -- # set +x 00:05:45.875 ************************************ 00:05:45.875 END TEST env_pci 00:05:45.875 ************************************ 00:05:45.875 22:57:49 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:05:45.875 22:57:49 -- env/env.sh@15 -- # uname 00:05:45.875 22:57:49 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:05:45.875 22:57:49 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:05:45.875 22:57:49 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:45.875 22:57:49 -- common/autotest_common.sh@1087 -- # '[' 5 -le 1 ']' 00:05:45.875 22:57:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:45.875 22:57:49 -- common/autotest_common.sh@10 -- # set +x 00:05:45.875 ************************************ 00:05:45.875 START TEST env_dpdk_post_init 00:05:45.875 ************************************ 00:05:45.875 22:57:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:45.875 EAL: Detected CPU lcores: 48 00:05:45.875 EAL: Detected NUMA nodes: 2 00:05:45.875 EAL: Detected shared linkage of DPDK 00:05:45.875 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:45.875 EAL: Selected IOVA mode 'VA' 00:05:45.875 EAL: No free 2048 kB hugepages reported on node 1 00:05:45.875 EAL: VFIO support initialized 00:05:45.875 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:45.875 EAL: Using IOMMU type 1 (Type 1) 00:05:45.875 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:00:04.0 (socket 0) 00:05:45.875 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:00:04.1 (socket 0) 00:05:45.875 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:00:04.2 (socket 0) 00:05:45.875 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:00:04.3 (socket 0) 00:05:45.875 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:00:04.4 (socket 0) 00:05:45.875 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:00:04.5 (socket 0) 00:05:45.875 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:00:04.6 (socket 0) 00:05:45.875 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:00:04.7 (socket 0) 00:05:46.134 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:80:04.0 (socket 1) 00:05:46.134 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:80:04.1 (socket 1) 00:05:46.134 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:80:04.2 (socket 1) 00:05:46.135 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:80:04.3 (socket 1) 00:05:46.135 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:80:04.4 (socket 1) 00:05:46.135 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:80:04.5 (socket 1) 00:05:46.135 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:80:04.6 (socket 1) 00:05:46.135 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:80:04.7 (socket 1) 00:05:47.072 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:88:00.0 (socket 1) 00:05:50.354 EAL: Releasing PCI mapped resource for 0000:88:00.0 00:05:50.354 EAL: Calling pci_unmap_resource for 0000:88:00.0 at 0x202001040000 00:05:50.354 Starting DPDK initialization... 00:05:50.354 Starting SPDK post initialization... 00:05:50.354 SPDK NVMe probe 00:05:50.354 Attaching to 0000:88:00.0 00:05:50.354 Attached to 0000:88:00.0 00:05:50.354 Cleaning up... 00:05:50.354 00:05:50.354 real 0m4.408s 00:05:50.354 user 0m3.275s 00:05:50.354 sys 0m0.189s 00:05:50.354 22:57:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:50.354 22:57:53 -- common/autotest_common.sh@10 -- # set +x 00:05:50.354 ************************************ 00:05:50.354 END TEST env_dpdk_post_init 00:05:50.354 ************************************ 00:05:50.354 22:57:53 -- env/env.sh@26 -- # uname 00:05:50.354 22:57:53 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:05:50.354 22:57:53 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:50.354 22:57:53 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:50.354 22:57:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:50.354 22:57:53 -- common/autotest_common.sh@10 -- # set +x 00:05:50.354 ************************************ 00:05:50.354 START TEST env_mem_callbacks 00:05:50.354 ************************************ 00:05:50.354 22:57:53 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:50.354 EAL: Detected CPU lcores: 48 00:05:50.354 EAL: Detected NUMA nodes: 2 00:05:50.354 EAL: Detected shared linkage of DPDK 00:05:50.354 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:50.354 EAL: Selected IOVA mode 'VA' 00:05:50.354 EAL: No free 2048 kB hugepages reported on node 1 00:05:50.354 EAL: VFIO support initialized 00:05:50.354 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:50.354 00:05:50.354 00:05:50.354 CUnit - A unit testing framework for C - Version 2.1-3 00:05:50.354 http://cunit.sourceforge.net/ 00:05:50.354 00:05:50.354 00:05:50.354 Suite: memory 00:05:50.354 Test: test ... 00:05:50.354 register 0x200000200000 2097152 00:05:50.354 malloc 3145728 00:05:50.354 register 0x200000400000 4194304 00:05:50.354 buf 0x200000500000 len 3145728 PASSED 00:05:50.354 malloc 64 00:05:50.354 buf 0x2000004fff40 len 64 PASSED 00:05:50.354 malloc 4194304 00:05:50.354 register 0x200000800000 6291456 00:05:50.354 buf 0x200000a00000 len 4194304 PASSED 00:05:50.354 free 0x200000500000 3145728 00:05:50.354 free 0x2000004fff40 64 00:05:50.354 unregister 0x200000400000 4194304 PASSED 00:05:50.354 free 0x200000a00000 4194304 00:05:50.354 unregister 0x200000800000 6291456 PASSED 00:05:50.354 malloc 8388608 00:05:50.354 register 0x200000400000 10485760 00:05:50.354 buf 0x200000600000 len 8388608 PASSED 00:05:50.354 free 0x200000600000 8388608 00:05:50.354 unregister 0x200000400000 10485760 PASSED 00:05:50.354 passed 00:05:50.354 00:05:50.354 Run Summary: Type Total Ran Passed Failed Inactive 00:05:50.354 suites 1 1 n/a 0 0 00:05:50.354 tests 1 1 1 0 0 00:05:50.354 asserts 15 15 15 0 n/a 00:05:50.354 00:05:50.354 Elapsed time = 0.006 seconds 00:05:50.354 00:05:50.354 real 0m0.050s 00:05:50.354 user 0m0.009s 00:05:50.354 sys 0m0.040s 00:05:50.354 22:57:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:50.354 22:57:53 -- common/autotest_common.sh@10 -- # set +x 00:05:50.354 ************************************ 00:05:50.354 END TEST env_mem_callbacks 00:05:50.354 ************************************ 00:05:50.354 00:05:50.354 real 0m6.415s 00:05:50.354 user 0m4.448s 00:05:50.354 sys 0m1.022s 00:05:50.354 22:57:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:50.354 22:57:53 -- common/autotest_common.sh@10 -- # set +x 00:05:50.354 ************************************ 00:05:50.354 END TEST env 00:05:50.354 ************************************ 00:05:50.354 22:57:53 -- spdk/autotest.sh@163 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:05:50.354 22:57:53 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:50.354 22:57:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:50.354 22:57:53 -- common/autotest_common.sh@10 -- # set +x 00:05:50.354 ************************************ 00:05:50.354 START TEST rpc 00:05:50.354 ************************************ 00:05:50.354 22:57:53 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:05:50.354 * Looking for test storage... 00:05:50.354 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:50.354 22:57:53 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:50.354 22:57:53 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:50.354 22:57:53 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:50.354 22:57:53 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:50.354 22:57:53 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:50.354 22:57:53 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:50.354 22:57:53 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:50.354 22:57:53 -- scripts/common.sh@335 -- # IFS=.-: 00:05:50.354 22:57:53 -- scripts/common.sh@335 -- # read -ra ver1 00:05:50.354 22:57:53 -- scripts/common.sh@336 -- # IFS=.-: 00:05:50.354 22:57:53 -- scripts/common.sh@336 -- # read -ra ver2 00:05:50.354 22:57:53 -- scripts/common.sh@337 -- # local 'op=<' 00:05:50.354 22:57:53 -- scripts/common.sh@339 -- # ver1_l=2 00:05:50.354 22:57:53 -- scripts/common.sh@340 -- # ver2_l=1 00:05:50.354 22:57:53 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:50.354 22:57:53 -- scripts/common.sh@343 -- # case "$op" in 00:05:50.354 22:57:53 -- scripts/common.sh@344 -- # : 1 00:05:50.354 22:57:53 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:50.354 22:57:53 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:50.354 22:57:53 -- scripts/common.sh@364 -- # decimal 1 00:05:50.355 22:57:53 -- scripts/common.sh@352 -- # local d=1 00:05:50.355 22:57:53 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:50.355 22:57:53 -- scripts/common.sh@354 -- # echo 1 00:05:50.355 22:57:53 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:50.355 22:57:53 -- scripts/common.sh@365 -- # decimal 2 00:05:50.355 22:57:53 -- scripts/common.sh@352 -- # local d=2 00:05:50.355 22:57:53 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:50.355 22:57:53 -- scripts/common.sh@354 -- # echo 2 00:05:50.355 22:57:53 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:50.355 22:57:53 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:50.355 22:57:53 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:50.355 22:57:53 -- scripts/common.sh@367 -- # return 0 00:05:50.355 22:57:53 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:50.355 22:57:53 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:50.355 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:50.355 --rc genhtml_branch_coverage=1 00:05:50.355 --rc genhtml_function_coverage=1 00:05:50.355 --rc genhtml_legend=1 00:05:50.355 --rc geninfo_all_blocks=1 00:05:50.355 --rc geninfo_unexecuted_blocks=1 00:05:50.355 00:05:50.355 ' 00:05:50.355 22:57:53 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:50.355 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:50.355 --rc genhtml_branch_coverage=1 00:05:50.355 --rc genhtml_function_coverage=1 00:05:50.355 --rc genhtml_legend=1 00:05:50.355 --rc geninfo_all_blocks=1 00:05:50.355 --rc geninfo_unexecuted_blocks=1 00:05:50.355 00:05:50.355 ' 00:05:50.355 22:57:53 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:50.355 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:50.355 --rc genhtml_branch_coverage=1 00:05:50.355 --rc genhtml_function_coverage=1 00:05:50.355 --rc genhtml_legend=1 00:05:50.355 --rc geninfo_all_blocks=1 00:05:50.355 --rc geninfo_unexecuted_blocks=1 00:05:50.355 00:05:50.355 ' 00:05:50.355 22:57:53 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:50.355 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:50.355 --rc genhtml_branch_coverage=1 00:05:50.355 --rc genhtml_function_coverage=1 00:05:50.355 --rc genhtml_legend=1 00:05:50.355 --rc geninfo_all_blocks=1 00:05:50.355 --rc geninfo_unexecuted_blocks=1 00:05:50.355 00:05:50.355 ' 00:05:50.355 22:57:53 -- rpc/rpc.sh@65 -- # spdk_pid=2324197 00:05:50.355 22:57:53 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:05:50.355 22:57:53 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:05:50.355 22:57:53 -- rpc/rpc.sh@67 -- # waitforlisten 2324197 00:05:50.355 22:57:53 -- common/autotest_common.sh@829 -- # '[' -z 2324197 ']' 00:05:50.355 22:57:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:50.355 22:57:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:50.355 22:57:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:50.355 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:50.355 22:57:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:50.355 22:57:53 -- common/autotest_common.sh@10 -- # set +x 00:05:50.613 [2024-11-28 22:57:54.004941] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:50.614 [2024-11-28 22:57:54.005030] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2324197 ] 00:05:50.614 EAL: No free 2048 kB hugepages reported on node 1 00:05:50.614 [2024-11-28 22:57:54.083337] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:50.614 [2024-11-28 22:57:54.172609] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:50.614 [2024-11-28 22:57:54.172775] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:05:50.614 [2024-11-28 22:57:54.172792] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 2324197' to capture a snapshot of events at runtime. 00:05:50.614 [2024-11-28 22:57:54.172803] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid2324197 for offline analysis/debug. 00:05:50.614 [2024-11-28 22:57:54.172832] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:51.549 22:57:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:51.549 22:57:54 -- common/autotest_common.sh@862 -- # return 0 00:05:51.549 22:57:54 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:51.549 22:57:54 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:51.549 22:57:54 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:05:51.549 22:57:54 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:05:51.549 22:57:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:51.549 22:57:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:51.549 22:57:54 -- common/autotest_common.sh@10 -- # set +x 00:05:51.549 ************************************ 00:05:51.549 START TEST rpc_integrity 00:05:51.549 ************************************ 00:05:51.549 22:57:54 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:05:51.549 22:57:54 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:51.549 22:57:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:51.549 22:57:54 -- common/autotest_common.sh@10 -- # set +x 00:05:51.549 22:57:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:51.549 22:57:54 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:51.549 22:57:54 -- rpc/rpc.sh@13 -- # jq length 00:05:51.549 22:57:54 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:51.549 22:57:54 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:51.549 22:57:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:51.549 22:57:54 -- common/autotest_common.sh@10 -- # set +x 00:05:51.549 22:57:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:51.549 22:57:55 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:05:51.549 22:57:55 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:51.549 22:57:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:51.549 22:57:55 -- common/autotest_common.sh@10 -- # set +x 00:05:51.549 22:57:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:51.549 22:57:55 -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:51.549 { 00:05:51.549 "name": "Malloc0", 00:05:51.549 "aliases": [ 00:05:51.549 "d350fe7f-3d67-4ff6-a5a1-927e96ec3c7d" 00:05:51.549 ], 00:05:51.549 "product_name": "Malloc disk", 00:05:51.549 "block_size": 512, 00:05:51.549 "num_blocks": 16384, 00:05:51.549 "uuid": "d350fe7f-3d67-4ff6-a5a1-927e96ec3c7d", 00:05:51.549 "assigned_rate_limits": { 00:05:51.549 "rw_ios_per_sec": 0, 00:05:51.549 "rw_mbytes_per_sec": 0, 00:05:51.549 "r_mbytes_per_sec": 0, 00:05:51.549 "w_mbytes_per_sec": 0 00:05:51.549 }, 00:05:51.549 "claimed": false, 00:05:51.549 "zoned": false, 00:05:51.549 "supported_io_types": { 00:05:51.549 "read": true, 00:05:51.549 "write": true, 00:05:51.549 "unmap": true, 00:05:51.549 "write_zeroes": true, 00:05:51.549 "flush": true, 00:05:51.549 "reset": true, 00:05:51.549 "compare": false, 00:05:51.549 "compare_and_write": false, 00:05:51.549 "abort": true, 00:05:51.549 "nvme_admin": false, 00:05:51.549 "nvme_io": false 00:05:51.549 }, 00:05:51.549 "memory_domains": [ 00:05:51.549 { 00:05:51.549 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:51.549 "dma_device_type": 2 00:05:51.549 } 00:05:51.549 ], 00:05:51.549 "driver_specific": {} 00:05:51.549 } 00:05:51.549 ]' 00:05:51.549 22:57:55 -- rpc/rpc.sh@17 -- # jq length 00:05:51.549 22:57:55 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:51.549 22:57:55 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:05:51.549 22:57:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:51.549 22:57:55 -- common/autotest_common.sh@10 -- # set +x 00:05:51.549 [2024-11-28 22:57:55.059779] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:05:51.549 [2024-11-28 22:57:55.059830] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:51.549 [2024-11-28 22:57:55.059854] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x12dfbf0 00:05:51.549 [2024-11-28 22:57:55.059870] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:51.549 [2024-11-28 22:57:55.061281] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:51.549 [2024-11-28 22:57:55.061310] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:51.549 Passthru0 00:05:51.549 22:57:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:51.549 22:57:55 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:51.549 22:57:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:51.549 22:57:55 -- common/autotest_common.sh@10 -- # set +x 00:05:51.549 22:57:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:51.549 22:57:55 -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:51.549 { 00:05:51.549 "name": "Malloc0", 00:05:51.549 "aliases": [ 00:05:51.549 "d350fe7f-3d67-4ff6-a5a1-927e96ec3c7d" 00:05:51.549 ], 00:05:51.549 "product_name": "Malloc disk", 00:05:51.549 "block_size": 512, 00:05:51.549 "num_blocks": 16384, 00:05:51.549 "uuid": "d350fe7f-3d67-4ff6-a5a1-927e96ec3c7d", 00:05:51.549 "assigned_rate_limits": { 00:05:51.549 "rw_ios_per_sec": 0, 00:05:51.549 "rw_mbytes_per_sec": 0, 00:05:51.549 "r_mbytes_per_sec": 0, 00:05:51.549 "w_mbytes_per_sec": 0 00:05:51.549 }, 00:05:51.549 "claimed": true, 00:05:51.549 "claim_type": "exclusive_write", 00:05:51.549 "zoned": false, 00:05:51.549 "supported_io_types": { 00:05:51.549 "read": true, 00:05:51.549 "write": true, 00:05:51.549 "unmap": true, 00:05:51.549 "write_zeroes": true, 00:05:51.549 "flush": true, 00:05:51.549 "reset": true, 00:05:51.549 "compare": false, 00:05:51.549 "compare_and_write": false, 00:05:51.549 "abort": true, 00:05:51.549 "nvme_admin": false, 00:05:51.550 "nvme_io": false 00:05:51.550 }, 00:05:51.550 "memory_domains": [ 00:05:51.550 { 00:05:51.550 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:51.550 "dma_device_type": 2 00:05:51.550 } 00:05:51.550 ], 00:05:51.550 "driver_specific": {} 00:05:51.550 }, 00:05:51.550 { 00:05:51.550 "name": "Passthru0", 00:05:51.550 "aliases": [ 00:05:51.550 "a44eae7d-8a78-5beb-9961-93327d6e756b" 00:05:51.550 ], 00:05:51.550 "product_name": "passthru", 00:05:51.550 "block_size": 512, 00:05:51.550 "num_blocks": 16384, 00:05:51.550 "uuid": "a44eae7d-8a78-5beb-9961-93327d6e756b", 00:05:51.550 "assigned_rate_limits": { 00:05:51.550 "rw_ios_per_sec": 0, 00:05:51.550 "rw_mbytes_per_sec": 0, 00:05:51.550 "r_mbytes_per_sec": 0, 00:05:51.550 "w_mbytes_per_sec": 0 00:05:51.550 }, 00:05:51.550 "claimed": false, 00:05:51.550 "zoned": false, 00:05:51.550 "supported_io_types": { 00:05:51.550 "read": true, 00:05:51.550 "write": true, 00:05:51.550 "unmap": true, 00:05:51.550 "write_zeroes": true, 00:05:51.550 "flush": true, 00:05:51.550 "reset": true, 00:05:51.550 "compare": false, 00:05:51.550 "compare_and_write": false, 00:05:51.550 "abort": true, 00:05:51.550 "nvme_admin": false, 00:05:51.550 "nvme_io": false 00:05:51.550 }, 00:05:51.550 "memory_domains": [ 00:05:51.550 { 00:05:51.550 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:51.550 "dma_device_type": 2 00:05:51.550 } 00:05:51.550 ], 00:05:51.550 "driver_specific": { 00:05:51.550 "passthru": { 00:05:51.550 "name": "Passthru0", 00:05:51.550 "base_bdev_name": "Malloc0" 00:05:51.550 } 00:05:51.550 } 00:05:51.550 } 00:05:51.550 ]' 00:05:51.550 22:57:55 -- rpc/rpc.sh@21 -- # jq length 00:05:51.550 22:57:55 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:51.550 22:57:55 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:51.550 22:57:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:51.550 22:57:55 -- common/autotest_common.sh@10 -- # set +x 00:05:51.550 22:57:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:51.550 22:57:55 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:05:51.550 22:57:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:51.550 22:57:55 -- common/autotest_common.sh@10 -- # set +x 00:05:51.550 22:57:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:51.550 22:57:55 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:51.550 22:57:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:51.550 22:57:55 -- common/autotest_common.sh@10 -- # set +x 00:05:51.550 22:57:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:51.550 22:57:55 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:51.550 22:57:55 -- rpc/rpc.sh@26 -- # jq length 00:05:51.815 22:57:55 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:51.815 00:05:51.815 real 0m0.226s 00:05:51.815 user 0m0.140s 00:05:51.815 sys 0m0.024s 00:05:51.815 22:57:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:51.815 22:57:55 -- common/autotest_common.sh@10 -- # set +x 00:05:51.815 ************************************ 00:05:51.815 END TEST rpc_integrity 00:05:51.815 ************************************ 00:05:51.815 22:57:55 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:05:51.815 22:57:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:51.815 22:57:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:51.815 22:57:55 -- common/autotest_common.sh@10 -- # set +x 00:05:51.815 ************************************ 00:05:51.815 START TEST rpc_plugins 00:05:51.815 ************************************ 00:05:51.815 22:57:55 -- common/autotest_common.sh@1114 -- # rpc_plugins 00:05:51.815 22:57:55 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:05:51.815 22:57:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:51.815 22:57:55 -- common/autotest_common.sh@10 -- # set +x 00:05:51.815 22:57:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:51.815 22:57:55 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:05:51.815 22:57:55 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:05:51.815 22:57:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:51.815 22:57:55 -- common/autotest_common.sh@10 -- # set +x 00:05:51.815 22:57:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:51.815 22:57:55 -- rpc/rpc.sh@31 -- # bdevs='[ 00:05:51.815 { 00:05:51.815 "name": "Malloc1", 00:05:51.815 "aliases": [ 00:05:51.815 "36e07780-35c3-4f8f-9b4a-1977106be3e3" 00:05:51.815 ], 00:05:51.816 "product_name": "Malloc disk", 00:05:51.816 "block_size": 4096, 00:05:51.816 "num_blocks": 256, 00:05:51.816 "uuid": "36e07780-35c3-4f8f-9b4a-1977106be3e3", 00:05:51.816 "assigned_rate_limits": { 00:05:51.816 "rw_ios_per_sec": 0, 00:05:51.816 "rw_mbytes_per_sec": 0, 00:05:51.816 "r_mbytes_per_sec": 0, 00:05:51.816 "w_mbytes_per_sec": 0 00:05:51.816 }, 00:05:51.816 "claimed": false, 00:05:51.816 "zoned": false, 00:05:51.816 "supported_io_types": { 00:05:51.816 "read": true, 00:05:51.816 "write": true, 00:05:51.816 "unmap": true, 00:05:51.816 "write_zeroes": true, 00:05:51.816 "flush": true, 00:05:51.816 "reset": true, 00:05:51.816 "compare": false, 00:05:51.816 "compare_and_write": false, 00:05:51.816 "abort": true, 00:05:51.816 "nvme_admin": false, 00:05:51.816 "nvme_io": false 00:05:51.816 }, 00:05:51.816 "memory_domains": [ 00:05:51.816 { 00:05:51.816 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:51.816 "dma_device_type": 2 00:05:51.816 } 00:05:51.816 ], 00:05:51.816 "driver_specific": {} 00:05:51.816 } 00:05:51.816 ]' 00:05:51.816 22:57:55 -- rpc/rpc.sh@32 -- # jq length 00:05:51.816 22:57:55 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:05:51.816 22:57:55 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:05:51.816 22:57:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:51.816 22:57:55 -- common/autotest_common.sh@10 -- # set +x 00:05:51.816 22:57:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:51.816 22:57:55 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:05:51.816 22:57:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:51.816 22:57:55 -- common/autotest_common.sh@10 -- # set +x 00:05:51.816 22:57:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:51.816 22:57:55 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:05:51.816 22:57:55 -- rpc/rpc.sh@36 -- # jq length 00:05:51.816 22:57:55 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:05:51.816 00:05:51.816 real 0m0.113s 00:05:51.816 user 0m0.075s 00:05:51.816 sys 0m0.007s 00:05:51.816 22:57:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:51.816 22:57:55 -- common/autotest_common.sh@10 -- # set +x 00:05:51.816 ************************************ 00:05:51.816 END TEST rpc_plugins 00:05:51.816 ************************************ 00:05:51.816 22:57:55 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:05:51.816 22:57:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:51.816 22:57:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:51.816 22:57:55 -- common/autotest_common.sh@10 -- # set +x 00:05:51.816 ************************************ 00:05:51.816 START TEST rpc_trace_cmd_test 00:05:51.816 ************************************ 00:05:51.816 22:57:55 -- common/autotest_common.sh@1114 -- # rpc_trace_cmd_test 00:05:51.816 22:57:55 -- rpc/rpc.sh@40 -- # local info 00:05:51.816 22:57:55 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:05:51.816 22:57:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:51.816 22:57:55 -- common/autotest_common.sh@10 -- # set +x 00:05:51.816 22:57:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:51.816 22:57:55 -- rpc/rpc.sh@42 -- # info='{ 00:05:51.816 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid2324197", 00:05:51.816 "tpoint_group_mask": "0x8", 00:05:51.816 "iscsi_conn": { 00:05:51.816 "mask": "0x2", 00:05:51.816 "tpoint_mask": "0x0" 00:05:51.816 }, 00:05:51.816 "scsi": { 00:05:51.816 "mask": "0x4", 00:05:51.816 "tpoint_mask": "0x0" 00:05:51.816 }, 00:05:51.816 "bdev": { 00:05:51.816 "mask": "0x8", 00:05:51.816 "tpoint_mask": "0xffffffffffffffff" 00:05:51.816 }, 00:05:51.816 "nvmf_rdma": { 00:05:51.816 "mask": "0x10", 00:05:51.816 "tpoint_mask": "0x0" 00:05:51.816 }, 00:05:51.816 "nvmf_tcp": { 00:05:51.816 "mask": "0x20", 00:05:51.816 "tpoint_mask": "0x0" 00:05:51.816 }, 00:05:51.816 "ftl": { 00:05:51.816 "mask": "0x40", 00:05:51.816 "tpoint_mask": "0x0" 00:05:51.816 }, 00:05:51.816 "blobfs": { 00:05:51.816 "mask": "0x80", 00:05:51.816 "tpoint_mask": "0x0" 00:05:51.816 }, 00:05:51.816 "dsa": { 00:05:51.816 "mask": "0x200", 00:05:51.816 "tpoint_mask": "0x0" 00:05:51.816 }, 00:05:51.816 "thread": { 00:05:51.816 "mask": "0x400", 00:05:51.816 "tpoint_mask": "0x0" 00:05:51.816 }, 00:05:51.816 "nvme_pcie": { 00:05:51.816 "mask": "0x800", 00:05:51.816 "tpoint_mask": "0x0" 00:05:51.816 }, 00:05:51.816 "iaa": { 00:05:51.816 "mask": "0x1000", 00:05:51.816 "tpoint_mask": "0x0" 00:05:51.816 }, 00:05:51.816 "nvme_tcp": { 00:05:51.816 "mask": "0x2000", 00:05:51.816 "tpoint_mask": "0x0" 00:05:51.816 }, 00:05:51.816 "bdev_nvme": { 00:05:51.816 "mask": "0x4000", 00:05:51.816 "tpoint_mask": "0x0" 00:05:51.816 } 00:05:51.816 }' 00:05:51.816 22:57:55 -- rpc/rpc.sh@43 -- # jq length 00:05:51.816 22:57:55 -- rpc/rpc.sh@43 -- # '[' 15 -gt 2 ']' 00:05:51.816 22:57:55 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:05:52.074 22:57:55 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:05:52.074 22:57:55 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:05:52.074 22:57:55 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:05:52.074 22:57:55 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:05:52.074 22:57:55 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:05:52.074 22:57:55 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:05:52.074 22:57:55 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:05:52.074 00:05:52.074 real 0m0.196s 00:05:52.074 user 0m0.175s 00:05:52.074 sys 0m0.014s 00:05:52.074 22:57:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:52.074 22:57:55 -- common/autotest_common.sh@10 -- # set +x 00:05:52.074 ************************************ 00:05:52.074 END TEST rpc_trace_cmd_test 00:05:52.074 ************************************ 00:05:52.074 22:57:55 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:05:52.074 22:57:55 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:05:52.074 22:57:55 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:05:52.074 22:57:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:52.074 22:57:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:52.074 22:57:55 -- common/autotest_common.sh@10 -- # set +x 00:05:52.074 ************************************ 00:05:52.074 START TEST rpc_daemon_integrity 00:05:52.074 ************************************ 00:05:52.074 22:57:55 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:05:52.074 22:57:55 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:52.074 22:57:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:52.074 22:57:55 -- common/autotest_common.sh@10 -- # set +x 00:05:52.074 22:57:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:52.074 22:57:55 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:52.074 22:57:55 -- rpc/rpc.sh@13 -- # jq length 00:05:52.074 22:57:55 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:52.074 22:57:55 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:52.074 22:57:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:52.074 22:57:55 -- common/autotest_common.sh@10 -- # set +x 00:05:52.074 22:57:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:52.074 22:57:55 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:05:52.074 22:57:55 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:52.074 22:57:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:52.074 22:57:55 -- common/autotest_common.sh@10 -- # set +x 00:05:52.074 22:57:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:52.074 22:57:55 -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:52.074 { 00:05:52.074 "name": "Malloc2", 00:05:52.074 "aliases": [ 00:05:52.074 "294e4c5e-95c0-4021-91c7-3038c3620c02" 00:05:52.074 ], 00:05:52.074 "product_name": "Malloc disk", 00:05:52.074 "block_size": 512, 00:05:52.074 "num_blocks": 16384, 00:05:52.074 "uuid": "294e4c5e-95c0-4021-91c7-3038c3620c02", 00:05:52.074 "assigned_rate_limits": { 00:05:52.074 "rw_ios_per_sec": 0, 00:05:52.074 "rw_mbytes_per_sec": 0, 00:05:52.074 "r_mbytes_per_sec": 0, 00:05:52.074 "w_mbytes_per_sec": 0 00:05:52.074 }, 00:05:52.074 "claimed": false, 00:05:52.074 "zoned": false, 00:05:52.074 "supported_io_types": { 00:05:52.074 "read": true, 00:05:52.074 "write": true, 00:05:52.074 "unmap": true, 00:05:52.074 "write_zeroes": true, 00:05:52.074 "flush": true, 00:05:52.074 "reset": true, 00:05:52.074 "compare": false, 00:05:52.074 "compare_and_write": false, 00:05:52.074 "abort": true, 00:05:52.074 "nvme_admin": false, 00:05:52.074 "nvme_io": false 00:05:52.074 }, 00:05:52.074 "memory_domains": [ 00:05:52.074 { 00:05:52.074 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:52.074 "dma_device_type": 2 00:05:52.074 } 00:05:52.074 ], 00:05:52.074 "driver_specific": {} 00:05:52.074 } 00:05:52.074 ]' 00:05:52.074 22:57:55 -- rpc/rpc.sh@17 -- # jq length 00:05:52.074 22:57:55 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:52.074 22:57:55 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:05:52.074 22:57:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:52.074 22:57:55 -- common/autotest_common.sh@10 -- # set +x 00:05:52.074 [2024-11-28 22:57:55.677580] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:05:52.074 [2024-11-28 22:57:55.677627] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:52.074 [2024-11-28 22:57:55.677651] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x147f940 00:05:52.074 [2024-11-28 22:57:55.677665] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:52.074 [2024-11-28 22:57:55.679065] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:52.075 [2024-11-28 22:57:55.679093] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:52.333 Passthru0 00:05:52.333 22:57:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:52.333 22:57:55 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:52.333 22:57:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:52.333 22:57:55 -- common/autotest_common.sh@10 -- # set +x 00:05:52.333 22:57:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:52.333 22:57:55 -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:52.333 { 00:05:52.333 "name": "Malloc2", 00:05:52.333 "aliases": [ 00:05:52.333 "294e4c5e-95c0-4021-91c7-3038c3620c02" 00:05:52.333 ], 00:05:52.333 "product_name": "Malloc disk", 00:05:52.333 "block_size": 512, 00:05:52.333 "num_blocks": 16384, 00:05:52.333 "uuid": "294e4c5e-95c0-4021-91c7-3038c3620c02", 00:05:52.333 "assigned_rate_limits": { 00:05:52.333 "rw_ios_per_sec": 0, 00:05:52.333 "rw_mbytes_per_sec": 0, 00:05:52.333 "r_mbytes_per_sec": 0, 00:05:52.333 "w_mbytes_per_sec": 0 00:05:52.333 }, 00:05:52.333 "claimed": true, 00:05:52.333 "claim_type": "exclusive_write", 00:05:52.333 "zoned": false, 00:05:52.333 "supported_io_types": { 00:05:52.333 "read": true, 00:05:52.333 "write": true, 00:05:52.333 "unmap": true, 00:05:52.333 "write_zeroes": true, 00:05:52.333 "flush": true, 00:05:52.333 "reset": true, 00:05:52.333 "compare": false, 00:05:52.333 "compare_and_write": false, 00:05:52.333 "abort": true, 00:05:52.333 "nvme_admin": false, 00:05:52.333 "nvme_io": false 00:05:52.333 }, 00:05:52.333 "memory_domains": [ 00:05:52.333 { 00:05:52.333 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:52.333 "dma_device_type": 2 00:05:52.333 } 00:05:52.333 ], 00:05:52.333 "driver_specific": {} 00:05:52.333 }, 00:05:52.333 { 00:05:52.333 "name": "Passthru0", 00:05:52.333 "aliases": [ 00:05:52.333 "a7daf33f-e62b-5e19-a831-44ff3e0a3c0e" 00:05:52.333 ], 00:05:52.333 "product_name": "passthru", 00:05:52.333 "block_size": 512, 00:05:52.333 "num_blocks": 16384, 00:05:52.333 "uuid": "a7daf33f-e62b-5e19-a831-44ff3e0a3c0e", 00:05:52.333 "assigned_rate_limits": { 00:05:52.333 "rw_ios_per_sec": 0, 00:05:52.333 "rw_mbytes_per_sec": 0, 00:05:52.333 "r_mbytes_per_sec": 0, 00:05:52.333 "w_mbytes_per_sec": 0 00:05:52.333 }, 00:05:52.333 "claimed": false, 00:05:52.333 "zoned": false, 00:05:52.333 "supported_io_types": { 00:05:52.333 "read": true, 00:05:52.333 "write": true, 00:05:52.333 "unmap": true, 00:05:52.333 "write_zeroes": true, 00:05:52.333 "flush": true, 00:05:52.333 "reset": true, 00:05:52.333 "compare": false, 00:05:52.333 "compare_and_write": false, 00:05:52.333 "abort": true, 00:05:52.333 "nvme_admin": false, 00:05:52.333 "nvme_io": false 00:05:52.333 }, 00:05:52.333 "memory_domains": [ 00:05:52.333 { 00:05:52.333 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:52.333 "dma_device_type": 2 00:05:52.333 } 00:05:52.333 ], 00:05:52.333 "driver_specific": { 00:05:52.333 "passthru": { 00:05:52.333 "name": "Passthru0", 00:05:52.333 "base_bdev_name": "Malloc2" 00:05:52.333 } 00:05:52.333 } 00:05:52.333 } 00:05:52.333 ]' 00:05:52.333 22:57:55 -- rpc/rpc.sh@21 -- # jq length 00:05:52.333 22:57:55 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:52.333 22:57:55 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:52.333 22:57:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:52.333 22:57:55 -- common/autotest_common.sh@10 -- # set +x 00:05:52.333 22:57:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:52.333 22:57:55 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:05:52.333 22:57:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:52.333 22:57:55 -- common/autotest_common.sh@10 -- # set +x 00:05:52.333 22:57:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:52.333 22:57:55 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:52.333 22:57:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:52.333 22:57:55 -- common/autotest_common.sh@10 -- # set +x 00:05:52.333 22:57:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:52.333 22:57:55 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:52.333 22:57:55 -- rpc/rpc.sh@26 -- # jq length 00:05:52.333 22:57:55 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:52.333 00:05:52.333 real 0m0.226s 00:05:52.333 user 0m0.146s 00:05:52.333 sys 0m0.021s 00:05:52.333 22:57:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:52.333 22:57:55 -- common/autotest_common.sh@10 -- # set +x 00:05:52.333 ************************************ 00:05:52.333 END TEST rpc_daemon_integrity 00:05:52.333 ************************************ 00:05:52.333 22:57:55 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:05:52.333 22:57:55 -- rpc/rpc.sh@84 -- # killprocess 2324197 00:05:52.333 22:57:55 -- common/autotest_common.sh@936 -- # '[' -z 2324197 ']' 00:05:52.333 22:57:55 -- common/autotest_common.sh@940 -- # kill -0 2324197 00:05:52.333 22:57:55 -- common/autotest_common.sh@941 -- # uname 00:05:52.333 22:57:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:52.333 22:57:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2324197 00:05:52.333 22:57:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:52.333 22:57:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:52.333 22:57:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2324197' 00:05:52.333 killing process with pid 2324197 00:05:52.333 22:57:55 -- common/autotest_common.sh@955 -- # kill 2324197 00:05:52.333 22:57:55 -- common/autotest_common.sh@960 -- # wait 2324197 00:05:52.900 00:05:52.900 real 0m2.441s 00:05:52.900 user 0m3.080s 00:05:52.900 sys 0m0.588s 00:05:52.900 22:57:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:52.900 22:57:56 -- common/autotest_common.sh@10 -- # set +x 00:05:52.900 ************************************ 00:05:52.900 END TEST rpc 00:05:52.900 ************************************ 00:05:52.900 22:57:56 -- spdk/autotest.sh@164 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:52.900 22:57:56 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:52.900 22:57:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:52.900 22:57:56 -- common/autotest_common.sh@10 -- # set +x 00:05:52.900 ************************************ 00:05:52.900 START TEST rpc_client 00:05:52.900 ************************************ 00:05:52.900 22:57:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:52.900 * Looking for test storage... 00:05:52.900 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:05:52.900 22:57:56 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:52.900 22:57:56 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:52.900 22:57:56 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:52.900 22:57:56 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:52.900 22:57:56 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:52.900 22:57:56 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:52.900 22:57:56 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:52.900 22:57:56 -- scripts/common.sh@335 -- # IFS=.-: 00:05:52.900 22:57:56 -- scripts/common.sh@335 -- # read -ra ver1 00:05:52.900 22:57:56 -- scripts/common.sh@336 -- # IFS=.-: 00:05:52.900 22:57:56 -- scripts/common.sh@336 -- # read -ra ver2 00:05:52.900 22:57:56 -- scripts/common.sh@337 -- # local 'op=<' 00:05:52.900 22:57:56 -- scripts/common.sh@339 -- # ver1_l=2 00:05:52.900 22:57:56 -- scripts/common.sh@340 -- # ver2_l=1 00:05:52.900 22:57:56 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:52.900 22:57:56 -- scripts/common.sh@343 -- # case "$op" in 00:05:52.900 22:57:56 -- scripts/common.sh@344 -- # : 1 00:05:52.900 22:57:56 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:52.900 22:57:56 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:52.900 22:57:56 -- scripts/common.sh@364 -- # decimal 1 00:05:52.900 22:57:56 -- scripts/common.sh@352 -- # local d=1 00:05:52.900 22:57:56 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:52.900 22:57:56 -- scripts/common.sh@354 -- # echo 1 00:05:52.900 22:57:56 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:52.900 22:57:56 -- scripts/common.sh@365 -- # decimal 2 00:05:52.900 22:57:56 -- scripts/common.sh@352 -- # local d=2 00:05:52.900 22:57:56 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:52.900 22:57:56 -- scripts/common.sh@354 -- # echo 2 00:05:52.900 22:57:56 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:52.900 22:57:56 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:52.900 22:57:56 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:52.900 22:57:56 -- scripts/common.sh@367 -- # return 0 00:05:52.900 22:57:56 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:52.900 22:57:56 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:52.900 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:52.900 --rc genhtml_branch_coverage=1 00:05:52.900 --rc genhtml_function_coverage=1 00:05:52.900 --rc genhtml_legend=1 00:05:52.900 --rc geninfo_all_blocks=1 00:05:52.900 --rc geninfo_unexecuted_blocks=1 00:05:52.900 00:05:52.900 ' 00:05:52.900 22:57:56 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:52.900 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:52.900 --rc genhtml_branch_coverage=1 00:05:52.900 --rc genhtml_function_coverage=1 00:05:52.900 --rc genhtml_legend=1 00:05:52.900 --rc geninfo_all_blocks=1 00:05:52.900 --rc geninfo_unexecuted_blocks=1 00:05:52.900 00:05:52.900 ' 00:05:52.900 22:57:56 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:52.900 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:52.900 --rc genhtml_branch_coverage=1 00:05:52.900 --rc genhtml_function_coverage=1 00:05:52.900 --rc genhtml_legend=1 00:05:52.900 --rc geninfo_all_blocks=1 00:05:52.900 --rc geninfo_unexecuted_blocks=1 00:05:52.900 00:05:52.900 ' 00:05:52.900 22:57:56 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:52.900 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:52.900 --rc genhtml_branch_coverage=1 00:05:52.900 --rc genhtml_function_coverage=1 00:05:52.900 --rc genhtml_legend=1 00:05:52.900 --rc geninfo_all_blocks=1 00:05:52.900 --rc geninfo_unexecuted_blocks=1 00:05:52.900 00:05:52.900 ' 00:05:52.900 22:57:56 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:05:52.900 OK 00:05:52.900 22:57:56 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:05:52.900 00:05:52.900 real 0m0.158s 00:05:52.900 user 0m0.108s 00:05:52.900 sys 0m0.058s 00:05:52.900 22:57:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:52.900 22:57:56 -- common/autotest_common.sh@10 -- # set +x 00:05:52.900 ************************************ 00:05:52.900 END TEST rpc_client 00:05:52.900 ************************************ 00:05:52.900 22:57:56 -- spdk/autotest.sh@165 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:05:52.900 22:57:56 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:52.900 22:57:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:52.900 22:57:56 -- common/autotest_common.sh@10 -- # set +x 00:05:52.900 ************************************ 00:05:52.900 START TEST json_config 00:05:52.900 ************************************ 00:05:52.900 22:57:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:05:52.900 22:57:56 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:53.159 22:57:56 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:53.159 22:57:56 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:53.159 22:57:56 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:53.159 22:57:56 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:53.159 22:57:56 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:53.159 22:57:56 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:53.159 22:57:56 -- scripts/common.sh@335 -- # IFS=.-: 00:05:53.159 22:57:56 -- scripts/common.sh@335 -- # read -ra ver1 00:05:53.159 22:57:56 -- scripts/common.sh@336 -- # IFS=.-: 00:05:53.159 22:57:56 -- scripts/common.sh@336 -- # read -ra ver2 00:05:53.159 22:57:56 -- scripts/common.sh@337 -- # local 'op=<' 00:05:53.159 22:57:56 -- scripts/common.sh@339 -- # ver1_l=2 00:05:53.159 22:57:56 -- scripts/common.sh@340 -- # ver2_l=1 00:05:53.159 22:57:56 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:53.159 22:57:56 -- scripts/common.sh@343 -- # case "$op" in 00:05:53.159 22:57:56 -- scripts/common.sh@344 -- # : 1 00:05:53.159 22:57:56 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:53.159 22:57:56 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:53.159 22:57:56 -- scripts/common.sh@364 -- # decimal 1 00:05:53.159 22:57:56 -- scripts/common.sh@352 -- # local d=1 00:05:53.159 22:57:56 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:53.159 22:57:56 -- scripts/common.sh@354 -- # echo 1 00:05:53.159 22:57:56 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:53.159 22:57:56 -- scripts/common.sh@365 -- # decimal 2 00:05:53.159 22:57:56 -- scripts/common.sh@352 -- # local d=2 00:05:53.159 22:57:56 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:53.159 22:57:56 -- scripts/common.sh@354 -- # echo 2 00:05:53.159 22:57:56 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:53.159 22:57:56 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:53.159 22:57:56 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:53.159 22:57:56 -- scripts/common.sh@367 -- # return 0 00:05:53.159 22:57:56 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:53.160 22:57:56 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:53.160 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:53.160 --rc genhtml_branch_coverage=1 00:05:53.160 --rc genhtml_function_coverage=1 00:05:53.160 --rc genhtml_legend=1 00:05:53.160 --rc geninfo_all_blocks=1 00:05:53.160 --rc geninfo_unexecuted_blocks=1 00:05:53.160 00:05:53.160 ' 00:05:53.160 22:57:56 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:53.160 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:53.160 --rc genhtml_branch_coverage=1 00:05:53.160 --rc genhtml_function_coverage=1 00:05:53.160 --rc genhtml_legend=1 00:05:53.160 --rc geninfo_all_blocks=1 00:05:53.160 --rc geninfo_unexecuted_blocks=1 00:05:53.160 00:05:53.160 ' 00:05:53.160 22:57:56 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:53.160 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:53.160 --rc genhtml_branch_coverage=1 00:05:53.160 --rc genhtml_function_coverage=1 00:05:53.160 --rc genhtml_legend=1 00:05:53.160 --rc geninfo_all_blocks=1 00:05:53.160 --rc geninfo_unexecuted_blocks=1 00:05:53.160 00:05:53.160 ' 00:05:53.160 22:57:56 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:53.160 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:53.160 --rc genhtml_branch_coverage=1 00:05:53.160 --rc genhtml_function_coverage=1 00:05:53.160 --rc genhtml_legend=1 00:05:53.160 --rc geninfo_all_blocks=1 00:05:53.160 --rc geninfo_unexecuted_blocks=1 00:05:53.160 00:05:53.160 ' 00:05:53.160 22:57:56 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:05:53.160 22:57:56 -- nvmf/common.sh@7 -- # uname -s 00:05:53.160 22:57:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:53.160 22:57:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:53.160 22:57:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:53.160 22:57:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:53.160 22:57:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:53.160 22:57:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:53.160 22:57:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:53.160 22:57:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:53.160 22:57:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:53.160 22:57:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:53.160 22:57:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:05:53.160 22:57:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:05:53.160 22:57:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:53.160 22:57:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:53.160 22:57:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:05:53.160 22:57:56 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:05:53.160 22:57:56 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:53.160 22:57:56 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:53.160 22:57:56 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:53.160 22:57:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:53.160 22:57:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:53.160 22:57:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:53.160 22:57:56 -- paths/export.sh@5 -- # export PATH 00:05:53.160 22:57:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:53.160 22:57:56 -- nvmf/common.sh@46 -- # : 0 00:05:53.160 22:57:56 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:05:53.160 22:57:56 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:05:53.160 22:57:56 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:05:53.160 22:57:56 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:53.160 22:57:56 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:53.160 22:57:56 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:05:53.160 22:57:56 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:05:53.160 22:57:56 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:05:53.160 22:57:56 -- json_config/json_config.sh@10 -- # [[ 0 -eq 1 ]] 00:05:53.160 22:57:56 -- json_config/json_config.sh@14 -- # [[ 0 -ne 1 ]] 00:05:53.160 22:57:56 -- json_config/json_config.sh@14 -- # [[ 0 -eq 1 ]] 00:05:53.160 22:57:56 -- json_config/json_config.sh@25 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:05:53.160 22:57:56 -- json_config/json_config.sh@30 -- # app_pid=(['target']='' ['initiator']='') 00:05:53.160 22:57:56 -- json_config/json_config.sh@30 -- # declare -A app_pid 00:05:53.160 22:57:56 -- json_config/json_config.sh@31 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:05:53.160 22:57:56 -- json_config/json_config.sh@31 -- # declare -A app_socket 00:05:53.160 22:57:56 -- json_config/json_config.sh@32 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:05:53.160 22:57:56 -- json_config/json_config.sh@32 -- # declare -A app_params 00:05:53.160 22:57:56 -- json_config/json_config.sh@33 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:05:53.160 22:57:56 -- json_config/json_config.sh@33 -- # declare -A configs_path 00:05:53.160 22:57:56 -- json_config/json_config.sh@43 -- # last_event_id=0 00:05:53.160 22:57:56 -- json_config/json_config.sh@418 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:05:53.160 22:57:56 -- json_config/json_config.sh@419 -- # echo 'INFO: JSON configuration test init' 00:05:53.160 INFO: JSON configuration test init 00:05:53.160 22:57:56 -- json_config/json_config.sh@420 -- # json_config_test_init 00:05:53.160 22:57:56 -- json_config/json_config.sh@315 -- # timing_enter json_config_test_init 00:05:53.160 22:57:56 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:53.160 22:57:56 -- common/autotest_common.sh@10 -- # set +x 00:05:53.160 22:57:56 -- json_config/json_config.sh@316 -- # timing_enter json_config_setup_target 00:05:53.160 22:57:56 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:53.160 22:57:56 -- common/autotest_common.sh@10 -- # set +x 00:05:53.160 22:57:56 -- json_config/json_config.sh@318 -- # json_config_test_start_app target --wait-for-rpc 00:05:53.160 22:57:56 -- json_config/json_config.sh@98 -- # local app=target 00:05:53.160 22:57:56 -- json_config/json_config.sh@99 -- # shift 00:05:53.160 22:57:56 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:05:53.160 22:57:56 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:05:53.160 22:57:56 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:05:53.160 22:57:56 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:53.160 22:57:56 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:53.160 22:57:56 -- json_config/json_config.sh@111 -- # app_pid[$app]=2324696 00:05:53.160 22:57:56 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:05:53.160 22:57:56 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:05:53.160 Waiting for target to run... 00:05:53.160 22:57:56 -- json_config/json_config.sh@114 -- # waitforlisten 2324696 /var/tmp/spdk_tgt.sock 00:05:53.160 22:57:56 -- common/autotest_common.sh@829 -- # '[' -z 2324696 ']' 00:05:53.160 22:57:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:53.160 22:57:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:53.160 22:57:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:53.160 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:53.160 22:57:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:53.160 22:57:56 -- common/autotest_common.sh@10 -- # set +x 00:05:53.160 [2024-11-28 22:57:56.662749] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:53.160 [2024-11-28 22:57:56.662844] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2324696 ] 00:05:53.160 EAL: No free 2048 kB hugepages reported on node 1 00:05:53.419 [2024-11-28 22:57:57.021369] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:53.677 [2024-11-28 22:57:57.083030] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:53.677 [2024-11-28 22:57:57.083233] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:54.243 22:57:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:54.243 22:57:57 -- common/autotest_common.sh@862 -- # return 0 00:05:54.243 22:57:57 -- json_config/json_config.sh@115 -- # echo '' 00:05:54.243 00:05:54.243 22:57:57 -- json_config/json_config.sh@322 -- # create_accel_config 00:05:54.243 22:57:57 -- json_config/json_config.sh@146 -- # timing_enter create_accel_config 00:05:54.243 22:57:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:54.243 22:57:57 -- common/autotest_common.sh@10 -- # set +x 00:05:54.243 22:57:57 -- json_config/json_config.sh@148 -- # [[ 0 -eq 1 ]] 00:05:54.243 22:57:57 -- json_config/json_config.sh@154 -- # timing_exit create_accel_config 00:05:54.243 22:57:57 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:54.243 22:57:57 -- common/autotest_common.sh@10 -- # set +x 00:05:54.243 22:57:57 -- json_config/json_config.sh@326 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:05:54.243 22:57:57 -- json_config/json_config.sh@327 -- # tgt_rpc load_config 00:05:54.243 22:57:57 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:05:57.526 22:58:00 -- json_config/json_config.sh@329 -- # tgt_check_notification_types 00:05:57.527 22:58:00 -- json_config/json_config.sh@46 -- # timing_enter tgt_check_notification_types 00:05:57.527 22:58:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:57.527 22:58:00 -- common/autotest_common.sh@10 -- # set +x 00:05:57.527 22:58:00 -- json_config/json_config.sh@48 -- # local ret=0 00:05:57.527 22:58:00 -- json_config/json_config.sh@49 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:05:57.527 22:58:00 -- json_config/json_config.sh@49 -- # local enabled_types 00:05:57.527 22:58:00 -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:05:57.527 22:58:00 -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:05:57.527 22:58:00 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:05:57.527 22:58:01 -- json_config/json_config.sh@51 -- # get_types=('bdev_register' 'bdev_unregister') 00:05:57.527 22:58:01 -- json_config/json_config.sh@51 -- # local get_types 00:05:57.527 22:58:01 -- json_config/json_config.sh@52 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:05:57.527 22:58:01 -- json_config/json_config.sh@57 -- # timing_exit tgt_check_notification_types 00:05:57.527 22:58:01 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:57.527 22:58:01 -- common/autotest_common.sh@10 -- # set +x 00:05:57.527 22:58:01 -- json_config/json_config.sh@58 -- # return 0 00:05:57.527 22:58:01 -- json_config/json_config.sh@331 -- # [[ 0 -eq 1 ]] 00:05:57.527 22:58:01 -- json_config/json_config.sh@335 -- # [[ 0 -eq 1 ]] 00:05:57.527 22:58:01 -- json_config/json_config.sh@339 -- # [[ 0 -eq 1 ]] 00:05:57.527 22:58:01 -- json_config/json_config.sh@343 -- # [[ 1 -eq 1 ]] 00:05:57.527 22:58:01 -- json_config/json_config.sh@344 -- # create_nvmf_subsystem_config 00:05:57.527 22:58:01 -- json_config/json_config.sh@283 -- # timing_enter create_nvmf_subsystem_config 00:05:57.527 22:58:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:57.527 22:58:01 -- common/autotest_common.sh@10 -- # set +x 00:05:57.527 22:58:01 -- json_config/json_config.sh@285 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:05:57.527 22:58:01 -- json_config/json_config.sh@286 -- # [[ tcp == \r\d\m\a ]] 00:05:57.527 22:58:01 -- json_config/json_config.sh@290 -- # [[ -z 127.0.0.1 ]] 00:05:57.527 22:58:01 -- json_config/json_config.sh@295 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:05:57.527 22:58:01 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:05:57.784 MallocForNvmf0 00:05:57.784 22:58:01 -- json_config/json_config.sh@296 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:05:57.784 22:58:01 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:05:58.042 MallocForNvmf1 00:05:58.042 22:58:01 -- json_config/json_config.sh@298 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:05:58.042 22:58:01 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:05:58.300 [2024-11-28 22:58:01.862010] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:05:58.300 22:58:01 -- json_config/json_config.sh@299 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:05:58.300 22:58:01 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:05:58.557 22:58:02 -- json_config/json_config.sh@300 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:05:58.557 22:58:02 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:05:58.815 22:58:02 -- json_config/json_config.sh@301 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:05:58.815 22:58:02 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:05:59.073 22:58:02 -- json_config/json_config.sh@302 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:05:59.073 22:58:02 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:05:59.331 [2024-11-28 22:58:02.845302] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:05:59.331 22:58:02 -- json_config/json_config.sh@304 -- # timing_exit create_nvmf_subsystem_config 00:05:59.331 22:58:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:59.331 22:58:02 -- common/autotest_common.sh@10 -- # set +x 00:05:59.331 22:58:02 -- json_config/json_config.sh@346 -- # timing_exit json_config_setup_target 00:05:59.331 22:58:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:59.331 22:58:02 -- common/autotest_common.sh@10 -- # set +x 00:05:59.331 22:58:02 -- json_config/json_config.sh@348 -- # [[ 0 -eq 1 ]] 00:05:59.331 22:58:02 -- json_config/json_config.sh@353 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:05:59.331 22:58:02 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:05:59.590 MallocBdevForConfigChangeCheck 00:05:59.590 22:58:03 -- json_config/json_config.sh@355 -- # timing_exit json_config_test_init 00:05:59.590 22:58:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:59.590 22:58:03 -- common/autotest_common.sh@10 -- # set +x 00:05:59.590 22:58:03 -- json_config/json_config.sh@422 -- # tgt_rpc save_config 00:05:59.590 22:58:03 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:06:00.156 22:58:03 -- json_config/json_config.sh@424 -- # echo 'INFO: shutting down applications...' 00:06:00.156 INFO: shutting down applications... 00:06:00.156 22:58:03 -- json_config/json_config.sh@425 -- # [[ 0 -eq 1 ]] 00:06:00.156 22:58:03 -- json_config/json_config.sh@431 -- # json_config_clear target 00:06:00.156 22:58:03 -- json_config/json_config.sh@385 -- # [[ -n 22 ]] 00:06:00.156 22:58:03 -- json_config/json_config.sh@386 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:06:01.577 Calling clear_iscsi_subsystem 00:06:01.577 Calling clear_nvmf_subsystem 00:06:01.577 Calling clear_nbd_subsystem 00:06:01.577 Calling clear_ublk_subsystem 00:06:01.577 Calling clear_vhost_blk_subsystem 00:06:01.577 Calling clear_vhost_scsi_subsystem 00:06:01.577 Calling clear_scheduler_subsystem 00:06:01.577 Calling clear_bdev_subsystem 00:06:01.577 Calling clear_accel_subsystem 00:06:01.577 Calling clear_vmd_subsystem 00:06:01.577 Calling clear_sock_subsystem 00:06:01.577 Calling clear_iobuf_subsystem 00:06:01.860 22:58:05 -- json_config/json_config.sh@390 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:06:01.860 22:58:05 -- json_config/json_config.sh@396 -- # count=100 00:06:01.860 22:58:05 -- json_config/json_config.sh@397 -- # '[' 100 -gt 0 ']' 00:06:01.860 22:58:05 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:06:01.860 22:58:05 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:06:01.860 22:58:05 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:06:02.117 22:58:05 -- json_config/json_config.sh@398 -- # break 00:06:02.117 22:58:05 -- json_config/json_config.sh@403 -- # '[' 100 -eq 0 ']' 00:06:02.117 22:58:05 -- json_config/json_config.sh@432 -- # json_config_test_shutdown_app target 00:06:02.117 22:58:05 -- json_config/json_config.sh@120 -- # local app=target 00:06:02.117 22:58:05 -- json_config/json_config.sh@123 -- # [[ -n 22 ]] 00:06:02.117 22:58:05 -- json_config/json_config.sh@124 -- # [[ -n 2324696 ]] 00:06:02.117 22:58:05 -- json_config/json_config.sh@127 -- # kill -SIGINT 2324696 00:06:02.117 22:58:05 -- json_config/json_config.sh@129 -- # (( i = 0 )) 00:06:02.117 22:58:05 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:06:02.117 22:58:05 -- json_config/json_config.sh@130 -- # kill -0 2324696 00:06:02.117 22:58:05 -- json_config/json_config.sh@134 -- # sleep 0.5 00:06:02.684 22:58:06 -- json_config/json_config.sh@129 -- # (( i++ )) 00:06:02.684 22:58:06 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:06:02.684 22:58:06 -- json_config/json_config.sh@130 -- # kill -0 2324696 00:06:02.684 22:58:06 -- json_config/json_config.sh@131 -- # app_pid[$app]= 00:06:02.684 22:58:06 -- json_config/json_config.sh@132 -- # break 00:06:02.684 22:58:06 -- json_config/json_config.sh@137 -- # [[ -n '' ]] 00:06:02.684 22:58:06 -- json_config/json_config.sh@142 -- # echo 'SPDK target shutdown done' 00:06:02.684 SPDK target shutdown done 00:06:02.684 22:58:06 -- json_config/json_config.sh@434 -- # echo 'INFO: relaunching applications...' 00:06:02.684 INFO: relaunching applications... 00:06:02.684 22:58:06 -- json_config/json_config.sh@435 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:06:02.684 22:58:06 -- json_config/json_config.sh@98 -- # local app=target 00:06:02.684 22:58:06 -- json_config/json_config.sh@99 -- # shift 00:06:02.684 22:58:06 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:06:02.684 22:58:06 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:06:02.684 22:58:06 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:06:02.684 22:58:06 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:06:02.684 22:58:06 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:06:02.684 22:58:06 -- json_config/json_config.sh@111 -- # app_pid[$app]=2326042 00:06:02.684 22:58:06 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:06:02.684 Waiting for target to run... 00:06:02.684 22:58:06 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:06:02.684 22:58:06 -- json_config/json_config.sh@114 -- # waitforlisten 2326042 /var/tmp/spdk_tgt.sock 00:06:02.684 22:58:06 -- common/autotest_common.sh@829 -- # '[' -z 2326042 ']' 00:06:02.684 22:58:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:06:02.684 22:58:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:02.685 22:58:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:06:02.685 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:06:02.685 22:58:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:02.685 22:58:06 -- common/autotest_common.sh@10 -- # set +x 00:06:02.685 [2024-11-28 22:58:06.113326] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:02.685 [2024-11-28 22:58:06.113409] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2326042 ] 00:06:02.685 EAL: No free 2048 kB hugepages reported on node 1 00:06:03.254 [2024-11-28 22:58:06.587505] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:03.254 [2024-11-28 22:58:06.667202] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:03.254 [2024-11-28 22:58:06.667419] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:06.540 [2024-11-28 22:58:09.696367] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:06.540 [2024-11-28 22:58:09.728879] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:06:06.540 22:58:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:06.540 22:58:10 -- common/autotest_common.sh@862 -- # return 0 00:06:06.540 22:58:10 -- json_config/json_config.sh@115 -- # echo '' 00:06:06.540 00:06:06.540 22:58:10 -- json_config/json_config.sh@436 -- # [[ 0 -eq 1 ]] 00:06:06.540 22:58:10 -- json_config/json_config.sh@440 -- # echo 'INFO: Checking if target configuration is the same...' 00:06:06.540 INFO: Checking if target configuration is the same... 00:06:06.540 22:58:10 -- json_config/json_config.sh@441 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:06:06.540 22:58:10 -- json_config/json_config.sh@441 -- # tgt_rpc save_config 00:06:06.540 22:58:10 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:06:06.540 + '[' 2 -ne 2 ']' 00:06:06.540 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:06:06.540 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:06:06.540 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:06.540 +++ basename /dev/fd/62 00:06:06.540 ++ mktemp /tmp/62.XXX 00:06:06.540 + tmp_file_1=/tmp/62.tIL 00:06:06.540 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:06:06.540 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:06:06.540 + tmp_file_2=/tmp/spdk_tgt_config.json.bl2 00:06:06.540 + ret=0 00:06:06.540 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:06:07.106 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:06:07.106 + diff -u /tmp/62.tIL /tmp/spdk_tgt_config.json.bl2 00:06:07.106 + echo 'INFO: JSON config files are the same' 00:06:07.106 INFO: JSON config files are the same 00:06:07.106 + rm /tmp/62.tIL /tmp/spdk_tgt_config.json.bl2 00:06:07.106 + exit 0 00:06:07.106 22:58:10 -- json_config/json_config.sh@442 -- # [[ 0 -eq 1 ]] 00:06:07.106 22:58:10 -- json_config/json_config.sh@447 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:06:07.106 INFO: changing configuration and checking if this can be detected... 00:06:07.106 22:58:10 -- json_config/json_config.sh@449 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:06:07.106 22:58:10 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:06:07.364 22:58:10 -- json_config/json_config.sh@450 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:06:07.364 22:58:10 -- json_config/json_config.sh@450 -- # tgt_rpc save_config 00:06:07.364 22:58:10 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:06:07.364 + '[' 2 -ne 2 ']' 00:06:07.364 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:06:07.364 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:06:07.364 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:07.364 +++ basename /dev/fd/62 00:06:07.364 ++ mktemp /tmp/62.XXX 00:06:07.364 + tmp_file_1=/tmp/62.CqJ 00:06:07.364 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:06:07.364 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:06:07.364 + tmp_file_2=/tmp/spdk_tgt_config.json.bq7 00:06:07.364 + ret=0 00:06:07.364 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:06:07.622 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:06:07.622 + diff -u /tmp/62.CqJ /tmp/spdk_tgt_config.json.bq7 00:06:07.622 + ret=1 00:06:07.622 + echo '=== Start of file: /tmp/62.CqJ ===' 00:06:07.622 + cat /tmp/62.CqJ 00:06:07.622 + echo '=== End of file: /tmp/62.CqJ ===' 00:06:07.622 + echo '' 00:06:07.622 + echo '=== Start of file: /tmp/spdk_tgt_config.json.bq7 ===' 00:06:07.622 + cat /tmp/spdk_tgt_config.json.bq7 00:06:07.622 + echo '=== End of file: /tmp/spdk_tgt_config.json.bq7 ===' 00:06:07.622 + echo '' 00:06:07.622 + rm /tmp/62.CqJ /tmp/spdk_tgt_config.json.bq7 00:06:07.622 + exit 1 00:06:07.622 22:58:11 -- json_config/json_config.sh@454 -- # echo 'INFO: configuration change detected.' 00:06:07.622 INFO: configuration change detected. 00:06:07.622 22:58:11 -- json_config/json_config.sh@457 -- # json_config_test_fini 00:06:07.622 22:58:11 -- json_config/json_config.sh@359 -- # timing_enter json_config_test_fini 00:06:07.622 22:58:11 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:07.622 22:58:11 -- common/autotest_common.sh@10 -- # set +x 00:06:07.622 22:58:11 -- json_config/json_config.sh@360 -- # local ret=0 00:06:07.622 22:58:11 -- json_config/json_config.sh@362 -- # [[ -n '' ]] 00:06:07.622 22:58:11 -- json_config/json_config.sh@370 -- # [[ -n 2326042 ]] 00:06:07.622 22:58:11 -- json_config/json_config.sh@373 -- # cleanup_bdev_subsystem_config 00:06:07.622 22:58:11 -- json_config/json_config.sh@237 -- # timing_enter cleanup_bdev_subsystem_config 00:06:07.622 22:58:11 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:07.622 22:58:11 -- common/autotest_common.sh@10 -- # set +x 00:06:07.622 22:58:11 -- json_config/json_config.sh@239 -- # [[ 0 -eq 1 ]] 00:06:07.622 22:58:11 -- json_config/json_config.sh@246 -- # uname -s 00:06:07.622 22:58:11 -- json_config/json_config.sh@246 -- # [[ Linux = Linux ]] 00:06:07.622 22:58:11 -- json_config/json_config.sh@247 -- # rm -f /sample_aio 00:06:07.622 22:58:11 -- json_config/json_config.sh@250 -- # [[ 0 -eq 1 ]] 00:06:07.622 22:58:11 -- json_config/json_config.sh@254 -- # timing_exit cleanup_bdev_subsystem_config 00:06:07.622 22:58:11 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:07.622 22:58:11 -- common/autotest_common.sh@10 -- # set +x 00:06:07.880 22:58:11 -- json_config/json_config.sh@376 -- # killprocess 2326042 00:06:07.880 22:58:11 -- common/autotest_common.sh@936 -- # '[' -z 2326042 ']' 00:06:07.880 22:58:11 -- common/autotest_common.sh@940 -- # kill -0 2326042 00:06:07.880 22:58:11 -- common/autotest_common.sh@941 -- # uname 00:06:07.880 22:58:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:07.880 22:58:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2326042 00:06:07.880 22:58:11 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:07.880 22:58:11 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:07.880 22:58:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2326042' 00:06:07.880 killing process with pid 2326042 00:06:07.880 22:58:11 -- common/autotest_common.sh@955 -- # kill 2326042 00:06:07.880 22:58:11 -- common/autotest_common.sh@960 -- # wait 2326042 00:06:09.780 22:58:12 -- json_config/json_config.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:06:09.780 22:58:12 -- json_config/json_config.sh@380 -- # timing_exit json_config_test_fini 00:06:09.780 22:58:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:09.780 22:58:12 -- common/autotest_common.sh@10 -- # set +x 00:06:09.780 22:58:12 -- json_config/json_config.sh@381 -- # return 0 00:06:09.780 22:58:12 -- json_config/json_config.sh@459 -- # echo 'INFO: Success' 00:06:09.780 INFO: Success 00:06:09.780 00:06:09.780 real 0m16.430s 00:06:09.780 user 0m19.004s 00:06:09.781 sys 0m2.078s 00:06:09.781 22:58:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:09.781 22:58:12 -- common/autotest_common.sh@10 -- # set +x 00:06:09.781 ************************************ 00:06:09.781 END TEST json_config 00:06:09.781 ************************************ 00:06:09.781 22:58:12 -- spdk/autotest.sh@166 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:06:09.781 22:58:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:09.781 22:58:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:09.781 22:58:12 -- common/autotest_common.sh@10 -- # set +x 00:06:09.781 ************************************ 00:06:09.781 START TEST json_config_extra_key 00:06:09.781 ************************************ 00:06:09.781 22:58:12 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:06:09.781 22:58:12 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:09.781 22:58:12 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:09.781 22:58:12 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:09.781 22:58:13 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:09.781 22:58:13 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:09.781 22:58:13 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:09.781 22:58:13 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:09.781 22:58:13 -- scripts/common.sh@335 -- # IFS=.-: 00:06:09.781 22:58:13 -- scripts/common.sh@335 -- # read -ra ver1 00:06:09.781 22:58:13 -- scripts/common.sh@336 -- # IFS=.-: 00:06:09.781 22:58:13 -- scripts/common.sh@336 -- # read -ra ver2 00:06:09.781 22:58:13 -- scripts/common.sh@337 -- # local 'op=<' 00:06:09.781 22:58:13 -- scripts/common.sh@339 -- # ver1_l=2 00:06:09.781 22:58:13 -- scripts/common.sh@340 -- # ver2_l=1 00:06:09.781 22:58:13 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:09.781 22:58:13 -- scripts/common.sh@343 -- # case "$op" in 00:06:09.781 22:58:13 -- scripts/common.sh@344 -- # : 1 00:06:09.781 22:58:13 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:09.781 22:58:13 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:09.781 22:58:13 -- scripts/common.sh@364 -- # decimal 1 00:06:09.781 22:58:13 -- scripts/common.sh@352 -- # local d=1 00:06:09.781 22:58:13 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:09.781 22:58:13 -- scripts/common.sh@354 -- # echo 1 00:06:09.781 22:58:13 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:09.781 22:58:13 -- scripts/common.sh@365 -- # decimal 2 00:06:09.781 22:58:13 -- scripts/common.sh@352 -- # local d=2 00:06:09.781 22:58:13 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:09.781 22:58:13 -- scripts/common.sh@354 -- # echo 2 00:06:09.781 22:58:13 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:09.781 22:58:13 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:09.781 22:58:13 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:09.781 22:58:13 -- scripts/common.sh@367 -- # return 0 00:06:09.781 22:58:13 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:09.781 22:58:13 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:09.781 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:09.781 --rc genhtml_branch_coverage=1 00:06:09.781 --rc genhtml_function_coverage=1 00:06:09.781 --rc genhtml_legend=1 00:06:09.781 --rc geninfo_all_blocks=1 00:06:09.781 --rc geninfo_unexecuted_blocks=1 00:06:09.781 00:06:09.781 ' 00:06:09.781 22:58:13 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:09.781 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:09.781 --rc genhtml_branch_coverage=1 00:06:09.781 --rc genhtml_function_coverage=1 00:06:09.781 --rc genhtml_legend=1 00:06:09.781 --rc geninfo_all_blocks=1 00:06:09.781 --rc geninfo_unexecuted_blocks=1 00:06:09.781 00:06:09.781 ' 00:06:09.781 22:58:13 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:09.781 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:09.781 --rc genhtml_branch_coverage=1 00:06:09.781 --rc genhtml_function_coverage=1 00:06:09.781 --rc genhtml_legend=1 00:06:09.781 --rc geninfo_all_blocks=1 00:06:09.781 --rc geninfo_unexecuted_blocks=1 00:06:09.781 00:06:09.781 ' 00:06:09.781 22:58:13 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:09.781 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:09.781 --rc genhtml_branch_coverage=1 00:06:09.781 --rc genhtml_function_coverage=1 00:06:09.781 --rc genhtml_legend=1 00:06:09.781 --rc geninfo_all_blocks=1 00:06:09.781 --rc geninfo_unexecuted_blocks=1 00:06:09.781 00:06:09.781 ' 00:06:09.781 22:58:13 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:09.781 22:58:13 -- nvmf/common.sh@7 -- # uname -s 00:06:09.781 22:58:13 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:09.781 22:58:13 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:09.781 22:58:13 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:09.781 22:58:13 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:09.781 22:58:13 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:09.781 22:58:13 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:09.781 22:58:13 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:09.781 22:58:13 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:09.781 22:58:13 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:09.781 22:58:13 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:09.781 22:58:13 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:09.781 22:58:13 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:09.781 22:58:13 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:09.781 22:58:13 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:09.781 22:58:13 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:06:09.781 22:58:13 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:09.781 22:58:13 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:09.781 22:58:13 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:09.781 22:58:13 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:09.781 22:58:13 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:09.781 22:58:13 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:09.781 22:58:13 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:09.781 22:58:13 -- paths/export.sh@5 -- # export PATH 00:06:09.781 22:58:13 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:09.781 22:58:13 -- nvmf/common.sh@46 -- # : 0 00:06:09.781 22:58:13 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:09.781 22:58:13 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:09.781 22:58:13 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:09.781 22:58:13 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:09.781 22:58:13 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:09.781 22:58:13 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:09.781 22:58:13 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:09.781 22:58:13 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:09.781 22:58:13 -- json_config/json_config_extra_key.sh@16 -- # app_pid=(['target']='') 00:06:09.781 22:58:13 -- json_config/json_config_extra_key.sh@16 -- # declare -A app_pid 00:06:09.781 22:58:13 -- json_config/json_config_extra_key.sh@17 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:06:09.781 22:58:13 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_socket 00:06:09.782 22:58:13 -- json_config/json_config_extra_key.sh@18 -- # app_params=(['target']='-m 0x1 -s 1024') 00:06:09.782 22:58:13 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_params 00:06:09.782 22:58:13 -- json_config/json_config_extra_key.sh@19 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:06:09.782 22:58:13 -- json_config/json_config_extra_key.sh@19 -- # declare -A configs_path 00:06:09.782 22:58:13 -- json_config/json_config_extra_key.sh@74 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:06:09.782 22:58:13 -- json_config/json_config_extra_key.sh@76 -- # echo 'INFO: launching applications...' 00:06:09.782 INFO: launching applications... 00:06:09.782 22:58:13 -- json_config/json_config_extra_key.sh@77 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:06:09.782 22:58:13 -- json_config/json_config_extra_key.sh@24 -- # local app=target 00:06:09.782 22:58:13 -- json_config/json_config_extra_key.sh@25 -- # shift 00:06:09.782 22:58:13 -- json_config/json_config_extra_key.sh@27 -- # [[ -n 22 ]] 00:06:09.782 22:58:13 -- json_config/json_config_extra_key.sh@28 -- # [[ -z '' ]] 00:06:09.782 22:58:13 -- json_config/json_config_extra_key.sh@31 -- # app_pid[$app]=2327004 00:06:09.782 22:58:13 -- json_config/json_config_extra_key.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:06:09.782 22:58:13 -- json_config/json_config_extra_key.sh@33 -- # echo 'Waiting for target to run...' 00:06:09.782 Waiting for target to run... 00:06:09.782 22:58:13 -- json_config/json_config_extra_key.sh@34 -- # waitforlisten 2327004 /var/tmp/spdk_tgt.sock 00:06:09.782 22:58:13 -- common/autotest_common.sh@829 -- # '[' -z 2327004 ']' 00:06:09.782 22:58:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:06:09.782 22:58:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:09.782 22:58:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:06:09.782 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:06:09.782 22:58:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:09.782 22:58:13 -- common/autotest_common.sh@10 -- # set +x 00:06:09.782 [2024-11-28 22:58:13.106893] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:09.782 [2024-11-28 22:58:13.106993] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2327004 ] 00:06:09.782 EAL: No free 2048 kB hugepages reported on node 1 00:06:10.045 [2024-11-28 22:58:13.467484] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:10.045 [2024-11-28 22:58:13.528676] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:10.045 [2024-11-28 22:58:13.528863] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:10.612 22:58:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:10.612 22:58:14 -- common/autotest_common.sh@862 -- # return 0 00:06:10.612 22:58:14 -- json_config/json_config_extra_key.sh@35 -- # echo '' 00:06:10.612 00:06:10.612 22:58:14 -- json_config/json_config_extra_key.sh@79 -- # echo 'INFO: shutting down applications...' 00:06:10.612 INFO: shutting down applications... 00:06:10.612 22:58:14 -- json_config/json_config_extra_key.sh@80 -- # json_config_test_shutdown_app target 00:06:10.612 22:58:14 -- json_config/json_config_extra_key.sh@40 -- # local app=target 00:06:10.612 22:58:14 -- json_config/json_config_extra_key.sh@43 -- # [[ -n 22 ]] 00:06:10.612 22:58:14 -- json_config/json_config_extra_key.sh@44 -- # [[ -n 2327004 ]] 00:06:10.612 22:58:14 -- json_config/json_config_extra_key.sh@47 -- # kill -SIGINT 2327004 00:06:10.612 22:58:14 -- json_config/json_config_extra_key.sh@49 -- # (( i = 0 )) 00:06:10.612 22:58:14 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:06:10.612 22:58:14 -- json_config/json_config_extra_key.sh@50 -- # kill -0 2327004 00:06:10.612 22:58:14 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:06:11.178 22:58:14 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:06:11.178 22:58:14 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:06:11.178 22:58:14 -- json_config/json_config_extra_key.sh@50 -- # kill -0 2327004 00:06:11.178 22:58:14 -- json_config/json_config_extra_key.sh@51 -- # app_pid[$app]= 00:06:11.178 22:58:14 -- json_config/json_config_extra_key.sh@52 -- # break 00:06:11.178 22:58:14 -- json_config/json_config_extra_key.sh@57 -- # [[ -n '' ]] 00:06:11.178 22:58:14 -- json_config/json_config_extra_key.sh@62 -- # echo 'SPDK target shutdown done' 00:06:11.178 SPDK target shutdown done 00:06:11.178 22:58:14 -- json_config/json_config_extra_key.sh@82 -- # echo Success 00:06:11.178 Success 00:06:11.178 00:06:11.178 real 0m1.692s 00:06:11.178 user 0m1.685s 00:06:11.178 sys 0m0.453s 00:06:11.178 22:58:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:11.178 22:58:14 -- common/autotest_common.sh@10 -- # set +x 00:06:11.178 ************************************ 00:06:11.178 END TEST json_config_extra_key 00:06:11.178 ************************************ 00:06:11.178 22:58:14 -- spdk/autotest.sh@167 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:06:11.178 22:58:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:11.178 22:58:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:11.178 22:58:14 -- common/autotest_common.sh@10 -- # set +x 00:06:11.178 ************************************ 00:06:11.178 START TEST alias_rpc 00:06:11.178 ************************************ 00:06:11.178 22:58:14 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:06:11.178 * Looking for test storage... 00:06:11.178 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:06:11.178 22:58:14 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:11.178 22:58:14 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:11.178 22:58:14 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:11.178 22:58:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:11.178 22:58:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:11.178 22:58:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:11.178 22:58:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:11.178 22:58:14 -- scripts/common.sh@335 -- # IFS=.-: 00:06:11.178 22:58:14 -- scripts/common.sh@335 -- # read -ra ver1 00:06:11.178 22:58:14 -- scripts/common.sh@336 -- # IFS=.-: 00:06:11.178 22:58:14 -- scripts/common.sh@336 -- # read -ra ver2 00:06:11.178 22:58:14 -- scripts/common.sh@337 -- # local 'op=<' 00:06:11.178 22:58:14 -- scripts/common.sh@339 -- # ver1_l=2 00:06:11.178 22:58:14 -- scripts/common.sh@340 -- # ver2_l=1 00:06:11.178 22:58:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:11.178 22:58:14 -- scripts/common.sh@343 -- # case "$op" in 00:06:11.178 22:58:14 -- scripts/common.sh@344 -- # : 1 00:06:11.178 22:58:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:11.178 22:58:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:11.178 22:58:14 -- scripts/common.sh@364 -- # decimal 1 00:06:11.179 22:58:14 -- scripts/common.sh@352 -- # local d=1 00:06:11.179 22:58:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:11.179 22:58:14 -- scripts/common.sh@354 -- # echo 1 00:06:11.179 22:58:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:11.179 22:58:14 -- scripts/common.sh@365 -- # decimal 2 00:06:11.179 22:58:14 -- scripts/common.sh@352 -- # local d=2 00:06:11.179 22:58:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:11.179 22:58:14 -- scripts/common.sh@354 -- # echo 2 00:06:11.179 22:58:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:11.179 22:58:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:11.179 22:58:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:11.179 22:58:14 -- scripts/common.sh@367 -- # return 0 00:06:11.179 22:58:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:11.179 22:58:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:11.179 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:11.179 --rc genhtml_branch_coverage=1 00:06:11.179 --rc genhtml_function_coverage=1 00:06:11.179 --rc genhtml_legend=1 00:06:11.179 --rc geninfo_all_blocks=1 00:06:11.179 --rc geninfo_unexecuted_blocks=1 00:06:11.179 00:06:11.179 ' 00:06:11.179 22:58:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:11.179 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:11.179 --rc genhtml_branch_coverage=1 00:06:11.179 --rc genhtml_function_coverage=1 00:06:11.179 --rc genhtml_legend=1 00:06:11.179 --rc geninfo_all_blocks=1 00:06:11.179 --rc geninfo_unexecuted_blocks=1 00:06:11.179 00:06:11.179 ' 00:06:11.179 22:58:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:11.179 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:11.179 --rc genhtml_branch_coverage=1 00:06:11.179 --rc genhtml_function_coverage=1 00:06:11.179 --rc genhtml_legend=1 00:06:11.179 --rc geninfo_all_blocks=1 00:06:11.179 --rc geninfo_unexecuted_blocks=1 00:06:11.179 00:06:11.179 ' 00:06:11.179 22:58:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:11.179 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:11.179 --rc genhtml_branch_coverage=1 00:06:11.179 --rc genhtml_function_coverage=1 00:06:11.179 --rc genhtml_legend=1 00:06:11.179 --rc geninfo_all_blocks=1 00:06:11.179 --rc geninfo_unexecuted_blocks=1 00:06:11.179 00:06:11.179 ' 00:06:11.179 22:58:14 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:11.179 22:58:14 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=2327212 00:06:11.179 22:58:14 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:06:11.179 22:58:14 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 2327212 00:06:11.179 22:58:14 -- common/autotest_common.sh@829 -- # '[' -z 2327212 ']' 00:06:11.179 22:58:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:11.179 22:58:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:11.179 22:58:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:11.179 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:11.179 22:58:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:11.179 22:58:14 -- common/autotest_common.sh@10 -- # set +x 00:06:11.438 [2024-11-28 22:58:14.828361] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:11.438 [2024-11-28 22:58:14.828468] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2327212 ] 00:06:11.438 EAL: No free 2048 kB hugepages reported on node 1 00:06:11.438 [2024-11-28 22:58:14.892843] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:11.438 [2024-11-28 22:58:14.985695] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:11.438 [2024-11-28 22:58:14.985849] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:12.371 22:58:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:12.371 22:58:15 -- common/autotest_common.sh@862 -- # return 0 00:06:12.371 22:58:15 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:06:12.629 22:58:16 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 2327212 00:06:12.629 22:58:16 -- common/autotest_common.sh@936 -- # '[' -z 2327212 ']' 00:06:12.629 22:58:16 -- common/autotest_common.sh@940 -- # kill -0 2327212 00:06:12.629 22:58:16 -- common/autotest_common.sh@941 -- # uname 00:06:12.629 22:58:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:12.629 22:58:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2327212 00:06:12.629 22:58:16 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:12.629 22:58:16 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:12.629 22:58:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2327212' 00:06:12.629 killing process with pid 2327212 00:06:12.629 22:58:16 -- common/autotest_common.sh@955 -- # kill 2327212 00:06:12.629 22:58:16 -- common/autotest_common.sh@960 -- # wait 2327212 00:06:12.889 00:06:12.889 real 0m1.846s 00:06:12.889 user 0m2.105s 00:06:12.889 sys 0m0.494s 00:06:12.889 22:58:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:12.889 22:58:16 -- common/autotest_common.sh@10 -- # set +x 00:06:12.889 ************************************ 00:06:12.889 END TEST alias_rpc 00:06:12.889 ************************************ 00:06:13.148 22:58:16 -- spdk/autotest.sh@169 -- # [[ 0 -eq 0 ]] 00:06:13.148 22:58:16 -- spdk/autotest.sh@170 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:06:13.148 22:58:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:13.148 22:58:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:13.148 22:58:16 -- common/autotest_common.sh@10 -- # set +x 00:06:13.148 ************************************ 00:06:13.148 START TEST spdkcli_tcp 00:06:13.148 ************************************ 00:06:13.148 22:58:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:06:13.148 * Looking for test storage... 00:06:13.148 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:06:13.148 22:58:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:13.148 22:58:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:13.148 22:58:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:13.148 22:58:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:13.148 22:58:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:13.148 22:58:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:13.148 22:58:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:13.148 22:58:16 -- scripts/common.sh@335 -- # IFS=.-: 00:06:13.148 22:58:16 -- scripts/common.sh@335 -- # read -ra ver1 00:06:13.148 22:58:16 -- scripts/common.sh@336 -- # IFS=.-: 00:06:13.148 22:58:16 -- scripts/common.sh@336 -- # read -ra ver2 00:06:13.148 22:58:16 -- scripts/common.sh@337 -- # local 'op=<' 00:06:13.148 22:58:16 -- scripts/common.sh@339 -- # ver1_l=2 00:06:13.148 22:58:16 -- scripts/common.sh@340 -- # ver2_l=1 00:06:13.148 22:58:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:13.148 22:58:16 -- scripts/common.sh@343 -- # case "$op" in 00:06:13.148 22:58:16 -- scripts/common.sh@344 -- # : 1 00:06:13.148 22:58:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:13.148 22:58:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:13.148 22:58:16 -- scripts/common.sh@364 -- # decimal 1 00:06:13.148 22:58:16 -- scripts/common.sh@352 -- # local d=1 00:06:13.148 22:58:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:13.148 22:58:16 -- scripts/common.sh@354 -- # echo 1 00:06:13.148 22:58:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:13.148 22:58:16 -- scripts/common.sh@365 -- # decimal 2 00:06:13.148 22:58:16 -- scripts/common.sh@352 -- # local d=2 00:06:13.148 22:58:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:13.148 22:58:16 -- scripts/common.sh@354 -- # echo 2 00:06:13.148 22:58:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:13.148 22:58:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:13.148 22:58:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:13.148 22:58:16 -- scripts/common.sh@367 -- # return 0 00:06:13.148 22:58:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:13.148 22:58:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:13.148 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:13.148 --rc genhtml_branch_coverage=1 00:06:13.148 --rc genhtml_function_coverage=1 00:06:13.148 --rc genhtml_legend=1 00:06:13.148 --rc geninfo_all_blocks=1 00:06:13.148 --rc geninfo_unexecuted_blocks=1 00:06:13.148 00:06:13.148 ' 00:06:13.148 22:58:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:13.148 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:13.148 --rc genhtml_branch_coverage=1 00:06:13.148 --rc genhtml_function_coverage=1 00:06:13.148 --rc genhtml_legend=1 00:06:13.148 --rc geninfo_all_blocks=1 00:06:13.148 --rc geninfo_unexecuted_blocks=1 00:06:13.148 00:06:13.148 ' 00:06:13.148 22:58:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:13.148 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:13.148 --rc genhtml_branch_coverage=1 00:06:13.148 --rc genhtml_function_coverage=1 00:06:13.148 --rc genhtml_legend=1 00:06:13.148 --rc geninfo_all_blocks=1 00:06:13.148 --rc geninfo_unexecuted_blocks=1 00:06:13.148 00:06:13.148 ' 00:06:13.148 22:58:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:13.148 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:13.148 --rc genhtml_branch_coverage=1 00:06:13.148 --rc genhtml_function_coverage=1 00:06:13.148 --rc genhtml_legend=1 00:06:13.148 --rc geninfo_all_blocks=1 00:06:13.148 --rc geninfo_unexecuted_blocks=1 00:06:13.148 00:06:13.148 ' 00:06:13.148 22:58:16 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:06:13.148 22:58:16 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:06:13.148 22:58:16 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:06:13.148 22:58:16 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:06:13.148 22:58:16 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:06:13.148 22:58:16 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:06:13.148 22:58:16 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:06:13.148 22:58:16 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:13.148 22:58:16 -- common/autotest_common.sh@10 -- # set +x 00:06:13.148 22:58:16 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=2327535 00:06:13.148 22:58:16 -- spdkcli/tcp.sh@27 -- # waitforlisten 2327535 00:06:13.148 22:58:16 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:06:13.148 22:58:16 -- common/autotest_common.sh@829 -- # '[' -z 2327535 ']' 00:06:13.148 22:58:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:13.148 22:58:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:13.148 22:58:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:13.148 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:13.148 22:58:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:13.148 22:58:16 -- common/autotest_common.sh@10 -- # set +x 00:06:13.148 [2024-11-28 22:58:16.703667] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:13.148 [2024-11-28 22:58:16.703785] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2327535 ] 00:06:13.148 EAL: No free 2048 kB hugepages reported on node 1 00:06:13.407 [2024-11-28 22:58:16.766208] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:13.407 [2024-11-28 22:58:16.853369] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:13.407 [2024-11-28 22:58:16.853598] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:13.407 [2024-11-28 22:58:16.853605] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:14.341 22:58:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:14.341 22:58:17 -- common/autotest_common.sh@862 -- # return 0 00:06:14.341 22:58:17 -- spdkcli/tcp.sh@31 -- # socat_pid=2327676 00:06:14.341 22:58:17 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:06:14.341 22:58:17 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:06:14.341 [ 00:06:14.341 "bdev_malloc_delete", 00:06:14.341 "bdev_malloc_create", 00:06:14.341 "bdev_null_resize", 00:06:14.341 "bdev_null_delete", 00:06:14.341 "bdev_null_create", 00:06:14.341 "bdev_nvme_cuse_unregister", 00:06:14.341 "bdev_nvme_cuse_register", 00:06:14.341 "bdev_opal_new_user", 00:06:14.341 "bdev_opal_set_lock_state", 00:06:14.341 "bdev_opal_delete", 00:06:14.341 "bdev_opal_get_info", 00:06:14.341 "bdev_opal_create", 00:06:14.341 "bdev_nvme_opal_revert", 00:06:14.341 "bdev_nvme_opal_init", 00:06:14.341 "bdev_nvme_send_cmd", 00:06:14.341 "bdev_nvme_get_path_iostat", 00:06:14.341 "bdev_nvme_get_mdns_discovery_info", 00:06:14.341 "bdev_nvme_stop_mdns_discovery", 00:06:14.341 "bdev_nvme_start_mdns_discovery", 00:06:14.341 "bdev_nvme_set_multipath_policy", 00:06:14.341 "bdev_nvme_set_preferred_path", 00:06:14.341 "bdev_nvme_get_io_paths", 00:06:14.341 "bdev_nvme_remove_error_injection", 00:06:14.341 "bdev_nvme_add_error_injection", 00:06:14.341 "bdev_nvme_get_discovery_info", 00:06:14.341 "bdev_nvme_stop_discovery", 00:06:14.341 "bdev_nvme_start_discovery", 00:06:14.342 "bdev_nvme_get_controller_health_info", 00:06:14.342 "bdev_nvme_disable_controller", 00:06:14.342 "bdev_nvme_enable_controller", 00:06:14.342 "bdev_nvme_reset_controller", 00:06:14.342 "bdev_nvme_get_transport_statistics", 00:06:14.342 "bdev_nvme_apply_firmware", 00:06:14.342 "bdev_nvme_detach_controller", 00:06:14.342 "bdev_nvme_get_controllers", 00:06:14.342 "bdev_nvme_attach_controller", 00:06:14.342 "bdev_nvme_set_hotplug", 00:06:14.342 "bdev_nvme_set_options", 00:06:14.342 "bdev_passthru_delete", 00:06:14.342 "bdev_passthru_create", 00:06:14.342 "bdev_lvol_grow_lvstore", 00:06:14.342 "bdev_lvol_get_lvols", 00:06:14.342 "bdev_lvol_get_lvstores", 00:06:14.342 "bdev_lvol_delete", 00:06:14.342 "bdev_lvol_set_read_only", 00:06:14.342 "bdev_lvol_resize", 00:06:14.342 "bdev_lvol_decouple_parent", 00:06:14.342 "bdev_lvol_inflate", 00:06:14.342 "bdev_lvol_rename", 00:06:14.342 "bdev_lvol_clone_bdev", 00:06:14.342 "bdev_lvol_clone", 00:06:14.342 "bdev_lvol_snapshot", 00:06:14.342 "bdev_lvol_create", 00:06:14.342 "bdev_lvol_delete_lvstore", 00:06:14.342 "bdev_lvol_rename_lvstore", 00:06:14.342 "bdev_lvol_create_lvstore", 00:06:14.342 "bdev_raid_set_options", 00:06:14.342 "bdev_raid_remove_base_bdev", 00:06:14.342 "bdev_raid_add_base_bdev", 00:06:14.342 "bdev_raid_delete", 00:06:14.342 "bdev_raid_create", 00:06:14.342 "bdev_raid_get_bdevs", 00:06:14.342 "bdev_error_inject_error", 00:06:14.342 "bdev_error_delete", 00:06:14.342 "bdev_error_create", 00:06:14.342 "bdev_split_delete", 00:06:14.342 "bdev_split_create", 00:06:14.342 "bdev_delay_delete", 00:06:14.342 "bdev_delay_create", 00:06:14.342 "bdev_delay_update_latency", 00:06:14.342 "bdev_zone_block_delete", 00:06:14.342 "bdev_zone_block_create", 00:06:14.342 "blobfs_create", 00:06:14.342 "blobfs_detect", 00:06:14.342 "blobfs_set_cache_size", 00:06:14.342 "bdev_aio_delete", 00:06:14.342 "bdev_aio_rescan", 00:06:14.342 "bdev_aio_create", 00:06:14.342 "bdev_ftl_set_property", 00:06:14.342 "bdev_ftl_get_properties", 00:06:14.342 "bdev_ftl_get_stats", 00:06:14.342 "bdev_ftl_unmap", 00:06:14.342 "bdev_ftl_unload", 00:06:14.342 "bdev_ftl_delete", 00:06:14.342 "bdev_ftl_load", 00:06:14.342 "bdev_ftl_create", 00:06:14.342 "bdev_virtio_attach_controller", 00:06:14.342 "bdev_virtio_scsi_get_devices", 00:06:14.342 "bdev_virtio_detach_controller", 00:06:14.342 "bdev_virtio_blk_set_hotplug", 00:06:14.342 "bdev_iscsi_delete", 00:06:14.342 "bdev_iscsi_create", 00:06:14.342 "bdev_iscsi_set_options", 00:06:14.342 "accel_error_inject_error", 00:06:14.342 "ioat_scan_accel_module", 00:06:14.342 "dsa_scan_accel_module", 00:06:14.342 "iaa_scan_accel_module", 00:06:14.342 "vfu_virtio_create_scsi_endpoint", 00:06:14.342 "vfu_virtio_scsi_remove_target", 00:06:14.342 "vfu_virtio_scsi_add_target", 00:06:14.342 "vfu_virtio_create_blk_endpoint", 00:06:14.342 "vfu_virtio_delete_endpoint", 00:06:14.342 "iscsi_set_options", 00:06:14.342 "iscsi_get_auth_groups", 00:06:14.342 "iscsi_auth_group_remove_secret", 00:06:14.342 "iscsi_auth_group_add_secret", 00:06:14.342 "iscsi_delete_auth_group", 00:06:14.342 "iscsi_create_auth_group", 00:06:14.342 "iscsi_set_discovery_auth", 00:06:14.342 "iscsi_get_options", 00:06:14.342 "iscsi_target_node_request_logout", 00:06:14.342 "iscsi_target_node_set_redirect", 00:06:14.342 "iscsi_target_node_set_auth", 00:06:14.342 "iscsi_target_node_add_lun", 00:06:14.342 "iscsi_get_connections", 00:06:14.342 "iscsi_portal_group_set_auth", 00:06:14.342 "iscsi_start_portal_group", 00:06:14.342 "iscsi_delete_portal_group", 00:06:14.342 "iscsi_create_portal_group", 00:06:14.342 "iscsi_get_portal_groups", 00:06:14.342 "iscsi_delete_target_node", 00:06:14.342 "iscsi_target_node_remove_pg_ig_maps", 00:06:14.342 "iscsi_target_node_add_pg_ig_maps", 00:06:14.342 "iscsi_create_target_node", 00:06:14.342 "iscsi_get_target_nodes", 00:06:14.342 "iscsi_delete_initiator_group", 00:06:14.342 "iscsi_initiator_group_remove_initiators", 00:06:14.342 "iscsi_initiator_group_add_initiators", 00:06:14.342 "iscsi_create_initiator_group", 00:06:14.342 "iscsi_get_initiator_groups", 00:06:14.342 "nvmf_set_crdt", 00:06:14.342 "nvmf_set_config", 00:06:14.342 "nvmf_set_max_subsystems", 00:06:14.342 "nvmf_subsystem_get_listeners", 00:06:14.342 "nvmf_subsystem_get_qpairs", 00:06:14.342 "nvmf_subsystem_get_controllers", 00:06:14.342 "nvmf_get_stats", 00:06:14.342 "nvmf_get_transports", 00:06:14.342 "nvmf_create_transport", 00:06:14.342 "nvmf_get_targets", 00:06:14.342 "nvmf_delete_target", 00:06:14.342 "nvmf_create_target", 00:06:14.342 "nvmf_subsystem_allow_any_host", 00:06:14.342 "nvmf_subsystem_remove_host", 00:06:14.342 "nvmf_subsystem_add_host", 00:06:14.342 "nvmf_subsystem_remove_ns", 00:06:14.342 "nvmf_subsystem_add_ns", 00:06:14.342 "nvmf_subsystem_listener_set_ana_state", 00:06:14.342 "nvmf_discovery_get_referrals", 00:06:14.342 "nvmf_discovery_remove_referral", 00:06:14.342 "nvmf_discovery_add_referral", 00:06:14.342 "nvmf_subsystem_remove_listener", 00:06:14.342 "nvmf_subsystem_add_listener", 00:06:14.342 "nvmf_delete_subsystem", 00:06:14.342 "nvmf_create_subsystem", 00:06:14.342 "nvmf_get_subsystems", 00:06:14.342 "env_dpdk_get_mem_stats", 00:06:14.342 "nbd_get_disks", 00:06:14.342 "nbd_stop_disk", 00:06:14.342 "nbd_start_disk", 00:06:14.342 "ublk_recover_disk", 00:06:14.342 "ublk_get_disks", 00:06:14.342 "ublk_stop_disk", 00:06:14.342 "ublk_start_disk", 00:06:14.342 "ublk_destroy_target", 00:06:14.342 "ublk_create_target", 00:06:14.342 "virtio_blk_create_transport", 00:06:14.342 "virtio_blk_get_transports", 00:06:14.342 "vhost_controller_set_coalescing", 00:06:14.342 "vhost_get_controllers", 00:06:14.342 "vhost_delete_controller", 00:06:14.342 "vhost_create_blk_controller", 00:06:14.342 "vhost_scsi_controller_remove_target", 00:06:14.342 "vhost_scsi_controller_add_target", 00:06:14.342 "vhost_start_scsi_controller", 00:06:14.342 "vhost_create_scsi_controller", 00:06:14.342 "thread_set_cpumask", 00:06:14.342 "framework_get_scheduler", 00:06:14.342 "framework_set_scheduler", 00:06:14.342 "framework_get_reactors", 00:06:14.342 "thread_get_io_channels", 00:06:14.342 "thread_get_pollers", 00:06:14.342 "thread_get_stats", 00:06:14.342 "framework_monitor_context_switch", 00:06:14.342 "spdk_kill_instance", 00:06:14.342 "log_enable_timestamps", 00:06:14.342 "log_get_flags", 00:06:14.342 "log_clear_flag", 00:06:14.342 "log_set_flag", 00:06:14.342 "log_get_level", 00:06:14.342 "log_set_level", 00:06:14.342 "log_get_print_level", 00:06:14.342 "log_set_print_level", 00:06:14.342 "framework_enable_cpumask_locks", 00:06:14.342 "framework_disable_cpumask_locks", 00:06:14.342 "framework_wait_init", 00:06:14.342 "framework_start_init", 00:06:14.342 "scsi_get_devices", 00:06:14.342 "bdev_get_histogram", 00:06:14.342 "bdev_enable_histogram", 00:06:14.342 "bdev_set_qos_limit", 00:06:14.342 "bdev_set_qd_sampling_period", 00:06:14.342 "bdev_get_bdevs", 00:06:14.342 "bdev_reset_iostat", 00:06:14.342 "bdev_get_iostat", 00:06:14.342 "bdev_examine", 00:06:14.342 "bdev_wait_for_examine", 00:06:14.342 "bdev_set_options", 00:06:14.342 "notify_get_notifications", 00:06:14.342 "notify_get_types", 00:06:14.342 "accel_get_stats", 00:06:14.342 "accel_set_options", 00:06:14.342 "accel_set_driver", 00:06:14.342 "accel_crypto_key_destroy", 00:06:14.342 "accel_crypto_keys_get", 00:06:14.342 "accel_crypto_key_create", 00:06:14.342 "accel_assign_opc", 00:06:14.342 "accel_get_module_info", 00:06:14.342 "accel_get_opc_assignments", 00:06:14.342 "vmd_rescan", 00:06:14.342 "vmd_remove_device", 00:06:14.342 "vmd_enable", 00:06:14.342 "sock_set_default_impl", 00:06:14.342 "sock_impl_set_options", 00:06:14.342 "sock_impl_get_options", 00:06:14.342 "iobuf_get_stats", 00:06:14.342 "iobuf_set_options", 00:06:14.342 "framework_get_pci_devices", 00:06:14.342 "framework_get_config", 00:06:14.342 "framework_get_subsystems", 00:06:14.342 "vfu_tgt_set_base_path", 00:06:14.342 "trace_get_info", 00:06:14.342 "trace_get_tpoint_group_mask", 00:06:14.342 "trace_disable_tpoint_group", 00:06:14.342 "trace_enable_tpoint_group", 00:06:14.342 "trace_clear_tpoint_mask", 00:06:14.342 "trace_set_tpoint_mask", 00:06:14.342 "spdk_get_version", 00:06:14.342 "rpc_get_methods" 00:06:14.342 ] 00:06:14.342 22:58:17 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:06:14.342 22:58:17 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:14.342 22:58:17 -- common/autotest_common.sh@10 -- # set +x 00:06:14.342 22:58:17 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:06:14.342 22:58:17 -- spdkcli/tcp.sh@38 -- # killprocess 2327535 00:06:14.342 22:58:17 -- common/autotest_common.sh@936 -- # '[' -z 2327535 ']' 00:06:14.342 22:58:17 -- common/autotest_common.sh@940 -- # kill -0 2327535 00:06:14.342 22:58:17 -- common/autotest_common.sh@941 -- # uname 00:06:14.342 22:58:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:14.342 22:58:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2327535 00:06:14.601 22:58:17 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:14.601 22:58:17 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:14.601 22:58:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2327535' 00:06:14.601 killing process with pid 2327535 00:06:14.601 22:58:17 -- common/autotest_common.sh@955 -- # kill 2327535 00:06:14.601 22:58:17 -- common/autotest_common.sh@960 -- # wait 2327535 00:06:14.859 00:06:14.859 real 0m1.852s 00:06:14.859 user 0m3.553s 00:06:14.859 sys 0m0.491s 00:06:14.859 22:58:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:14.859 22:58:18 -- common/autotest_common.sh@10 -- # set +x 00:06:14.859 ************************************ 00:06:14.859 END TEST spdkcli_tcp 00:06:14.859 ************************************ 00:06:14.859 22:58:18 -- spdk/autotest.sh@173 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:06:14.859 22:58:18 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:14.859 22:58:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:14.859 22:58:18 -- common/autotest_common.sh@10 -- # set +x 00:06:14.859 ************************************ 00:06:14.859 START TEST dpdk_mem_utility 00:06:14.859 ************************************ 00:06:14.859 22:58:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:06:14.859 * Looking for test storage... 00:06:14.859 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:06:14.859 22:58:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:14.859 22:58:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:14.859 22:58:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:15.118 22:58:18 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:15.118 22:58:18 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:15.118 22:58:18 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:15.118 22:58:18 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:15.118 22:58:18 -- scripts/common.sh@335 -- # IFS=.-: 00:06:15.118 22:58:18 -- scripts/common.sh@335 -- # read -ra ver1 00:06:15.118 22:58:18 -- scripts/common.sh@336 -- # IFS=.-: 00:06:15.118 22:58:18 -- scripts/common.sh@336 -- # read -ra ver2 00:06:15.118 22:58:18 -- scripts/common.sh@337 -- # local 'op=<' 00:06:15.118 22:58:18 -- scripts/common.sh@339 -- # ver1_l=2 00:06:15.118 22:58:18 -- scripts/common.sh@340 -- # ver2_l=1 00:06:15.118 22:58:18 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:15.118 22:58:18 -- scripts/common.sh@343 -- # case "$op" in 00:06:15.118 22:58:18 -- scripts/common.sh@344 -- # : 1 00:06:15.118 22:58:18 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:15.118 22:58:18 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:15.118 22:58:18 -- scripts/common.sh@364 -- # decimal 1 00:06:15.118 22:58:18 -- scripts/common.sh@352 -- # local d=1 00:06:15.118 22:58:18 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:15.118 22:58:18 -- scripts/common.sh@354 -- # echo 1 00:06:15.118 22:58:18 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:15.118 22:58:18 -- scripts/common.sh@365 -- # decimal 2 00:06:15.118 22:58:18 -- scripts/common.sh@352 -- # local d=2 00:06:15.118 22:58:18 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:15.118 22:58:18 -- scripts/common.sh@354 -- # echo 2 00:06:15.118 22:58:18 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:15.118 22:58:18 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:15.118 22:58:18 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:15.118 22:58:18 -- scripts/common.sh@367 -- # return 0 00:06:15.118 22:58:18 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:15.118 22:58:18 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:15.118 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:15.118 --rc genhtml_branch_coverage=1 00:06:15.118 --rc genhtml_function_coverage=1 00:06:15.118 --rc genhtml_legend=1 00:06:15.118 --rc geninfo_all_blocks=1 00:06:15.118 --rc geninfo_unexecuted_blocks=1 00:06:15.118 00:06:15.118 ' 00:06:15.118 22:58:18 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:15.118 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:15.118 --rc genhtml_branch_coverage=1 00:06:15.118 --rc genhtml_function_coverage=1 00:06:15.118 --rc genhtml_legend=1 00:06:15.118 --rc geninfo_all_blocks=1 00:06:15.118 --rc geninfo_unexecuted_blocks=1 00:06:15.118 00:06:15.118 ' 00:06:15.118 22:58:18 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:15.118 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:15.118 --rc genhtml_branch_coverage=1 00:06:15.118 --rc genhtml_function_coverage=1 00:06:15.118 --rc genhtml_legend=1 00:06:15.118 --rc geninfo_all_blocks=1 00:06:15.118 --rc geninfo_unexecuted_blocks=1 00:06:15.118 00:06:15.118 ' 00:06:15.118 22:58:18 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:15.118 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:15.118 --rc genhtml_branch_coverage=1 00:06:15.118 --rc genhtml_function_coverage=1 00:06:15.118 --rc genhtml_legend=1 00:06:15.118 --rc geninfo_all_blocks=1 00:06:15.118 --rc geninfo_unexecuted_blocks=1 00:06:15.118 00:06:15.118 ' 00:06:15.118 22:58:18 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:06:15.118 22:58:18 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=2327881 00:06:15.118 22:58:18 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:06:15.118 22:58:18 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 2327881 00:06:15.118 22:58:18 -- common/autotest_common.sh@829 -- # '[' -z 2327881 ']' 00:06:15.118 22:58:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:15.118 22:58:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:15.118 22:58:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:15.118 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:15.118 22:58:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:15.118 22:58:18 -- common/autotest_common.sh@10 -- # set +x 00:06:15.118 [2024-11-28 22:58:18.573252] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:15.118 [2024-11-28 22:58:18.573345] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2327881 ] 00:06:15.118 EAL: No free 2048 kB hugepages reported on node 1 00:06:15.118 [2024-11-28 22:58:18.631390] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:15.118 [2024-11-28 22:58:18.715660] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:15.118 [2024-11-28 22:58:18.715846] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:16.053 22:58:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:16.053 22:58:19 -- common/autotest_common.sh@862 -- # return 0 00:06:16.053 22:58:19 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:06:16.053 22:58:19 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:06:16.053 22:58:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:16.053 22:58:19 -- common/autotest_common.sh@10 -- # set +x 00:06:16.053 { 00:06:16.053 "filename": "/tmp/spdk_mem_dump.txt" 00:06:16.053 } 00:06:16.053 22:58:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:16.053 22:58:19 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:06:16.053 DPDK memory size 814.000000 MiB in 1 heap(s) 00:06:16.053 1 heaps totaling size 814.000000 MiB 00:06:16.053 size: 814.000000 MiB heap id: 0 00:06:16.053 end heaps---------- 00:06:16.053 8 mempools totaling size 598.116089 MiB 00:06:16.053 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:06:16.053 size: 158.602051 MiB name: PDU_data_out_Pool 00:06:16.053 size: 84.521057 MiB name: bdev_io_2327881 00:06:16.053 size: 51.011292 MiB name: evtpool_2327881 00:06:16.053 size: 50.003479 MiB name: msgpool_2327881 00:06:16.053 size: 21.763794 MiB name: PDU_Pool 00:06:16.053 size: 19.513306 MiB name: SCSI_TASK_Pool 00:06:16.053 size: 0.026123 MiB name: Session_Pool 00:06:16.053 end mempools------- 00:06:16.053 6 memzones totaling size 4.142822 MiB 00:06:16.053 size: 1.000366 MiB name: RG_ring_0_2327881 00:06:16.053 size: 1.000366 MiB name: RG_ring_1_2327881 00:06:16.053 size: 1.000366 MiB name: RG_ring_4_2327881 00:06:16.053 size: 1.000366 MiB name: RG_ring_5_2327881 00:06:16.053 size: 0.125366 MiB name: RG_ring_2_2327881 00:06:16.053 size: 0.015991 MiB name: RG_ring_3_2327881 00:06:16.053 end memzones------- 00:06:16.053 22:58:19 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:06:16.312 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:06:16.312 list of free elements. size: 12.519348 MiB 00:06:16.312 element at address: 0x200000400000 with size: 1.999512 MiB 00:06:16.312 element at address: 0x200018e00000 with size: 0.999878 MiB 00:06:16.312 element at address: 0x200019000000 with size: 0.999878 MiB 00:06:16.312 element at address: 0x200003e00000 with size: 0.996277 MiB 00:06:16.312 element at address: 0x200031c00000 with size: 0.994446 MiB 00:06:16.312 element at address: 0x200013800000 with size: 0.978699 MiB 00:06:16.312 element at address: 0x200007000000 with size: 0.959839 MiB 00:06:16.312 element at address: 0x200019200000 with size: 0.936584 MiB 00:06:16.312 element at address: 0x200000200000 with size: 0.841614 MiB 00:06:16.312 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:06:16.312 element at address: 0x20000b200000 with size: 0.490723 MiB 00:06:16.312 element at address: 0x200000800000 with size: 0.487793 MiB 00:06:16.312 element at address: 0x200019400000 with size: 0.485657 MiB 00:06:16.312 element at address: 0x200027e00000 with size: 0.410034 MiB 00:06:16.312 element at address: 0x200003a00000 with size: 0.355530 MiB 00:06:16.312 list of standard malloc elements. size: 199.218079 MiB 00:06:16.312 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:06:16.312 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:06:16.312 element at address: 0x200018efff80 with size: 1.000122 MiB 00:06:16.312 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:06:16.312 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:06:16.312 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:06:16.312 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:06:16.312 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:06:16.312 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:06:16.312 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:06:16.312 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:06:16.312 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:06:16.312 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:06:16.312 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:06:16.312 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:06:16.312 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:06:16.312 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:06:16.312 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:06:16.312 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:06:16.312 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:06:16.312 element at address: 0x200003adb300 with size: 0.000183 MiB 00:06:16.312 element at address: 0x200003adb500 with size: 0.000183 MiB 00:06:16.312 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:06:16.312 element at address: 0x200003affa80 with size: 0.000183 MiB 00:06:16.312 element at address: 0x200003affb40 with size: 0.000183 MiB 00:06:16.312 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:06:16.312 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:06:16.312 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:06:16.312 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:06:16.312 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:06:16.312 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:06:16.312 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:06:16.312 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:06:16.312 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:06:16.312 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:06:16.312 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:06:16.313 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:06:16.313 element at address: 0x200027e69040 with size: 0.000183 MiB 00:06:16.313 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:06:16.313 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:06:16.313 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:06:16.313 list of memzone associated elements. size: 602.262573 MiB 00:06:16.313 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:06:16.313 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:06:16.313 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:06:16.313 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:06:16.313 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:06:16.313 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_2327881_0 00:06:16.313 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:06:16.313 associated memzone info: size: 48.002930 MiB name: MP_evtpool_2327881_0 00:06:16.313 element at address: 0x200003fff380 with size: 48.003052 MiB 00:06:16.313 associated memzone info: size: 48.002930 MiB name: MP_msgpool_2327881_0 00:06:16.313 element at address: 0x2000195be940 with size: 20.255554 MiB 00:06:16.313 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:06:16.313 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:06:16.313 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:06:16.313 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:06:16.313 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_2327881 00:06:16.313 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:06:16.313 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_2327881 00:06:16.313 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:06:16.313 associated memzone info: size: 1.007996 MiB name: MP_evtpool_2327881 00:06:16.313 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:06:16.313 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:06:16.313 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:06:16.313 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:06:16.313 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:06:16.313 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:06:16.313 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:06:16.313 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:06:16.313 element at address: 0x200003eff180 with size: 1.000488 MiB 00:06:16.313 associated memzone info: size: 1.000366 MiB name: RG_ring_0_2327881 00:06:16.313 element at address: 0x200003affc00 with size: 1.000488 MiB 00:06:16.313 associated memzone info: size: 1.000366 MiB name: RG_ring_1_2327881 00:06:16.313 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:06:16.313 associated memzone info: size: 1.000366 MiB name: RG_ring_4_2327881 00:06:16.313 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:06:16.313 associated memzone info: size: 1.000366 MiB name: RG_ring_5_2327881 00:06:16.313 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:06:16.313 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_2327881 00:06:16.313 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:06:16.313 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:06:16.313 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:06:16.313 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:06:16.313 element at address: 0x20001947c540 with size: 0.250488 MiB 00:06:16.313 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:06:16.313 element at address: 0x200003adf880 with size: 0.125488 MiB 00:06:16.313 associated memzone info: size: 0.125366 MiB name: RG_ring_2_2327881 00:06:16.313 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:06:16.313 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:06:16.313 element at address: 0x200027e69100 with size: 0.023743 MiB 00:06:16.313 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:06:16.313 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:06:16.313 associated memzone info: size: 0.015991 MiB name: RG_ring_3_2327881 00:06:16.313 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:06:16.313 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:06:16.313 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:06:16.313 associated memzone info: size: 0.000183 MiB name: MP_msgpool_2327881 00:06:16.313 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:06:16.313 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_2327881 00:06:16.313 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:06:16.313 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:06:16.313 22:58:19 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:06:16.313 22:58:19 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 2327881 00:06:16.313 22:58:19 -- common/autotest_common.sh@936 -- # '[' -z 2327881 ']' 00:06:16.313 22:58:19 -- common/autotest_common.sh@940 -- # kill -0 2327881 00:06:16.313 22:58:19 -- common/autotest_common.sh@941 -- # uname 00:06:16.313 22:58:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:16.313 22:58:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2327881 00:06:16.313 22:58:19 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:16.313 22:58:19 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:16.313 22:58:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2327881' 00:06:16.313 killing process with pid 2327881 00:06:16.313 22:58:19 -- common/autotest_common.sh@955 -- # kill 2327881 00:06:16.313 22:58:19 -- common/autotest_common.sh@960 -- # wait 2327881 00:06:16.571 00:06:16.571 real 0m1.746s 00:06:16.571 user 0m1.971s 00:06:16.571 sys 0m0.453s 00:06:16.571 22:58:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:16.571 22:58:20 -- common/autotest_common.sh@10 -- # set +x 00:06:16.571 ************************************ 00:06:16.571 END TEST dpdk_mem_utility 00:06:16.571 ************************************ 00:06:16.571 22:58:20 -- spdk/autotest.sh@174 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:06:16.571 22:58:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:16.571 22:58:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:16.571 22:58:20 -- common/autotest_common.sh@10 -- # set +x 00:06:16.571 ************************************ 00:06:16.571 START TEST event 00:06:16.571 ************************************ 00:06:16.571 22:58:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:06:16.831 * Looking for test storage... 00:06:16.831 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:06:16.831 22:58:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:16.831 22:58:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:16.831 22:58:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:16.831 22:58:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:16.831 22:58:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:16.831 22:58:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:16.831 22:58:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:16.831 22:58:20 -- scripts/common.sh@335 -- # IFS=.-: 00:06:16.831 22:58:20 -- scripts/common.sh@335 -- # read -ra ver1 00:06:16.831 22:58:20 -- scripts/common.sh@336 -- # IFS=.-: 00:06:16.831 22:58:20 -- scripts/common.sh@336 -- # read -ra ver2 00:06:16.831 22:58:20 -- scripts/common.sh@337 -- # local 'op=<' 00:06:16.831 22:58:20 -- scripts/common.sh@339 -- # ver1_l=2 00:06:16.831 22:58:20 -- scripts/common.sh@340 -- # ver2_l=1 00:06:16.831 22:58:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:16.831 22:58:20 -- scripts/common.sh@343 -- # case "$op" in 00:06:16.831 22:58:20 -- scripts/common.sh@344 -- # : 1 00:06:16.831 22:58:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:16.831 22:58:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:16.831 22:58:20 -- scripts/common.sh@364 -- # decimal 1 00:06:16.831 22:58:20 -- scripts/common.sh@352 -- # local d=1 00:06:16.831 22:58:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:16.831 22:58:20 -- scripts/common.sh@354 -- # echo 1 00:06:16.831 22:58:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:16.831 22:58:20 -- scripts/common.sh@365 -- # decimal 2 00:06:16.831 22:58:20 -- scripts/common.sh@352 -- # local d=2 00:06:16.831 22:58:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:16.831 22:58:20 -- scripts/common.sh@354 -- # echo 2 00:06:16.831 22:58:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:16.831 22:58:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:16.831 22:58:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:16.831 22:58:20 -- scripts/common.sh@367 -- # return 0 00:06:16.831 22:58:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:16.831 22:58:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:16.831 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:16.831 --rc genhtml_branch_coverage=1 00:06:16.831 --rc genhtml_function_coverage=1 00:06:16.831 --rc genhtml_legend=1 00:06:16.831 --rc geninfo_all_blocks=1 00:06:16.831 --rc geninfo_unexecuted_blocks=1 00:06:16.831 00:06:16.831 ' 00:06:16.831 22:58:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:16.831 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:16.831 --rc genhtml_branch_coverage=1 00:06:16.831 --rc genhtml_function_coverage=1 00:06:16.831 --rc genhtml_legend=1 00:06:16.831 --rc geninfo_all_blocks=1 00:06:16.831 --rc geninfo_unexecuted_blocks=1 00:06:16.831 00:06:16.831 ' 00:06:16.831 22:58:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:16.831 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:16.831 --rc genhtml_branch_coverage=1 00:06:16.831 --rc genhtml_function_coverage=1 00:06:16.831 --rc genhtml_legend=1 00:06:16.831 --rc geninfo_all_blocks=1 00:06:16.831 --rc geninfo_unexecuted_blocks=1 00:06:16.831 00:06:16.831 ' 00:06:16.831 22:58:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:16.831 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:16.831 --rc genhtml_branch_coverage=1 00:06:16.831 --rc genhtml_function_coverage=1 00:06:16.831 --rc genhtml_legend=1 00:06:16.831 --rc geninfo_all_blocks=1 00:06:16.831 --rc geninfo_unexecuted_blocks=1 00:06:16.831 00:06:16.831 ' 00:06:16.831 22:58:20 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:06:16.831 22:58:20 -- bdev/nbd_common.sh@6 -- # set -e 00:06:16.831 22:58:20 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:06:16.831 22:58:20 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:16.831 22:58:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:16.831 22:58:20 -- common/autotest_common.sh@10 -- # set +x 00:06:16.831 ************************************ 00:06:16.831 START TEST event_perf 00:06:16.831 ************************************ 00:06:16.831 22:58:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:06:16.831 Running I/O for 1 seconds...[2024-11-28 22:58:20.325464] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:16.831 [2024-11-28 22:58:20.325537] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2328090 ] 00:06:16.831 EAL: No free 2048 kB hugepages reported on node 1 00:06:16.831 [2024-11-28 22:58:20.392869] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:17.089 [2024-11-28 22:58:20.485313] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:17.089 [2024-11-28 22:58:20.485383] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:17.089 [2024-11-28 22:58:20.485482] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:17.089 [2024-11-28 22:58:20.485485] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:18.019 Running I/O for 1 seconds... 00:06:18.019 lcore 0: 224722 00:06:18.019 lcore 1: 224721 00:06:18.019 lcore 2: 224720 00:06:18.019 lcore 3: 224721 00:06:18.019 done. 00:06:18.019 00:06:18.019 real 0m1.258s 00:06:18.019 user 0m4.162s 00:06:18.019 sys 0m0.090s 00:06:18.019 22:58:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:18.019 22:58:21 -- common/autotest_common.sh@10 -- # set +x 00:06:18.019 ************************************ 00:06:18.019 END TEST event_perf 00:06:18.019 ************************************ 00:06:18.019 22:58:21 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:06:18.019 22:58:21 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:18.019 22:58:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:18.019 22:58:21 -- common/autotest_common.sh@10 -- # set +x 00:06:18.019 ************************************ 00:06:18.019 START TEST event_reactor 00:06:18.019 ************************************ 00:06:18.019 22:58:21 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:06:18.019 [2024-11-28 22:58:21.610856] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:18.019 [2024-11-28 22:58:21.610938] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2328255 ] 00:06:18.277 EAL: No free 2048 kB hugepages reported on node 1 00:06:18.277 [2024-11-28 22:58:21.672425] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:18.277 [2024-11-28 22:58:21.763741] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:19.650 test_start 00:06:19.650 oneshot 00:06:19.650 tick 100 00:06:19.650 tick 100 00:06:19.650 tick 250 00:06:19.650 tick 100 00:06:19.650 tick 100 00:06:19.650 tick 250 00:06:19.650 tick 500 00:06:19.650 tick 100 00:06:19.650 tick 100 00:06:19.651 tick 100 00:06:19.651 tick 250 00:06:19.651 tick 100 00:06:19.651 tick 100 00:06:19.651 test_end 00:06:19.651 00:06:19.651 real 0m1.250s 00:06:19.651 user 0m1.163s 00:06:19.651 sys 0m0.081s 00:06:19.651 22:58:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:19.651 22:58:22 -- common/autotest_common.sh@10 -- # set +x 00:06:19.651 ************************************ 00:06:19.651 END TEST event_reactor 00:06:19.651 ************************************ 00:06:19.651 22:58:22 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:06:19.651 22:58:22 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:19.651 22:58:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:19.651 22:58:22 -- common/autotest_common.sh@10 -- # set +x 00:06:19.651 ************************************ 00:06:19.651 START TEST event_reactor_perf 00:06:19.651 ************************************ 00:06:19.651 22:58:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:06:19.651 [2024-11-28 22:58:22.886688] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:19.651 [2024-11-28 22:58:22.886782] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2328427 ] 00:06:19.651 EAL: No free 2048 kB hugepages reported on node 1 00:06:19.651 [2024-11-28 22:58:22.948920] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:19.651 [2024-11-28 22:58:23.038697] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:20.584 test_start 00:06:20.584 test_end 00:06:20.584 Performance: 351542 events per second 00:06:20.584 00:06:20.584 real 0m1.244s 00:06:20.584 user 0m1.152s 00:06:20.584 sys 0m0.086s 00:06:20.584 22:58:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:20.584 22:58:24 -- common/autotest_common.sh@10 -- # set +x 00:06:20.584 ************************************ 00:06:20.584 END TEST event_reactor_perf 00:06:20.584 ************************************ 00:06:20.584 22:58:24 -- event/event.sh@49 -- # uname -s 00:06:20.584 22:58:24 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:06:20.584 22:58:24 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:06:20.584 22:58:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:20.584 22:58:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:20.584 22:58:24 -- common/autotest_common.sh@10 -- # set +x 00:06:20.584 ************************************ 00:06:20.584 START TEST event_scheduler 00:06:20.584 ************************************ 00:06:20.584 22:58:24 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:06:20.843 * Looking for test storage... 00:06:20.843 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:06:20.843 22:58:24 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:20.843 22:58:24 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:20.843 22:58:24 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:20.843 22:58:24 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:20.843 22:58:24 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:20.843 22:58:24 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:20.843 22:58:24 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:20.843 22:58:24 -- scripts/common.sh@335 -- # IFS=.-: 00:06:20.843 22:58:24 -- scripts/common.sh@335 -- # read -ra ver1 00:06:20.843 22:58:24 -- scripts/common.sh@336 -- # IFS=.-: 00:06:20.843 22:58:24 -- scripts/common.sh@336 -- # read -ra ver2 00:06:20.843 22:58:24 -- scripts/common.sh@337 -- # local 'op=<' 00:06:20.843 22:58:24 -- scripts/common.sh@339 -- # ver1_l=2 00:06:20.843 22:58:24 -- scripts/common.sh@340 -- # ver2_l=1 00:06:20.843 22:58:24 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:20.843 22:58:24 -- scripts/common.sh@343 -- # case "$op" in 00:06:20.843 22:58:24 -- scripts/common.sh@344 -- # : 1 00:06:20.843 22:58:24 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:20.843 22:58:24 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:20.843 22:58:24 -- scripts/common.sh@364 -- # decimal 1 00:06:20.843 22:58:24 -- scripts/common.sh@352 -- # local d=1 00:06:20.843 22:58:24 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:20.843 22:58:24 -- scripts/common.sh@354 -- # echo 1 00:06:20.843 22:58:24 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:20.843 22:58:24 -- scripts/common.sh@365 -- # decimal 2 00:06:20.843 22:58:24 -- scripts/common.sh@352 -- # local d=2 00:06:20.843 22:58:24 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:20.843 22:58:24 -- scripts/common.sh@354 -- # echo 2 00:06:20.843 22:58:24 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:20.843 22:58:24 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:20.843 22:58:24 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:20.843 22:58:24 -- scripts/common.sh@367 -- # return 0 00:06:20.843 22:58:24 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:20.843 22:58:24 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:20.843 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:20.843 --rc genhtml_branch_coverage=1 00:06:20.843 --rc genhtml_function_coverage=1 00:06:20.843 --rc genhtml_legend=1 00:06:20.843 --rc geninfo_all_blocks=1 00:06:20.843 --rc geninfo_unexecuted_blocks=1 00:06:20.843 00:06:20.843 ' 00:06:20.843 22:58:24 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:20.843 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:20.843 --rc genhtml_branch_coverage=1 00:06:20.843 --rc genhtml_function_coverage=1 00:06:20.843 --rc genhtml_legend=1 00:06:20.843 --rc geninfo_all_blocks=1 00:06:20.843 --rc geninfo_unexecuted_blocks=1 00:06:20.843 00:06:20.843 ' 00:06:20.843 22:58:24 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:20.843 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:20.843 --rc genhtml_branch_coverage=1 00:06:20.843 --rc genhtml_function_coverage=1 00:06:20.843 --rc genhtml_legend=1 00:06:20.843 --rc geninfo_all_blocks=1 00:06:20.843 --rc geninfo_unexecuted_blocks=1 00:06:20.843 00:06:20.843 ' 00:06:20.843 22:58:24 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:20.843 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:20.843 --rc genhtml_branch_coverage=1 00:06:20.843 --rc genhtml_function_coverage=1 00:06:20.843 --rc genhtml_legend=1 00:06:20.843 --rc geninfo_all_blocks=1 00:06:20.843 --rc geninfo_unexecuted_blocks=1 00:06:20.843 00:06:20.843 ' 00:06:20.843 22:58:24 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:06:20.843 22:58:24 -- scheduler/scheduler.sh@35 -- # scheduler_pid=2328719 00:06:20.843 22:58:24 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:06:20.843 22:58:24 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:06:20.843 22:58:24 -- scheduler/scheduler.sh@37 -- # waitforlisten 2328719 00:06:20.843 22:58:24 -- common/autotest_common.sh@829 -- # '[' -z 2328719 ']' 00:06:20.843 22:58:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:20.843 22:58:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:20.843 22:58:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:20.843 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:20.844 22:58:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:20.844 22:58:24 -- common/autotest_common.sh@10 -- # set +x 00:06:20.844 [2024-11-28 22:58:24.322354] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:20.844 [2024-11-28 22:58:24.322466] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2328719 ] 00:06:20.844 EAL: No free 2048 kB hugepages reported on node 1 00:06:20.844 [2024-11-28 22:58:24.380560] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:21.102 [2024-11-28 22:58:24.467512] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:21.102 [2024-11-28 22:58:24.467565] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:21.102 [2024-11-28 22:58:24.467629] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:21.102 [2024-11-28 22:58:24.467632] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:21.102 22:58:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:21.102 22:58:24 -- common/autotest_common.sh@862 -- # return 0 00:06:21.102 22:58:24 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:06:21.102 22:58:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:21.102 22:58:24 -- common/autotest_common.sh@10 -- # set +x 00:06:21.102 POWER: Env isn't set yet! 00:06:21.102 POWER: Attempting to initialise ACPI cpufreq power management... 00:06:21.102 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_available_frequencies 00:06:21.102 POWER: Cannot get available frequencies of lcore 0 00:06:21.102 POWER: Attempting to initialise PSTAT power management... 00:06:21.102 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:06:21.102 POWER: Initialized successfully for lcore 0 power management 00:06:21.102 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:06:21.102 POWER: Initialized successfully for lcore 1 power management 00:06:21.102 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:06:21.102 POWER: Initialized successfully for lcore 2 power management 00:06:21.102 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:06:21.102 POWER: Initialized successfully for lcore 3 power management 00:06:21.102 [2024-11-28 22:58:24.573600] scheduler_dynamic.c: 387:set_opts: *NOTICE*: Setting scheduler load limit to 20 00:06:21.102 [2024-11-28 22:58:24.573618] scheduler_dynamic.c: 389:set_opts: *NOTICE*: Setting scheduler core limit to 80 00:06:21.102 [2024-11-28 22:58:24.573629] scheduler_dynamic.c: 391:set_opts: *NOTICE*: Setting scheduler core busy to 95 00:06:21.102 22:58:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:21.102 22:58:24 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:06:21.102 22:58:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:21.102 22:58:24 -- common/autotest_common.sh@10 -- # set +x 00:06:21.102 [2024-11-28 22:58:24.669481] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:06:21.102 22:58:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:21.102 22:58:24 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:06:21.102 22:58:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:21.102 22:58:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:21.102 22:58:24 -- common/autotest_common.sh@10 -- # set +x 00:06:21.102 ************************************ 00:06:21.102 START TEST scheduler_create_thread 00:06:21.102 ************************************ 00:06:21.102 22:58:24 -- common/autotest_common.sh@1114 -- # scheduler_create_thread 00:06:21.102 22:58:24 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:06:21.102 22:58:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:21.102 22:58:24 -- common/autotest_common.sh@10 -- # set +x 00:06:21.102 2 00:06:21.102 22:58:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:21.102 22:58:24 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:06:21.102 22:58:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:21.102 22:58:24 -- common/autotest_common.sh@10 -- # set +x 00:06:21.102 3 00:06:21.102 22:58:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:21.102 22:58:24 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:06:21.102 22:58:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:21.102 22:58:24 -- common/autotest_common.sh@10 -- # set +x 00:06:21.102 4 00:06:21.102 22:58:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:21.102 22:58:24 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:06:21.102 22:58:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:21.102 22:58:24 -- common/autotest_common.sh@10 -- # set +x 00:06:21.360 5 00:06:21.360 22:58:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:21.360 22:58:24 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:06:21.360 22:58:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:21.360 22:58:24 -- common/autotest_common.sh@10 -- # set +x 00:06:21.360 6 00:06:21.360 22:58:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:21.360 22:58:24 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:06:21.360 22:58:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:21.360 22:58:24 -- common/autotest_common.sh@10 -- # set +x 00:06:21.360 7 00:06:21.360 22:58:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:21.360 22:58:24 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:06:21.360 22:58:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:21.360 22:58:24 -- common/autotest_common.sh@10 -- # set +x 00:06:21.360 8 00:06:21.360 22:58:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:21.360 22:58:24 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:06:21.360 22:58:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:21.360 22:58:24 -- common/autotest_common.sh@10 -- # set +x 00:06:21.360 9 00:06:21.360 22:58:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:21.360 22:58:24 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:06:21.360 22:58:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:21.360 22:58:24 -- common/autotest_common.sh@10 -- # set +x 00:06:21.360 10 00:06:21.360 22:58:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:21.360 22:58:24 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:06:21.360 22:58:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:21.360 22:58:24 -- common/autotest_common.sh@10 -- # set +x 00:06:21.360 22:58:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:21.360 22:58:24 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:06:21.361 22:58:24 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:06:21.361 22:58:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:21.361 22:58:24 -- common/autotest_common.sh@10 -- # set +x 00:06:21.361 22:58:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:21.361 22:58:24 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:06:21.361 22:58:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:21.361 22:58:24 -- common/autotest_common.sh@10 -- # set +x 00:06:21.926 22:58:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:21.926 22:58:25 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:06:21.926 22:58:25 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:06:21.926 22:58:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:21.926 22:58:25 -- common/autotest_common.sh@10 -- # set +x 00:06:22.859 22:58:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:22.859 00:06:22.859 real 0m1.754s 00:06:22.859 user 0m0.011s 00:06:22.859 sys 0m0.004s 00:06:22.859 22:58:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:22.860 22:58:26 -- common/autotest_common.sh@10 -- # set +x 00:06:22.860 ************************************ 00:06:22.860 END TEST scheduler_create_thread 00:06:22.860 ************************************ 00:06:22.860 22:58:26 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:06:22.860 22:58:26 -- scheduler/scheduler.sh@46 -- # killprocess 2328719 00:06:22.860 22:58:26 -- common/autotest_common.sh@936 -- # '[' -z 2328719 ']' 00:06:22.860 22:58:26 -- common/autotest_common.sh@940 -- # kill -0 2328719 00:06:22.860 22:58:26 -- common/autotest_common.sh@941 -- # uname 00:06:22.860 22:58:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:22.860 22:58:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2328719 00:06:23.117 22:58:26 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:06:23.117 22:58:26 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:06:23.117 22:58:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2328719' 00:06:23.118 killing process with pid 2328719 00:06:23.118 22:58:26 -- common/autotest_common.sh@955 -- # kill 2328719 00:06:23.118 22:58:26 -- common/autotest_common.sh@960 -- # wait 2328719 00:06:23.375 [2024-11-28 22:58:26.909537] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:06:23.633 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:06:23.633 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:06:23.633 POWER: Power management governor of lcore 1 has been set to 'schedutil' successfully 00:06:23.633 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:06:23.633 POWER: Power management governor of lcore 2 has been set to 'schedutil' successfully 00:06:23.633 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:06:23.633 POWER: Power management governor of lcore 3 has been set to 'schedutil' successfully 00:06:23.634 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:06:23.634 00:06:23.634 real 0m2.975s 00:06:23.634 user 0m3.915s 00:06:23.634 sys 0m0.309s 00:06:23.634 22:58:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:23.634 22:58:27 -- common/autotest_common.sh@10 -- # set +x 00:06:23.634 ************************************ 00:06:23.634 END TEST event_scheduler 00:06:23.634 ************************************ 00:06:23.634 22:58:27 -- event/event.sh@51 -- # modprobe -n nbd 00:06:23.634 22:58:27 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:06:23.634 22:58:27 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:23.634 22:58:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:23.634 22:58:27 -- common/autotest_common.sh@10 -- # set +x 00:06:23.634 ************************************ 00:06:23.634 START TEST app_repeat 00:06:23.634 ************************************ 00:06:23.634 22:58:27 -- common/autotest_common.sh@1114 -- # app_repeat_test 00:06:23.634 22:58:27 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:23.634 22:58:27 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:23.634 22:58:27 -- event/event.sh@13 -- # local nbd_list 00:06:23.634 22:58:27 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:23.634 22:58:27 -- event/event.sh@14 -- # local bdev_list 00:06:23.634 22:58:27 -- event/event.sh@15 -- # local repeat_times=4 00:06:23.634 22:58:27 -- event/event.sh@17 -- # modprobe nbd 00:06:23.634 22:58:27 -- event/event.sh@19 -- # repeat_pid=2329056 00:06:23.634 22:58:27 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:06:23.634 22:58:27 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:06:23.634 22:58:27 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 2329056' 00:06:23.634 Process app_repeat pid: 2329056 00:06:23.634 22:58:27 -- event/event.sh@23 -- # for i in {0..2} 00:06:23.634 22:58:27 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:06:23.634 spdk_app_start Round 0 00:06:23.634 22:58:27 -- event/event.sh@25 -- # waitforlisten 2329056 /var/tmp/spdk-nbd.sock 00:06:23.634 22:58:27 -- common/autotest_common.sh@829 -- # '[' -z 2329056 ']' 00:06:23.634 22:58:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:23.634 22:58:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:23.634 22:58:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:23.634 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:23.634 22:58:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:23.634 22:58:27 -- common/autotest_common.sh@10 -- # set +x 00:06:23.634 [2024-11-28 22:58:27.180677] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:23.634 [2024-11-28 22:58:27.180773] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2329056 ] 00:06:23.634 EAL: No free 2048 kB hugepages reported on node 1 00:06:23.892 [2024-11-28 22:58:27.245273] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:23.892 [2024-11-28 22:58:27.333516] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:23.893 [2024-11-28 22:58:27.333522] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:24.827 22:58:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:24.827 22:58:28 -- common/autotest_common.sh@862 -- # return 0 00:06:24.827 22:58:28 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:24.827 Malloc0 00:06:24.827 22:58:28 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:25.394 Malloc1 00:06:25.394 22:58:28 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:25.394 22:58:28 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:25.394 22:58:28 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:25.394 22:58:28 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:25.394 22:58:28 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:25.394 22:58:28 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:25.394 22:58:28 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:25.394 22:58:28 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:25.394 22:58:28 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:25.394 22:58:28 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:25.394 22:58:28 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:25.394 22:58:28 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:25.394 22:58:28 -- bdev/nbd_common.sh@12 -- # local i 00:06:25.394 22:58:28 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:25.394 22:58:28 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:25.394 22:58:28 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:25.394 /dev/nbd0 00:06:25.394 22:58:28 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:25.394 22:58:28 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:25.394 22:58:28 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:06:25.394 22:58:28 -- common/autotest_common.sh@867 -- # local i 00:06:25.394 22:58:28 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:25.394 22:58:28 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:25.394 22:58:28 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:06:25.394 22:58:28 -- common/autotest_common.sh@871 -- # break 00:06:25.394 22:58:28 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:25.394 22:58:28 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:25.394 22:58:28 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:25.652 1+0 records in 00:06:25.652 1+0 records out 00:06:25.652 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000179068 s, 22.9 MB/s 00:06:25.652 22:58:29 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:25.652 22:58:29 -- common/autotest_common.sh@884 -- # size=4096 00:06:25.652 22:58:29 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:25.652 22:58:29 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:25.652 22:58:29 -- common/autotest_common.sh@887 -- # return 0 00:06:25.652 22:58:29 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:25.652 22:58:29 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:25.652 22:58:29 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:25.910 /dev/nbd1 00:06:25.911 22:58:29 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:25.911 22:58:29 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:25.911 22:58:29 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:06:25.911 22:58:29 -- common/autotest_common.sh@867 -- # local i 00:06:25.911 22:58:29 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:25.911 22:58:29 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:25.911 22:58:29 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:06:25.911 22:58:29 -- common/autotest_common.sh@871 -- # break 00:06:25.911 22:58:29 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:25.911 22:58:29 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:25.911 22:58:29 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:25.911 1+0 records in 00:06:25.911 1+0 records out 00:06:25.911 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000208231 s, 19.7 MB/s 00:06:25.911 22:58:29 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:25.911 22:58:29 -- common/autotest_common.sh@884 -- # size=4096 00:06:25.911 22:58:29 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:25.911 22:58:29 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:25.911 22:58:29 -- common/autotest_common.sh@887 -- # return 0 00:06:25.911 22:58:29 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:25.911 22:58:29 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:25.911 22:58:29 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:25.911 22:58:29 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:25.911 22:58:29 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:26.169 22:58:29 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:26.169 { 00:06:26.169 "nbd_device": "/dev/nbd0", 00:06:26.169 "bdev_name": "Malloc0" 00:06:26.169 }, 00:06:26.169 { 00:06:26.169 "nbd_device": "/dev/nbd1", 00:06:26.169 "bdev_name": "Malloc1" 00:06:26.169 } 00:06:26.169 ]' 00:06:26.169 22:58:29 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:26.169 { 00:06:26.169 "nbd_device": "/dev/nbd0", 00:06:26.169 "bdev_name": "Malloc0" 00:06:26.169 }, 00:06:26.169 { 00:06:26.169 "nbd_device": "/dev/nbd1", 00:06:26.169 "bdev_name": "Malloc1" 00:06:26.169 } 00:06:26.169 ]' 00:06:26.169 22:58:29 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:26.169 22:58:29 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:26.169 /dev/nbd1' 00:06:26.169 22:58:29 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:26.169 /dev/nbd1' 00:06:26.169 22:58:29 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:26.169 22:58:29 -- bdev/nbd_common.sh@65 -- # count=2 00:06:26.169 22:58:29 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:26.169 22:58:29 -- bdev/nbd_common.sh@95 -- # count=2 00:06:26.169 22:58:29 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:26.169 22:58:29 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:26.169 22:58:29 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:26.169 22:58:29 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:26.169 22:58:29 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:26.169 22:58:29 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:26.169 22:58:29 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:26.169 22:58:29 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:26.169 256+0 records in 00:06:26.169 256+0 records out 00:06:26.169 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00512374 s, 205 MB/s 00:06:26.169 22:58:29 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:26.169 22:58:29 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:26.169 256+0 records in 00:06:26.169 256+0 records out 00:06:26.169 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188729 s, 55.6 MB/s 00:06:26.169 22:58:29 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:26.169 22:58:29 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:26.169 256+0 records in 00:06:26.169 256+0 records out 00:06:26.169 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229129 s, 45.8 MB/s 00:06:26.169 22:58:29 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:26.170 22:58:29 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:26.170 22:58:29 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:26.170 22:58:29 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:26.170 22:58:29 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:26.170 22:58:29 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:26.170 22:58:29 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:26.170 22:58:29 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:26.170 22:58:29 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:26.170 22:58:29 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:26.170 22:58:29 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:26.170 22:58:29 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:26.170 22:58:29 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:26.170 22:58:29 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:26.170 22:58:29 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:26.170 22:58:29 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:26.170 22:58:29 -- bdev/nbd_common.sh@51 -- # local i 00:06:26.170 22:58:29 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:26.170 22:58:29 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:26.429 22:58:29 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:26.429 22:58:29 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:26.429 22:58:29 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:26.429 22:58:29 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:26.429 22:58:29 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:26.429 22:58:29 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:26.429 22:58:29 -- bdev/nbd_common.sh@41 -- # break 00:06:26.429 22:58:29 -- bdev/nbd_common.sh@45 -- # return 0 00:06:26.429 22:58:29 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:26.429 22:58:29 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:26.687 22:58:30 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:26.687 22:58:30 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:26.687 22:58:30 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:26.687 22:58:30 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:26.687 22:58:30 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:26.687 22:58:30 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:26.687 22:58:30 -- bdev/nbd_common.sh@41 -- # break 00:06:26.687 22:58:30 -- bdev/nbd_common.sh@45 -- # return 0 00:06:26.687 22:58:30 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:26.687 22:58:30 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:26.687 22:58:30 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:26.944 22:58:30 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:26.944 22:58:30 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:26.944 22:58:30 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:26.944 22:58:30 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:26.944 22:58:30 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:26.944 22:58:30 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:26.944 22:58:30 -- bdev/nbd_common.sh@65 -- # true 00:06:26.945 22:58:30 -- bdev/nbd_common.sh@65 -- # count=0 00:06:26.945 22:58:30 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:26.945 22:58:30 -- bdev/nbd_common.sh@104 -- # count=0 00:06:26.945 22:58:30 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:26.945 22:58:30 -- bdev/nbd_common.sh@109 -- # return 0 00:06:26.945 22:58:30 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:27.511 22:58:30 -- event/event.sh@35 -- # sleep 3 00:06:27.511 [2024-11-28 22:58:31.039521] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:27.777 [2024-11-28 22:58:31.127721] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:27.777 [2024-11-28 22:58:31.127721] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:27.777 [2024-11-28 22:58:31.189240] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:27.777 [2024-11-28 22:58:31.189323] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:30.364 22:58:33 -- event/event.sh@23 -- # for i in {0..2} 00:06:30.364 22:58:33 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:06:30.364 spdk_app_start Round 1 00:06:30.364 22:58:33 -- event/event.sh@25 -- # waitforlisten 2329056 /var/tmp/spdk-nbd.sock 00:06:30.364 22:58:33 -- common/autotest_common.sh@829 -- # '[' -z 2329056 ']' 00:06:30.364 22:58:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:30.364 22:58:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:30.364 22:58:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:30.364 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:30.364 22:58:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:30.364 22:58:33 -- common/autotest_common.sh@10 -- # set +x 00:06:30.622 22:58:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:30.622 22:58:34 -- common/autotest_common.sh@862 -- # return 0 00:06:30.622 22:58:34 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:30.880 Malloc0 00:06:30.880 22:58:34 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:31.139 Malloc1 00:06:31.139 22:58:34 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:31.139 22:58:34 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:31.139 22:58:34 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:31.139 22:58:34 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:31.139 22:58:34 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:31.139 22:58:34 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:31.139 22:58:34 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:31.139 22:58:34 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:31.139 22:58:34 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:31.139 22:58:34 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:31.139 22:58:34 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:31.139 22:58:34 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:31.139 22:58:34 -- bdev/nbd_common.sh@12 -- # local i 00:06:31.139 22:58:34 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:31.139 22:58:34 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:31.139 22:58:34 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:31.397 /dev/nbd0 00:06:31.397 22:58:34 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:31.397 22:58:34 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:31.397 22:58:34 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:06:31.397 22:58:34 -- common/autotest_common.sh@867 -- # local i 00:06:31.397 22:58:34 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:31.397 22:58:34 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:31.397 22:58:34 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:06:31.397 22:58:34 -- common/autotest_common.sh@871 -- # break 00:06:31.397 22:58:34 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:31.397 22:58:34 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:31.397 22:58:34 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:31.397 1+0 records in 00:06:31.397 1+0 records out 00:06:31.397 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000203713 s, 20.1 MB/s 00:06:31.397 22:58:34 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:31.397 22:58:34 -- common/autotest_common.sh@884 -- # size=4096 00:06:31.397 22:58:34 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:31.397 22:58:34 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:31.397 22:58:34 -- common/autotest_common.sh@887 -- # return 0 00:06:31.397 22:58:34 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:31.397 22:58:34 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:31.397 22:58:34 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:31.658 /dev/nbd1 00:06:31.658 22:58:35 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:31.658 22:58:35 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:31.658 22:58:35 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:06:31.658 22:58:35 -- common/autotest_common.sh@867 -- # local i 00:06:31.658 22:58:35 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:31.658 22:58:35 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:31.658 22:58:35 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:06:31.658 22:58:35 -- common/autotest_common.sh@871 -- # break 00:06:31.658 22:58:35 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:31.658 22:58:35 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:31.658 22:58:35 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:31.658 1+0 records in 00:06:31.658 1+0 records out 00:06:31.658 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000208777 s, 19.6 MB/s 00:06:31.658 22:58:35 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:31.658 22:58:35 -- common/autotest_common.sh@884 -- # size=4096 00:06:31.658 22:58:35 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:31.658 22:58:35 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:31.658 22:58:35 -- common/autotest_common.sh@887 -- # return 0 00:06:31.658 22:58:35 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:31.658 22:58:35 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:31.658 22:58:35 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:31.658 22:58:35 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:31.658 22:58:35 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:31.915 22:58:35 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:31.915 { 00:06:31.915 "nbd_device": "/dev/nbd0", 00:06:31.915 "bdev_name": "Malloc0" 00:06:31.915 }, 00:06:31.915 { 00:06:31.915 "nbd_device": "/dev/nbd1", 00:06:31.915 "bdev_name": "Malloc1" 00:06:31.915 } 00:06:31.915 ]' 00:06:31.915 22:58:35 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:31.915 { 00:06:31.915 "nbd_device": "/dev/nbd0", 00:06:31.915 "bdev_name": "Malloc0" 00:06:31.915 }, 00:06:31.915 { 00:06:31.915 "nbd_device": "/dev/nbd1", 00:06:31.915 "bdev_name": "Malloc1" 00:06:31.915 } 00:06:31.915 ]' 00:06:31.915 22:58:35 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:31.915 22:58:35 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:31.915 /dev/nbd1' 00:06:31.915 22:58:35 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:31.915 /dev/nbd1' 00:06:31.915 22:58:35 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:31.915 22:58:35 -- bdev/nbd_common.sh@65 -- # count=2 00:06:31.915 22:58:35 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:31.915 22:58:35 -- bdev/nbd_common.sh@95 -- # count=2 00:06:31.915 22:58:35 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:31.915 22:58:35 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:31.915 22:58:35 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:31.915 22:58:35 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:31.915 22:58:35 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:31.915 22:58:35 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:31.915 22:58:35 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:31.915 22:58:35 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:31.915 256+0 records in 00:06:31.915 256+0 records out 00:06:31.915 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00496722 s, 211 MB/s 00:06:31.915 22:58:35 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:31.915 22:58:35 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:32.173 256+0 records in 00:06:32.173 256+0 records out 00:06:32.173 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022534 s, 46.5 MB/s 00:06:32.173 22:58:35 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:32.173 22:58:35 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:32.173 256+0 records in 00:06:32.173 256+0 records out 00:06:32.173 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220051 s, 47.7 MB/s 00:06:32.173 22:58:35 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:32.173 22:58:35 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:32.173 22:58:35 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:32.173 22:58:35 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:32.173 22:58:35 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:32.173 22:58:35 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:32.173 22:58:35 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:32.173 22:58:35 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:32.173 22:58:35 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:32.173 22:58:35 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:32.173 22:58:35 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:32.173 22:58:35 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:32.173 22:58:35 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:32.173 22:58:35 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:32.173 22:58:35 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:32.173 22:58:35 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:32.173 22:58:35 -- bdev/nbd_common.sh@51 -- # local i 00:06:32.173 22:58:35 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:32.173 22:58:35 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:32.432 22:58:35 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:32.432 22:58:35 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:32.432 22:58:35 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:32.432 22:58:35 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:32.432 22:58:35 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:32.432 22:58:35 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:32.432 22:58:35 -- bdev/nbd_common.sh@41 -- # break 00:06:32.432 22:58:35 -- bdev/nbd_common.sh@45 -- # return 0 00:06:32.432 22:58:35 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:32.432 22:58:35 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:32.690 22:58:36 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:32.690 22:58:36 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:32.690 22:58:36 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:32.690 22:58:36 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:32.690 22:58:36 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:32.690 22:58:36 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:32.690 22:58:36 -- bdev/nbd_common.sh@41 -- # break 00:06:32.690 22:58:36 -- bdev/nbd_common.sh@45 -- # return 0 00:06:32.690 22:58:36 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:32.690 22:58:36 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:32.690 22:58:36 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:32.948 22:58:36 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:32.948 22:58:36 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:32.948 22:58:36 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:32.948 22:58:36 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:32.948 22:58:36 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:32.948 22:58:36 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:32.948 22:58:36 -- bdev/nbd_common.sh@65 -- # true 00:06:32.948 22:58:36 -- bdev/nbd_common.sh@65 -- # count=0 00:06:32.948 22:58:36 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:32.948 22:58:36 -- bdev/nbd_common.sh@104 -- # count=0 00:06:32.948 22:58:36 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:32.948 22:58:36 -- bdev/nbd_common.sh@109 -- # return 0 00:06:32.948 22:58:36 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:33.206 22:58:36 -- event/event.sh@35 -- # sleep 3 00:06:33.464 [2024-11-28 22:58:36.922690] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:33.464 [2024-11-28 22:58:37.009310] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:33.464 [2024-11-28 22:58:37.009314] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:33.722 [2024-11-28 22:58:37.072337] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:33.722 [2024-11-28 22:58:37.072420] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:36.247 22:58:39 -- event/event.sh@23 -- # for i in {0..2} 00:06:36.247 22:58:39 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:06:36.247 spdk_app_start Round 2 00:06:36.247 22:58:39 -- event/event.sh@25 -- # waitforlisten 2329056 /var/tmp/spdk-nbd.sock 00:06:36.247 22:58:39 -- common/autotest_common.sh@829 -- # '[' -z 2329056 ']' 00:06:36.247 22:58:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:36.247 22:58:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:36.247 22:58:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:36.247 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:36.247 22:58:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:36.247 22:58:39 -- common/autotest_common.sh@10 -- # set +x 00:06:36.504 22:58:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:36.504 22:58:39 -- common/autotest_common.sh@862 -- # return 0 00:06:36.504 22:58:39 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:36.762 Malloc0 00:06:36.762 22:58:40 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:37.020 Malloc1 00:06:37.020 22:58:40 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:37.020 22:58:40 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:37.020 22:58:40 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:37.020 22:58:40 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:37.020 22:58:40 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:37.020 22:58:40 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:37.020 22:58:40 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:37.020 22:58:40 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:37.020 22:58:40 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:37.020 22:58:40 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:37.020 22:58:40 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:37.020 22:58:40 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:37.020 22:58:40 -- bdev/nbd_common.sh@12 -- # local i 00:06:37.020 22:58:40 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:37.020 22:58:40 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:37.020 22:58:40 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:37.277 /dev/nbd0 00:06:37.277 22:58:40 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:37.277 22:58:40 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:37.277 22:58:40 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:06:37.277 22:58:40 -- common/autotest_common.sh@867 -- # local i 00:06:37.277 22:58:40 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:37.277 22:58:40 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:37.277 22:58:40 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:06:37.277 22:58:40 -- common/autotest_common.sh@871 -- # break 00:06:37.277 22:58:40 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:37.277 22:58:40 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:37.277 22:58:40 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:37.277 1+0 records in 00:06:37.277 1+0 records out 00:06:37.277 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000182882 s, 22.4 MB/s 00:06:37.277 22:58:40 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:37.277 22:58:40 -- common/autotest_common.sh@884 -- # size=4096 00:06:37.277 22:58:40 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:37.278 22:58:40 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:37.278 22:58:40 -- common/autotest_common.sh@887 -- # return 0 00:06:37.278 22:58:40 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:37.278 22:58:40 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:37.278 22:58:40 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:37.535 /dev/nbd1 00:06:37.535 22:58:41 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:37.535 22:58:41 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:37.535 22:58:41 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:06:37.535 22:58:41 -- common/autotest_common.sh@867 -- # local i 00:06:37.535 22:58:41 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:37.535 22:58:41 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:37.535 22:58:41 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:06:37.535 22:58:41 -- common/autotest_common.sh@871 -- # break 00:06:37.535 22:58:41 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:37.535 22:58:41 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:37.535 22:58:41 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:37.535 1+0 records in 00:06:37.535 1+0 records out 00:06:37.535 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000218491 s, 18.7 MB/s 00:06:37.535 22:58:41 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:37.535 22:58:41 -- common/autotest_common.sh@884 -- # size=4096 00:06:37.535 22:58:41 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:37.535 22:58:41 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:37.535 22:58:41 -- common/autotest_common.sh@887 -- # return 0 00:06:37.535 22:58:41 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:37.535 22:58:41 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:37.535 22:58:41 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:37.535 22:58:41 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:37.535 22:58:41 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:37.792 22:58:41 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:37.792 { 00:06:37.792 "nbd_device": "/dev/nbd0", 00:06:37.792 "bdev_name": "Malloc0" 00:06:37.792 }, 00:06:37.792 { 00:06:37.792 "nbd_device": "/dev/nbd1", 00:06:37.792 "bdev_name": "Malloc1" 00:06:37.792 } 00:06:37.792 ]' 00:06:37.792 22:58:41 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:37.792 { 00:06:37.792 "nbd_device": "/dev/nbd0", 00:06:37.792 "bdev_name": "Malloc0" 00:06:37.792 }, 00:06:37.792 { 00:06:37.792 "nbd_device": "/dev/nbd1", 00:06:37.792 "bdev_name": "Malloc1" 00:06:37.792 } 00:06:37.792 ]' 00:06:37.792 22:58:41 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:37.792 22:58:41 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:37.792 /dev/nbd1' 00:06:37.793 22:58:41 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:37.793 /dev/nbd1' 00:06:37.793 22:58:41 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:37.793 22:58:41 -- bdev/nbd_common.sh@65 -- # count=2 00:06:37.793 22:58:41 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:37.793 22:58:41 -- bdev/nbd_common.sh@95 -- # count=2 00:06:37.793 22:58:41 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:37.793 22:58:41 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:37.793 22:58:41 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:37.793 22:58:41 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:37.793 22:58:41 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:37.793 22:58:41 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:37.793 22:58:41 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:37.793 22:58:41 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:37.793 256+0 records in 00:06:37.793 256+0 records out 00:06:37.793 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00406463 s, 258 MB/s 00:06:37.793 22:58:41 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:37.793 22:58:41 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:38.050 256+0 records in 00:06:38.050 256+0 records out 00:06:38.050 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228452 s, 45.9 MB/s 00:06:38.050 22:58:41 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:38.050 22:58:41 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:38.050 256+0 records in 00:06:38.050 256+0 records out 00:06:38.050 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241257 s, 43.5 MB/s 00:06:38.050 22:58:41 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:38.050 22:58:41 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:38.050 22:58:41 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:38.050 22:58:41 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:38.050 22:58:41 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:38.050 22:58:41 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:38.050 22:58:41 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:38.050 22:58:41 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:38.050 22:58:41 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:38.050 22:58:41 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:38.050 22:58:41 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:38.050 22:58:41 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:38.050 22:58:41 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:38.050 22:58:41 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:38.050 22:58:41 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:38.050 22:58:41 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:38.050 22:58:41 -- bdev/nbd_common.sh@51 -- # local i 00:06:38.050 22:58:41 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:38.050 22:58:41 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:38.308 22:58:41 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:38.308 22:58:41 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:38.308 22:58:41 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:38.308 22:58:41 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:38.308 22:58:41 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:38.308 22:58:41 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:38.308 22:58:41 -- bdev/nbd_common.sh@41 -- # break 00:06:38.308 22:58:41 -- bdev/nbd_common.sh@45 -- # return 0 00:06:38.308 22:58:41 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:38.308 22:58:41 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:38.566 22:58:41 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:38.566 22:58:41 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:38.566 22:58:41 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:38.566 22:58:41 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:38.566 22:58:41 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:38.566 22:58:41 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:38.566 22:58:41 -- bdev/nbd_common.sh@41 -- # break 00:06:38.566 22:58:41 -- bdev/nbd_common.sh@45 -- # return 0 00:06:38.566 22:58:41 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:38.566 22:58:41 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:38.566 22:58:41 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:38.823 22:58:42 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:38.823 22:58:42 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:38.823 22:58:42 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:38.823 22:58:42 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:38.823 22:58:42 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:38.823 22:58:42 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:38.823 22:58:42 -- bdev/nbd_common.sh@65 -- # true 00:06:38.823 22:58:42 -- bdev/nbd_common.sh@65 -- # count=0 00:06:38.823 22:58:42 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:38.823 22:58:42 -- bdev/nbd_common.sh@104 -- # count=0 00:06:38.823 22:58:42 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:38.823 22:58:42 -- bdev/nbd_common.sh@109 -- # return 0 00:06:38.823 22:58:42 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:39.081 22:58:42 -- event/event.sh@35 -- # sleep 3 00:06:39.339 [2024-11-28 22:58:42.794120] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:39.339 [2024-11-28 22:58:42.881199] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:39.339 [2024-11-28 22:58:42.881204] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:39.339 [2024-11-28 22:58:42.943203] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:39.339 [2024-11-28 22:58:42.943280] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:42.626 22:58:45 -- event/event.sh@38 -- # waitforlisten 2329056 /var/tmp/spdk-nbd.sock 00:06:42.626 22:58:45 -- common/autotest_common.sh@829 -- # '[' -z 2329056 ']' 00:06:42.626 22:58:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:42.626 22:58:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:42.626 22:58:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:42.626 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:42.626 22:58:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:42.626 22:58:45 -- common/autotest_common.sh@10 -- # set +x 00:06:42.626 22:58:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:42.626 22:58:45 -- common/autotest_common.sh@862 -- # return 0 00:06:42.626 22:58:45 -- event/event.sh@39 -- # killprocess 2329056 00:06:42.626 22:58:45 -- common/autotest_common.sh@936 -- # '[' -z 2329056 ']' 00:06:42.626 22:58:45 -- common/autotest_common.sh@940 -- # kill -0 2329056 00:06:42.626 22:58:45 -- common/autotest_common.sh@941 -- # uname 00:06:42.626 22:58:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:42.626 22:58:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2329056 00:06:42.626 22:58:45 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:42.626 22:58:45 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:42.626 22:58:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2329056' 00:06:42.626 killing process with pid 2329056 00:06:42.626 22:58:45 -- common/autotest_common.sh@955 -- # kill 2329056 00:06:42.626 22:58:45 -- common/autotest_common.sh@960 -- # wait 2329056 00:06:42.626 spdk_app_start is called in Round 0. 00:06:42.626 Shutdown signal received, stop current app iteration 00:06:42.626 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:06:42.626 spdk_app_start is called in Round 1. 00:06:42.626 Shutdown signal received, stop current app iteration 00:06:42.626 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:06:42.626 spdk_app_start is called in Round 2. 00:06:42.626 Shutdown signal received, stop current app iteration 00:06:42.626 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:06:42.626 spdk_app_start is called in Round 3. 00:06:42.626 Shutdown signal received, stop current app iteration 00:06:42.626 22:58:46 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:06:42.626 22:58:46 -- event/event.sh@42 -- # return 0 00:06:42.626 00:06:42.626 real 0m18.905s 00:06:42.626 user 0m41.588s 00:06:42.626 sys 0m3.102s 00:06:42.626 22:58:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:42.626 22:58:46 -- common/autotest_common.sh@10 -- # set +x 00:06:42.626 ************************************ 00:06:42.626 END TEST app_repeat 00:06:42.626 ************************************ 00:06:42.626 22:58:46 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:06:42.626 22:58:46 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:42.626 22:58:46 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:42.626 22:58:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:42.626 22:58:46 -- common/autotest_common.sh@10 -- # set +x 00:06:42.626 ************************************ 00:06:42.626 START TEST cpu_locks 00:06:42.626 ************************************ 00:06:42.626 22:58:46 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:42.626 * Looking for test storage... 00:06:42.626 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:06:42.626 22:58:46 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:42.626 22:58:46 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:42.626 22:58:46 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:42.626 22:58:46 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:42.626 22:58:46 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:42.626 22:58:46 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:42.626 22:58:46 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:42.626 22:58:46 -- scripts/common.sh@335 -- # IFS=.-: 00:06:42.626 22:58:46 -- scripts/common.sh@335 -- # read -ra ver1 00:06:42.626 22:58:46 -- scripts/common.sh@336 -- # IFS=.-: 00:06:42.626 22:58:46 -- scripts/common.sh@336 -- # read -ra ver2 00:06:42.626 22:58:46 -- scripts/common.sh@337 -- # local 'op=<' 00:06:42.626 22:58:46 -- scripts/common.sh@339 -- # ver1_l=2 00:06:42.626 22:58:46 -- scripts/common.sh@340 -- # ver2_l=1 00:06:42.626 22:58:46 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:42.626 22:58:46 -- scripts/common.sh@343 -- # case "$op" in 00:06:42.626 22:58:46 -- scripts/common.sh@344 -- # : 1 00:06:42.626 22:58:46 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:42.626 22:58:46 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:42.626 22:58:46 -- scripts/common.sh@364 -- # decimal 1 00:06:42.626 22:58:46 -- scripts/common.sh@352 -- # local d=1 00:06:42.626 22:58:46 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:42.626 22:58:46 -- scripts/common.sh@354 -- # echo 1 00:06:42.626 22:58:46 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:42.626 22:58:46 -- scripts/common.sh@365 -- # decimal 2 00:06:42.626 22:58:46 -- scripts/common.sh@352 -- # local d=2 00:06:42.626 22:58:46 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:42.626 22:58:46 -- scripts/common.sh@354 -- # echo 2 00:06:42.626 22:58:46 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:42.626 22:58:46 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:42.626 22:58:46 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:42.626 22:58:46 -- scripts/common.sh@367 -- # return 0 00:06:42.626 22:58:46 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:42.626 22:58:46 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:42.626 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:42.626 --rc genhtml_branch_coverage=1 00:06:42.626 --rc genhtml_function_coverage=1 00:06:42.626 --rc genhtml_legend=1 00:06:42.626 --rc geninfo_all_blocks=1 00:06:42.626 --rc geninfo_unexecuted_blocks=1 00:06:42.626 00:06:42.626 ' 00:06:42.626 22:58:46 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:42.626 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:42.626 --rc genhtml_branch_coverage=1 00:06:42.626 --rc genhtml_function_coverage=1 00:06:42.626 --rc genhtml_legend=1 00:06:42.626 --rc geninfo_all_blocks=1 00:06:42.626 --rc geninfo_unexecuted_blocks=1 00:06:42.626 00:06:42.626 ' 00:06:42.626 22:58:46 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:42.626 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:42.626 --rc genhtml_branch_coverage=1 00:06:42.626 --rc genhtml_function_coverage=1 00:06:42.626 --rc genhtml_legend=1 00:06:42.626 --rc geninfo_all_blocks=1 00:06:42.626 --rc geninfo_unexecuted_blocks=1 00:06:42.626 00:06:42.626 ' 00:06:42.626 22:58:46 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:42.626 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:42.626 --rc genhtml_branch_coverage=1 00:06:42.626 --rc genhtml_function_coverage=1 00:06:42.626 --rc genhtml_legend=1 00:06:42.626 --rc geninfo_all_blocks=1 00:06:42.626 --rc geninfo_unexecuted_blocks=1 00:06:42.626 00:06:42.626 ' 00:06:42.626 22:58:46 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:06:42.626 22:58:46 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:06:42.626 22:58:46 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:06:42.626 22:58:46 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:06:42.626 22:58:46 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:42.626 22:58:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:42.627 22:58:46 -- common/autotest_common.sh@10 -- # set +x 00:06:42.885 ************************************ 00:06:42.885 START TEST default_locks 00:06:42.885 ************************************ 00:06:42.885 22:58:46 -- common/autotest_common.sh@1114 -- # default_locks 00:06:42.885 22:58:46 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=2331608 00:06:42.885 22:58:46 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:42.886 22:58:46 -- event/cpu_locks.sh@47 -- # waitforlisten 2331608 00:06:42.886 22:58:46 -- common/autotest_common.sh@829 -- # '[' -z 2331608 ']' 00:06:42.886 22:58:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:42.886 22:58:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:42.886 22:58:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:42.886 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:42.886 22:58:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:42.886 22:58:46 -- common/autotest_common.sh@10 -- # set +x 00:06:42.886 [2024-11-28 22:58:46.282824] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:42.886 [2024-11-28 22:58:46.282901] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2331608 ] 00:06:42.886 EAL: No free 2048 kB hugepages reported on node 1 00:06:42.886 [2024-11-28 22:58:46.344195] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:42.886 [2024-11-28 22:58:46.432191] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:42.886 [2024-11-28 22:58:46.432369] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:43.820 22:58:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:43.820 22:58:47 -- common/autotest_common.sh@862 -- # return 0 00:06:43.820 22:58:47 -- event/cpu_locks.sh@49 -- # locks_exist 2331608 00:06:43.820 22:58:47 -- event/cpu_locks.sh@22 -- # lslocks -p 2331608 00:06:43.820 22:58:47 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:44.078 lslocks: write error 00:06:44.078 22:58:47 -- event/cpu_locks.sh@50 -- # killprocess 2331608 00:06:44.078 22:58:47 -- common/autotest_common.sh@936 -- # '[' -z 2331608 ']' 00:06:44.079 22:58:47 -- common/autotest_common.sh@940 -- # kill -0 2331608 00:06:44.079 22:58:47 -- common/autotest_common.sh@941 -- # uname 00:06:44.079 22:58:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:44.079 22:58:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2331608 00:06:44.079 22:58:47 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:44.079 22:58:47 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:44.079 22:58:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2331608' 00:06:44.079 killing process with pid 2331608 00:06:44.079 22:58:47 -- common/autotest_common.sh@955 -- # kill 2331608 00:06:44.079 22:58:47 -- common/autotest_common.sh@960 -- # wait 2331608 00:06:44.338 22:58:47 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 2331608 00:06:44.338 22:58:47 -- common/autotest_common.sh@650 -- # local es=0 00:06:44.338 22:58:47 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 2331608 00:06:44.338 22:58:47 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:06:44.338 22:58:47 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:44.338 22:58:47 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:06:44.338 22:58:47 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:44.338 22:58:47 -- common/autotest_common.sh@653 -- # waitforlisten 2331608 00:06:44.338 22:58:47 -- common/autotest_common.sh@829 -- # '[' -z 2331608 ']' 00:06:44.338 22:58:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:44.338 22:58:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:44.338 22:58:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:44.338 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:44.338 22:58:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:44.338 22:58:47 -- common/autotest_common.sh@10 -- # set +x 00:06:44.338 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (2331608) - No such process 00:06:44.338 ERROR: process (pid: 2331608) is no longer running 00:06:44.338 22:58:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:44.338 22:58:47 -- common/autotest_common.sh@862 -- # return 1 00:06:44.338 22:58:47 -- common/autotest_common.sh@653 -- # es=1 00:06:44.338 22:58:47 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:44.338 22:58:47 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:44.338 22:58:47 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:44.338 22:58:47 -- event/cpu_locks.sh@54 -- # no_locks 00:06:44.338 22:58:47 -- event/cpu_locks.sh@26 -- # lock_files=() 00:06:44.338 22:58:47 -- event/cpu_locks.sh@26 -- # local lock_files 00:06:44.338 22:58:47 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:06:44.338 00:06:44.338 real 0m1.659s 00:06:44.338 user 0m1.807s 00:06:44.338 sys 0m0.513s 00:06:44.338 22:58:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:44.338 22:58:47 -- common/autotest_common.sh@10 -- # set +x 00:06:44.338 ************************************ 00:06:44.338 END TEST default_locks 00:06:44.338 ************************************ 00:06:44.338 22:58:47 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:06:44.338 22:58:47 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:44.338 22:58:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:44.338 22:58:47 -- common/autotest_common.sh@10 -- # set +x 00:06:44.338 ************************************ 00:06:44.338 START TEST default_locks_via_rpc 00:06:44.338 ************************************ 00:06:44.338 22:58:47 -- common/autotest_common.sh@1114 -- # default_locks_via_rpc 00:06:44.338 22:58:47 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=2331905 00:06:44.338 22:58:47 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:44.338 22:58:47 -- event/cpu_locks.sh@63 -- # waitforlisten 2331905 00:06:44.338 22:58:47 -- common/autotest_common.sh@829 -- # '[' -z 2331905 ']' 00:06:44.338 22:58:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:44.338 22:58:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:44.338 22:58:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:44.338 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:44.338 22:58:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:44.338 22:58:47 -- common/autotest_common.sh@10 -- # set +x 00:06:44.597 [2024-11-28 22:58:47.966639] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:44.597 [2024-11-28 22:58:47.966743] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2331905 ] 00:06:44.597 EAL: No free 2048 kB hugepages reported on node 1 00:06:44.597 [2024-11-28 22:58:48.024777] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:44.597 [2024-11-28 22:58:48.111604] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:44.597 [2024-11-28 22:58:48.111757] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:45.531 22:58:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:45.532 22:58:48 -- common/autotest_common.sh@862 -- # return 0 00:06:45.532 22:58:48 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:06:45.532 22:58:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:45.532 22:58:48 -- common/autotest_common.sh@10 -- # set +x 00:06:45.532 22:58:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:45.532 22:58:48 -- event/cpu_locks.sh@67 -- # no_locks 00:06:45.532 22:58:48 -- event/cpu_locks.sh@26 -- # lock_files=() 00:06:45.532 22:58:48 -- event/cpu_locks.sh@26 -- # local lock_files 00:06:45.532 22:58:48 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:06:45.532 22:58:48 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:06:45.532 22:58:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:45.532 22:58:48 -- common/autotest_common.sh@10 -- # set +x 00:06:45.532 22:58:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:45.532 22:58:48 -- event/cpu_locks.sh@71 -- # locks_exist 2331905 00:06:45.532 22:58:48 -- event/cpu_locks.sh@22 -- # lslocks -p 2331905 00:06:45.532 22:58:48 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:45.790 22:58:49 -- event/cpu_locks.sh@73 -- # killprocess 2331905 00:06:45.790 22:58:49 -- common/autotest_common.sh@936 -- # '[' -z 2331905 ']' 00:06:45.790 22:58:49 -- common/autotest_common.sh@940 -- # kill -0 2331905 00:06:45.790 22:58:49 -- common/autotest_common.sh@941 -- # uname 00:06:45.790 22:58:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:45.790 22:58:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2331905 00:06:45.790 22:58:49 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:45.790 22:58:49 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:45.790 22:58:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2331905' 00:06:45.790 killing process with pid 2331905 00:06:45.790 22:58:49 -- common/autotest_common.sh@955 -- # kill 2331905 00:06:45.790 22:58:49 -- common/autotest_common.sh@960 -- # wait 2331905 00:06:46.357 00:06:46.357 real 0m1.796s 00:06:46.357 user 0m1.980s 00:06:46.357 sys 0m0.544s 00:06:46.357 22:58:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:46.357 22:58:49 -- common/autotest_common.sh@10 -- # set +x 00:06:46.357 ************************************ 00:06:46.357 END TEST default_locks_via_rpc 00:06:46.357 ************************************ 00:06:46.357 22:58:49 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:06:46.357 22:58:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:46.357 22:58:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:46.357 22:58:49 -- common/autotest_common.sh@10 -- # set +x 00:06:46.357 ************************************ 00:06:46.357 START TEST non_locking_app_on_locked_coremask 00:06:46.357 ************************************ 00:06:46.357 22:58:49 -- common/autotest_common.sh@1114 -- # non_locking_app_on_locked_coremask 00:06:46.357 22:58:49 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=2332080 00:06:46.357 22:58:49 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:46.357 22:58:49 -- event/cpu_locks.sh@81 -- # waitforlisten 2332080 /var/tmp/spdk.sock 00:06:46.357 22:58:49 -- common/autotest_common.sh@829 -- # '[' -z 2332080 ']' 00:06:46.357 22:58:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:46.357 22:58:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:46.357 22:58:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:46.357 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:46.357 22:58:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:46.357 22:58:49 -- common/autotest_common.sh@10 -- # set +x 00:06:46.357 [2024-11-28 22:58:49.787503] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:46.357 [2024-11-28 22:58:49.787590] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2332080 ] 00:06:46.357 EAL: No free 2048 kB hugepages reported on node 1 00:06:46.357 [2024-11-28 22:58:49.850596] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:46.357 [2024-11-28 22:58:49.941918] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:46.357 [2024-11-28 22:58:49.942094] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:47.291 22:58:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:47.291 22:58:50 -- common/autotest_common.sh@862 -- # return 0 00:06:47.291 22:58:50 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=2332222 00:06:47.291 22:58:50 -- event/cpu_locks.sh@85 -- # waitforlisten 2332222 /var/tmp/spdk2.sock 00:06:47.291 22:58:50 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:06:47.291 22:58:50 -- common/autotest_common.sh@829 -- # '[' -z 2332222 ']' 00:06:47.291 22:58:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:47.291 22:58:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:47.291 22:58:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:47.291 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:47.291 22:58:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:47.291 22:58:50 -- common/autotest_common.sh@10 -- # set +x 00:06:47.291 [2024-11-28 22:58:50.839885] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:47.291 [2024-11-28 22:58:50.839957] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2332222 ] 00:06:47.291 EAL: No free 2048 kB hugepages reported on node 1 00:06:47.550 [2024-11-28 22:58:50.930496] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:47.550 [2024-11-28 22:58:50.930529] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:47.550 [2024-11-28 22:58:51.111959] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:47.550 [2024-11-28 22:58:51.112136] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:48.485 22:58:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:48.485 22:58:51 -- common/autotest_common.sh@862 -- # return 0 00:06:48.485 22:58:51 -- event/cpu_locks.sh@87 -- # locks_exist 2332080 00:06:48.485 22:58:51 -- event/cpu_locks.sh@22 -- # lslocks -p 2332080 00:06:48.485 22:58:51 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:48.743 lslocks: write error 00:06:48.743 22:58:52 -- event/cpu_locks.sh@89 -- # killprocess 2332080 00:06:48.743 22:58:52 -- common/autotest_common.sh@936 -- # '[' -z 2332080 ']' 00:06:48.743 22:58:52 -- common/autotest_common.sh@940 -- # kill -0 2332080 00:06:48.743 22:58:52 -- common/autotest_common.sh@941 -- # uname 00:06:48.743 22:58:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:48.743 22:58:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2332080 00:06:48.743 22:58:52 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:48.743 22:58:52 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:48.743 22:58:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2332080' 00:06:48.743 killing process with pid 2332080 00:06:48.743 22:58:52 -- common/autotest_common.sh@955 -- # kill 2332080 00:06:48.743 22:58:52 -- common/autotest_common.sh@960 -- # wait 2332080 00:06:49.678 22:58:53 -- event/cpu_locks.sh@90 -- # killprocess 2332222 00:06:49.678 22:58:53 -- common/autotest_common.sh@936 -- # '[' -z 2332222 ']' 00:06:49.678 22:58:53 -- common/autotest_common.sh@940 -- # kill -0 2332222 00:06:49.678 22:58:53 -- common/autotest_common.sh@941 -- # uname 00:06:49.678 22:58:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:49.678 22:58:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2332222 00:06:49.678 22:58:53 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:49.678 22:58:53 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:49.678 22:58:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2332222' 00:06:49.678 killing process with pid 2332222 00:06:49.678 22:58:53 -- common/autotest_common.sh@955 -- # kill 2332222 00:06:49.678 22:58:53 -- common/autotest_common.sh@960 -- # wait 2332222 00:06:50.244 00:06:50.244 real 0m3.817s 00:06:50.244 user 0m4.202s 00:06:50.244 sys 0m1.068s 00:06:50.244 22:58:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:50.244 22:58:53 -- common/autotest_common.sh@10 -- # set +x 00:06:50.244 ************************************ 00:06:50.244 END TEST non_locking_app_on_locked_coremask 00:06:50.244 ************************************ 00:06:50.244 22:58:53 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:06:50.244 22:58:53 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:50.244 22:58:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:50.244 22:58:53 -- common/autotest_common.sh@10 -- # set +x 00:06:50.244 ************************************ 00:06:50.244 START TEST locking_app_on_unlocked_coremask 00:06:50.244 ************************************ 00:06:50.244 22:58:53 -- common/autotest_common.sh@1114 -- # locking_app_on_unlocked_coremask 00:06:50.244 22:58:53 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=2332653 00:06:50.244 22:58:53 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:06:50.244 22:58:53 -- event/cpu_locks.sh@99 -- # waitforlisten 2332653 /var/tmp/spdk.sock 00:06:50.244 22:58:53 -- common/autotest_common.sh@829 -- # '[' -z 2332653 ']' 00:06:50.244 22:58:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:50.244 22:58:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:50.244 22:58:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:50.244 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:50.244 22:58:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:50.244 22:58:53 -- common/autotest_common.sh@10 -- # set +x 00:06:50.245 [2024-11-28 22:58:53.632267] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:50.245 [2024-11-28 22:58:53.632374] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2332653 ] 00:06:50.245 EAL: No free 2048 kB hugepages reported on node 1 00:06:50.245 [2024-11-28 22:58:53.695361] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:50.245 [2024-11-28 22:58:53.695417] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:50.245 [2024-11-28 22:58:53.783984] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:50.245 [2024-11-28 22:58:53.784159] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:51.179 22:58:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:51.179 22:58:54 -- common/autotest_common.sh@862 -- # return 0 00:06:51.179 22:58:54 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=2332790 00:06:51.179 22:58:54 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:06:51.180 22:58:54 -- event/cpu_locks.sh@103 -- # waitforlisten 2332790 /var/tmp/spdk2.sock 00:06:51.180 22:58:54 -- common/autotest_common.sh@829 -- # '[' -z 2332790 ']' 00:06:51.180 22:58:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:51.180 22:58:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:51.180 22:58:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:51.180 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:51.180 22:58:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:51.180 22:58:54 -- common/autotest_common.sh@10 -- # set +x 00:06:51.180 [2024-11-28 22:58:54.635428] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:51.180 [2024-11-28 22:58:54.635523] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2332790 ] 00:06:51.180 EAL: No free 2048 kB hugepages reported on node 1 00:06:51.180 [2024-11-28 22:58:54.718450] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:51.438 [2024-11-28 22:58:54.904513] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:51.438 [2024-11-28 22:58:54.904677] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:52.371 22:58:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:52.372 22:58:55 -- common/autotest_common.sh@862 -- # return 0 00:06:52.372 22:58:55 -- event/cpu_locks.sh@105 -- # locks_exist 2332790 00:06:52.372 22:58:55 -- event/cpu_locks.sh@22 -- # lslocks -p 2332790 00:06:52.372 22:58:55 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:52.630 lslocks: write error 00:06:52.630 22:58:56 -- event/cpu_locks.sh@107 -- # killprocess 2332653 00:06:52.630 22:58:56 -- common/autotest_common.sh@936 -- # '[' -z 2332653 ']' 00:06:52.630 22:58:56 -- common/autotest_common.sh@940 -- # kill -0 2332653 00:06:52.630 22:58:56 -- common/autotest_common.sh@941 -- # uname 00:06:52.630 22:58:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:52.630 22:58:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2332653 00:06:52.630 22:58:56 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:52.630 22:58:56 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:52.630 22:58:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2332653' 00:06:52.630 killing process with pid 2332653 00:06:52.630 22:58:56 -- common/autotest_common.sh@955 -- # kill 2332653 00:06:52.630 22:58:56 -- common/autotest_common.sh@960 -- # wait 2332653 00:06:53.565 22:58:56 -- event/cpu_locks.sh@108 -- # killprocess 2332790 00:06:53.565 22:58:56 -- common/autotest_common.sh@936 -- # '[' -z 2332790 ']' 00:06:53.565 22:58:56 -- common/autotest_common.sh@940 -- # kill -0 2332790 00:06:53.565 22:58:56 -- common/autotest_common.sh@941 -- # uname 00:06:53.565 22:58:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:53.565 22:58:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2332790 00:06:53.565 22:58:56 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:53.565 22:58:56 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:53.565 22:58:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2332790' 00:06:53.565 killing process with pid 2332790 00:06:53.565 22:58:56 -- common/autotest_common.sh@955 -- # kill 2332790 00:06:53.565 22:58:56 -- common/autotest_common.sh@960 -- # wait 2332790 00:06:53.824 00:06:53.824 real 0m3.744s 00:06:53.824 user 0m4.128s 00:06:53.824 sys 0m1.047s 00:06:53.824 22:58:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:53.824 22:58:57 -- common/autotest_common.sh@10 -- # set +x 00:06:53.824 ************************************ 00:06:53.824 END TEST locking_app_on_unlocked_coremask 00:06:53.824 ************************************ 00:06:53.824 22:58:57 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:06:53.824 22:58:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:53.824 22:58:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:53.824 22:58:57 -- common/autotest_common.sh@10 -- # set +x 00:06:53.824 ************************************ 00:06:53.824 START TEST locking_app_on_locked_coremask 00:06:53.824 ************************************ 00:06:53.824 22:58:57 -- common/autotest_common.sh@1114 -- # locking_app_on_locked_coremask 00:06:53.824 22:58:57 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=2333110 00:06:53.824 22:58:57 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:53.824 22:58:57 -- event/cpu_locks.sh@116 -- # waitforlisten 2333110 /var/tmp/spdk.sock 00:06:53.824 22:58:57 -- common/autotest_common.sh@829 -- # '[' -z 2333110 ']' 00:06:53.824 22:58:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:53.824 22:58:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:53.824 22:58:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:53.824 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:53.824 22:58:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:53.824 22:58:57 -- common/autotest_common.sh@10 -- # set +x 00:06:53.824 [2024-11-28 22:58:57.406192] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:53.824 [2024-11-28 22:58:57.406298] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2333110 ] 00:06:54.083 EAL: No free 2048 kB hugepages reported on node 1 00:06:54.083 [2024-11-28 22:58:57.469415] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:54.083 [2024-11-28 22:58:57.554613] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:54.083 [2024-11-28 22:58:57.554814] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:55.017 22:58:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:55.017 22:58:58 -- common/autotest_common.sh@862 -- # return 0 00:06:55.017 22:58:58 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=2333249 00:06:55.017 22:58:58 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:06:55.017 22:58:58 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 2333249 /var/tmp/spdk2.sock 00:06:55.017 22:58:58 -- common/autotest_common.sh@650 -- # local es=0 00:06:55.017 22:58:58 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 2333249 /var/tmp/spdk2.sock 00:06:55.017 22:58:58 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:06:55.017 22:58:58 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:55.017 22:58:58 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:06:55.017 22:58:58 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:55.017 22:58:58 -- common/autotest_common.sh@653 -- # waitforlisten 2333249 /var/tmp/spdk2.sock 00:06:55.017 22:58:58 -- common/autotest_common.sh@829 -- # '[' -z 2333249 ']' 00:06:55.017 22:58:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:55.017 22:58:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:55.017 22:58:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:55.017 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:55.017 22:58:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:55.017 22:58:58 -- common/autotest_common.sh@10 -- # set +x 00:06:55.017 [2024-11-28 22:58:58.388183] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:55.017 [2024-11-28 22:58:58.388277] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2333249 ] 00:06:55.017 EAL: No free 2048 kB hugepages reported on node 1 00:06:55.017 [2024-11-28 22:58:58.485121] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 2333110 has claimed it. 00:06:55.017 [2024-11-28 22:58:58.485195] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:06:55.585 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (2333249) - No such process 00:06:55.585 ERROR: process (pid: 2333249) is no longer running 00:06:55.585 22:58:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:55.585 22:58:59 -- common/autotest_common.sh@862 -- # return 1 00:06:55.586 22:58:59 -- common/autotest_common.sh@653 -- # es=1 00:06:55.586 22:58:59 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:55.586 22:58:59 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:55.586 22:58:59 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:55.586 22:58:59 -- event/cpu_locks.sh@122 -- # locks_exist 2333110 00:06:55.586 22:58:59 -- event/cpu_locks.sh@22 -- # lslocks -p 2333110 00:06:55.586 22:58:59 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:55.900 lslocks: write error 00:06:55.900 22:58:59 -- event/cpu_locks.sh@124 -- # killprocess 2333110 00:06:55.900 22:58:59 -- common/autotest_common.sh@936 -- # '[' -z 2333110 ']' 00:06:55.900 22:58:59 -- common/autotest_common.sh@940 -- # kill -0 2333110 00:06:55.900 22:58:59 -- common/autotest_common.sh@941 -- # uname 00:06:55.900 22:58:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:55.900 22:58:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2333110 00:06:55.900 22:58:59 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:55.900 22:58:59 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:55.900 22:58:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2333110' 00:06:55.900 killing process with pid 2333110 00:06:55.900 22:58:59 -- common/autotest_common.sh@955 -- # kill 2333110 00:06:55.900 22:58:59 -- common/autotest_common.sh@960 -- # wait 2333110 00:06:56.159 00:06:56.159 real 0m2.401s 00:06:56.159 user 0m2.751s 00:06:56.159 sys 0m0.636s 00:06:56.159 22:58:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:56.159 22:58:59 -- common/autotest_common.sh@10 -- # set +x 00:06:56.159 ************************************ 00:06:56.159 END TEST locking_app_on_locked_coremask 00:06:56.159 ************************************ 00:06:56.418 22:58:59 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:06:56.418 22:58:59 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:56.418 22:58:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:56.418 22:58:59 -- common/autotest_common.sh@10 -- # set +x 00:06:56.418 ************************************ 00:06:56.418 START TEST locking_overlapped_coremask 00:06:56.418 ************************************ 00:06:56.418 22:58:59 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask 00:06:56.418 22:58:59 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=2333419 00:06:56.418 22:58:59 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:06:56.418 22:58:59 -- event/cpu_locks.sh@133 -- # waitforlisten 2333419 /var/tmp/spdk.sock 00:06:56.418 22:58:59 -- common/autotest_common.sh@829 -- # '[' -z 2333419 ']' 00:06:56.418 22:58:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:56.418 22:58:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:56.418 22:58:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:56.418 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:56.418 22:58:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:56.418 22:58:59 -- common/autotest_common.sh@10 -- # set +x 00:06:56.418 [2024-11-28 22:58:59.835974] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:56.418 [2024-11-28 22:58:59.836062] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2333419 ] 00:06:56.418 EAL: No free 2048 kB hugepages reported on node 1 00:06:56.418 [2024-11-28 22:58:59.895295] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:56.418 [2024-11-28 22:58:59.983752] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:56.418 [2024-11-28 22:58:59.983924] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:56.418 [2024-11-28 22:58:59.983984] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:56.418 [2024-11-28 22:58:59.983987] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:57.352 22:59:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:57.352 22:59:00 -- common/autotest_common.sh@862 -- # return 0 00:06:57.352 22:59:00 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=2333561 00:06:57.352 22:59:00 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 2333561 /var/tmp/spdk2.sock 00:06:57.352 22:59:00 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:06:57.352 22:59:00 -- common/autotest_common.sh@650 -- # local es=0 00:06:57.352 22:59:00 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 2333561 /var/tmp/spdk2.sock 00:06:57.352 22:59:00 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:06:57.352 22:59:00 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:57.352 22:59:00 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:06:57.352 22:59:00 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:57.352 22:59:00 -- common/autotest_common.sh@653 -- # waitforlisten 2333561 /var/tmp/spdk2.sock 00:06:57.352 22:59:00 -- common/autotest_common.sh@829 -- # '[' -z 2333561 ']' 00:06:57.352 22:59:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:57.352 22:59:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:57.352 22:59:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:57.352 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:57.352 22:59:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:57.352 22:59:00 -- common/autotest_common.sh@10 -- # set +x 00:06:57.352 [2024-11-28 22:59:00.847187] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:57.353 [2024-11-28 22:59:00.847278] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2333561 ] 00:06:57.353 EAL: No free 2048 kB hugepages reported on node 1 00:06:57.353 [2024-11-28 22:59:00.939523] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 2333419 has claimed it. 00:06:57.353 [2024-11-28 22:59:00.939587] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:06:58.286 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (2333561) - No such process 00:06:58.286 ERROR: process (pid: 2333561) is no longer running 00:06:58.286 22:59:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:58.286 22:59:01 -- common/autotest_common.sh@862 -- # return 1 00:06:58.286 22:59:01 -- common/autotest_common.sh@653 -- # es=1 00:06:58.286 22:59:01 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:58.286 22:59:01 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:58.286 22:59:01 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:58.286 22:59:01 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:06:58.286 22:59:01 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:06:58.286 22:59:01 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:06:58.286 22:59:01 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:06:58.286 22:59:01 -- event/cpu_locks.sh@141 -- # killprocess 2333419 00:06:58.286 22:59:01 -- common/autotest_common.sh@936 -- # '[' -z 2333419 ']' 00:06:58.286 22:59:01 -- common/autotest_common.sh@940 -- # kill -0 2333419 00:06:58.286 22:59:01 -- common/autotest_common.sh@941 -- # uname 00:06:58.286 22:59:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:58.286 22:59:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2333419 00:06:58.286 22:59:01 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:58.286 22:59:01 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:58.286 22:59:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2333419' 00:06:58.286 killing process with pid 2333419 00:06:58.286 22:59:01 -- common/autotest_common.sh@955 -- # kill 2333419 00:06:58.286 22:59:01 -- common/autotest_common.sh@960 -- # wait 2333419 00:06:58.544 00:06:58.544 real 0m2.192s 00:06:58.544 user 0m6.314s 00:06:58.544 sys 0m0.501s 00:06:58.544 22:59:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:58.544 22:59:01 -- common/autotest_common.sh@10 -- # set +x 00:06:58.544 ************************************ 00:06:58.544 END TEST locking_overlapped_coremask 00:06:58.544 ************************************ 00:06:58.544 22:59:01 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:06:58.544 22:59:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:58.544 22:59:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:58.544 22:59:01 -- common/autotest_common.sh@10 -- # set +x 00:06:58.545 ************************************ 00:06:58.545 START TEST locking_overlapped_coremask_via_rpc 00:06:58.545 ************************************ 00:06:58.545 22:59:02 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask_via_rpc 00:06:58.545 22:59:02 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=2333731 00:06:58.545 22:59:02 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:06:58.545 22:59:02 -- event/cpu_locks.sh@149 -- # waitforlisten 2333731 /var/tmp/spdk.sock 00:06:58.545 22:59:02 -- common/autotest_common.sh@829 -- # '[' -z 2333731 ']' 00:06:58.545 22:59:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:58.545 22:59:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:58.545 22:59:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:58.545 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:58.545 22:59:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:58.545 22:59:02 -- common/autotest_common.sh@10 -- # set +x 00:06:58.545 [2024-11-28 22:59:02.054430] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:58.545 [2024-11-28 22:59:02.054527] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2333731 ] 00:06:58.545 EAL: No free 2048 kB hugepages reported on node 1 00:06:58.545 [2024-11-28 22:59:02.118340] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:58.545 [2024-11-28 22:59:02.118408] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:58.803 [2024-11-28 22:59:02.206071] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:58.803 [2024-11-28 22:59:02.206322] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:58.803 [2024-11-28 22:59:02.206379] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:58.803 [2024-11-28 22:59:02.206404] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:59.737 22:59:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:59.737 22:59:02 -- common/autotest_common.sh@862 -- # return 0 00:06:59.737 22:59:02 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=2333875 00:06:59.737 22:59:02 -- event/cpu_locks.sh@153 -- # waitforlisten 2333875 /var/tmp/spdk2.sock 00:06:59.737 22:59:02 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:06:59.737 22:59:02 -- common/autotest_common.sh@829 -- # '[' -z 2333875 ']' 00:06:59.737 22:59:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:59.737 22:59:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:59.737 22:59:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:59.737 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:59.737 22:59:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:59.737 22:59:02 -- common/autotest_common.sh@10 -- # set +x 00:06:59.737 [2024-11-28 22:59:03.044407] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:59.737 [2024-11-28 22:59:03.044501] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2333875 ] 00:06:59.737 EAL: No free 2048 kB hugepages reported on node 1 00:06:59.737 [2024-11-28 22:59:03.134000] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:59.737 [2024-11-28 22:59:03.134044] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:59.737 [2024-11-28 22:59:03.301458] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:59.737 [2024-11-28 22:59:03.301666] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:59.737 [2024-11-28 22:59:03.301787] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:06:59.737 [2024-11-28 22:59:03.301789] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:00.671 22:59:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:00.671 22:59:03 -- common/autotest_common.sh@862 -- # return 0 00:07:00.671 22:59:03 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:07:00.671 22:59:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:00.671 22:59:03 -- common/autotest_common.sh@10 -- # set +x 00:07:00.671 22:59:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:00.671 22:59:04 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:07:00.671 22:59:04 -- common/autotest_common.sh@650 -- # local es=0 00:07:00.671 22:59:04 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:07:00.671 22:59:04 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:07:00.671 22:59:04 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:00.671 22:59:04 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:07:00.671 22:59:04 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:00.671 22:59:04 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:07:00.671 22:59:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:00.671 22:59:04 -- common/autotest_common.sh@10 -- # set +x 00:07:00.671 [2024-11-28 22:59:04.014490] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 2333731 has claimed it. 00:07:00.671 request: 00:07:00.671 { 00:07:00.671 "method": "framework_enable_cpumask_locks", 00:07:00.671 "req_id": 1 00:07:00.671 } 00:07:00.671 Got JSON-RPC error response 00:07:00.671 response: 00:07:00.671 { 00:07:00.671 "code": -32603, 00:07:00.671 "message": "Failed to claim CPU core: 2" 00:07:00.671 } 00:07:00.671 22:59:04 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:07:00.671 22:59:04 -- common/autotest_common.sh@653 -- # es=1 00:07:00.671 22:59:04 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:07:00.671 22:59:04 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:07:00.671 22:59:04 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:07:00.671 22:59:04 -- event/cpu_locks.sh@158 -- # waitforlisten 2333731 /var/tmp/spdk.sock 00:07:00.671 22:59:04 -- common/autotest_common.sh@829 -- # '[' -z 2333731 ']' 00:07:00.671 22:59:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:00.671 22:59:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:00.671 22:59:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:00.671 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:00.671 22:59:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:00.671 22:59:04 -- common/autotest_common.sh@10 -- # set +x 00:07:00.671 22:59:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:00.671 22:59:04 -- common/autotest_common.sh@862 -- # return 0 00:07:00.671 22:59:04 -- event/cpu_locks.sh@159 -- # waitforlisten 2333875 /var/tmp/spdk2.sock 00:07:00.671 22:59:04 -- common/autotest_common.sh@829 -- # '[' -z 2333875 ']' 00:07:00.671 22:59:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:07:00.671 22:59:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:00.671 22:59:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:07:00.671 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:07:00.671 22:59:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:00.671 22:59:04 -- common/autotest_common.sh@10 -- # set +x 00:07:00.928 22:59:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:00.928 22:59:04 -- common/autotest_common.sh@862 -- # return 0 00:07:00.928 22:59:04 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:07:00.928 22:59:04 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:07:00.928 22:59:04 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:07:00.928 22:59:04 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:07:00.928 00:07:00.928 real 0m2.518s 00:07:00.928 user 0m1.248s 00:07:00.928 sys 0m0.201s 00:07:00.928 22:59:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:00.928 22:59:04 -- common/autotest_common.sh@10 -- # set +x 00:07:00.928 ************************************ 00:07:00.928 END TEST locking_overlapped_coremask_via_rpc 00:07:00.928 ************************************ 00:07:01.187 22:59:04 -- event/cpu_locks.sh@174 -- # cleanup 00:07:01.187 22:59:04 -- event/cpu_locks.sh@15 -- # [[ -z 2333731 ]] 00:07:01.187 22:59:04 -- event/cpu_locks.sh@15 -- # killprocess 2333731 00:07:01.187 22:59:04 -- common/autotest_common.sh@936 -- # '[' -z 2333731 ']' 00:07:01.187 22:59:04 -- common/autotest_common.sh@940 -- # kill -0 2333731 00:07:01.187 22:59:04 -- common/autotest_common.sh@941 -- # uname 00:07:01.187 22:59:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:01.187 22:59:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2333731 00:07:01.187 22:59:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:01.187 22:59:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:01.187 22:59:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2333731' 00:07:01.187 killing process with pid 2333731 00:07:01.187 22:59:04 -- common/autotest_common.sh@955 -- # kill 2333731 00:07:01.187 22:59:04 -- common/autotest_common.sh@960 -- # wait 2333731 00:07:01.444 22:59:04 -- event/cpu_locks.sh@16 -- # [[ -z 2333875 ]] 00:07:01.445 22:59:04 -- event/cpu_locks.sh@16 -- # killprocess 2333875 00:07:01.445 22:59:04 -- common/autotest_common.sh@936 -- # '[' -z 2333875 ']' 00:07:01.445 22:59:04 -- common/autotest_common.sh@940 -- # kill -0 2333875 00:07:01.445 22:59:04 -- common/autotest_common.sh@941 -- # uname 00:07:01.445 22:59:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:01.445 22:59:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2333875 00:07:01.445 22:59:05 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:07:01.445 22:59:05 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:07:01.445 22:59:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2333875' 00:07:01.445 killing process with pid 2333875 00:07:01.445 22:59:05 -- common/autotest_common.sh@955 -- # kill 2333875 00:07:01.445 22:59:05 -- common/autotest_common.sh@960 -- # wait 2333875 00:07:02.011 22:59:05 -- event/cpu_locks.sh@18 -- # rm -f 00:07:02.011 22:59:05 -- event/cpu_locks.sh@1 -- # cleanup 00:07:02.011 22:59:05 -- event/cpu_locks.sh@15 -- # [[ -z 2333731 ]] 00:07:02.011 22:59:05 -- event/cpu_locks.sh@15 -- # killprocess 2333731 00:07:02.011 22:59:05 -- common/autotest_common.sh@936 -- # '[' -z 2333731 ']' 00:07:02.011 22:59:05 -- common/autotest_common.sh@940 -- # kill -0 2333731 00:07:02.011 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2333731) - No such process 00:07:02.011 22:59:05 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2333731 is not found' 00:07:02.011 Process with pid 2333731 is not found 00:07:02.011 22:59:05 -- event/cpu_locks.sh@16 -- # [[ -z 2333875 ]] 00:07:02.011 22:59:05 -- event/cpu_locks.sh@16 -- # killprocess 2333875 00:07:02.011 22:59:05 -- common/autotest_common.sh@936 -- # '[' -z 2333875 ']' 00:07:02.011 22:59:05 -- common/autotest_common.sh@940 -- # kill -0 2333875 00:07:02.011 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2333875) - No such process 00:07:02.011 22:59:05 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2333875 is not found' 00:07:02.011 Process with pid 2333875 is not found 00:07:02.011 22:59:05 -- event/cpu_locks.sh@18 -- # rm -f 00:07:02.011 00:07:02.011 real 0m19.339s 00:07:02.011 user 0m34.982s 00:07:02.011 sys 0m5.340s 00:07:02.011 22:59:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:02.011 22:59:05 -- common/autotest_common.sh@10 -- # set +x 00:07:02.011 ************************************ 00:07:02.011 END TEST cpu_locks 00:07:02.011 ************************************ 00:07:02.011 00:07:02.011 real 0m45.290s 00:07:02.011 user 1m27.131s 00:07:02.011 sys 0m9.191s 00:07:02.011 22:59:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:02.011 22:59:05 -- common/autotest_common.sh@10 -- # set +x 00:07:02.011 ************************************ 00:07:02.011 END TEST event 00:07:02.011 ************************************ 00:07:02.011 22:59:05 -- spdk/autotest.sh@175 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:07:02.011 22:59:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:02.011 22:59:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:02.011 22:59:05 -- common/autotest_common.sh@10 -- # set +x 00:07:02.011 ************************************ 00:07:02.011 START TEST thread 00:07:02.011 ************************************ 00:07:02.011 22:59:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:07:02.011 * Looking for test storage... 00:07:02.011 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:07:02.011 22:59:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:02.011 22:59:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:02.011 22:59:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:02.011 22:59:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:02.011 22:59:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:02.011 22:59:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:02.011 22:59:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:02.011 22:59:05 -- scripts/common.sh@335 -- # IFS=.-: 00:07:02.011 22:59:05 -- scripts/common.sh@335 -- # read -ra ver1 00:07:02.011 22:59:05 -- scripts/common.sh@336 -- # IFS=.-: 00:07:02.011 22:59:05 -- scripts/common.sh@336 -- # read -ra ver2 00:07:02.011 22:59:05 -- scripts/common.sh@337 -- # local 'op=<' 00:07:02.011 22:59:05 -- scripts/common.sh@339 -- # ver1_l=2 00:07:02.011 22:59:05 -- scripts/common.sh@340 -- # ver2_l=1 00:07:02.011 22:59:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:02.011 22:59:05 -- scripts/common.sh@343 -- # case "$op" in 00:07:02.011 22:59:05 -- scripts/common.sh@344 -- # : 1 00:07:02.011 22:59:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:02.011 22:59:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:02.011 22:59:05 -- scripts/common.sh@364 -- # decimal 1 00:07:02.011 22:59:05 -- scripts/common.sh@352 -- # local d=1 00:07:02.011 22:59:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:02.011 22:59:05 -- scripts/common.sh@354 -- # echo 1 00:07:02.011 22:59:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:02.011 22:59:05 -- scripts/common.sh@365 -- # decimal 2 00:07:02.011 22:59:05 -- scripts/common.sh@352 -- # local d=2 00:07:02.011 22:59:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:02.011 22:59:05 -- scripts/common.sh@354 -- # echo 2 00:07:02.270 22:59:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:02.270 22:59:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:02.270 22:59:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:02.270 22:59:05 -- scripts/common.sh@367 -- # return 0 00:07:02.270 22:59:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:02.270 22:59:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:02.270 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:02.270 --rc genhtml_branch_coverage=1 00:07:02.270 --rc genhtml_function_coverage=1 00:07:02.270 --rc genhtml_legend=1 00:07:02.270 --rc geninfo_all_blocks=1 00:07:02.270 --rc geninfo_unexecuted_blocks=1 00:07:02.270 00:07:02.270 ' 00:07:02.270 22:59:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:02.270 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:02.270 --rc genhtml_branch_coverage=1 00:07:02.270 --rc genhtml_function_coverage=1 00:07:02.270 --rc genhtml_legend=1 00:07:02.270 --rc geninfo_all_blocks=1 00:07:02.270 --rc geninfo_unexecuted_blocks=1 00:07:02.270 00:07:02.270 ' 00:07:02.270 22:59:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:02.270 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:02.270 --rc genhtml_branch_coverage=1 00:07:02.270 --rc genhtml_function_coverage=1 00:07:02.270 --rc genhtml_legend=1 00:07:02.270 --rc geninfo_all_blocks=1 00:07:02.270 --rc geninfo_unexecuted_blocks=1 00:07:02.270 00:07:02.270 ' 00:07:02.270 22:59:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:02.270 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:02.270 --rc genhtml_branch_coverage=1 00:07:02.270 --rc genhtml_function_coverage=1 00:07:02.270 --rc genhtml_legend=1 00:07:02.270 --rc geninfo_all_blocks=1 00:07:02.270 --rc geninfo_unexecuted_blocks=1 00:07:02.270 00:07:02.270 ' 00:07:02.270 22:59:05 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:07:02.270 22:59:05 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:07:02.270 22:59:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:02.270 22:59:05 -- common/autotest_common.sh@10 -- # set +x 00:07:02.270 ************************************ 00:07:02.270 START TEST thread_poller_perf 00:07:02.270 ************************************ 00:07:02.270 22:59:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:07:02.270 [2024-11-28 22:59:05.633293] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:02.270 [2024-11-28 22:59:05.633385] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2334249 ] 00:07:02.270 EAL: No free 2048 kB hugepages reported on node 1 00:07:02.270 [2024-11-28 22:59:05.690924] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:02.270 [2024-11-28 22:59:05.777876] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:02.270 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:07:03.645 [2024-11-28T21:59:07.251Z] ====================================== 00:07:03.645 [2024-11-28T21:59:07.251Z] busy:2709795958 (cyc) 00:07:03.645 [2024-11-28T21:59:07.251Z] total_run_count: 280000 00:07:03.645 [2024-11-28T21:59:07.251Z] tsc_hz: 2700000000 (cyc) 00:07:03.645 [2024-11-28T21:59:07.251Z] ====================================== 00:07:03.645 [2024-11-28T21:59:07.251Z] poller_cost: 9677 (cyc), 3584 (nsec) 00:07:03.645 00:07:03.645 real 0m1.242s 00:07:03.645 user 0m1.162s 00:07:03.645 sys 0m0.073s 00:07:03.645 22:59:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:03.645 22:59:06 -- common/autotest_common.sh@10 -- # set +x 00:07:03.645 ************************************ 00:07:03.645 END TEST thread_poller_perf 00:07:03.645 ************************************ 00:07:03.645 22:59:06 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:07:03.645 22:59:06 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:07:03.645 22:59:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:03.645 22:59:06 -- common/autotest_common.sh@10 -- # set +x 00:07:03.645 ************************************ 00:07:03.645 START TEST thread_poller_perf 00:07:03.645 ************************************ 00:07:03.645 22:59:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:07:03.645 [2024-11-28 22:59:06.904375] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:03.645 [2024-11-28 22:59:06.904480] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2334477 ] 00:07:03.645 EAL: No free 2048 kB hugepages reported on node 1 00:07:03.645 [2024-11-28 22:59:06.967380] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:03.645 [2024-11-28 22:59:07.059348] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:03.645 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:07:04.581 [2024-11-28T21:59:08.187Z] ====================================== 00:07:04.581 [2024-11-28T21:59:08.187Z] busy:2703330107 (cyc) 00:07:04.581 [2024-11-28T21:59:08.187Z] total_run_count: 3836000 00:07:04.581 [2024-11-28T21:59:08.187Z] tsc_hz: 2700000000 (cyc) 00:07:04.581 [2024-11-28T21:59:08.187Z] ====================================== 00:07:04.581 [2024-11-28T21:59:08.187Z] poller_cost: 704 (cyc), 260 (nsec) 00:07:04.581 00:07:04.581 real 0m1.253s 00:07:04.581 user 0m1.164s 00:07:04.581 sys 0m0.081s 00:07:04.581 22:59:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:04.581 22:59:08 -- common/autotest_common.sh@10 -- # set +x 00:07:04.581 ************************************ 00:07:04.581 END TEST thread_poller_perf 00:07:04.581 ************************************ 00:07:04.581 22:59:08 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:07:04.581 00:07:04.581 real 0m2.688s 00:07:04.581 user 0m2.444s 00:07:04.581 sys 0m0.248s 00:07:04.581 22:59:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:04.581 22:59:08 -- common/autotest_common.sh@10 -- # set +x 00:07:04.581 ************************************ 00:07:04.581 END TEST thread 00:07:04.581 ************************************ 00:07:04.840 22:59:08 -- spdk/autotest.sh@176 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:07:04.840 22:59:08 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:04.840 22:59:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:04.840 22:59:08 -- common/autotest_common.sh@10 -- # set +x 00:07:04.840 ************************************ 00:07:04.840 START TEST accel 00:07:04.840 ************************************ 00:07:04.840 22:59:08 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:07:04.840 * Looking for test storage... 00:07:04.840 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:07:04.840 22:59:08 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:04.840 22:59:08 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:04.840 22:59:08 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:04.840 22:59:08 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:04.840 22:59:08 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:04.840 22:59:08 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:04.840 22:59:08 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:04.840 22:59:08 -- scripts/common.sh@335 -- # IFS=.-: 00:07:04.840 22:59:08 -- scripts/common.sh@335 -- # read -ra ver1 00:07:04.840 22:59:08 -- scripts/common.sh@336 -- # IFS=.-: 00:07:04.840 22:59:08 -- scripts/common.sh@336 -- # read -ra ver2 00:07:04.840 22:59:08 -- scripts/common.sh@337 -- # local 'op=<' 00:07:04.840 22:59:08 -- scripts/common.sh@339 -- # ver1_l=2 00:07:04.840 22:59:08 -- scripts/common.sh@340 -- # ver2_l=1 00:07:04.840 22:59:08 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:04.840 22:59:08 -- scripts/common.sh@343 -- # case "$op" in 00:07:04.840 22:59:08 -- scripts/common.sh@344 -- # : 1 00:07:04.840 22:59:08 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:04.840 22:59:08 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:04.840 22:59:08 -- scripts/common.sh@364 -- # decimal 1 00:07:04.840 22:59:08 -- scripts/common.sh@352 -- # local d=1 00:07:04.840 22:59:08 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:04.840 22:59:08 -- scripts/common.sh@354 -- # echo 1 00:07:04.840 22:59:08 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:04.840 22:59:08 -- scripts/common.sh@365 -- # decimal 2 00:07:04.840 22:59:08 -- scripts/common.sh@352 -- # local d=2 00:07:04.840 22:59:08 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:04.840 22:59:08 -- scripts/common.sh@354 -- # echo 2 00:07:04.840 22:59:08 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:04.840 22:59:08 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:04.840 22:59:08 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:04.840 22:59:08 -- scripts/common.sh@367 -- # return 0 00:07:04.840 22:59:08 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:04.840 22:59:08 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:04.840 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:04.840 --rc genhtml_branch_coverage=1 00:07:04.840 --rc genhtml_function_coverage=1 00:07:04.840 --rc genhtml_legend=1 00:07:04.840 --rc geninfo_all_blocks=1 00:07:04.840 --rc geninfo_unexecuted_blocks=1 00:07:04.840 00:07:04.840 ' 00:07:04.840 22:59:08 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:04.840 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:04.840 --rc genhtml_branch_coverage=1 00:07:04.840 --rc genhtml_function_coverage=1 00:07:04.840 --rc genhtml_legend=1 00:07:04.840 --rc geninfo_all_blocks=1 00:07:04.840 --rc geninfo_unexecuted_blocks=1 00:07:04.840 00:07:04.840 ' 00:07:04.840 22:59:08 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:04.840 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:04.840 --rc genhtml_branch_coverage=1 00:07:04.840 --rc genhtml_function_coverage=1 00:07:04.840 --rc genhtml_legend=1 00:07:04.840 --rc geninfo_all_blocks=1 00:07:04.840 --rc geninfo_unexecuted_blocks=1 00:07:04.840 00:07:04.840 ' 00:07:04.840 22:59:08 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:04.840 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:04.840 --rc genhtml_branch_coverage=1 00:07:04.840 --rc genhtml_function_coverage=1 00:07:04.840 --rc genhtml_legend=1 00:07:04.840 --rc geninfo_all_blocks=1 00:07:04.840 --rc geninfo_unexecuted_blocks=1 00:07:04.840 00:07:04.840 ' 00:07:04.840 22:59:08 -- accel/accel.sh@73 -- # declare -A expected_opcs 00:07:04.840 22:59:08 -- accel/accel.sh@74 -- # get_expected_opcs 00:07:04.840 22:59:08 -- accel/accel.sh@57 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:07:04.840 22:59:08 -- accel/accel.sh@59 -- # spdk_tgt_pid=2334732 00:07:04.840 22:59:08 -- accel/accel.sh@60 -- # waitforlisten 2334732 00:07:04.840 22:59:08 -- common/autotest_common.sh@829 -- # '[' -z 2334732 ']' 00:07:04.840 22:59:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:04.840 22:59:08 -- accel/accel.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:07:04.840 22:59:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:04.840 22:59:08 -- accel/accel.sh@58 -- # build_accel_config 00:07:04.840 22:59:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:04.840 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:04.840 22:59:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:04.840 22:59:08 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:04.840 22:59:08 -- common/autotest_common.sh@10 -- # set +x 00:07:04.840 22:59:08 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:04.840 22:59:08 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:04.840 22:59:08 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:04.840 22:59:08 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:04.840 22:59:08 -- accel/accel.sh@41 -- # local IFS=, 00:07:04.840 22:59:08 -- accel/accel.sh@42 -- # jq -r . 00:07:04.840 [2024-11-28 22:59:08.380745] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:04.840 [2024-11-28 22:59:08.380825] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2334732 ] 00:07:04.840 EAL: No free 2048 kB hugepages reported on node 1 00:07:05.099 [2024-11-28 22:59:08.449490] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:05.099 [2024-11-28 22:59:08.538057] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:05.099 [2024-11-28 22:59:08.538240] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:06.034 22:59:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:06.034 22:59:09 -- common/autotest_common.sh@862 -- # return 0 00:07:06.034 22:59:09 -- accel/accel.sh@62 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:07:06.034 22:59:09 -- accel/accel.sh@62 -- # rpc_cmd accel_get_opc_assignments 00:07:06.034 22:59:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.034 22:59:09 -- common/autotest_common.sh@10 -- # set +x 00:07:06.034 22:59:09 -- accel/accel.sh@62 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:07:06.034 22:59:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.034 22:59:09 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:06.034 22:59:09 -- accel/accel.sh@64 -- # IFS== 00:07:06.034 22:59:09 -- accel/accel.sh@64 -- # read -r opc module 00:07:06.034 22:59:09 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:06.034 22:59:09 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:06.034 22:59:09 -- accel/accel.sh@64 -- # IFS== 00:07:06.034 22:59:09 -- accel/accel.sh@64 -- # read -r opc module 00:07:06.034 22:59:09 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:06.034 22:59:09 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:06.034 22:59:09 -- accel/accel.sh@64 -- # IFS== 00:07:06.034 22:59:09 -- accel/accel.sh@64 -- # read -r opc module 00:07:06.034 22:59:09 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:06.034 22:59:09 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:06.034 22:59:09 -- accel/accel.sh@64 -- # IFS== 00:07:06.034 22:59:09 -- accel/accel.sh@64 -- # read -r opc module 00:07:06.034 22:59:09 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:06.034 22:59:09 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:06.034 22:59:09 -- accel/accel.sh@64 -- # IFS== 00:07:06.034 22:59:09 -- accel/accel.sh@64 -- # read -r opc module 00:07:06.034 22:59:09 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:06.034 22:59:09 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:06.034 22:59:09 -- accel/accel.sh@64 -- # IFS== 00:07:06.034 22:59:09 -- accel/accel.sh@64 -- # read -r opc module 00:07:06.034 22:59:09 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:06.034 22:59:09 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:06.034 22:59:09 -- accel/accel.sh@64 -- # IFS== 00:07:06.034 22:59:09 -- accel/accel.sh@64 -- # read -r opc module 00:07:06.034 22:59:09 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:06.034 22:59:09 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:06.034 22:59:09 -- accel/accel.sh@64 -- # IFS== 00:07:06.034 22:59:09 -- accel/accel.sh@64 -- # read -r opc module 00:07:06.034 22:59:09 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:06.034 22:59:09 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:06.034 22:59:09 -- accel/accel.sh@64 -- # IFS== 00:07:06.034 22:59:09 -- accel/accel.sh@64 -- # read -r opc module 00:07:06.034 22:59:09 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:06.034 22:59:09 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:06.034 22:59:09 -- accel/accel.sh@64 -- # IFS== 00:07:06.034 22:59:09 -- accel/accel.sh@64 -- # read -r opc module 00:07:06.034 22:59:09 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:06.034 22:59:09 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:06.034 22:59:09 -- accel/accel.sh@64 -- # IFS== 00:07:06.034 22:59:09 -- accel/accel.sh@64 -- # read -r opc module 00:07:06.034 22:59:09 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:06.034 22:59:09 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:06.034 22:59:09 -- accel/accel.sh@64 -- # IFS== 00:07:06.034 22:59:09 -- accel/accel.sh@64 -- # read -r opc module 00:07:06.034 22:59:09 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:06.034 22:59:09 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:06.034 22:59:09 -- accel/accel.sh@64 -- # IFS== 00:07:06.034 22:59:09 -- accel/accel.sh@64 -- # read -r opc module 00:07:06.034 22:59:09 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:06.034 22:59:09 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:06.034 22:59:09 -- accel/accel.sh@64 -- # IFS== 00:07:06.034 22:59:09 -- accel/accel.sh@64 -- # read -r opc module 00:07:06.034 22:59:09 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:06.034 22:59:09 -- accel/accel.sh@67 -- # killprocess 2334732 00:07:06.034 22:59:09 -- common/autotest_common.sh@936 -- # '[' -z 2334732 ']' 00:07:06.034 22:59:09 -- common/autotest_common.sh@940 -- # kill -0 2334732 00:07:06.034 22:59:09 -- common/autotest_common.sh@941 -- # uname 00:07:06.034 22:59:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:06.034 22:59:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2334732 00:07:06.034 22:59:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:06.034 22:59:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:06.034 22:59:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2334732' 00:07:06.034 killing process with pid 2334732 00:07:06.034 22:59:09 -- common/autotest_common.sh@955 -- # kill 2334732 00:07:06.034 22:59:09 -- common/autotest_common.sh@960 -- # wait 2334732 00:07:06.293 22:59:09 -- accel/accel.sh@68 -- # trap - ERR 00:07:06.294 22:59:09 -- accel/accel.sh@81 -- # run_test accel_help accel_perf -h 00:07:06.294 22:59:09 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:06.294 22:59:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:06.294 22:59:09 -- common/autotest_common.sh@10 -- # set +x 00:07:06.294 22:59:09 -- common/autotest_common.sh@1114 -- # accel_perf -h 00:07:06.294 22:59:09 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:07:06.294 22:59:09 -- accel/accel.sh@12 -- # build_accel_config 00:07:06.294 22:59:09 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:06.294 22:59:09 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:06.294 22:59:09 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:06.294 22:59:09 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:06.294 22:59:09 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:06.294 22:59:09 -- accel/accel.sh@41 -- # local IFS=, 00:07:06.294 22:59:09 -- accel/accel.sh@42 -- # jq -r . 00:07:06.294 22:59:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:06.294 22:59:09 -- common/autotest_common.sh@10 -- # set +x 00:07:06.294 22:59:09 -- accel/accel.sh@83 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:07:06.294 22:59:09 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:06.294 22:59:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:06.294 22:59:09 -- common/autotest_common.sh@10 -- # set +x 00:07:06.294 ************************************ 00:07:06.294 START TEST accel_missing_filename 00:07:06.294 ************************************ 00:07:06.294 22:59:09 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress 00:07:06.294 22:59:09 -- common/autotest_common.sh@650 -- # local es=0 00:07:06.294 22:59:09 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress 00:07:06.294 22:59:09 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:07:06.294 22:59:09 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:06.294 22:59:09 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:07:06.294 22:59:09 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:06.294 22:59:09 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress 00:07:06.294 22:59:09 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:07:06.294 22:59:09 -- accel/accel.sh@12 -- # build_accel_config 00:07:06.294 22:59:09 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:06.294 22:59:09 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:06.294 22:59:09 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:06.294 22:59:09 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:06.294 22:59:09 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:06.294 22:59:09 -- accel/accel.sh@41 -- # local IFS=, 00:07:06.294 22:59:09 -- accel/accel.sh@42 -- # jq -r . 00:07:06.294 [2024-11-28 22:59:09.896894] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:06.294 [2024-11-28 22:59:09.896981] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2334910 ] 00:07:06.553 EAL: No free 2048 kB hugepages reported on node 1 00:07:06.553 [2024-11-28 22:59:09.958602] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:06.553 [2024-11-28 22:59:10.057864] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:06.553 [2024-11-28 22:59:10.120124] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:07:06.811 [2024-11-28 22:59:10.203813] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:07:06.811 A filename is required. 00:07:06.811 22:59:10 -- common/autotest_common.sh@653 -- # es=234 00:07:06.811 22:59:10 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:07:06.811 22:59:10 -- common/autotest_common.sh@662 -- # es=106 00:07:06.811 22:59:10 -- common/autotest_common.sh@663 -- # case "$es" in 00:07:06.811 22:59:10 -- common/autotest_common.sh@670 -- # es=1 00:07:06.811 22:59:10 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:07:06.811 00:07:06.811 real 0m0.406s 00:07:06.811 user 0m0.295s 00:07:06.811 sys 0m0.142s 00:07:06.811 22:59:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:06.811 22:59:10 -- common/autotest_common.sh@10 -- # set +x 00:07:06.811 ************************************ 00:07:06.811 END TEST accel_missing_filename 00:07:06.811 ************************************ 00:07:06.811 22:59:10 -- accel/accel.sh@85 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:06.811 22:59:10 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:07:06.811 22:59:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:06.811 22:59:10 -- common/autotest_common.sh@10 -- # set +x 00:07:06.811 ************************************ 00:07:06.811 START TEST accel_compress_verify 00:07:06.811 ************************************ 00:07:06.811 22:59:10 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:06.811 22:59:10 -- common/autotest_common.sh@650 -- # local es=0 00:07:06.811 22:59:10 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:06.811 22:59:10 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:07:06.811 22:59:10 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:06.811 22:59:10 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:07:06.811 22:59:10 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:06.811 22:59:10 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:06.811 22:59:10 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:06.811 22:59:10 -- accel/accel.sh@12 -- # build_accel_config 00:07:06.811 22:59:10 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:06.811 22:59:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:06.811 22:59:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:06.811 22:59:10 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:06.811 22:59:10 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:06.811 22:59:10 -- accel/accel.sh@41 -- # local IFS=, 00:07:06.811 22:59:10 -- accel/accel.sh@42 -- # jq -r . 00:07:06.812 [2024-11-28 22:59:10.331617] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:06.812 [2024-11-28 22:59:10.331704] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2335024 ] 00:07:06.812 EAL: No free 2048 kB hugepages reported on node 1 00:07:06.812 [2024-11-28 22:59:10.396709] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:07.071 [2024-11-28 22:59:10.489590] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:07.071 [2024-11-28 22:59:10.552275] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:07:07.071 [2024-11-28 22:59:10.630702] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:07:07.330 00:07:07.330 Compression does not support the verify option, aborting. 00:07:07.330 22:59:10 -- common/autotest_common.sh@653 -- # es=161 00:07:07.330 22:59:10 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:07:07.330 22:59:10 -- common/autotest_common.sh@662 -- # es=33 00:07:07.330 22:59:10 -- common/autotest_common.sh@663 -- # case "$es" in 00:07:07.330 22:59:10 -- common/autotest_common.sh@670 -- # es=1 00:07:07.330 22:59:10 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:07:07.330 00:07:07.330 real 0m0.400s 00:07:07.330 user 0m0.285s 00:07:07.330 sys 0m0.149s 00:07:07.330 22:59:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:07.330 22:59:10 -- common/autotest_common.sh@10 -- # set +x 00:07:07.330 ************************************ 00:07:07.330 END TEST accel_compress_verify 00:07:07.330 ************************************ 00:07:07.330 22:59:10 -- accel/accel.sh@87 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:07:07.330 22:59:10 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:07.330 22:59:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:07.330 22:59:10 -- common/autotest_common.sh@10 -- # set +x 00:07:07.330 ************************************ 00:07:07.330 START TEST accel_wrong_workload 00:07:07.330 ************************************ 00:07:07.330 22:59:10 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w foobar 00:07:07.330 22:59:10 -- common/autotest_common.sh@650 -- # local es=0 00:07:07.330 22:59:10 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:07:07.330 22:59:10 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:07:07.330 22:59:10 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:07.330 22:59:10 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:07:07.330 22:59:10 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:07.330 22:59:10 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w foobar 00:07:07.330 22:59:10 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:07:07.330 22:59:10 -- accel/accel.sh@12 -- # build_accel_config 00:07:07.330 22:59:10 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:07.330 22:59:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:07.330 22:59:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:07.330 22:59:10 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:07.330 22:59:10 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:07.330 22:59:10 -- accel/accel.sh@41 -- # local IFS=, 00:07:07.330 22:59:10 -- accel/accel.sh@42 -- # jq -r . 00:07:07.330 Unsupported workload type: foobar 00:07:07.330 [2024-11-28 22:59:10.755180] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:07:07.330 accel_perf options: 00:07:07.330 [-h help message] 00:07:07.330 [-q queue depth per core] 00:07:07.330 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:07:07.330 [-T number of threads per core 00:07:07.330 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:07:07.330 [-t time in seconds] 00:07:07.330 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:07:07.330 [ dif_verify, , dif_generate, dif_generate_copy 00:07:07.330 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:07:07.330 [-l for compress/decompress workloads, name of uncompressed input file 00:07:07.330 [-S for crc32c workload, use this seed value (default 0) 00:07:07.330 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:07:07.330 [-f for fill workload, use this BYTE value (default 255) 00:07:07.330 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:07:07.330 [-y verify result if this switch is on] 00:07:07.330 [-a tasks to allocate per core (default: same value as -q)] 00:07:07.330 Can be used to spread operations across a wider range of memory. 00:07:07.330 22:59:10 -- common/autotest_common.sh@653 -- # es=1 00:07:07.330 22:59:10 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:07:07.330 22:59:10 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:07:07.330 22:59:10 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:07:07.330 00:07:07.330 real 0m0.022s 00:07:07.330 user 0m0.013s 00:07:07.330 sys 0m0.010s 00:07:07.330 22:59:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:07.330 22:59:10 -- common/autotest_common.sh@10 -- # set +x 00:07:07.330 ************************************ 00:07:07.330 END TEST accel_wrong_workload 00:07:07.330 ************************************ 00:07:07.330 22:59:10 -- accel/accel.sh@89 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:07:07.330 22:59:10 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:07:07.330 22:59:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:07.330 22:59:10 -- common/autotest_common.sh@10 -- # set +x 00:07:07.330 Error: writing output failed: Broken pipe 00:07:07.330 ************************************ 00:07:07.330 START TEST accel_negative_buffers 00:07:07.330 ************************************ 00:07:07.330 22:59:10 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:07:07.330 22:59:10 -- common/autotest_common.sh@650 -- # local es=0 00:07:07.330 22:59:10 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:07:07.330 22:59:10 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:07:07.330 22:59:10 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:07.330 22:59:10 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:07:07.330 22:59:10 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:07.330 22:59:10 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w xor -y -x -1 00:07:07.330 22:59:10 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:07:07.330 22:59:10 -- accel/accel.sh@12 -- # build_accel_config 00:07:07.330 22:59:10 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:07.330 22:59:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:07.330 22:59:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:07.330 22:59:10 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:07.330 22:59:10 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:07.330 22:59:10 -- accel/accel.sh@41 -- # local IFS=, 00:07:07.330 22:59:10 -- accel/accel.sh@42 -- # jq -r . 00:07:07.330 -x option must be non-negative. 00:07:07.330 [2024-11-28 22:59:10.800242] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:07:07.330 accel_perf options: 00:07:07.330 [-h help message] 00:07:07.330 [-q queue depth per core] 00:07:07.330 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:07:07.330 [-T number of threads per core 00:07:07.330 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:07:07.330 [-t time in seconds] 00:07:07.330 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:07:07.330 [ dif_verify, , dif_generate, dif_generate_copy 00:07:07.330 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:07:07.330 [-l for compress/decompress workloads, name of uncompressed input file 00:07:07.330 [-S for crc32c workload, use this seed value (default 0) 00:07:07.330 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:07:07.330 [-f for fill workload, use this BYTE value (default 255) 00:07:07.330 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:07:07.330 [-y verify result if this switch is on] 00:07:07.330 [-a tasks to allocate per core (default: same value as -q)] 00:07:07.330 Can be used to spread operations across a wider range of memory. 00:07:07.330 22:59:10 -- common/autotest_common.sh@653 -- # es=1 00:07:07.330 22:59:10 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:07:07.330 22:59:10 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:07:07.330 22:59:10 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:07:07.330 00:07:07.330 real 0m0.022s 00:07:07.330 user 0m0.011s 00:07:07.330 sys 0m0.011s 00:07:07.330 22:59:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:07.330 22:59:10 -- common/autotest_common.sh@10 -- # set +x 00:07:07.330 ************************************ 00:07:07.330 END TEST accel_negative_buffers 00:07:07.330 ************************************ 00:07:07.330 22:59:10 -- accel/accel.sh@93 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:07:07.330 22:59:10 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:07.330 22:59:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:07.330 22:59:10 -- common/autotest_common.sh@10 -- # set +x 00:07:07.330 Error: writing output failed: Broken pipe 00:07:07.330 ************************************ 00:07:07.330 START TEST accel_crc32c 00:07:07.330 ************************************ 00:07:07.330 22:59:10 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -S 32 -y 00:07:07.330 22:59:10 -- accel/accel.sh@16 -- # local accel_opc 00:07:07.330 22:59:10 -- accel/accel.sh@17 -- # local accel_module 00:07:07.330 22:59:10 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:07:07.331 22:59:10 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:07:07.331 22:59:10 -- accel/accel.sh@12 -- # build_accel_config 00:07:07.331 22:59:10 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:07.331 22:59:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:07.331 22:59:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:07.331 22:59:10 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:07.331 22:59:10 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:07.331 22:59:10 -- accel/accel.sh@41 -- # local IFS=, 00:07:07.331 22:59:10 -- accel/accel.sh@42 -- # jq -r . 00:07:07.331 [2024-11-28 22:59:10.842694] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:07.331 [2024-11-28 22:59:10.842754] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2335116 ] 00:07:07.331 EAL: No free 2048 kB hugepages reported on node 1 00:07:07.331 [2024-11-28 22:59:10.904080] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:07.590 [2024-11-28 22:59:10.996355] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:08.964 22:59:12 -- accel/accel.sh@18 -- # out=' 00:07:08.964 SPDK Configuration: 00:07:08.964 Core mask: 0x1 00:07:08.964 00:07:08.964 Accel Perf Configuration: 00:07:08.964 Workload Type: crc32c 00:07:08.964 CRC-32C seed: 32 00:07:08.964 Transfer size: 4096 bytes 00:07:08.964 Vector count 1 00:07:08.964 Module: software 00:07:08.964 Queue depth: 32 00:07:08.964 Allocate depth: 32 00:07:08.964 # threads/core: 1 00:07:08.964 Run time: 1 seconds 00:07:08.964 Verify: Yes 00:07:08.964 00:07:08.964 Running for 1 seconds... 00:07:08.964 00:07:08.964 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:08.964 ------------------------------------------------------------------------------------ 00:07:08.964 0,0 406432/s 1587 MiB/s 0 0 00:07:08.964 ==================================================================================== 00:07:08.964 Total 406432/s 1587 MiB/s 0 0' 00:07:08.964 22:59:12 -- accel/accel.sh@20 -- # IFS=: 00:07:08.964 22:59:12 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:07:08.964 22:59:12 -- accel/accel.sh@20 -- # read -r var val 00:07:08.964 22:59:12 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:07:08.964 22:59:12 -- accel/accel.sh@12 -- # build_accel_config 00:07:08.964 22:59:12 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:08.964 22:59:12 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:08.964 22:59:12 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:08.964 22:59:12 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:08.964 22:59:12 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:08.964 22:59:12 -- accel/accel.sh@41 -- # local IFS=, 00:07:08.964 22:59:12 -- accel/accel.sh@42 -- # jq -r . 00:07:08.964 [2024-11-28 22:59:12.251230] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:08.964 [2024-11-28 22:59:12.251314] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2335263 ] 00:07:08.964 EAL: No free 2048 kB hugepages reported on node 1 00:07:08.964 [2024-11-28 22:59:12.312286] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:08.964 [2024-11-28 22:59:12.402341] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:08.964 22:59:12 -- accel/accel.sh@21 -- # val= 00:07:08.964 22:59:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.964 22:59:12 -- accel/accel.sh@20 -- # IFS=: 00:07:08.964 22:59:12 -- accel/accel.sh@20 -- # read -r var val 00:07:08.964 22:59:12 -- accel/accel.sh@21 -- # val= 00:07:08.964 22:59:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.964 22:59:12 -- accel/accel.sh@20 -- # IFS=: 00:07:08.964 22:59:12 -- accel/accel.sh@20 -- # read -r var val 00:07:08.964 22:59:12 -- accel/accel.sh@21 -- # val=0x1 00:07:08.964 22:59:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.964 22:59:12 -- accel/accel.sh@20 -- # IFS=: 00:07:08.964 22:59:12 -- accel/accel.sh@20 -- # read -r var val 00:07:08.964 22:59:12 -- accel/accel.sh@21 -- # val= 00:07:08.964 22:59:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.964 22:59:12 -- accel/accel.sh@20 -- # IFS=: 00:07:08.964 22:59:12 -- accel/accel.sh@20 -- # read -r var val 00:07:08.964 22:59:12 -- accel/accel.sh@21 -- # val= 00:07:08.964 22:59:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.964 22:59:12 -- accel/accel.sh@20 -- # IFS=: 00:07:08.964 22:59:12 -- accel/accel.sh@20 -- # read -r var val 00:07:08.965 22:59:12 -- accel/accel.sh@21 -- # val=crc32c 00:07:08.965 22:59:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.965 22:59:12 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:07:08.965 22:59:12 -- accel/accel.sh@20 -- # IFS=: 00:07:08.965 22:59:12 -- accel/accel.sh@20 -- # read -r var val 00:07:08.965 22:59:12 -- accel/accel.sh@21 -- # val=32 00:07:08.965 22:59:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.965 22:59:12 -- accel/accel.sh@20 -- # IFS=: 00:07:08.965 22:59:12 -- accel/accel.sh@20 -- # read -r var val 00:07:08.965 22:59:12 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:08.965 22:59:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.965 22:59:12 -- accel/accel.sh@20 -- # IFS=: 00:07:08.965 22:59:12 -- accel/accel.sh@20 -- # read -r var val 00:07:08.965 22:59:12 -- accel/accel.sh@21 -- # val= 00:07:08.965 22:59:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.965 22:59:12 -- accel/accel.sh@20 -- # IFS=: 00:07:08.965 22:59:12 -- accel/accel.sh@20 -- # read -r var val 00:07:08.965 22:59:12 -- accel/accel.sh@21 -- # val=software 00:07:08.965 22:59:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.965 22:59:12 -- accel/accel.sh@23 -- # accel_module=software 00:07:08.965 22:59:12 -- accel/accel.sh@20 -- # IFS=: 00:07:08.965 22:59:12 -- accel/accel.sh@20 -- # read -r var val 00:07:08.965 22:59:12 -- accel/accel.sh@21 -- # val=32 00:07:08.965 22:59:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.965 22:59:12 -- accel/accel.sh@20 -- # IFS=: 00:07:08.965 22:59:12 -- accel/accel.sh@20 -- # read -r var val 00:07:08.965 22:59:12 -- accel/accel.sh@21 -- # val=32 00:07:08.965 22:59:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.965 22:59:12 -- accel/accel.sh@20 -- # IFS=: 00:07:08.965 22:59:12 -- accel/accel.sh@20 -- # read -r var val 00:07:08.965 22:59:12 -- accel/accel.sh@21 -- # val=1 00:07:08.965 22:59:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.965 22:59:12 -- accel/accel.sh@20 -- # IFS=: 00:07:08.965 22:59:12 -- accel/accel.sh@20 -- # read -r var val 00:07:08.965 22:59:12 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:08.965 22:59:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.965 22:59:12 -- accel/accel.sh@20 -- # IFS=: 00:07:08.965 22:59:12 -- accel/accel.sh@20 -- # read -r var val 00:07:08.965 22:59:12 -- accel/accel.sh@21 -- # val=Yes 00:07:08.965 22:59:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.965 22:59:12 -- accel/accel.sh@20 -- # IFS=: 00:07:08.965 22:59:12 -- accel/accel.sh@20 -- # read -r var val 00:07:08.965 22:59:12 -- accel/accel.sh@21 -- # val= 00:07:08.965 22:59:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.965 22:59:12 -- accel/accel.sh@20 -- # IFS=: 00:07:08.965 22:59:12 -- accel/accel.sh@20 -- # read -r var val 00:07:08.965 22:59:12 -- accel/accel.sh@21 -- # val= 00:07:08.965 22:59:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.965 22:59:12 -- accel/accel.sh@20 -- # IFS=: 00:07:08.965 22:59:12 -- accel/accel.sh@20 -- # read -r var val 00:07:10.336 22:59:13 -- accel/accel.sh@21 -- # val= 00:07:10.336 22:59:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.336 22:59:13 -- accel/accel.sh@20 -- # IFS=: 00:07:10.336 22:59:13 -- accel/accel.sh@20 -- # read -r var val 00:07:10.336 22:59:13 -- accel/accel.sh@21 -- # val= 00:07:10.336 22:59:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.336 22:59:13 -- accel/accel.sh@20 -- # IFS=: 00:07:10.336 22:59:13 -- accel/accel.sh@20 -- # read -r var val 00:07:10.336 22:59:13 -- accel/accel.sh@21 -- # val= 00:07:10.336 22:59:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.336 22:59:13 -- accel/accel.sh@20 -- # IFS=: 00:07:10.336 22:59:13 -- accel/accel.sh@20 -- # read -r var val 00:07:10.336 22:59:13 -- accel/accel.sh@21 -- # val= 00:07:10.336 22:59:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.336 22:59:13 -- accel/accel.sh@20 -- # IFS=: 00:07:10.336 22:59:13 -- accel/accel.sh@20 -- # read -r var val 00:07:10.336 22:59:13 -- accel/accel.sh@21 -- # val= 00:07:10.336 22:59:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.336 22:59:13 -- accel/accel.sh@20 -- # IFS=: 00:07:10.336 22:59:13 -- accel/accel.sh@20 -- # read -r var val 00:07:10.336 22:59:13 -- accel/accel.sh@21 -- # val= 00:07:10.336 22:59:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.336 22:59:13 -- accel/accel.sh@20 -- # IFS=: 00:07:10.336 22:59:13 -- accel/accel.sh@20 -- # read -r var val 00:07:10.336 22:59:13 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:10.336 22:59:13 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:07:10.336 22:59:13 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:10.337 00:07:10.337 real 0m2.812s 00:07:10.337 user 0m2.507s 00:07:10.337 sys 0m0.298s 00:07:10.337 22:59:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:10.337 22:59:13 -- common/autotest_common.sh@10 -- # set +x 00:07:10.337 ************************************ 00:07:10.337 END TEST accel_crc32c 00:07:10.337 ************************************ 00:07:10.337 22:59:13 -- accel/accel.sh@94 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:07:10.337 22:59:13 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:10.337 22:59:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:10.337 22:59:13 -- common/autotest_common.sh@10 -- # set +x 00:07:10.337 ************************************ 00:07:10.337 START TEST accel_crc32c_C2 00:07:10.337 ************************************ 00:07:10.337 22:59:13 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -y -C 2 00:07:10.337 22:59:13 -- accel/accel.sh@16 -- # local accel_opc 00:07:10.337 22:59:13 -- accel/accel.sh@17 -- # local accel_module 00:07:10.337 22:59:13 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -y -C 2 00:07:10.337 22:59:13 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:07:10.337 22:59:13 -- accel/accel.sh@12 -- # build_accel_config 00:07:10.337 22:59:13 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:10.337 22:59:13 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:10.337 22:59:13 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:10.337 22:59:13 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:10.337 22:59:13 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:10.337 22:59:13 -- accel/accel.sh@41 -- # local IFS=, 00:07:10.337 22:59:13 -- accel/accel.sh@42 -- # jq -r . 00:07:10.337 [2024-11-28 22:59:13.679891] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:10.337 [2024-11-28 22:59:13.679971] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2335451 ] 00:07:10.337 EAL: No free 2048 kB hugepages reported on node 1 00:07:10.337 [2024-11-28 22:59:13.742760] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:10.337 [2024-11-28 22:59:13.833747] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:11.707 22:59:15 -- accel/accel.sh@18 -- # out=' 00:07:11.707 SPDK Configuration: 00:07:11.707 Core mask: 0x1 00:07:11.707 00:07:11.707 Accel Perf Configuration: 00:07:11.707 Workload Type: crc32c 00:07:11.707 CRC-32C seed: 0 00:07:11.707 Transfer size: 4096 bytes 00:07:11.707 Vector count 2 00:07:11.707 Module: software 00:07:11.707 Queue depth: 32 00:07:11.707 Allocate depth: 32 00:07:11.707 # threads/core: 1 00:07:11.707 Run time: 1 seconds 00:07:11.707 Verify: Yes 00:07:11.707 00:07:11.707 Running for 1 seconds... 00:07:11.707 00:07:11.707 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:11.707 ------------------------------------------------------------------------------------ 00:07:11.707 0,0 314848/s 2459 MiB/s 0 0 00:07:11.707 ==================================================================================== 00:07:11.707 Total 314848/s 1229 MiB/s 0 0' 00:07:11.707 22:59:15 -- accel/accel.sh@20 -- # IFS=: 00:07:11.707 22:59:15 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:07:11.707 22:59:15 -- accel/accel.sh@20 -- # read -r var val 00:07:11.707 22:59:15 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:07:11.707 22:59:15 -- accel/accel.sh@12 -- # build_accel_config 00:07:11.707 22:59:15 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:11.707 22:59:15 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:11.707 22:59:15 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:11.707 22:59:15 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:11.707 22:59:15 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:11.707 22:59:15 -- accel/accel.sh@41 -- # local IFS=, 00:07:11.707 22:59:15 -- accel/accel.sh@42 -- # jq -r . 00:07:11.707 [2024-11-28 22:59:15.087032] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:11.707 [2024-11-28 22:59:15.087116] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2335683 ] 00:07:11.707 EAL: No free 2048 kB hugepages reported on node 1 00:07:11.707 [2024-11-28 22:59:15.149867] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:11.707 [2024-11-28 22:59:15.242109] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:11.707 22:59:15 -- accel/accel.sh@21 -- # val= 00:07:11.707 22:59:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.707 22:59:15 -- accel/accel.sh@20 -- # IFS=: 00:07:11.707 22:59:15 -- accel/accel.sh@20 -- # read -r var val 00:07:11.707 22:59:15 -- accel/accel.sh@21 -- # val= 00:07:11.707 22:59:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.707 22:59:15 -- accel/accel.sh@20 -- # IFS=: 00:07:11.707 22:59:15 -- accel/accel.sh@20 -- # read -r var val 00:07:11.707 22:59:15 -- accel/accel.sh@21 -- # val=0x1 00:07:11.707 22:59:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.707 22:59:15 -- accel/accel.sh@20 -- # IFS=: 00:07:11.707 22:59:15 -- accel/accel.sh@20 -- # read -r var val 00:07:11.707 22:59:15 -- accel/accel.sh@21 -- # val= 00:07:11.707 22:59:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.707 22:59:15 -- accel/accel.sh@20 -- # IFS=: 00:07:11.708 22:59:15 -- accel/accel.sh@20 -- # read -r var val 00:07:11.708 22:59:15 -- accel/accel.sh@21 -- # val= 00:07:11.708 22:59:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.708 22:59:15 -- accel/accel.sh@20 -- # IFS=: 00:07:11.708 22:59:15 -- accel/accel.sh@20 -- # read -r var val 00:07:11.708 22:59:15 -- accel/accel.sh@21 -- # val=crc32c 00:07:11.708 22:59:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.708 22:59:15 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:07:11.708 22:59:15 -- accel/accel.sh@20 -- # IFS=: 00:07:11.708 22:59:15 -- accel/accel.sh@20 -- # read -r var val 00:07:11.708 22:59:15 -- accel/accel.sh@21 -- # val=0 00:07:11.708 22:59:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.708 22:59:15 -- accel/accel.sh@20 -- # IFS=: 00:07:11.708 22:59:15 -- accel/accel.sh@20 -- # read -r var val 00:07:11.708 22:59:15 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:11.708 22:59:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.708 22:59:15 -- accel/accel.sh@20 -- # IFS=: 00:07:11.708 22:59:15 -- accel/accel.sh@20 -- # read -r var val 00:07:11.708 22:59:15 -- accel/accel.sh@21 -- # val= 00:07:11.708 22:59:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.708 22:59:15 -- accel/accel.sh@20 -- # IFS=: 00:07:11.708 22:59:15 -- accel/accel.sh@20 -- # read -r var val 00:07:11.708 22:59:15 -- accel/accel.sh@21 -- # val=software 00:07:11.708 22:59:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.708 22:59:15 -- accel/accel.sh@23 -- # accel_module=software 00:07:11.708 22:59:15 -- accel/accel.sh@20 -- # IFS=: 00:07:11.708 22:59:15 -- accel/accel.sh@20 -- # read -r var val 00:07:11.708 22:59:15 -- accel/accel.sh@21 -- # val=32 00:07:11.708 22:59:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.708 22:59:15 -- accel/accel.sh@20 -- # IFS=: 00:07:11.708 22:59:15 -- accel/accel.sh@20 -- # read -r var val 00:07:11.708 22:59:15 -- accel/accel.sh@21 -- # val=32 00:07:11.708 22:59:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.708 22:59:15 -- accel/accel.sh@20 -- # IFS=: 00:07:11.708 22:59:15 -- accel/accel.sh@20 -- # read -r var val 00:07:11.708 22:59:15 -- accel/accel.sh@21 -- # val=1 00:07:11.708 22:59:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.708 22:59:15 -- accel/accel.sh@20 -- # IFS=: 00:07:11.708 22:59:15 -- accel/accel.sh@20 -- # read -r var val 00:07:11.708 22:59:15 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:11.708 22:59:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.708 22:59:15 -- accel/accel.sh@20 -- # IFS=: 00:07:11.708 22:59:15 -- accel/accel.sh@20 -- # read -r var val 00:07:11.708 22:59:15 -- accel/accel.sh@21 -- # val=Yes 00:07:11.708 22:59:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.708 22:59:15 -- accel/accel.sh@20 -- # IFS=: 00:07:11.708 22:59:15 -- accel/accel.sh@20 -- # read -r var val 00:07:11.708 22:59:15 -- accel/accel.sh@21 -- # val= 00:07:11.708 22:59:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.708 22:59:15 -- accel/accel.sh@20 -- # IFS=: 00:07:11.708 22:59:15 -- accel/accel.sh@20 -- # read -r var val 00:07:11.708 22:59:15 -- accel/accel.sh@21 -- # val= 00:07:11.708 22:59:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.708 22:59:15 -- accel/accel.sh@20 -- # IFS=: 00:07:11.708 22:59:15 -- accel/accel.sh@20 -- # read -r var val 00:07:13.082 22:59:16 -- accel/accel.sh@21 -- # val= 00:07:13.082 22:59:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.082 22:59:16 -- accel/accel.sh@20 -- # IFS=: 00:07:13.082 22:59:16 -- accel/accel.sh@20 -- # read -r var val 00:07:13.082 22:59:16 -- accel/accel.sh@21 -- # val= 00:07:13.082 22:59:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.082 22:59:16 -- accel/accel.sh@20 -- # IFS=: 00:07:13.082 22:59:16 -- accel/accel.sh@20 -- # read -r var val 00:07:13.082 22:59:16 -- accel/accel.sh@21 -- # val= 00:07:13.082 22:59:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.082 22:59:16 -- accel/accel.sh@20 -- # IFS=: 00:07:13.082 22:59:16 -- accel/accel.sh@20 -- # read -r var val 00:07:13.082 22:59:16 -- accel/accel.sh@21 -- # val= 00:07:13.082 22:59:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.082 22:59:16 -- accel/accel.sh@20 -- # IFS=: 00:07:13.082 22:59:16 -- accel/accel.sh@20 -- # read -r var val 00:07:13.082 22:59:16 -- accel/accel.sh@21 -- # val= 00:07:13.082 22:59:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.082 22:59:16 -- accel/accel.sh@20 -- # IFS=: 00:07:13.082 22:59:16 -- accel/accel.sh@20 -- # read -r var val 00:07:13.082 22:59:16 -- accel/accel.sh@21 -- # val= 00:07:13.082 22:59:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.082 22:59:16 -- accel/accel.sh@20 -- # IFS=: 00:07:13.082 22:59:16 -- accel/accel.sh@20 -- # read -r var val 00:07:13.082 22:59:16 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:13.082 22:59:16 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:07:13.082 22:59:16 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:13.082 00:07:13.082 real 0m2.795s 00:07:13.082 user 0m2.504s 00:07:13.082 sys 0m0.282s 00:07:13.083 22:59:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:13.083 22:59:16 -- common/autotest_common.sh@10 -- # set +x 00:07:13.083 ************************************ 00:07:13.083 END TEST accel_crc32c_C2 00:07:13.083 ************************************ 00:07:13.083 22:59:16 -- accel/accel.sh@95 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:07:13.083 22:59:16 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:13.083 22:59:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:13.083 22:59:16 -- common/autotest_common.sh@10 -- # set +x 00:07:13.083 ************************************ 00:07:13.083 START TEST accel_copy 00:07:13.083 ************************************ 00:07:13.083 22:59:16 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy -y 00:07:13.083 22:59:16 -- accel/accel.sh@16 -- # local accel_opc 00:07:13.083 22:59:16 -- accel/accel.sh@17 -- # local accel_module 00:07:13.083 22:59:16 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy -y 00:07:13.083 22:59:16 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:07:13.083 22:59:16 -- accel/accel.sh@12 -- # build_accel_config 00:07:13.083 22:59:16 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:13.083 22:59:16 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:13.083 22:59:16 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:13.083 22:59:16 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:13.083 22:59:16 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:13.083 22:59:16 -- accel/accel.sh@41 -- # local IFS=, 00:07:13.083 22:59:16 -- accel/accel.sh@42 -- # jq -r . 00:07:13.083 [2024-11-28 22:59:16.505350] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:13.083 [2024-11-28 22:59:16.505439] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2335844 ] 00:07:13.083 EAL: No free 2048 kB hugepages reported on node 1 00:07:13.083 [2024-11-28 22:59:16.569742] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:13.083 [2024-11-28 22:59:16.658269] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:14.457 22:59:17 -- accel/accel.sh@18 -- # out=' 00:07:14.457 SPDK Configuration: 00:07:14.457 Core mask: 0x1 00:07:14.457 00:07:14.457 Accel Perf Configuration: 00:07:14.457 Workload Type: copy 00:07:14.457 Transfer size: 4096 bytes 00:07:14.457 Vector count 1 00:07:14.457 Module: software 00:07:14.457 Queue depth: 32 00:07:14.457 Allocate depth: 32 00:07:14.457 # threads/core: 1 00:07:14.457 Run time: 1 seconds 00:07:14.457 Verify: Yes 00:07:14.457 00:07:14.457 Running for 1 seconds... 00:07:14.457 00:07:14.457 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:14.457 ------------------------------------------------------------------------------------ 00:07:14.457 0,0 280224/s 1094 MiB/s 0 0 00:07:14.457 ==================================================================================== 00:07:14.457 Total 280224/s 1094 MiB/s 0 0' 00:07:14.457 22:59:17 -- accel/accel.sh@20 -- # IFS=: 00:07:14.457 22:59:17 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:07:14.457 22:59:17 -- accel/accel.sh@20 -- # read -r var val 00:07:14.457 22:59:17 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:07:14.457 22:59:17 -- accel/accel.sh@12 -- # build_accel_config 00:07:14.457 22:59:17 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:14.457 22:59:17 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:14.457 22:59:17 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:14.457 22:59:17 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:14.457 22:59:17 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:14.457 22:59:17 -- accel/accel.sh@41 -- # local IFS=, 00:07:14.457 22:59:17 -- accel/accel.sh@42 -- # jq -r . 00:07:14.457 [2024-11-28 22:59:17.917347] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:14.457 [2024-11-28 22:59:17.917440] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2335984 ] 00:07:14.457 EAL: No free 2048 kB hugepages reported on node 1 00:07:14.457 [2024-11-28 22:59:17.979762] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:14.716 [2024-11-28 22:59:18.071562] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:14.716 22:59:18 -- accel/accel.sh@21 -- # val= 00:07:14.716 22:59:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.716 22:59:18 -- accel/accel.sh@20 -- # IFS=: 00:07:14.716 22:59:18 -- accel/accel.sh@20 -- # read -r var val 00:07:14.716 22:59:18 -- accel/accel.sh@21 -- # val= 00:07:14.716 22:59:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.716 22:59:18 -- accel/accel.sh@20 -- # IFS=: 00:07:14.716 22:59:18 -- accel/accel.sh@20 -- # read -r var val 00:07:14.716 22:59:18 -- accel/accel.sh@21 -- # val=0x1 00:07:14.716 22:59:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.716 22:59:18 -- accel/accel.sh@20 -- # IFS=: 00:07:14.716 22:59:18 -- accel/accel.sh@20 -- # read -r var val 00:07:14.716 22:59:18 -- accel/accel.sh@21 -- # val= 00:07:14.716 22:59:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.716 22:59:18 -- accel/accel.sh@20 -- # IFS=: 00:07:14.716 22:59:18 -- accel/accel.sh@20 -- # read -r var val 00:07:14.716 22:59:18 -- accel/accel.sh@21 -- # val= 00:07:14.716 22:59:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.716 22:59:18 -- accel/accel.sh@20 -- # IFS=: 00:07:14.716 22:59:18 -- accel/accel.sh@20 -- # read -r var val 00:07:14.716 22:59:18 -- accel/accel.sh@21 -- # val=copy 00:07:14.716 22:59:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.716 22:59:18 -- accel/accel.sh@24 -- # accel_opc=copy 00:07:14.716 22:59:18 -- accel/accel.sh@20 -- # IFS=: 00:07:14.716 22:59:18 -- accel/accel.sh@20 -- # read -r var val 00:07:14.716 22:59:18 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:14.716 22:59:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.716 22:59:18 -- accel/accel.sh@20 -- # IFS=: 00:07:14.716 22:59:18 -- accel/accel.sh@20 -- # read -r var val 00:07:14.716 22:59:18 -- accel/accel.sh@21 -- # val= 00:07:14.716 22:59:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.716 22:59:18 -- accel/accel.sh@20 -- # IFS=: 00:07:14.716 22:59:18 -- accel/accel.sh@20 -- # read -r var val 00:07:14.716 22:59:18 -- accel/accel.sh@21 -- # val=software 00:07:14.716 22:59:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.716 22:59:18 -- accel/accel.sh@23 -- # accel_module=software 00:07:14.716 22:59:18 -- accel/accel.sh@20 -- # IFS=: 00:07:14.716 22:59:18 -- accel/accel.sh@20 -- # read -r var val 00:07:14.716 22:59:18 -- accel/accel.sh@21 -- # val=32 00:07:14.716 22:59:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.716 22:59:18 -- accel/accel.sh@20 -- # IFS=: 00:07:14.716 22:59:18 -- accel/accel.sh@20 -- # read -r var val 00:07:14.716 22:59:18 -- accel/accel.sh@21 -- # val=32 00:07:14.716 22:59:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.716 22:59:18 -- accel/accel.sh@20 -- # IFS=: 00:07:14.716 22:59:18 -- accel/accel.sh@20 -- # read -r var val 00:07:14.716 22:59:18 -- accel/accel.sh@21 -- # val=1 00:07:14.716 22:59:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.716 22:59:18 -- accel/accel.sh@20 -- # IFS=: 00:07:14.716 22:59:18 -- accel/accel.sh@20 -- # read -r var val 00:07:14.716 22:59:18 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:14.716 22:59:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.716 22:59:18 -- accel/accel.sh@20 -- # IFS=: 00:07:14.716 22:59:18 -- accel/accel.sh@20 -- # read -r var val 00:07:14.716 22:59:18 -- accel/accel.sh@21 -- # val=Yes 00:07:14.716 22:59:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.716 22:59:18 -- accel/accel.sh@20 -- # IFS=: 00:07:14.716 22:59:18 -- accel/accel.sh@20 -- # read -r var val 00:07:14.716 22:59:18 -- accel/accel.sh@21 -- # val= 00:07:14.716 22:59:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.716 22:59:18 -- accel/accel.sh@20 -- # IFS=: 00:07:14.716 22:59:18 -- accel/accel.sh@20 -- # read -r var val 00:07:14.716 22:59:18 -- accel/accel.sh@21 -- # val= 00:07:14.716 22:59:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.716 22:59:18 -- accel/accel.sh@20 -- # IFS=: 00:07:14.716 22:59:18 -- accel/accel.sh@20 -- # read -r var val 00:07:16.090 22:59:19 -- accel/accel.sh@21 -- # val= 00:07:16.090 22:59:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.090 22:59:19 -- accel/accel.sh@20 -- # IFS=: 00:07:16.090 22:59:19 -- accel/accel.sh@20 -- # read -r var val 00:07:16.090 22:59:19 -- accel/accel.sh@21 -- # val= 00:07:16.090 22:59:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.090 22:59:19 -- accel/accel.sh@20 -- # IFS=: 00:07:16.090 22:59:19 -- accel/accel.sh@20 -- # read -r var val 00:07:16.090 22:59:19 -- accel/accel.sh@21 -- # val= 00:07:16.090 22:59:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.090 22:59:19 -- accel/accel.sh@20 -- # IFS=: 00:07:16.090 22:59:19 -- accel/accel.sh@20 -- # read -r var val 00:07:16.090 22:59:19 -- accel/accel.sh@21 -- # val= 00:07:16.090 22:59:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.090 22:59:19 -- accel/accel.sh@20 -- # IFS=: 00:07:16.090 22:59:19 -- accel/accel.sh@20 -- # read -r var val 00:07:16.090 22:59:19 -- accel/accel.sh@21 -- # val= 00:07:16.090 22:59:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.090 22:59:19 -- accel/accel.sh@20 -- # IFS=: 00:07:16.090 22:59:19 -- accel/accel.sh@20 -- # read -r var val 00:07:16.090 22:59:19 -- accel/accel.sh@21 -- # val= 00:07:16.090 22:59:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.090 22:59:19 -- accel/accel.sh@20 -- # IFS=: 00:07:16.090 22:59:19 -- accel/accel.sh@20 -- # read -r var val 00:07:16.090 22:59:19 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:16.090 22:59:19 -- accel/accel.sh@28 -- # [[ -n copy ]] 00:07:16.090 22:59:19 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:16.090 00:07:16.090 real 0m2.821s 00:07:16.090 user 0m2.522s 00:07:16.090 sys 0m0.290s 00:07:16.090 22:59:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:16.090 22:59:19 -- common/autotest_common.sh@10 -- # set +x 00:07:16.090 ************************************ 00:07:16.090 END TEST accel_copy 00:07:16.090 ************************************ 00:07:16.091 22:59:19 -- accel/accel.sh@96 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:16.091 22:59:19 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:07:16.091 22:59:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:16.091 22:59:19 -- common/autotest_common.sh@10 -- # set +x 00:07:16.091 ************************************ 00:07:16.091 START TEST accel_fill 00:07:16.091 ************************************ 00:07:16.091 22:59:19 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:16.091 22:59:19 -- accel/accel.sh@16 -- # local accel_opc 00:07:16.091 22:59:19 -- accel/accel.sh@17 -- # local accel_module 00:07:16.091 22:59:19 -- accel/accel.sh@18 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:16.091 22:59:19 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:16.091 22:59:19 -- accel/accel.sh@12 -- # build_accel_config 00:07:16.091 22:59:19 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:16.091 22:59:19 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:16.091 22:59:19 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:16.091 22:59:19 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:16.091 22:59:19 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:16.091 22:59:19 -- accel/accel.sh@41 -- # local IFS=, 00:07:16.091 22:59:19 -- accel/accel.sh@42 -- # jq -r . 00:07:16.091 [2024-11-28 22:59:19.350437] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:16.091 [2024-11-28 22:59:19.350518] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2336187 ] 00:07:16.091 EAL: No free 2048 kB hugepages reported on node 1 00:07:16.091 [2024-11-28 22:59:19.413161] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:16.091 [2024-11-28 22:59:19.504039] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:17.171 22:59:20 -- accel/accel.sh@18 -- # out=' 00:07:17.171 SPDK Configuration: 00:07:17.171 Core mask: 0x1 00:07:17.171 00:07:17.171 Accel Perf Configuration: 00:07:17.171 Workload Type: fill 00:07:17.171 Fill pattern: 0x80 00:07:17.171 Transfer size: 4096 bytes 00:07:17.171 Vector count 1 00:07:17.171 Module: software 00:07:17.171 Queue depth: 64 00:07:17.171 Allocate depth: 64 00:07:17.171 # threads/core: 1 00:07:17.171 Run time: 1 seconds 00:07:17.171 Verify: Yes 00:07:17.171 00:07:17.171 Running for 1 seconds... 00:07:17.171 00:07:17.171 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:17.171 ------------------------------------------------------------------------------------ 00:07:17.171 0,0 402432/s 1572 MiB/s 0 0 00:07:17.171 ==================================================================================== 00:07:17.171 Total 402432/s 1572 MiB/s 0 0' 00:07:17.171 22:59:20 -- accel/accel.sh@20 -- # IFS=: 00:07:17.171 22:59:20 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:17.171 22:59:20 -- accel/accel.sh@20 -- # read -r var val 00:07:17.171 22:59:20 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:17.171 22:59:20 -- accel/accel.sh@12 -- # build_accel_config 00:07:17.171 22:59:20 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:17.171 22:59:20 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:17.171 22:59:20 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:17.171 22:59:20 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:17.171 22:59:20 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:17.171 22:59:20 -- accel/accel.sh@41 -- # local IFS=, 00:07:17.171 22:59:20 -- accel/accel.sh@42 -- # jq -r . 00:07:17.171 [2024-11-28 22:59:20.755969] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:17.171 [2024-11-28 22:59:20.756053] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2336405 ] 00:07:17.430 EAL: No free 2048 kB hugepages reported on node 1 00:07:17.430 [2024-11-28 22:59:20.818317] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:17.430 [2024-11-28 22:59:20.907965] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:17.430 22:59:20 -- accel/accel.sh@21 -- # val= 00:07:17.430 22:59:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.430 22:59:20 -- accel/accel.sh@20 -- # IFS=: 00:07:17.430 22:59:20 -- accel/accel.sh@20 -- # read -r var val 00:07:17.430 22:59:20 -- accel/accel.sh@21 -- # val= 00:07:17.430 22:59:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.430 22:59:20 -- accel/accel.sh@20 -- # IFS=: 00:07:17.430 22:59:20 -- accel/accel.sh@20 -- # read -r var val 00:07:17.430 22:59:20 -- accel/accel.sh@21 -- # val=0x1 00:07:17.430 22:59:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.430 22:59:20 -- accel/accel.sh@20 -- # IFS=: 00:07:17.430 22:59:20 -- accel/accel.sh@20 -- # read -r var val 00:07:17.430 22:59:20 -- accel/accel.sh@21 -- # val= 00:07:17.430 22:59:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.430 22:59:20 -- accel/accel.sh@20 -- # IFS=: 00:07:17.430 22:59:20 -- accel/accel.sh@20 -- # read -r var val 00:07:17.430 22:59:20 -- accel/accel.sh@21 -- # val= 00:07:17.430 22:59:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.430 22:59:20 -- accel/accel.sh@20 -- # IFS=: 00:07:17.430 22:59:20 -- accel/accel.sh@20 -- # read -r var val 00:07:17.430 22:59:20 -- accel/accel.sh@21 -- # val=fill 00:07:17.430 22:59:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.430 22:59:20 -- accel/accel.sh@24 -- # accel_opc=fill 00:07:17.430 22:59:20 -- accel/accel.sh@20 -- # IFS=: 00:07:17.430 22:59:20 -- accel/accel.sh@20 -- # read -r var val 00:07:17.430 22:59:20 -- accel/accel.sh@21 -- # val=0x80 00:07:17.430 22:59:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.430 22:59:20 -- accel/accel.sh@20 -- # IFS=: 00:07:17.430 22:59:20 -- accel/accel.sh@20 -- # read -r var val 00:07:17.430 22:59:20 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:17.430 22:59:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.430 22:59:20 -- accel/accel.sh@20 -- # IFS=: 00:07:17.430 22:59:20 -- accel/accel.sh@20 -- # read -r var val 00:07:17.430 22:59:20 -- accel/accel.sh@21 -- # val= 00:07:17.430 22:59:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.430 22:59:20 -- accel/accel.sh@20 -- # IFS=: 00:07:17.430 22:59:20 -- accel/accel.sh@20 -- # read -r var val 00:07:17.430 22:59:20 -- accel/accel.sh@21 -- # val=software 00:07:17.430 22:59:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.430 22:59:20 -- accel/accel.sh@23 -- # accel_module=software 00:07:17.430 22:59:20 -- accel/accel.sh@20 -- # IFS=: 00:07:17.430 22:59:20 -- accel/accel.sh@20 -- # read -r var val 00:07:17.430 22:59:20 -- accel/accel.sh@21 -- # val=64 00:07:17.430 22:59:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.430 22:59:20 -- accel/accel.sh@20 -- # IFS=: 00:07:17.430 22:59:20 -- accel/accel.sh@20 -- # read -r var val 00:07:17.430 22:59:20 -- accel/accel.sh@21 -- # val=64 00:07:17.430 22:59:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.430 22:59:20 -- accel/accel.sh@20 -- # IFS=: 00:07:17.430 22:59:20 -- accel/accel.sh@20 -- # read -r var val 00:07:17.430 22:59:20 -- accel/accel.sh@21 -- # val=1 00:07:17.430 22:59:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.430 22:59:20 -- accel/accel.sh@20 -- # IFS=: 00:07:17.430 22:59:20 -- accel/accel.sh@20 -- # read -r var val 00:07:17.430 22:59:20 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:17.430 22:59:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.430 22:59:20 -- accel/accel.sh@20 -- # IFS=: 00:07:17.430 22:59:20 -- accel/accel.sh@20 -- # read -r var val 00:07:17.430 22:59:20 -- accel/accel.sh@21 -- # val=Yes 00:07:17.430 22:59:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.430 22:59:20 -- accel/accel.sh@20 -- # IFS=: 00:07:17.430 22:59:20 -- accel/accel.sh@20 -- # read -r var val 00:07:17.430 22:59:20 -- accel/accel.sh@21 -- # val= 00:07:17.430 22:59:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.430 22:59:20 -- accel/accel.sh@20 -- # IFS=: 00:07:17.430 22:59:20 -- accel/accel.sh@20 -- # read -r var val 00:07:17.430 22:59:20 -- accel/accel.sh@21 -- # val= 00:07:17.430 22:59:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.430 22:59:20 -- accel/accel.sh@20 -- # IFS=: 00:07:17.430 22:59:20 -- accel/accel.sh@20 -- # read -r var val 00:07:18.805 22:59:22 -- accel/accel.sh@21 -- # val= 00:07:18.805 22:59:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.805 22:59:22 -- accel/accel.sh@20 -- # IFS=: 00:07:18.805 22:59:22 -- accel/accel.sh@20 -- # read -r var val 00:07:18.805 22:59:22 -- accel/accel.sh@21 -- # val= 00:07:18.805 22:59:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.805 22:59:22 -- accel/accel.sh@20 -- # IFS=: 00:07:18.805 22:59:22 -- accel/accel.sh@20 -- # read -r var val 00:07:18.805 22:59:22 -- accel/accel.sh@21 -- # val= 00:07:18.805 22:59:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.805 22:59:22 -- accel/accel.sh@20 -- # IFS=: 00:07:18.805 22:59:22 -- accel/accel.sh@20 -- # read -r var val 00:07:18.805 22:59:22 -- accel/accel.sh@21 -- # val= 00:07:18.805 22:59:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.805 22:59:22 -- accel/accel.sh@20 -- # IFS=: 00:07:18.805 22:59:22 -- accel/accel.sh@20 -- # read -r var val 00:07:18.805 22:59:22 -- accel/accel.sh@21 -- # val= 00:07:18.805 22:59:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.805 22:59:22 -- accel/accel.sh@20 -- # IFS=: 00:07:18.805 22:59:22 -- accel/accel.sh@20 -- # read -r var val 00:07:18.805 22:59:22 -- accel/accel.sh@21 -- # val= 00:07:18.805 22:59:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.805 22:59:22 -- accel/accel.sh@20 -- # IFS=: 00:07:18.805 22:59:22 -- accel/accel.sh@20 -- # read -r var val 00:07:18.805 22:59:22 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:18.805 22:59:22 -- accel/accel.sh@28 -- # [[ -n fill ]] 00:07:18.805 22:59:22 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:18.805 00:07:18.805 real 0m2.792s 00:07:18.805 user 0m2.501s 00:07:18.805 sys 0m0.282s 00:07:18.805 22:59:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:18.805 22:59:22 -- common/autotest_common.sh@10 -- # set +x 00:07:18.805 ************************************ 00:07:18.805 END TEST accel_fill 00:07:18.805 ************************************ 00:07:18.805 22:59:22 -- accel/accel.sh@97 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:07:18.805 22:59:22 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:18.805 22:59:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:18.805 22:59:22 -- common/autotest_common.sh@10 -- # set +x 00:07:18.805 ************************************ 00:07:18.805 START TEST accel_copy_crc32c 00:07:18.805 ************************************ 00:07:18.805 22:59:22 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y 00:07:18.805 22:59:22 -- accel/accel.sh@16 -- # local accel_opc 00:07:18.805 22:59:22 -- accel/accel.sh@17 -- # local accel_module 00:07:18.805 22:59:22 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y 00:07:18.805 22:59:22 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:07:18.805 22:59:22 -- accel/accel.sh@12 -- # build_accel_config 00:07:18.805 22:59:22 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:18.805 22:59:22 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:18.805 22:59:22 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:18.805 22:59:22 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:18.805 22:59:22 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:18.805 22:59:22 -- accel/accel.sh@41 -- # local IFS=, 00:07:18.805 22:59:22 -- accel/accel.sh@42 -- # jq -r . 00:07:18.805 [2024-11-28 22:59:22.168265] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:18.805 [2024-11-28 22:59:22.168344] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2336574 ] 00:07:18.805 EAL: No free 2048 kB hugepages reported on node 1 00:07:18.805 [2024-11-28 22:59:22.231132] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:18.805 [2024-11-28 22:59:22.321751] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:20.181 22:59:23 -- accel/accel.sh@18 -- # out=' 00:07:20.181 SPDK Configuration: 00:07:20.181 Core mask: 0x1 00:07:20.181 00:07:20.181 Accel Perf Configuration: 00:07:20.181 Workload Type: copy_crc32c 00:07:20.181 CRC-32C seed: 0 00:07:20.181 Vector size: 4096 bytes 00:07:20.181 Transfer size: 4096 bytes 00:07:20.181 Vector count 1 00:07:20.181 Module: software 00:07:20.181 Queue depth: 32 00:07:20.181 Allocate depth: 32 00:07:20.181 # threads/core: 1 00:07:20.181 Run time: 1 seconds 00:07:20.181 Verify: Yes 00:07:20.181 00:07:20.181 Running for 1 seconds... 00:07:20.181 00:07:20.181 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:20.181 ------------------------------------------------------------------------------------ 00:07:20.181 0,0 215648/s 842 MiB/s 0 0 00:07:20.181 ==================================================================================== 00:07:20.181 Total 215648/s 842 MiB/s 0 0' 00:07:20.181 22:59:23 -- accel/accel.sh@20 -- # IFS=: 00:07:20.181 22:59:23 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:07:20.181 22:59:23 -- accel/accel.sh@20 -- # read -r var val 00:07:20.181 22:59:23 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:07:20.181 22:59:23 -- accel/accel.sh@12 -- # build_accel_config 00:07:20.181 22:59:23 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:20.181 22:59:23 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:20.181 22:59:23 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:20.181 22:59:23 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:20.181 22:59:23 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:20.181 22:59:23 -- accel/accel.sh@41 -- # local IFS=, 00:07:20.181 22:59:23 -- accel/accel.sh@42 -- # jq -r . 00:07:20.181 [2024-11-28 22:59:23.578584] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:20.181 [2024-11-28 22:59:23.578669] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2336715 ] 00:07:20.181 EAL: No free 2048 kB hugepages reported on node 1 00:07:20.181 [2024-11-28 22:59:23.640553] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:20.181 [2024-11-28 22:59:23.731083] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:20.440 22:59:23 -- accel/accel.sh@21 -- # val= 00:07:20.440 22:59:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.440 22:59:23 -- accel/accel.sh@20 -- # IFS=: 00:07:20.440 22:59:23 -- accel/accel.sh@20 -- # read -r var val 00:07:20.440 22:59:23 -- accel/accel.sh@21 -- # val= 00:07:20.440 22:59:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.440 22:59:23 -- accel/accel.sh@20 -- # IFS=: 00:07:20.440 22:59:23 -- accel/accel.sh@20 -- # read -r var val 00:07:20.440 22:59:23 -- accel/accel.sh@21 -- # val=0x1 00:07:20.440 22:59:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.440 22:59:23 -- accel/accel.sh@20 -- # IFS=: 00:07:20.440 22:59:23 -- accel/accel.sh@20 -- # read -r var val 00:07:20.440 22:59:23 -- accel/accel.sh@21 -- # val= 00:07:20.440 22:59:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.440 22:59:23 -- accel/accel.sh@20 -- # IFS=: 00:07:20.440 22:59:23 -- accel/accel.sh@20 -- # read -r var val 00:07:20.440 22:59:23 -- accel/accel.sh@21 -- # val= 00:07:20.440 22:59:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.440 22:59:23 -- accel/accel.sh@20 -- # IFS=: 00:07:20.440 22:59:23 -- accel/accel.sh@20 -- # read -r var val 00:07:20.440 22:59:23 -- accel/accel.sh@21 -- # val=copy_crc32c 00:07:20.440 22:59:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.440 22:59:23 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:07:20.440 22:59:23 -- accel/accel.sh@20 -- # IFS=: 00:07:20.440 22:59:23 -- accel/accel.sh@20 -- # read -r var val 00:07:20.440 22:59:23 -- accel/accel.sh@21 -- # val=0 00:07:20.440 22:59:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.440 22:59:23 -- accel/accel.sh@20 -- # IFS=: 00:07:20.440 22:59:23 -- accel/accel.sh@20 -- # read -r var val 00:07:20.440 22:59:23 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:20.440 22:59:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.440 22:59:23 -- accel/accel.sh@20 -- # IFS=: 00:07:20.440 22:59:23 -- accel/accel.sh@20 -- # read -r var val 00:07:20.440 22:59:23 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:20.440 22:59:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.440 22:59:23 -- accel/accel.sh@20 -- # IFS=: 00:07:20.440 22:59:23 -- accel/accel.sh@20 -- # read -r var val 00:07:20.440 22:59:23 -- accel/accel.sh@21 -- # val= 00:07:20.440 22:59:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.440 22:59:23 -- accel/accel.sh@20 -- # IFS=: 00:07:20.440 22:59:23 -- accel/accel.sh@20 -- # read -r var val 00:07:20.440 22:59:23 -- accel/accel.sh@21 -- # val=software 00:07:20.440 22:59:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.440 22:59:23 -- accel/accel.sh@23 -- # accel_module=software 00:07:20.440 22:59:23 -- accel/accel.sh@20 -- # IFS=: 00:07:20.440 22:59:23 -- accel/accel.sh@20 -- # read -r var val 00:07:20.440 22:59:23 -- accel/accel.sh@21 -- # val=32 00:07:20.440 22:59:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.440 22:59:23 -- accel/accel.sh@20 -- # IFS=: 00:07:20.440 22:59:23 -- accel/accel.sh@20 -- # read -r var val 00:07:20.440 22:59:23 -- accel/accel.sh@21 -- # val=32 00:07:20.440 22:59:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.440 22:59:23 -- accel/accel.sh@20 -- # IFS=: 00:07:20.440 22:59:23 -- accel/accel.sh@20 -- # read -r var val 00:07:20.440 22:59:23 -- accel/accel.sh@21 -- # val=1 00:07:20.440 22:59:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.440 22:59:23 -- accel/accel.sh@20 -- # IFS=: 00:07:20.440 22:59:23 -- accel/accel.sh@20 -- # read -r var val 00:07:20.440 22:59:23 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:20.440 22:59:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.440 22:59:23 -- accel/accel.sh@20 -- # IFS=: 00:07:20.440 22:59:23 -- accel/accel.sh@20 -- # read -r var val 00:07:20.440 22:59:23 -- accel/accel.sh@21 -- # val=Yes 00:07:20.440 22:59:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.440 22:59:23 -- accel/accel.sh@20 -- # IFS=: 00:07:20.440 22:59:23 -- accel/accel.sh@20 -- # read -r var val 00:07:20.440 22:59:23 -- accel/accel.sh@21 -- # val= 00:07:20.440 22:59:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.440 22:59:23 -- accel/accel.sh@20 -- # IFS=: 00:07:20.440 22:59:23 -- accel/accel.sh@20 -- # read -r var val 00:07:20.440 22:59:23 -- accel/accel.sh@21 -- # val= 00:07:20.440 22:59:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.440 22:59:23 -- accel/accel.sh@20 -- # IFS=: 00:07:20.440 22:59:23 -- accel/accel.sh@20 -- # read -r var val 00:07:21.376 22:59:24 -- accel/accel.sh@21 -- # val= 00:07:21.376 22:59:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.376 22:59:24 -- accel/accel.sh@20 -- # IFS=: 00:07:21.376 22:59:24 -- accel/accel.sh@20 -- # read -r var val 00:07:21.376 22:59:24 -- accel/accel.sh@21 -- # val= 00:07:21.376 22:59:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.376 22:59:24 -- accel/accel.sh@20 -- # IFS=: 00:07:21.376 22:59:24 -- accel/accel.sh@20 -- # read -r var val 00:07:21.376 22:59:24 -- accel/accel.sh@21 -- # val= 00:07:21.376 22:59:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.376 22:59:24 -- accel/accel.sh@20 -- # IFS=: 00:07:21.376 22:59:24 -- accel/accel.sh@20 -- # read -r var val 00:07:21.376 22:59:24 -- accel/accel.sh@21 -- # val= 00:07:21.376 22:59:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.376 22:59:24 -- accel/accel.sh@20 -- # IFS=: 00:07:21.376 22:59:24 -- accel/accel.sh@20 -- # read -r var val 00:07:21.376 22:59:24 -- accel/accel.sh@21 -- # val= 00:07:21.376 22:59:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.376 22:59:24 -- accel/accel.sh@20 -- # IFS=: 00:07:21.376 22:59:24 -- accel/accel.sh@20 -- # read -r var val 00:07:21.376 22:59:24 -- accel/accel.sh@21 -- # val= 00:07:21.376 22:59:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.376 22:59:24 -- accel/accel.sh@20 -- # IFS=: 00:07:21.376 22:59:24 -- accel/accel.sh@20 -- # read -r var val 00:07:21.376 22:59:24 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:21.376 22:59:24 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:07:21.376 22:59:24 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:21.376 00:07:21.376 real 0m2.821s 00:07:21.376 user 0m2.516s 00:07:21.376 sys 0m0.296s 00:07:21.376 22:59:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:21.376 22:59:24 -- common/autotest_common.sh@10 -- # set +x 00:07:21.376 ************************************ 00:07:21.376 END TEST accel_copy_crc32c 00:07:21.376 ************************************ 00:07:21.634 22:59:24 -- accel/accel.sh@98 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:07:21.635 22:59:24 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:21.635 22:59:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:21.635 22:59:24 -- common/autotest_common.sh@10 -- # set +x 00:07:21.635 ************************************ 00:07:21.635 START TEST accel_copy_crc32c_C2 00:07:21.635 ************************************ 00:07:21.635 22:59:24 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:07:21.635 22:59:24 -- accel/accel.sh@16 -- # local accel_opc 00:07:21.635 22:59:24 -- accel/accel.sh@17 -- # local accel_module 00:07:21.635 22:59:24 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:07:21.635 22:59:25 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:07:21.635 22:59:25 -- accel/accel.sh@12 -- # build_accel_config 00:07:21.635 22:59:25 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:21.635 22:59:25 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:21.635 22:59:25 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:21.635 22:59:25 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:21.635 22:59:25 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:21.635 22:59:25 -- accel/accel.sh@41 -- # local IFS=, 00:07:21.635 22:59:25 -- accel/accel.sh@42 -- # jq -r . 00:07:21.635 [2024-11-28 22:59:25.016093] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:21.635 [2024-11-28 22:59:25.016163] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2336882 ] 00:07:21.635 EAL: No free 2048 kB hugepages reported on node 1 00:07:21.635 [2024-11-28 22:59:25.075100] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:21.635 [2024-11-28 22:59:25.165212] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:23.009 22:59:26 -- accel/accel.sh@18 -- # out=' 00:07:23.009 SPDK Configuration: 00:07:23.009 Core mask: 0x1 00:07:23.009 00:07:23.009 Accel Perf Configuration: 00:07:23.009 Workload Type: copy_crc32c 00:07:23.009 CRC-32C seed: 0 00:07:23.009 Vector size: 4096 bytes 00:07:23.009 Transfer size: 8192 bytes 00:07:23.009 Vector count 2 00:07:23.009 Module: software 00:07:23.009 Queue depth: 32 00:07:23.009 Allocate depth: 32 00:07:23.009 # threads/core: 1 00:07:23.009 Run time: 1 seconds 00:07:23.009 Verify: Yes 00:07:23.009 00:07:23.009 Running for 1 seconds... 00:07:23.009 00:07:23.009 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:23.009 ------------------------------------------------------------------------------------ 00:07:23.010 0,0 153696/s 1200 MiB/s 0 0 00:07:23.010 ==================================================================================== 00:07:23.010 Total 153696/s 600 MiB/s 0 0' 00:07:23.010 22:59:26 -- accel/accel.sh@20 -- # IFS=: 00:07:23.010 22:59:26 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:07:23.010 22:59:26 -- accel/accel.sh@20 -- # read -r var val 00:07:23.010 22:59:26 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:07:23.010 22:59:26 -- accel/accel.sh@12 -- # build_accel_config 00:07:23.010 22:59:26 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:23.010 22:59:26 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:23.010 22:59:26 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:23.010 22:59:26 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:23.010 22:59:26 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:23.010 22:59:26 -- accel/accel.sh@41 -- # local IFS=, 00:07:23.010 22:59:26 -- accel/accel.sh@42 -- # jq -r . 00:07:23.010 [2024-11-28 22:59:26.421146] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:23.010 [2024-11-28 22:59:26.421231] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2337133 ] 00:07:23.010 EAL: No free 2048 kB hugepages reported on node 1 00:07:23.010 [2024-11-28 22:59:26.483532] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:23.010 [2024-11-28 22:59:26.574886] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:23.269 22:59:26 -- accel/accel.sh@21 -- # val= 00:07:23.269 22:59:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.269 22:59:26 -- accel/accel.sh@20 -- # IFS=: 00:07:23.269 22:59:26 -- accel/accel.sh@20 -- # read -r var val 00:07:23.269 22:59:26 -- accel/accel.sh@21 -- # val= 00:07:23.269 22:59:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.269 22:59:26 -- accel/accel.sh@20 -- # IFS=: 00:07:23.269 22:59:26 -- accel/accel.sh@20 -- # read -r var val 00:07:23.269 22:59:26 -- accel/accel.sh@21 -- # val=0x1 00:07:23.269 22:59:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.269 22:59:26 -- accel/accel.sh@20 -- # IFS=: 00:07:23.269 22:59:26 -- accel/accel.sh@20 -- # read -r var val 00:07:23.269 22:59:26 -- accel/accel.sh@21 -- # val= 00:07:23.269 22:59:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.269 22:59:26 -- accel/accel.sh@20 -- # IFS=: 00:07:23.269 22:59:26 -- accel/accel.sh@20 -- # read -r var val 00:07:23.269 22:59:26 -- accel/accel.sh@21 -- # val= 00:07:23.269 22:59:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.269 22:59:26 -- accel/accel.sh@20 -- # IFS=: 00:07:23.269 22:59:26 -- accel/accel.sh@20 -- # read -r var val 00:07:23.269 22:59:26 -- accel/accel.sh@21 -- # val=copy_crc32c 00:07:23.269 22:59:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.269 22:59:26 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:07:23.269 22:59:26 -- accel/accel.sh@20 -- # IFS=: 00:07:23.269 22:59:26 -- accel/accel.sh@20 -- # read -r var val 00:07:23.269 22:59:26 -- accel/accel.sh@21 -- # val=0 00:07:23.269 22:59:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.269 22:59:26 -- accel/accel.sh@20 -- # IFS=: 00:07:23.269 22:59:26 -- accel/accel.sh@20 -- # read -r var val 00:07:23.269 22:59:26 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:23.269 22:59:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.269 22:59:26 -- accel/accel.sh@20 -- # IFS=: 00:07:23.269 22:59:26 -- accel/accel.sh@20 -- # read -r var val 00:07:23.269 22:59:26 -- accel/accel.sh@21 -- # val='8192 bytes' 00:07:23.269 22:59:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.269 22:59:26 -- accel/accel.sh@20 -- # IFS=: 00:07:23.269 22:59:26 -- accel/accel.sh@20 -- # read -r var val 00:07:23.269 22:59:26 -- accel/accel.sh@21 -- # val= 00:07:23.269 22:59:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.269 22:59:26 -- accel/accel.sh@20 -- # IFS=: 00:07:23.269 22:59:26 -- accel/accel.sh@20 -- # read -r var val 00:07:23.269 22:59:26 -- accel/accel.sh@21 -- # val=software 00:07:23.269 22:59:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.269 22:59:26 -- accel/accel.sh@23 -- # accel_module=software 00:07:23.269 22:59:26 -- accel/accel.sh@20 -- # IFS=: 00:07:23.269 22:59:26 -- accel/accel.sh@20 -- # read -r var val 00:07:23.269 22:59:26 -- accel/accel.sh@21 -- # val=32 00:07:23.269 22:59:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.269 22:59:26 -- accel/accel.sh@20 -- # IFS=: 00:07:23.269 22:59:26 -- accel/accel.sh@20 -- # read -r var val 00:07:23.269 22:59:26 -- accel/accel.sh@21 -- # val=32 00:07:23.269 22:59:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.269 22:59:26 -- accel/accel.sh@20 -- # IFS=: 00:07:23.269 22:59:26 -- accel/accel.sh@20 -- # read -r var val 00:07:23.269 22:59:26 -- accel/accel.sh@21 -- # val=1 00:07:23.269 22:59:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.269 22:59:26 -- accel/accel.sh@20 -- # IFS=: 00:07:23.269 22:59:26 -- accel/accel.sh@20 -- # read -r var val 00:07:23.269 22:59:26 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:23.269 22:59:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.269 22:59:26 -- accel/accel.sh@20 -- # IFS=: 00:07:23.269 22:59:26 -- accel/accel.sh@20 -- # read -r var val 00:07:23.269 22:59:26 -- accel/accel.sh@21 -- # val=Yes 00:07:23.269 22:59:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.269 22:59:26 -- accel/accel.sh@20 -- # IFS=: 00:07:23.269 22:59:26 -- accel/accel.sh@20 -- # read -r var val 00:07:23.269 22:59:26 -- accel/accel.sh@21 -- # val= 00:07:23.269 22:59:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.269 22:59:26 -- accel/accel.sh@20 -- # IFS=: 00:07:23.269 22:59:26 -- accel/accel.sh@20 -- # read -r var val 00:07:23.269 22:59:26 -- accel/accel.sh@21 -- # val= 00:07:23.269 22:59:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.269 22:59:26 -- accel/accel.sh@20 -- # IFS=: 00:07:23.269 22:59:26 -- accel/accel.sh@20 -- # read -r var val 00:07:24.205 22:59:27 -- accel/accel.sh@21 -- # val= 00:07:24.205 22:59:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.205 22:59:27 -- accel/accel.sh@20 -- # IFS=: 00:07:24.205 22:59:27 -- accel/accel.sh@20 -- # read -r var val 00:07:24.205 22:59:27 -- accel/accel.sh@21 -- # val= 00:07:24.205 22:59:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.205 22:59:27 -- accel/accel.sh@20 -- # IFS=: 00:07:24.205 22:59:27 -- accel/accel.sh@20 -- # read -r var val 00:07:24.205 22:59:27 -- accel/accel.sh@21 -- # val= 00:07:24.205 22:59:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.205 22:59:27 -- accel/accel.sh@20 -- # IFS=: 00:07:24.205 22:59:27 -- accel/accel.sh@20 -- # read -r var val 00:07:24.205 22:59:27 -- accel/accel.sh@21 -- # val= 00:07:24.205 22:59:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.205 22:59:27 -- accel/accel.sh@20 -- # IFS=: 00:07:24.205 22:59:27 -- accel/accel.sh@20 -- # read -r var val 00:07:24.205 22:59:27 -- accel/accel.sh@21 -- # val= 00:07:24.205 22:59:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.205 22:59:27 -- accel/accel.sh@20 -- # IFS=: 00:07:24.205 22:59:27 -- accel/accel.sh@20 -- # read -r var val 00:07:24.205 22:59:27 -- accel/accel.sh@21 -- # val= 00:07:24.205 22:59:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.205 22:59:27 -- accel/accel.sh@20 -- # IFS=: 00:07:24.205 22:59:27 -- accel/accel.sh@20 -- # read -r var val 00:07:24.205 22:59:27 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:24.205 22:59:27 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:07:24.205 22:59:27 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:24.205 00:07:24.205 real 0m2.802s 00:07:24.205 user 0m2.507s 00:07:24.205 sys 0m0.286s 00:07:24.205 22:59:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:24.205 22:59:27 -- common/autotest_common.sh@10 -- # set +x 00:07:24.205 ************************************ 00:07:24.205 END TEST accel_copy_crc32c_C2 00:07:24.205 ************************************ 00:07:24.465 22:59:27 -- accel/accel.sh@99 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:07:24.465 22:59:27 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:24.465 22:59:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:24.465 22:59:27 -- common/autotest_common.sh@10 -- # set +x 00:07:24.465 ************************************ 00:07:24.465 START TEST accel_dualcast 00:07:24.465 ************************************ 00:07:24.465 22:59:27 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dualcast -y 00:07:24.465 22:59:27 -- accel/accel.sh@16 -- # local accel_opc 00:07:24.465 22:59:27 -- accel/accel.sh@17 -- # local accel_module 00:07:24.465 22:59:27 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dualcast -y 00:07:24.465 22:59:27 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:07:24.465 22:59:27 -- accel/accel.sh@12 -- # build_accel_config 00:07:24.465 22:59:27 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:24.465 22:59:27 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:24.465 22:59:27 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:24.465 22:59:27 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:24.465 22:59:27 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:24.465 22:59:27 -- accel/accel.sh@41 -- # local IFS=, 00:07:24.465 22:59:27 -- accel/accel.sh@42 -- # jq -r . 00:07:24.465 [2024-11-28 22:59:27.844192] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:24.465 [2024-11-28 22:59:27.844259] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2337294 ] 00:07:24.465 EAL: No free 2048 kB hugepages reported on node 1 00:07:24.465 [2024-11-28 22:59:27.905912] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:24.465 [2024-11-28 22:59:27.996672] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:25.840 22:59:29 -- accel/accel.sh@18 -- # out=' 00:07:25.840 SPDK Configuration: 00:07:25.840 Core mask: 0x1 00:07:25.840 00:07:25.840 Accel Perf Configuration: 00:07:25.840 Workload Type: dualcast 00:07:25.840 Transfer size: 4096 bytes 00:07:25.840 Vector count 1 00:07:25.840 Module: software 00:07:25.840 Queue depth: 32 00:07:25.840 Allocate depth: 32 00:07:25.840 # threads/core: 1 00:07:25.840 Run time: 1 seconds 00:07:25.840 Verify: Yes 00:07:25.840 00:07:25.840 Running for 1 seconds... 00:07:25.840 00:07:25.840 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:25.840 ------------------------------------------------------------------------------------ 00:07:25.840 0,0 299424/s 1169 MiB/s 0 0 00:07:25.840 ==================================================================================== 00:07:25.840 Total 299424/s 1169 MiB/s 0 0' 00:07:25.840 22:59:29 -- accel/accel.sh@20 -- # IFS=: 00:07:25.840 22:59:29 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:07:25.840 22:59:29 -- accel/accel.sh@20 -- # read -r var val 00:07:25.840 22:59:29 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:07:25.840 22:59:29 -- accel/accel.sh@12 -- # build_accel_config 00:07:25.841 22:59:29 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:25.841 22:59:29 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:25.841 22:59:29 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:25.841 22:59:29 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:25.841 22:59:29 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:25.841 22:59:29 -- accel/accel.sh@41 -- # local IFS=, 00:07:25.841 22:59:29 -- accel/accel.sh@42 -- # jq -r . 00:07:25.841 [2024-11-28 22:59:29.247148] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:25.841 [2024-11-28 22:59:29.247234] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2337434 ] 00:07:25.841 EAL: No free 2048 kB hugepages reported on node 1 00:07:25.841 [2024-11-28 22:59:29.309991] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:25.841 [2024-11-28 22:59:29.401198] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:26.100 22:59:29 -- accel/accel.sh@21 -- # val= 00:07:26.100 22:59:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.100 22:59:29 -- accel/accel.sh@20 -- # IFS=: 00:07:26.100 22:59:29 -- accel/accel.sh@20 -- # read -r var val 00:07:26.100 22:59:29 -- accel/accel.sh@21 -- # val= 00:07:26.100 22:59:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.100 22:59:29 -- accel/accel.sh@20 -- # IFS=: 00:07:26.100 22:59:29 -- accel/accel.sh@20 -- # read -r var val 00:07:26.100 22:59:29 -- accel/accel.sh@21 -- # val=0x1 00:07:26.100 22:59:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.100 22:59:29 -- accel/accel.sh@20 -- # IFS=: 00:07:26.100 22:59:29 -- accel/accel.sh@20 -- # read -r var val 00:07:26.100 22:59:29 -- accel/accel.sh@21 -- # val= 00:07:26.100 22:59:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.100 22:59:29 -- accel/accel.sh@20 -- # IFS=: 00:07:26.100 22:59:29 -- accel/accel.sh@20 -- # read -r var val 00:07:26.100 22:59:29 -- accel/accel.sh@21 -- # val= 00:07:26.100 22:59:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.100 22:59:29 -- accel/accel.sh@20 -- # IFS=: 00:07:26.100 22:59:29 -- accel/accel.sh@20 -- # read -r var val 00:07:26.100 22:59:29 -- accel/accel.sh@21 -- # val=dualcast 00:07:26.100 22:59:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.100 22:59:29 -- accel/accel.sh@24 -- # accel_opc=dualcast 00:07:26.100 22:59:29 -- accel/accel.sh@20 -- # IFS=: 00:07:26.100 22:59:29 -- accel/accel.sh@20 -- # read -r var val 00:07:26.100 22:59:29 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:26.100 22:59:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.100 22:59:29 -- accel/accel.sh@20 -- # IFS=: 00:07:26.100 22:59:29 -- accel/accel.sh@20 -- # read -r var val 00:07:26.100 22:59:29 -- accel/accel.sh@21 -- # val= 00:07:26.100 22:59:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.100 22:59:29 -- accel/accel.sh@20 -- # IFS=: 00:07:26.100 22:59:29 -- accel/accel.sh@20 -- # read -r var val 00:07:26.100 22:59:29 -- accel/accel.sh@21 -- # val=software 00:07:26.100 22:59:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.100 22:59:29 -- accel/accel.sh@23 -- # accel_module=software 00:07:26.100 22:59:29 -- accel/accel.sh@20 -- # IFS=: 00:07:26.100 22:59:29 -- accel/accel.sh@20 -- # read -r var val 00:07:26.100 22:59:29 -- accel/accel.sh@21 -- # val=32 00:07:26.100 22:59:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.100 22:59:29 -- accel/accel.sh@20 -- # IFS=: 00:07:26.100 22:59:29 -- accel/accel.sh@20 -- # read -r var val 00:07:26.100 22:59:29 -- accel/accel.sh@21 -- # val=32 00:07:26.100 22:59:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.100 22:59:29 -- accel/accel.sh@20 -- # IFS=: 00:07:26.100 22:59:29 -- accel/accel.sh@20 -- # read -r var val 00:07:26.100 22:59:29 -- accel/accel.sh@21 -- # val=1 00:07:26.100 22:59:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.100 22:59:29 -- accel/accel.sh@20 -- # IFS=: 00:07:26.100 22:59:29 -- accel/accel.sh@20 -- # read -r var val 00:07:26.100 22:59:29 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:26.100 22:59:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.100 22:59:29 -- accel/accel.sh@20 -- # IFS=: 00:07:26.100 22:59:29 -- accel/accel.sh@20 -- # read -r var val 00:07:26.100 22:59:29 -- accel/accel.sh@21 -- # val=Yes 00:07:26.100 22:59:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.100 22:59:29 -- accel/accel.sh@20 -- # IFS=: 00:07:26.100 22:59:29 -- accel/accel.sh@20 -- # read -r var val 00:07:26.100 22:59:29 -- accel/accel.sh@21 -- # val= 00:07:26.100 22:59:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.100 22:59:29 -- accel/accel.sh@20 -- # IFS=: 00:07:26.100 22:59:29 -- accel/accel.sh@20 -- # read -r var val 00:07:26.100 22:59:29 -- accel/accel.sh@21 -- # val= 00:07:26.100 22:59:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.100 22:59:29 -- accel/accel.sh@20 -- # IFS=: 00:07:26.100 22:59:29 -- accel/accel.sh@20 -- # read -r var val 00:07:27.035 22:59:30 -- accel/accel.sh@21 -- # val= 00:07:27.035 22:59:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.035 22:59:30 -- accel/accel.sh@20 -- # IFS=: 00:07:27.035 22:59:30 -- accel/accel.sh@20 -- # read -r var val 00:07:27.035 22:59:30 -- accel/accel.sh@21 -- # val= 00:07:27.035 22:59:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.035 22:59:30 -- accel/accel.sh@20 -- # IFS=: 00:07:27.035 22:59:30 -- accel/accel.sh@20 -- # read -r var val 00:07:27.035 22:59:30 -- accel/accel.sh@21 -- # val= 00:07:27.035 22:59:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.035 22:59:30 -- accel/accel.sh@20 -- # IFS=: 00:07:27.035 22:59:30 -- accel/accel.sh@20 -- # read -r var val 00:07:27.036 22:59:30 -- accel/accel.sh@21 -- # val= 00:07:27.036 22:59:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.036 22:59:30 -- accel/accel.sh@20 -- # IFS=: 00:07:27.036 22:59:30 -- accel/accel.sh@20 -- # read -r var val 00:07:27.036 22:59:30 -- accel/accel.sh@21 -- # val= 00:07:27.036 22:59:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.036 22:59:30 -- accel/accel.sh@20 -- # IFS=: 00:07:27.036 22:59:30 -- accel/accel.sh@20 -- # read -r var val 00:07:27.036 22:59:30 -- accel/accel.sh@21 -- # val= 00:07:27.036 22:59:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.036 22:59:30 -- accel/accel.sh@20 -- # IFS=: 00:07:27.036 22:59:30 -- accel/accel.sh@20 -- # read -r var val 00:07:27.036 22:59:30 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:27.036 22:59:30 -- accel/accel.sh@28 -- # [[ -n dualcast ]] 00:07:27.036 22:59:30 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:27.036 00:07:27.036 real 0m2.808s 00:07:27.036 user 0m2.511s 00:07:27.036 sys 0m0.289s 00:07:27.036 22:59:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:27.036 22:59:30 -- common/autotest_common.sh@10 -- # set +x 00:07:27.036 ************************************ 00:07:27.036 END TEST accel_dualcast 00:07:27.036 ************************************ 00:07:27.294 22:59:30 -- accel/accel.sh@100 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:07:27.294 22:59:30 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:27.294 22:59:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:27.294 22:59:30 -- common/autotest_common.sh@10 -- # set +x 00:07:27.294 ************************************ 00:07:27.294 START TEST accel_compare 00:07:27.294 ************************************ 00:07:27.294 22:59:30 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compare -y 00:07:27.294 22:59:30 -- accel/accel.sh@16 -- # local accel_opc 00:07:27.294 22:59:30 -- accel/accel.sh@17 -- # local accel_module 00:07:27.294 22:59:30 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compare -y 00:07:27.294 22:59:30 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:07:27.294 22:59:30 -- accel/accel.sh@12 -- # build_accel_config 00:07:27.294 22:59:30 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:27.294 22:59:30 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:27.294 22:59:30 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:27.294 22:59:30 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:27.294 22:59:30 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:27.294 22:59:30 -- accel/accel.sh@41 -- # local IFS=, 00:07:27.294 22:59:30 -- accel/accel.sh@42 -- # jq -r . 00:07:27.294 [2024-11-28 22:59:30.682540] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:27.294 [2024-11-28 22:59:30.682617] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2337611 ] 00:07:27.294 EAL: No free 2048 kB hugepages reported on node 1 00:07:27.294 [2024-11-28 22:59:30.748376] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:27.294 [2024-11-28 22:59:30.839294] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:28.669 22:59:32 -- accel/accel.sh@18 -- # out=' 00:07:28.669 SPDK Configuration: 00:07:28.669 Core mask: 0x1 00:07:28.669 00:07:28.669 Accel Perf Configuration: 00:07:28.669 Workload Type: compare 00:07:28.669 Transfer size: 4096 bytes 00:07:28.669 Vector count 1 00:07:28.669 Module: software 00:07:28.669 Queue depth: 32 00:07:28.669 Allocate depth: 32 00:07:28.669 # threads/core: 1 00:07:28.669 Run time: 1 seconds 00:07:28.669 Verify: Yes 00:07:28.669 00:07:28.669 Running for 1 seconds... 00:07:28.669 00:07:28.669 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:28.669 ------------------------------------------------------------------------------------ 00:07:28.669 0,0 406720/s 1588 MiB/s 0 0 00:07:28.669 ==================================================================================== 00:07:28.669 Total 406720/s 1588 MiB/s 0 0' 00:07:28.669 22:59:32 -- accel/accel.sh@20 -- # IFS=: 00:07:28.669 22:59:32 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:07:28.669 22:59:32 -- accel/accel.sh@20 -- # read -r var val 00:07:28.669 22:59:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:07:28.669 22:59:32 -- accel/accel.sh@12 -- # build_accel_config 00:07:28.669 22:59:32 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:28.669 22:59:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:28.669 22:59:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:28.669 22:59:32 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:28.669 22:59:32 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:28.669 22:59:32 -- accel/accel.sh@41 -- # local IFS=, 00:07:28.669 22:59:32 -- accel/accel.sh@42 -- # jq -r . 00:07:28.669 [2024-11-28 22:59:32.092963] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:28.669 [2024-11-28 22:59:32.093047] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2337852 ] 00:07:28.669 EAL: No free 2048 kB hugepages reported on node 1 00:07:28.669 [2024-11-28 22:59:32.155624] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:28.669 [2024-11-28 22:59:32.245924] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:28.927 22:59:32 -- accel/accel.sh@21 -- # val= 00:07:28.927 22:59:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.927 22:59:32 -- accel/accel.sh@20 -- # IFS=: 00:07:28.927 22:59:32 -- accel/accel.sh@20 -- # read -r var val 00:07:28.927 22:59:32 -- accel/accel.sh@21 -- # val= 00:07:28.927 22:59:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.928 22:59:32 -- accel/accel.sh@20 -- # IFS=: 00:07:28.928 22:59:32 -- accel/accel.sh@20 -- # read -r var val 00:07:28.928 22:59:32 -- accel/accel.sh@21 -- # val=0x1 00:07:28.928 22:59:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.928 22:59:32 -- accel/accel.sh@20 -- # IFS=: 00:07:28.928 22:59:32 -- accel/accel.sh@20 -- # read -r var val 00:07:28.928 22:59:32 -- accel/accel.sh@21 -- # val= 00:07:28.928 22:59:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.928 22:59:32 -- accel/accel.sh@20 -- # IFS=: 00:07:28.928 22:59:32 -- accel/accel.sh@20 -- # read -r var val 00:07:28.928 22:59:32 -- accel/accel.sh@21 -- # val= 00:07:28.928 22:59:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.928 22:59:32 -- accel/accel.sh@20 -- # IFS=: 00:07:28.928 22:59:32 -- accel/accel.sh@20 -- # read -r var val 00:07:28.928 22:59:32 -- accel/accel.sh@21 -- # val=compare 00:07:28.928 22:59:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.928 22:59:32 -- accel/accel.sh@24 -- # accel_opc=compare 00:07:28.928 22:59:32 -- accel/accel.sh@20 -- # IFS=: 00:07:28.928 22:59:32 -- accel/accel.sh@20 -- # read -r var val 00:07:28.928 22:59:32 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:28.928 22:59:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.928 22:59:32 -- accel/accel.sh@20 -- # IFS=: 00:07:28.928 22:59:32 -- accel/accel.sh@20 -- # read -r var val 00:07:28.928 22:59:32 -- accel/accel.sh@21 -- # val= 00:07:28.928 22:59:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.928 22:59:32 -- accel/accel.sh@20 -- # IFS=: 00:07:28.928 22:59:32 -- accel/accel.sh@20 -- # read -r var val 00:07:28.928 22:59:32 -- accel/accel.sh@21 -- # val=software 00:07:28.928 22:59:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.928 22:59:32 -- accel/accel.sh@23 -- # accel_module=software 00:07:28.928 22:59:32 -- accel/accel.sh@20 -- # IFS=: 00:07:28.928 22:59:32 -- accel/accel.sh@20 -- # read -r var val 00:07:28.928 22:59:32 -- accel/accel.sh@21 -- # val=32 00:07:28.928 22:59:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.928 22:59:32 -- accel/accel.sh@20 -- # IFS=: 00:07:28.928 22:59:32 -- accel/accel.sh@20 -- # read -r var val 00:07:28.928 22:59:32 -- accel/accel.sh@21 -- # val=32 00:07:28.928 22:59:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.928 22:59:32 -- accel/accel.sh@20 -- # IFS=: 00:07:28.928 22:59:32 -- accel/accel.sh@20 -- # read -r var val 00:07:28.928 22:59:32 -- accel/accel.sh@21 -- # val=1 00:07:28.928 22:59:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.928 22:59:32 -- accel/accel.sh@20 -- # IFS=: 00:07:28.928 22:59:32 -- accel/accel.sh@20 -- # read -r var val 00:07:28.928 22:59:32 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:28.928 22:59:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.928 22:59:32 -- accel/accel.sh@20 -- # IFS=: 00:07:28.928 22:59:32 -- accel/accel.sh@20 -- # read -r var val 00:07:28.928 22:59:32 -- accel/accel.sh@21 -- # val=Yes 00:07:28.928 22:59:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.928 22:59:32 -- accel/accel.sh@20 -- # IFS=: 00:07:28.928 22:59:32 -- accel/accel.sh@20 -- # read -r var val 00:07:28.928 22:59:32 -- accel/accel.sh@21 -- # val= 00:07:28.928 22:59:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.928 22:59:32 -- accel/accel.sh@20 -- # IFS=: 00:07:28.928 22:59:32 -- accel/accel.sh@20 -- # read -r var val 00:07:28.928 22:59:32 -- accel/accel.sh@21 -- # val= 00:07:28.928 22:59:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.928 22:59:32 -- accel/accel.sh@20 -- # IFS=: 00:07:28.928 22:59:32 -- accel/accel.sh@20 -- # read -r var val 00:07:30.301 22:59:33 -- accel/accel.sh@21 -- # val= 00:07:30.301 22:59:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.301 22:59:33 -- accel/accel.sh@20 -- # IFS=: 00:07:30.301 22:59:33 -- accel/accel.sh@20 -- # read -r var val 00:07:30.301 22:59:33 -- accel/accel.sh@21 -- # val= 00:07:30.301 22:59:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.301 22:59:33 -- accel/accel.sh@20 -- # IFS=: 00:07:30.301 22:59:33 -- accel/accel.sh@20 -- # read -r var val 00:07:30.301 22:59:33 -- accel/accel.sh@21 -- # val= 00:07:30.301 22:59:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.301 22:59:33 -- accel/accel.sh@20 -- # IFS=: 00:07:30.301 22:59:33 -- accel/accel.sh@20 -- # read -r var val 00:07:30.301 22:59:33 -- accel/accel.sh@21 -- # val= 00:07:30.301 22:59:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.301 22:59:33 -- accel/accel.sh@20 -- # IFS=: 00:07:30.301 22:59:33 -- accel/accel.sh@20 -- # read -r var val 00:07:30.301 22:59:33 -- accel/accel.sh@21 -- # val= 00:07:30.301 22:59:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.301 22:59:33 -- accel/accel.sh@20 -- # IFS=: 00:07:30.301 22:59:33 -- accel/accel.sh@20 -- # read -r var val 00:07:30.301 22:59:33 -- accel/accel.sh@21 -- # val= 00:07:30.301 22:59:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.301 22:59:33 -- accel/accel.sh@20 -- # IFS=: 00:07:30.301 22:59:33 -- accel/accel.sh@20 -- # read -r var val 00:07:30.301 22:59:33 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:30.301 22:59:33 -- accel/accel.sh@28 -- # [[ -n compare ]] 00:07:30.301 22:59:33 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:30.301 00:07:30.301 real 0m2.814s 00:07:30.301 user 0m2.511s 00:07:30.301 sys 0m0.294s 00:07:30.301 22:59:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:30.301 22:59:33 -- common/autotest_common.sh@10 -- # set +x 00:07:30.301 ************************************ 00:07:30.301 END TEST accel_compare 00:07:30.301 ************************************ 00:07:30.301 22:59:33 -- accel/accel.sh@101 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:07:30.301 22:59:33 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:30.301 22:59:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:30.301 22:59:33 -- common/autotest_common.sh@10 -- # set +x 00:07:30.301 ************************************ 00:07:30.301 START TEST accel_xor 00:07:30.301 ************************************ 00:07:30.301 22:59:33 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y 00:07:30.301 22:59:33 -- accel/accel.sh@16 -- # local accel_opc 00:07:30.301 22:59:33 -- accel/accel.sh@17 -- # local accel_module 00:07:30.301 22:59:33 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y 00:07:30.301 22:59:33 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:07:30.301 22:59:33 -- accel/accel.sh@12 -- # build_accel_config 00:07:30.301 22:59:33 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:30.301 22:59:33 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:30.301 22:59:33 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:30.301 22:59:33 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:30.301 22:59:33 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:30.301 22:59:33 -- accel/accel.sh@41 -- # local IFS=, 00:07:30.301 22:59:33 -- accel/accel.sh@42 -- # jq -r . 00:07:30.301 [2024-11-28 22:59:33.522044] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:30.301 [2024-11-28 22:59:33.522117] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2338021 ] 00:07:30.301 EAL: No free 2048 kB hugepages reported on node 1 00:07:30.301 [2024-11-28 22:59:33.583254] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:30.301 [2024-11-28 22:59:33.674185] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:31.685 22:59:34 -- accel/accel.sh@18 -- # out=' 00:07:31.685 SPDK Configuration: 00:07:31.685 Core mask: 0x1 00:07:31.685 00:07:31.685 Accel Perf Configuration: 00:07:31.685 Workload Type: xor 00:07:31.685 Source buffers: 2 00:07:31.685 Transfer size: 4096 bytes 00:07:31.685 Vector count 1 00:07:31.685 Module: software 00:07:31.685 Queue depth: 32 00:07:31.685 Allocate depth: 32 00:07:31.685 # threads/core: 1 00:07:31.685 Run time: 1 seconds 00:07:31.685 Verify: Yes 00:07:31.685 00:07:31.685 Running for 1 seconds... 00:07:31.685 00:07:31.685 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:31.685 ------------------------------------------------------------------------------------ 00:07:31.685 0,0 195104/s 762 MiB/s 0 0 00:07:31.685 ==================================================================================== 00:07:31.685 Total 195104/s 762 MiB/s 0 0' 00:07:31.685 22:59:34 -- accel/accel.sh@20 -- # IFS=: 00:07:31.685 22:59:34 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:07:31.685 22:59:34 -- accel/accel.sh@20 -- # read -r var val 00:07:31.685 22:59:34 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:07:31.685 22:59:34 -- accel/accel.sh@12 -- # build_accel_config 00:07:31.685 22:59:34 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:31.685 22:59:34 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:31.685 22:59:34 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:31.685 22:59:34 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:31.685 22:59:34 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:31.685 22:59:34 -- accel/accel.sh@41 -- # local IFS=, 00:07:31.685 22:59:34 -- accel/accel.sh@42 -- # jq -r . 00:07:31.685 [2024-11-28 22:59:34.928283] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:31.685 [2024-11-28 22:59:34.928365] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2338161 ] 00:07:31.685 EAL: No free 2048 kB hugepages reported on node 1 00:07:31.685 [2024-11-28 22:59:34.990432] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:31.685 [2024-11-28 22:59:35.080495] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:31.685 22:59:35 -- accel/accel.sh@21 -- # val= 00:07:31.685 22:59:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.685 22:59:35 -- accel/accel.sh@20 -- # IFS=: 00:07:31.685 22:59:35 -- accel/accel.sh@20 -- # read -r var val 00:07:31.685 22:59:35 -- accel/accel.sh@21 -- # val= 00:07:31.685 22:59:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.685 22:59:35 -- accel/accel.sh@20 -- # IFS=: 00:07:31.685 22:59:35 -- accel/accel.sh@20 -- # read -r var val 00:07:31.685 22:59:35 -- accel/accel.sh@21 -- # val=0x1 00:07:31.685 22:59:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.685 22:59:35 -- accel/accel.sh@20 -- # IFS=: 00:07:31.685 22:59:35 -- accel/accel.sh@20 -- # read -r var val 00:07:31.685 22:59:35 -- accel/accel.sh@21 -- # val= 00:07:31.685 22:59:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.685 22:59:35 -- accel/accel.sh@20 -- # IFS=: 00:07:31.685 22:59:35 -- accel/accel.sh@20 -- # read -r var val 00:07:31.685 22:59:35 -- accel/accel.sh@21 -- # val= 00:07:31.685 22:59:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.685 22:59:35 -- accel/accel.sh@20 -- # IFS=: 00:07:31.685 22:59:35 -- accel/accel.sh@20 -- # read -r var val 00:07:31.685 22:59:35 -- accel/accel.sh@21 -- # val=xor 00:07:31.685 22:59:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.685 22:59:35 -- accel/accel.sh@24 -- # accel_opc=xor 00:07:31.685 22:59:35 -- accel/accel.sh@20 -- # IFS=: 00:07:31.685 22:59:35 -- accel/accel.sh@20 -- # read -r var val 00:07:31.685 22:59:35 -- accel/accel.sh@21 -- # val=2 00:07:31.685 22:59:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.685 22:59:35 -- accel/accel.sh@20 -- # IFS=: 00:07:31.685 22:59:35 -- accel/accel.sh@20 -- # read -r var val 00:07:31.685 22:59:35 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:31.685 22:59:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.685 22:59:35 -- accel/accel.sh@20 -- # IFS=: 00:07:31.685 22:59:35 -- accel/accel.sh@20 -- # read -r var val 00:07:31.685 22:59:35 -- accel/accel.sh@21 -- # val= 00:07:31.685 22:59:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.685 22:59:35 -- accel/accel.sh@20 -- # IFS=: 00:07:31.685 22:59:35 -- accel/accel.sh@20 -- # read -r var val 00:07:31.685 22:59:35 -- accel/accel.sh@21 -- # val=software 00:07:31.685 22:59:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.685 22:59:35 -- accel/accel.sh@23 -- # accel_module=software 00:07:31.685 22:59:35 -- accel/accel.sh@20 -- # IFS=: 00:07:31.685 22:59:35 -- accel/accel.sh@20 -- # read -r var val 00:07:31.685 22:59:35 -- accel/accel.sh@21 -- # val=32 00:07:31.685 22:59:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.685 22:59:35 -- accel/accel.sh@20 -- # IFS=: 00:07:31.685 22:59:35 -- accel/accel.sh@20 -- # read -r var val 00:07:31.685 22:59:35 -- accel/accel.sh@21 -- # val=32 00:07:31.685 22:59:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.685 22:59:35 -- accel/accel.sh@20 -- # IFS=: 00:07:31.685 22:59:35 -- accel/accel.sh@20 -- # read -r var val 00:07:31.685 22:59:35 -- accel/accel.sh@21 -- # val=1 00:07:31.685 22:59:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.685 22:59:35 -- accel/accel.sh@20 -- # IFS=: 00:07:31.685 22:59:35 -- accel/accel.sh@20 -- # read -r var val 00:07:31.685 22:59:35 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:31.685 22:59:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.685 22:59:35 -- accel/accel.sh@20 -- # IFS=: 00:07:31.685 22:59:35 -- accel/accel.sh@20 -- # read -r var val 00:07:31.685 22:59:35 -- accel/accel.sh@21 -- # val=Yes 00:07:31.685 22:59:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.685 22:59:35 -- accel/accel.sh@20 -- # IFS=: 00:07:31.685 22:59:35 -- accel/accel.sh@20 -- # read -r var val 00:07:31.685 22:59:35 -- accel/accel.sh@21 -- # val= 00:07:31.685 22:59:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.685 22:59:35 -- accel/accel.sh@20 -- # IFS=: 00:07:31.685 22:59:35 -- accel/accel.sh@20 -- # read -r var val 00:07:31.685 22:59:35 -- accel/accel.sh@21 -- # val= 00:07:31.685 22:59:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.685 22:59:35 -- accel/accel.sh@20 -- # IFS=: 00:07:31.685 22:59:35 -- accel/accel.sh@20 -- # read -r var val 00:07:33.060 22:59:36 -- accel/accel.sh@21 -- # val= 00:07:33.060 22:59:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.060 22:59:36 -- accel/accel.sh@20 -- # IFS=: 00:07:33.060 22:59:36 -- accel/accel.sh@20 -- # read -r var val 00:07:33.060 22:59:36 -- accel/accel.sh@21 -- # val= 00:07:33.060 22:59:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.060 22:59:36 -- accel/accel.sh@20 -- # IFS=: 00:07:33.060 22:59:36 -- accel/accel.sh@20 -- # read -r var val 00:07:33.060 22:59:36 -- accel/accel.sh@21 -- # val= 00:07:33.060 22:59:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.060 22:59:36 -- accel/accel.sh@20 -- # IFS=: 00:07:33.060 22:59:36 -- accel/accel.sh@20 -- # read -r var val 00:07:33.060 22:59:36 -- accel/accel.sh@21 -- # val= 00:07:33.060 22:59:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.060 22:59:36 -- accel/accel.sh@20 -- # IFS=: 00:07:33.060 22:59:36 -- accel/accel.sh@20 -- # read -r var val 00:07:33.060 22:59:36 -- accel/accel.sh@21 -- # val= 00:07:33.060 22:59:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.060 22:59:36 -- accel/accel.sh@20 -- # IFS=: 00:07:33.060 22:59:36 -- accel/accel.sh@20 -- # read -r var val 00:07:33.060 22:59:36 -- accel/accel.sh@21 -- # val= 00:07:33.060 22:59:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.060 22:59:36 -- accel/accel.sh@20 -- # IFS=: 00:07:33.060 22:59:36 -- accel/accel.sh@20 -- # read -r var val 00:07:33.060 22:59:36 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:33.060 22:59:36 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:07:33.060 22:59:36 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:33.060 00:07:33.060 real 0m2.812s 00:07:33.060 user 0m2.522s 00:07:33.060 sys 0m0.281s 00:07:33.060 22:59:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:33.060 22:59:36 -- common/autotest_common.sh@10 -- # set +x 00:07:33.060 ************************************ 00:07:33.060 END TEST accel_xor 00:07:33.060 ************************************ 00:07:33.060 22:59:36 -- accel/accel.sh@102 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:07:33.060 22:59:36 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:33.060 22:59:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:33.060 22:59:36 -- common/autotest_common.sh@10 -- # set +x 00:07:33.060 ************************************ 00:07:33.060 START TEST accel_xor 00:07:33.060 ************************************ 00:07:33.060 22:59:36 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y -x 3 00:07:33.060 22:59:36 -- accel/accel.sh@16 -- # local accel_opc 00:07:33.060 22:59:36 -- accel/accel.sh@17 -- # local accel_module 00:07:33.060 22:59:36 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y -x 3 00:07:33.060 22:59:36 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:07:33.060 22:59:36 -- accel/accel.sh@12 -- # build_accel_config 00:07:33.060 22:59:36 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:33.060 22:59:36 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:33.060 22:59:36 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:33.060 22:59:36 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:33.060 22:59:36 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:33.060 22:59:36 -- accel/accel.sh@41 -- # local IFS=, 00:07:33.060 22:59:36 -- accel/accel.sh@42 -- # jq -r . 00:07:33.060 [2024-11-28 22:59:36.360920] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:33.060 [2024-11-28 22:59:36.361000] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2338377 ] 00:07:33.060 EAL: No free 2048 kB hugepages reported on node 1 00:07:33.060 [2024-11-28 22:59:36.423781] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:33.060 [2024-11-28 22:59:36.514745] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:34.435 22:59:37 -- accel/accel.sh@18 -- # out=' 00:07:34.435 SPDK Configuration: 00:07:34.435 Core mask: 0x1 00:07:34.435 00:07:34.435 Accel Perf Configuration: 00:07:34.435 Workload Type: xor 00:07:34.435 Source buffers: 3 00:07:34.435 Transfer size: 4096 bytes 00:07:34.435 Vector count 1 00:07:34.435 Module: software 00:07:34.435 Queue depth: 32 00:07:34.435 Allocate depth: 32 00:07:34.435 # threads/core: 1 00:07:34.435 Run time: 1 seconds 00:07:34.435 Verify: Yes 00:07:34.435 00:07:34.435 Running for 1 seconds... 00:07:34.435 00:07:34.435 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:34.435 ------------------------------------------------------------------------------------ 00:07:34.435 0,0 186624/s 729 MiB/s 0 0 00:07:34.435 ==================================================================================== 00:07:34.435 Total 186624/s 729 MiB/s 0 0' 00:07:34.435 22:59:37 -- accel/accel.sh@20 -- # IFS=: 00:07:34.435 22:59:37 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:07:34.435 22:59:37 -- accel/accel.sh@20 -- # read -r var val 00:07:34.435 22:59:37 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:07:34.435 22:59:37 -- accel/accel.sh@12 -- # build_accel_config 00:07:34.435 22:59:37 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:34.435 22:59:37 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:34.435 22:59:37 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:34.435 22:59:37 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:34.435 22:59:37 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:34.435 22:59:37 -- accel/accel.sh@41 -- # local IFS=, 00:07:34.435 22:59:37 -- accel/accel.sh@42 -- # jq -r . 00:07:34.435 [2024-11-28 22:59:37.771963] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:34.435 [2024-11-28 22:59:37.772046] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2338579 ] 00:07:34.435 EAL: No free 2048 kB hugepages reported on node 1 00:07:34.435 [2024-11-28 22:59:37.832808] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:34.435 [2024-11-28 22:59:37.922813] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:34.435 22:59:37 -- accel/accel.sh@21 -- # val= 00:07:34.435 22:59:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.435 22:59:37 -- accel/accel.sh@20 -- # IFS=: 00:07:34.435 22:59:37 -- accel/accel.sh@20 -- # read -r var val 00:07:34.435 22:59:37 -- accel/accel.sh@21 -- # val= 00:07:34.435 22:59:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.435 22:59:37 -- accel/accel.sh@20 -- # IFS=: 00:07:34.435 22:59:37 -- accel/accel.sh@20 -- # read -r var val 00:07:34.435 22:59:37 -- accel/accel.sh@21 -- # val=0x1 00:07:34.435 22:59:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.435 22:59:37 -- accel/accel.sh@20 -- # IFS=: 00:07:34.435 22:59:37 -- accel/accel.sh@20 -- # read -r var val 00:07:34.435 22:59:37 -- accel/accel.sh@21 -- # val= 00:07:34.435 22:59:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.435 22:59:37 -- accel/accel.sh@20 -- # IFS=: 00:07:34.435 22:59:37 -- accel/accel.sh@20 -- # read -r var val 00:07:34.435 22:59:37 -- accel/accel.sh@21 -- # val= 00:07:34.435 22:59:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.435 22:59:37 -- accel/accel.sh@20 -- # IFS=: 00:07:34.435 22:59:37 -- accel/accel.sh@20 -- # read -r var val 00:07:34.435 22:59:37 -- accel/accel.sh@21 -- # val=xor 00:07:34.435 22:59:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.435 22:59:37 -- accel/accel.sh@24 -- # accel_opc=xor 00:07:34.435 22:59:37 -- accel/accel.sh@20 -- # IFS=: 00:07:34.435 22:59:37 -- accel/accel.sh@20 -- # read -r var val 00:07:34.436 22:59:37 -- accel/accel.sh@21 -- # val=3 00:07:34.436 22:59:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.436 22:59:37 -- accel/accel.sh@20 -- # IFS=: 00:07:34.436 22:59:37 -- accel/accel.sh@20 -- # read -r var val 00:07:34.436 22:59:37 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:34.436 22:59:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.436 22:59:37 -- accel/accel.sh@20 -- # IFS=: 00:07:34.436 22:59:37 -- accel/accel.sh@20 -- # read -r var val 00:07:34.436 22:59:37 -- accel/accel.sh@21 -- # val= 00:07:34.436 22:59:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.436 22:59:37 -- accel/accel.sh@20 -- # IFS=: 00:07:34.436 22:59:37 -- accel/accel.sh@20 -- # read -r var val 00:07:34.436 22:59:37 -- accel/accel.sh@21 -- # val=software 00:07:34.436 22:59:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.436 22:59:37 -- accel/accel.sh@23 -- # accel_module=software 00:07:34.436 22:59:37 -- accel/accel.sh@20 -- # IFS=: 00:07:34.436 22:59:37 -- accel/accel.sh@20 -- # read -r var val 00:07:34.436 22:59:37 -- accel/accel.sh@21 -- # val=32 00:07:34.436 22:59:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.436 22:59:37 -- accel/accel.sh@20 -- # IFS=: 00:07:34.436 22:59:37 -- accel/accel.sh@20 -- # read -r var val 00:07:34.436 22:59:37 -- accel/accel.sh@21 -- # val=32 00:07:34.436 22:59:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.436 22:59:37 -- accel/accel.sh@20 -- # IFS=: 00:07:34.436 22:59:37 -- accel/accel.sh@20 -- # read -r var val 00:07:34.436 22:59:37 -- accel/accel.sh@21 -- # val=1 00:07:34.436 22:59:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.436 22:59:37 -- accel/accel.sh@20 -- # IFS=: 00:07:34.436 22:59:37 -- accel/accel.sh@20 -- # read -r var val 00:07:34.436 22:59:37 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:34.436 22:59:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.436 22:59:37 -- accel/accel.sh@20 -- # IFS=: 00:07:34.436 22:59:37 -- accel/accel.sh@20 -- # read -r var val 00:07:34.436 22:59:37 -- accel/accel.sh@21 -- # val=Yes 00:07:34.436 22:59:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.436 22:59:37 -- accel/accel.sh@20 -- # IFS=: 00:07:34.436 22:59:37 -- accel/accel.sh@20 -- # read -r var val 00:07:34.436 22:59:37 -- accel/accel.sh@21 -- # val= 00:07:34.436 22:59:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.436 22:59:37 -- accel/accel.sh@20 -- # IFS=: 00:07:34.436 22:59:37 -- accel/accel.sh@20 -- # read -r var val 00:07:34.436 22:59:37 -- accel/accel.sh@21 -- # val= 00:07:34.436 22:59:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.436 22:59:37 -- accel/accel.sh@20 -- # IFS=: 00:07:34.436 22:59:37 -- accel/accel.sh@20 -- # read -r var val 00:07:35.810 22:59:39 -- accel/accel.sh@21 -- # val= 00:07:35.810 22:59:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.810 22:59:39 -- accel/accel.sh@20 -- # IFS=: 00:07:35.810 22:59:39 -- accel/accel.sh@20 -- # read -r var val 00:07:35.810 22:59:39 -- accel/accel.sh@21 -- # val= 00:07:35.810 22:59:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.810 22:59:39 -- accel/accel.sh@20 -- # IFS=: 00:07:35.810 22:59:39 -- accel/accel.sh@20 -- # read -r var val 00:07:35.810 22:59:39 -- accel/accel.sh@21 -- # val= 00:07:35.810 22:59:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.810 22:59:39 -- accel/accel.sh@20 -- # IFS=: 00:07:35.810 22:59:39 -- accel/accel.sh@20 -- # read -r var val 00:07:35.810 22:59:39 -- accel/accel.sh@21 -- # val= 00:07:35.810 22:59:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.810 22:59:39 -- accel/accel.sh@20 -- # IFS=: 00:07:35.810 22:59:39 -- accel/accel.sh@20 -- # read -r var val 00:07:35.810 22:59:39 -- accel/accel.sh@21 -- # val= 00:07:35.810 22:59:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.810 22:59:39 -- accel/accel.sh@20 -- # IFS=: 00:07:35.810 22:59:39 -- accel/accel.sh@20 -- # read -r var val 00:07:35.810 22:59:39 -- accel/accel.sh@21 -- # val= 00:07:35.810 22:59:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.810 22:59:39 -- accel/accel.sh@20 -- # IFS=: 00:07:35.810 22:59:39 -- accel/accel.sh@20 -- # read -r var val 00:07:35.810 22:59:39 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:35.810 22:59:39 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:07:35.810 22:59:39 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:35.810 00:07:35.810 real 0m2.817s 00:07:35.810 user 0m2.515s 00:07:35.810 sys 0m0.294s 00:07:35.810 22:59:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:35.810 22:59:39 -- common/autotest_common.sh@10 -- # set +x 00:07:35.810 ************************************ 00:07:35.810 END TEST accel_xor 00:07:35.810 ************************************ 00:07:35.810 22:59:39 -- accel/accel.sh@103 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:07:35.810 22:59:39 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:35.810 22:59:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:35.810 22:59:39 -- common/autotest_common.sh@10 -- # set +x 00:07:35.810 ************************************ 00:07:35.810 START TEST accel_dif_verify 00:07:35.810 ************************************ 00:07:35.810 22:59:39 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_verify 00:07:35.810 22:59:39 -- accel/accel.sh@16 -- # local accel_opc 00:07:35.810 22:59:39 -- accel/accel.sh@17 -- # local accel_module 00:07:35.810 22:59:39 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_verify 00:07:35.810 22:59:39 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:07:35.810 22:59:39 -- accel/accel.sh@12 -- # build_accel_config 00:07:35.810 22:59:39 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:35.810 22:59:39 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:35.810 22:59:39 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:35.810 22:59:39 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:35.810 22:59:39 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:35.810 22:59:39 -- accel/accel.sh@41 -- # local IFS=, 00:07:35.810 22:59:39 -- accel/accel.sh@42 -- # jq -r . 00:07:35.810 [2024-11-28 22:59:39.205558] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:35.810 [2024-11-28 22:59:39.205633] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2338736 ] 00:07:35.810 EAL: No free 2048 kB hugepages reported on node 1 00:07:35.810 [2024-11-28 22:59:39.267176] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:35.810 [2024-11-28 22:59:39.355425] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:37.184 22:59:40 -- accel/accel.sh@18 -- # out=' 00:07:37.184 SPDK Configuration: 00:07:37.184 Core mask: 0x1 00:07:37.184 00:07:37.184 Accel Perf Configuration: 00:07:37.184 Workload Type: dif_verify 00:07:37.184 Vector size: 4096 bytes 00:07:37.184 Transfer size: 4096 bytes 00:07:37.184 Block size: 512 bytes 00:07:37.184 Metadata size: 8 bytes 00:07:37.184 Vector count 1 00:07:37.184 Module: software 00:07:37.184 Queue depth: 32 00:07:37.184 Allocate depth: 32 00:07:37.184 # threads/core: 1 00:07:37.184 Run time: 1 seconds 00:07:37.184 Verify: No 00:07:37.184 00:07:37.184 Running for 1 seconds... 00:07:37.184 00:07:37.184 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:37.184 ------------------------------------------------------------------------------------ 00:07:37.184 0,0 83200/s 330 MiB/s 0 0 00:07:37.184 ==================================================================================== 00:07:37.185 Total 83200/s 325 MiB/s 0 0' 00:07:37.185 22:59:40 -- accel/accel.sh@20 -- # IFS=: 00:07:37.185 22:59:40 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:07:37.185 22:59:40 -- accel/accel.sh@20 -- # read -r var val 00:07:37.185 22:59:40 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:07:37.185 22:59:40 -- accel/accel.sh@12 -- # build_accel_config 00:07:37.185 22:59:40 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:37.185 22:59:40 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:37.185 22:59:40 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:37.185 22:59:40 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:37.185 22:59:40 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:37.185 22:59:40 -- accel/accel.sh@41 -- # local IFS=, 00:07:37.185 22:59:40 -- accel/accel.sh@42 -- # jq -r . 00:07:37.185 [2024-11-28 22:59:40.604861] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:37.185 [2024-11-28 22:59:40.604945] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2338888 ] 00:07:37.185 EAL: No free 2048 kB hugepages reported on node 1 00:07:37.185 [2024-11-28 22:59:40.667155] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:37.185 [2024-11-28 22:59:40.757319] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:37.443 22:59:40 -- accel/accel.sh@21 -- # val= 00:07:37.443 22:59:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.443 22:59:40 -- accel/accel.sh@20 -- # IFS=: 00:07:37.443 22:59:40 -- accel/accel.sh@20 -- # read -r var val 00:07:37.443 22:59:40 -- accel/accel.sh@21 -- # val= 00:07:37.443 22:59:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.443 22:59:40 -- accel/accel.sh@20 -- # IFS=: 00:07:37.443 22:59:40 -- accel/accel.sh@20 -- # read -r var val 00:07:37.443 22:59:40 -- accel/accel.sh@21 -- # val=0x1 00:07:37.443 22:59:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.443 22:59:40 -- accel/accel.sh@20 -- # IFS=: 00:07:37.443 22:59:40 -- accel/accel.sh@20 -- # read -r var val 00:07:37.443 22:59:40 -- accel/accel.sh@21 -- # val= 00:07:37.443 22:59:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.443 22:59:40 -- accel/accel.sh@20 -- # IFS=: 00:07:37.444 22:59:40 -- accel/accel.sh@20 -- # read -r var val 00:07:37.444 22:59:40 -- accel/accel.sh@21 -- # val= 00:07:37.444 22:59:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.444 22:59:40 -- accel/accel.sh@20 -- # IFS=: 00:07:37.444 22:59:40 -- accel/accel.sh@20 -- # read -r var val 00:07:37.444 22:59:40 -- accel/accel.sh@21 -- # val=dif_verify 00:07:37.444 22:59:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.444 22:59:40 -- accel/accel.sh@24 -- # accel_opc=dif_verify 00:07:37.444 22:59:40 -- accel/accel.sh@20 -- # IFS=: 00:07:37.444 22:59:40 -- accel/accel.sh@20 -- # read -r var val 00:07:37.444 22:59:40 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:37.444 22:59:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.444 22:59:40 -- accel/accel.sh@20 -- # IFS=: 00:07:37.444 22:59:40 -- accel/accel.sh@20 -- # read -r var val 00:07:37.444 22:59:40 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:37.444 22:59:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.444 22:59:40 -- accel/accel.sh@20 -- # IFS=: 00:07:37.444 22:59:40 -- accel/accel.sh@20 -- # read -r var val 00:07:37.444 22:59:40 -- accel/accel.sh@21 -- # val='512 bytes' 00:07:37.444 22:59:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.444 22:59:40 -- accel/accel.sh@20 -- # IFS=: 00:07:37.444 22:59:40 -- accel/accel.sh@20 -- # read -r var val 00:07:37.444 22:59:40 -- accel/accel.sh@21 -- # val='8 bytes' 00:07:37.444 22:59:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.444 22:59:40 -- accel/accel.sh@20 -- # IFS=: 00:07:37.444 22:59:40 -- accel/accel.sh@20 -- # read -r var val 00:07:37.444 22:59:40 -- accel/accel.sh@21 -- # val= 00:07:37.444 22:59:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.444 22:59:40 -- accel/accel.sh@20 -- # IFS=: 00:07:37.444 22:59:40 -- accel/accel.sh@20 -- # read -r var val 00:07:37.444 22:59:40 -- accel/accel.sh@21 -- # val=software 00:07:37.444 22:59:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.444 22:59:40 -- accel/accel.sh@23 -- # accel_module=software 00:07:37.444 22:59:40 -- accel/accel.sh@20 -- # IFS=: 00:07:37.444 22:59:40 -- accel/accel.sh@20 -- # read -r var val 00:07:37.444 22:59:40 -- accel/accel.sh@21 -- # val=32 00:07:37.444 22:59:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.444 22:59:40 -- accel/accel.sh@20 -- # IFS=: 00:07:37.444 22:59:40 -- accel/accel.sh@20 -- # read -r var val 00:07:37.444 22:59:40 -- accel/accel.sh@21 -- # val=32 00:07:37.444 22:59:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.444 22:59:40 -- accel/accel.sh@20 -- # IFS=: 00:07:37.444 22:59:40 -- accel/accel.sh@20 -- # read -r var val 00:07:37.444 22:59:40 -- accel/accel.sh@21 -- # val=1 00:07:37.444 22:59:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.444 22:59:40 -- accel/accel.sh@20 -- # IFS=: 00:07:37.444 22:59:40 -- accel/accel.sh@20 -- # read -r var val 00:07:37.444 22:59:40 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:37.444 22:59:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.444 22:59:40 -- accel/accel.sh@20 -- # IFS=: 00:07:37.444 22:59:40 -- accel/accel.sh@20 -- # read -r var val 00:07:37.444 22:59:40 -- accel/accel.sh@21 -- # val=No 00:07:37.444 22:59:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.444 22:59:40 -- accel/accel.sh@20 -- # IFS=: 00:07:37.444 22:59:40 -- accel/accel.sh@20 -- # read -r var val 00:07:37.444 22:59:40 -- accel/accel.sh@21 -- # val= 00:07:37.444 22:59:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.444 22:59:40 -- accel/accel.sh@20 -- # IFS=: 00:07:37.444 22:59:40 -- accel/accel.sh@20 -- # read -r var val 00:07:37.444 22:59:40 -- accel/accel.sh@21 -- # val= 00:07:37.444 22:59:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.444 22:59:40 -- accel/accel.sh@20 -- # IFS=: 00:07:37.444 22:59:40 -- accel/accel.sh@20 -- # read -r var val 00:07:38.819 22:59:41 -- accel/accel.sh@21 -- # val= 00:07:38.819 22:59:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.819 22:59:41 -- accel/accel.sh@20 -- # IFS=: 00:07:38.819 22:59:41 -- accel/accel.sh@20 -- # read -r var val 00:07:38.819 22:59:41 -- accel/accel.sh@21 -- # val= 00:07:38.819 22:59:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.819 22:59:41 -- accel/accel.sh@20 -- # IFS=: 00:07:38.819 22:59:41 -- accel/accel.sh@20 -- # read -r var val 00:07:38.819 22:59:41 -- accel/accel.sh@21 -- # val= 00:07:38.819 22:59:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.819 22:59:41 -- accel/accel.sh@20 -- # IFS=: 00:07:38.819 22:59:41 -- accel/accel.sh@20 -- # read -r var val 00:07:38.819 22:59:41 -- accel/accel.sh@21 -- # val= 00:07:38.819 22:59:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.819 22:59:41 -- accel/accel.sh@20 -- # IFS=: 00:07:38.819 22:59:41 -- accel/accel.sh@20 -- # read -r var val 00:07:38.819 22:59:41 -- accel/accel.sh@21 -- # val= 00:07:38.819 22:59:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.819 22:59:41 -- accel/accel.sh@20 -- # IFS=: 00:07:38.819 22:59:41 -- accel/accel.sh@20 -- # read -r var val 00:07:38.819 22:59:41 -- accel/accel.sh@21 -- # val= 00:07:38.819 22:59:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.819 22:59:41 -- accel/accel.sh@20 -- # IFS=: 00:07:38.819 22:59:41 -- accel/accel.sh@20 -- # read -r var val 00:07:38.819 22:59:41 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:38.819 22:59:41 -- accel/accel.sh@28 -- # [[ -n dif_verify ]] 00:07:38.819 22:59:41 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:38.819 00:07:38.819 real 0m2.811s 00:07:38.819 user 0m2.507s 00:07:38.819 sys 0m0.298s 00:07:38.819 22:59:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:38.819 22:59:41 -- common/autotest_common.sh@10 -- # set +x 00:07:38.819 ************************************ 00:07:38.819 END TEST accel_dif_verify 00:07:38.819 ************************************ 00:07:38.819 22:59:42 -- accel/accel.sh@104 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:07:38.819 22:59:42 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:38.819 22:59:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:38.819 22:59:42 -- common/autotest_common.sh@10 -- # set +x 00:07:38.819 ************************************ 00:07:38.819 START TEST accel_dif_generate 00:07:38.819 ************************************ 00:07:38.819 22:59:42 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate 00:07:38.819 22:59:42 -- accel/accel.sh@16 -- # local accel_opc 00:07:38.819 22:59:42 -- accel/accel.sh@17 -- # local accel_module 00:07:38.819 22:59:42 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate 00:07:38.819 22:59:42 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:07:38.819 22:59:42 -- accel/accel.sh@12 -- # build_accel_config 00:07:38.819 22:59:42 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:38.819 22:59:42 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:38.819 22:59:42 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:38.819 22:59:42 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:38.819 22:59:42 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:38.819 22:59:42 -- accel/accel.sh@41 -- # local IFS=, 00:07:38.819 22:59:42 -- accel/accel.sh@42 -- # jq -r . 00:07:38.819 [2024-11-28 22:59:42.039295] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:38.819 [2024-11-28 22:59:42.039375] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2339070 ] 00:07:38.819 EAL: No free 2048 kB hugepages reported on node 1 00:07:38.819 [2024-11-28 22:59:42.100479] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:38.819 [2024-11-28 22:59:42.190765] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:40.194 22:59:43 -- accel/accel.sh@18 -- # out=' 00:07:40.194 SPDK Configuration: 00:07:40.194 Core mask: 0x1 00:07:40.194 00:07:40.194 Accel Perf Configuration: 00:07:40.194 Workload Type: dif_generate 00:07:40.194 Vector size: 4096 bytes 00:07:40.194 Transfer size: 4096 bytes 00:07:40.194 Block size: 512 bytes 00:07:40.194 Metadata size: 8 bytes 00:07:40.194 Vector count 1 00:07:40.194 Module: software 00:07:40.194 Queue depth: 32 00:07:40.194 Allocate depth: 32 00:07:40.194 # threads/core: 1 00:07:40.194 Run time: 1 seconds 00:07:40.194 Verify: No 00:07:40.194 00:07:40.194 Running for 1 seconds... 00:07:40.194 00:07:40.194 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:40.194 ------------------------------------------------------------------------------------ 00:07:40.194 0,0 96288/s 382 MiB/s 0 0 00:07:40.194 ==================================================================================== 00:07:40.194 Total 96288/s 376 MiB/s 0 0' 00:07:40.194 22:59:43 -- accel/accel.sh@20 -- # IFS=: 00:07:40.194 22:59:43 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:07:40.194 22:59:43 -- accel/accel.sh@20 -- # read -r var val 00:07:40.194 22:59:43 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:07:40.194 22:59:43 -- accel/accel.sh@12 -- # build_accel_config 00:07:40.194 22:59:43 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:40.194 22:59:43 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:40.194 22:59:43 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:40.194 22:59:43 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:40.194 22:59:43 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:40.194 22:59:43 -- accel/accel.sh@41 -- # local IFS=, 00:07:40.194 22:59:43 -- accel/accel.sh@42 -- # jq -r . 00:07:40.195 [2024-11-28 22:59:43.447700] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:40.195 [2024-11-28 22:59:43.447781] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2339300 ] 00:07:40.195 EAL: No free 2048 kB hugepages reported on node 1 00:07:40.195 [2024-11-28 22:59:43.510284] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:40.195 [2024-11-28 22:59:43.600653] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:40.195 22:59:43 -- accel/accel.sh@21 -- # val= 00:07:40.195 22:59:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.195 22:59:43 -- accel/accel.sh@20 -- # IFS=: 00:07:40.195 22:59:43 -- accel/accel.sh@20 -- # read -r var val 00:07:40.195 22:59:43 -- accel/accel.sh@21 -- # val= 00:07:40.195 22:59:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.195 22:59:43 -- accel/accel.sh@20 -- # IFS=: 00:07:40.195 22:59:43 -- accel/accel.sh@20 -- # read -r var val 00:07:40.195 22:59:43 -- accel/accel.sh@21 -- # val=0x1 00:07:40.195 22:59:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.195 22:59:43 -- accel/accel.sh@20 -- # IFS=: 00:07:40.195 22:59:43 -- accel/accel.sh@20 -- # read -r var val 00:07:40.195 22:59:43 -- accel/accel.sh@21 -- # val= 00:07:40.195 22:59:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.195 22:59:43 -- accel/accel.sh@20 -- # IFS=: 00:07:40.195 22:59:43 -- accel/accel.sh@20 -- # read -r var val 00:07:40.195 22:59:43 -- accel/accel.sh@21 -- # val= 00:07:40.195 22:59:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.195 22:59:43 -- accel/accel.sh@20 -- # IFS=: 00:07:40.195 22:59:43 -- accel/accel.sh@20 -- # read -r var val 00:07:40.195 22:59:43 -- accel/accel.sh@21 -- # val=dif_generate 00:07:40.195 22:59:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.195 22:59:43 -- accel/accel.sh@24 -- # accel_opc=dif_generate 00:07:40.195 22:59:43 -- accel/accel.sh@20 -- # IFS=: 00:07:40.195 22:59:43 -- accel/accel.sh@20 -- # read -r var val 00:07:40.195 22:59:43 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:40.195 22:59:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.195 22:59:43 -- accel/accel.sh@20 -- # IFS=: 00:07:40.195 22:59:43 -- accel/accel.sh@20 -- # read -r var val 00:07:40.195 22:59:43 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:40.195 22:59:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.195 22:59:43 -- accel/accel.sh@20 -- # IFS=: 00:07:40.195 22:59:43 -- accel/accel.sh@20 -- # read -r var val 00:07:40.195 22:59:43 -- accel/accel.sh@21 -- # val='512 bytes' 00:07:40.195 22:59:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.195 22:59:43 -- accel/accel.sh@20 -- # IFS=: 00:07:40.195 22:59:43 -- accel/accel.sh@20 -- # read -r var val 00:07:40.195 22:59:43 -- accel/accel.sh@21 -- # val='8 bytes' 00:07:40.195 22:59:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.195 22:59:43 -- accel/accel.sh@20 -- # IFS=: 00:07:40.195 22:59:43 -- accel/accel.sh@20 -- # read -r var val 00:07:40.195 22:59:43 -- accel/accel.sh@21 -- # val= 00:07:40.195 22:59:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.195 22:59:43 -- accel/accel.sh@20 -- # IFS=: 00:07:40.195 22:59:43 -- accel/accel.sh@20 -- # read -r var val 00:07:40.195 22:59:43 -- accel/accel.sh@21 -- # val=software 00:07:40.195 22:59:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.195 22:59:43 -- accel/accel.sh@23 -- # accel_module=software 00:07:40.195 22:59:43 -- accel/accel.sh@20 -- # IFS=: 00:07:40.195 22:59:43 -- accel/accel.sh@20 -- # read -r var val 00:07:40.195 22:59:43 -- accel/accel.sh@21 -- # val=32 00:07:40.195 22:59:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.195 22:59:43 -- accel/accel.sh@20 -- # IFS=: 00:07:40.195 22:59:43 -- accel/accel.sh@20 -- # read -r var val 00:07:40.195 22:59:43 -- accel/accel.sh@21 -- # val=32 00:07:40.195 22:59:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.195 22:59:43 -- accel/accel.sh@20 -- # IFS=: 00:07:40.195 22:59:43 -- accel/accel.sh@20 -- # read -r var val 00:07:40.195 22:59:43 -- accel/accel.sh@21 -- # val=1 00:07:40.195 22:59:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.195 22:59:43 -- accel/accel.sh@20 -- # IFS=: 00:07:40.195 22:59:43 -- accel/accel.sh@20 -- # read -r var val 00:07:40.195 22:59:43 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:40.195 22:59:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.195 22:59:43 -- accel/accel.sh@20 -- # IFS=: 00:07:40.195 22:59:43 -- accel/accel.sh@20 -- # read -r var val 00:07:40.195 22:59:43 -- accel/accel.sh@21 -- # val=No 00:07:40.195 22:59:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.195 22:59:43 -- accel/accel.sh@20 -- # IFS=: 00:07:40.195 22:59:43 -- accel/accel.sh@20 -- # read -r var val 00:07:40.195 22:59:43 -- accel/accel.sh@21 -- # val= 00:07:40.195 22:59:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.195 22:59:43 -- accel/accel.sh@20 -- # IFS=: 00:07:40.195 22:59:43 -- accel/accel.sh@20 -- # read -r var val 00:07:40.195 22:59:43 -- accel/accel.sh@21 -- # val= 00:07:40.195 22:59:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.195 22:59:43 -- accel/accel.sh@20 -- # IFS=: 00:07:40.195 22:59:43 -- accel/accel.sh@20 -- # read -r var val 00:07:41.582 22:59:44 -- accel/accel.sh@21 -- # val= 00:07:41.582 22:59:44 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.582 22:59:44 -- accel/accel.sh@20 -- # IFS=: 00:07:41.582 22:59:44 -- accel/accel.sh@20 -- # read -r var val 00:07:41.582 22:59:44 -- accel/accel.sh@21 -- # val= 00:07:41.582 22:59:44 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.582 22:59:44 -- accel/accel.sh@20 -- # IFS=: 00:07:41.582 22:59:44 -- accel/accel.sh@20 -- # read -r var val 00:07:41.582 22:59:44 -- accel/accel.sh@21 -- # val= 00:07:41.582 22:59:44 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.582 22:59:44 -- accel/accel.sh@20 -- # IFS=: 00:07:41.582 22:59:44 -- accel/accel.sh@20 -- # read -r var val 00:07:41.582 22:59:44 -- accel/accel.sh@21 -- # val= 00:07:41.582 22:59:44 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.582 22:59:44 -- accel/accel.sh@20 -- # IFS=: 00:07:41.582 22:59:44 -- accel/accel.sh@20 -- # read -r var val 00:07:41.582 22:59:44 -- accel/accel.sh@21 -- # val= 00:07:41.582 22:59:44 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.582 22:59:44 -- accel/accel.sh@20 -- # IFS=: 00:07:41.582 22:59:44 -- accel/accel.sh@20 -- # read -r var val 00:07:41.582 22:59:44 -- accel/accel.sh@21 -- # val= 00:07:41.582 22:59:44 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.582 22:59:44 -- accel/accel.sh@20 -- # IFS=: 00:07:41.582 22:59:44 -- accel/accel.sh@20 -- # read -r var val 00:07:41.582 22:59:44 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:41.582 22:59:44 -- accel/accel.sh@28 -- # [[ -n dif_generate ]] 00:07:41.582 22:59:44 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:41.582 00:07:41.582 real 0m2.815s 00:07:41.582 user 0m2.523s 00:07:41.582 sys 0m0.286s 00:07:41.582 22:59:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:41.582 22:59:44 -- common/autotest_common.sh@10 -- # set +x 00:07:41.582 ************************************ 00:07:41.582 END TEST accel_dif_generate 00:07:41.582 ************************************ 00:07:41.582 22:59:44 -- accel/accel.sh@105 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:07:41.582 22:59:44 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:41.582 22:59:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:41.582 22:59:44 -- common/autotest_common.sh@10 -- # set +x 00:07:41.582 ************************************ 00:07:41.582 START TEST accel_dif_generate_copy 00:07:41.582 ************************************ 00:07:41.582 22:59:44 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate_copy 00:07:41.582 22:59:44 -- accel/accel.sh@16 -- # local accel_opc 00:07:41.582 22:59:44 -- accel/accel.sh@17 -- # local accel_module 00:07:41.582 22:59:44 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate_copy 00:07:41.582 22:59:44 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:07:41.582 22:59:44 -- accel/accel.sh@12 -- # build_accel_config 00:07:41.582 22:59:44 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:41.582 22:59:44 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:41.582 22:59:44 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:41.582 22:59:44 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:41.582 22:59:44 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:41.582 22:59:44 -- accel/accel.sh@41 -- # local IFS=, 00:07:41.582 22:59:44 -- accel/accel.sh@42 -- # jq -r . 00:07:41.582 [2024-11-28 22:59:44.883316] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:41.582 [2024-11-28 22:59:44.883413] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2339462 ] 00:07:41.582 EAL: No free 2048 kB hugepages reported on node 1 00:07:41.582 [2024-11-28 22:59:44.945606] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:41.582 [2024-11-28 22:59:45.034283] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:42.954 22:59:46 -- accel/accel.sh@18 -- # out=' 00:07:42.954 SPDK Configuration: 00:07:42.954 Core mask: 0x1 00:07:42.954 00:07:42.954 Accel Perf Configuration: 00:07:42.954 Workload Type: dif_generate_copy 00:07:42.954 Vector size: 4096 bytes 00:07:42.954 Transfer size: 4096 bytes 00:07:42.954 Vector count 1 00:07:42.954 Module: software 00:07:42.954 Queue depth: 32 00:07:42.954 Allocate depth: 32 00:07:42.954 # threads/core: 1 00:07:42.954 Run time: 1 seconds 00:07:42.954 Verify: No 00:07:42.954 00:07:42.954 Running for 1 seconds... 00:07:42.954 00:07:42.954 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:42.954 ------------------------------------------------------------------------------------ 00:07:42.954 0,0 75040/s 297 MiB/s 0 0 00:07:42.954 ==================================================================================== 00:07:42.954 Total 75040/s 293 MiB/s 0 0' 00:07:42.954 22:59:46 -- accel/accel.sh@20 -- # IFS=: 00:07:42.954 22:59:46 -- accel/accel.sh@20 -- # read -r var val 00:07:42.954 22:59:46 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:07:42.954 22:59:46 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:07:42.954 22:59:46 -- accel/accel.sh@12 -- # build_accel_config 00:07:42.954 22:59:46 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:42.954 22:59:46 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:42.954 22:59:46 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:42.954 22:59:46 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:42.954 22:59:46 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:42.954 22:59:46 -- accel/accel.sh@41 -- # local IFS=, 00:07:42.954 22:59:46 -- accel/accel.sh@42 -- # jq -r . 00:07:42.954 [2024-11-28 22:59:46.274983] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:42.954 [2024-11-28 22:59:46.275069] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2339609 ] 00:07:42.954 EAL: No free 2048 kB hugepages reported on node 1 00:07:42.954 [2024-11-28 22:59:46.337452] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:42.954 [2024-11-28 22:59:46.427706] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:42.954 22:59:46 -- accel/accel.sh@21 -- # val= 00:07:42.954 22:59:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.954 22:59:46 -- accel/accel.sh@20 -- # IFS=: 00:07:42.954 22:59:46 -- accel/accel.sh@20 -- # read -r var val 00:07:42.954 22:59:46 -- accel/accel.sh@21 -- # val= 00:07:42.954 22:59:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.954 22:59:46 -- accel/accel.sh@20 -- # IFS=: 00:07:42.954 22:59:46 -- accel/accel.sh@20 -- # read -r var val 00:07:42.954 22:59:46 -- accel/accel.sh@21 -- # val=0x1 00:07:42.954 22:59:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.954 22:59:46 -- accel/accel.sh@20 -- # IFS=: 00:07:42.954 22:59:46 -- accel/accel.sh@20 -- # read -r var val 00:07:42.954 22:59:46 -- accel/accel.sh@21 -- # val= 00:07:42.954 22:59:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.954 22:59:46 -- accel/accel.sh@20 -- # IFS=: 00:07:42.954 22:59:46 -- accel/accel.sh@20 -- # read -r var val 00:07:42.954 22:59:46 -- accel/accel.sh@21 -- # val= 00:07:42.954 22:59:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.954 22:59:46 -- accel/accel.sh@20 -- # IFS=: 00:07:42.954 22:59:46 -- accel/accel.sh@20 -- # read -r var val 00:07:42.954 22:59:46 -- accel/accel.sh@21 -- # val=dif_generate_copy 00:07:42.954 22:59:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.954 22:59:46 -- accel/accel.sh@24 -- # accel_opc=dif_generate_copy 00:07:42.954 22:59:46 -- accel/accel.sh@20 -- # IFS=: 00:07:42.954 22:59:46 -- accel/accel.sh@20 -- # read -r var val 00:07:42.954 22:59:46 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:42.954 22:59:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.954 22:59:46 -- accel/accel.sh@20 -- # IFS=: 00:07:42.954 22:59:46 -- accel/accel.sh@20 -- # read -r var val 00:07:42.954 22:59:46 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:42.954 22:59:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.954 22:59:46 -- accel/accel.sh@20 -- # IFS=: 00:07:42.954 22:59:46 -- accel/accel.sh@20 -- # read -r var val 00:07:42.954 22:59:46 -- accel/accel.sh@21 -- # val= 00:07:42.954 22:59:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.954 22:59:46 -- accel/accel.sh@20 -- # IFS=: 00:07:42.954 22:59:46 -- accel/accel.sh@20 -- # read -r var val 00:07:42.954 22:59:46 -- accel/accel.sh@21 -- # val=software 00:07:42.954 22:59:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.954 22:59:46 -- accel/accel.sh@23 -- # accel_module=software 00:07:42.954 22:59:46 -- accel/accel.sh@20 -- # IFS=: 00:07:42.954 22:59:46 -- accel/accel.sh@20 -- # read -r var val 00:07:42.954 22:59:46 -- accel/accel.sh@21 -- # val=32 00:07:42.954 22:59:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.954 22:59:46 -- accel/accel.sh@20 -- # IFS=: 00:07:42.954 22:59:46 -- accel/accel.sh@20 -- # read -r var val 00:07:42.954 22:59:46 -- accel/accel.sh@21 -- # val=32 00:07:42.954 22:59:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.954 22:59:46 -- accel/accel.sh@20 -- # IFS=: 00:07:42.954 22:59:46 -- accel/accel.sh@20 -- # read -r var val 00:07:42.954 22:59:46 -- accel/accel.sh@21 -- # val=1 00:07:42.954 22:59:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.954 22:59:46 -- accel/accel.sh@20 -- # IFS=: 00:07:42.954 22:59:46 -- accel/accel.sh@20 -- # read -r var val 00:07:42.954 22:59:46 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:42.954 22:59:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.954 22:59:46 -- accel/accel.sh@20 -- # IFS=: 00:07:42.954 22:59:46 -- accel/accel.sh@20 -- # read -r var val 00:07:42.954 22:59:46 -- accel/accel.sh@21 -- # val=No 00:07:42.954 22:59:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.954 22:59:46 -- accel/accel.sh@20 -- # IFS=: 00:07:42.954 22:59:46 -- accel/accel.sh@20 -- # read -r var val 00:07:42.954 22:59:46 -- accel/accel.sh@21 -- # val= 00:07:42.954 22:59:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.954 22:59:46 -- accel/accel.sh@20 -- # IFS=: 00:07:42.954 22:59:46 -- accel/accel.sh@20 -- # read -r var val 00:07:42.954 22:59:46 -- accel/accel.sh@21 -- # val= 00:07:42.954 22:59:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.954 22:59:46 -- accel/accel.sh@20 -- # IFS=: 00:07:42.954 22:59:46 -- accel/accel.sh@20 -- # read -r var val 00:07:44.350 22:59:47 -- accel/accel.sh@21 -- # val= 00:07:44.350 22:59:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.350 22:59:47 -- accel/accel.sh@20 -- # IFS=: 00:07:44.350 22:59:47 -- accel/accel.sh@20 -- # read -r var val 00:07:44.350 22:59:47 -- accel/accel.sh@21 -- # val= 00:07:44.350 22:59:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.350 22:59:47 -- accel/accel.sh@20 -- # IFS=: 00:07:44.350 22:59:47 -- accel/accel.sh@20 -- # read -r var val 00:07:44.350 22:59:47 -- accel/accel.sh@21 -- # val= 00:07:44.350 22:59:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.350 22:59:47 -- accel/accel.sh@20 -- # IFS=: 00:07:44.350 22:59:47 -- accel/accel.sh@20 -- # read -r var val 00:07:44.350 22:59:47 -- accel/accel.sh@21 -- # val= 00:07:44.350 22:59:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.350 22:59:47 -- accel/accel.sh@20 -- # IFS=: 00:07:44.350 22:59:47 -- accel/accel.sh@20 -- # read -r var val 00:07:44.350 22:59:47 -- accel/accel.sh@21 -- # val= 00:07:44.350 22:59:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.350 22:59:47 -- accel/accel.sh@20 -- # IFS=: 00:07:44.350 22:59:47 -- accel/accel.sh@20 -- # read -r var val 00:07:44.350 22:59:47 -- accel/accel.sh@21 -- # val= 00:07:44.350 22:59:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.350 22:59:47 -- accel/accel.sh@20 -- # IFS=: 00:07:44.350 22:59:47 -- accel/accel.sh@20 -- # read -r var val 00:07:44.350 22:59:47 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:44.350 22:59:47 -- accel/accel.sh@28 -- # [[ -n dif_generate_copy ]] 00:07:44.350 22:59:47 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:44.350 00:07:44.350 real 0m2.801s 00:07:44.350 user 0m2.511s 00:07:44.350 sys 0m0.282s 00:07:44.350 22:59:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:44.350 22:59:47 -- common/autotest_common.sh@10 -- # set +x 00:07:44.350 ************************************ 00:07:44.350 END TEST accel_dif_generate_copy 00:07:44.350 ************************************ 00:07:44.350 22:59:47 -- accel/accel.sh@107 -- # [[ y == y ]] 00:07:44.350 22:59:47 -- accel/accel.sh@108 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:44.350 22:59:47 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:07:44.350 22:59:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:44.350 22:59:47 -- common/autotest_common.sh@10 -- # set +x 00:07:44.350 ************************************ 00:07:44.350 START TEST accel_comp 00:07:44.350 ************************************ 00:07:44.350 22:59:47 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:44.350 22:59:47 -- accel/accel.sh@16 -- # local accel_opc 00:07:44.350 22:59:47 -- accel/accel.sh@17 -- # local accel_module 00:07:44.350 22:59:47 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:44.350 22:59:47 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:44.350 22:59:47 -- accel/accel.sh@12 -- # build_accel_config 00:07:44.350 22:59:47 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:44.350 22:59:47 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:44.350 22:59:47 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:44.350 22:59:47 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:44.350 22:59:47 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:44.351 22:59:47 -- accel/accel.sh@41 -- # local IFS=, 00:07:44.351 22:59:47 -- accel/accel.sh@42 -- # jq -r . 00:07:44.351 [2024-11-28 22:59:47.708118] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:44.351 [2024-11-28 22:59:47.708203] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2339791 ] 00:07:44.351 EAL: No free 2048 kB hugepages reported on node 1 00:07:44.351 [2024-11-28 22:59:47.770681] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:44.351 [2024-11-28 22:59:47.860651] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:45.721 22:59:49 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:45.721 00:07:45.721 SPDK Configuration: 00:07:45.721 Core mask: 0x1 00:07:45.721 00:07:45.721 Accel Perf Configuration: 00:07:45.721 Workload Type: compress 00:07:45.721 Transfer size: 4096 bytes 00:07:45.721 Vector count 1 00:07:45.721 Module: software 00:07:45.721 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:45.721 Queue depth: 32 00:07:45.721 Allocate depth: 32 00:07:45.721 # threads/core: 1 00:07:45.721 Run time: 1 seconds 00:07:45.721 Verify: No 00:07:45.721 00:07:45.721 Running for 1 seconds... 00:07:45.721 00:07:45.721 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:45.721 ------------------------------------------------------------------------------------ 00:07:45.721 0,0 31328/s 130 MiB/s 0 0 00:07:45.721 ==================================================================================== 00:07:45.721 Total 31328/s 122 MiB/s 0 0' 00:07:45.721 22:59:49 -- accel/accel.sh@20 -- # IFS=: 00:07:45.721 22:59:49 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:45.721 22:59:49 -- accel/accel.sh@20 -- # read -r var val 00:07:45.721 22:59:49 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:45.721 22:59:49 -- accel/accel.sh@12 -- # build_accel_config 00:07:45.721 22:59:49 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:45.721 22:59:49 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:45.721 22:59:49 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:45.721 22:59:49 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:45.721 22:59:49 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:45.721 22:59:49 -- accel/accel.sh@41 -- # local IFS=, 00:07:45.721 22:59:49 -- accel/accel.sh@42 -- # jq -r . 00:07:45.721 [2024-11-28 22:59:49.121063] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:45.721 [2024-11-28 22:59:49.121146] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2340029 ] 00:07:45.721 EAL: No free 2048 kB hugepages reported on node 1 00:07:45.721 [2024-11-28 22:59:49.182876] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:45.721 [2024-11-28 22:59:49.273410] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:45.979 22:59:49 -- accel/accel.sh@21 -- # val= 00:07:45.979 22:59:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.979 22:59:49 -- accel/accel.sh@20 -- # IFS=: 00:07:45.979 22:59:49 -- accel/accel.sh@20 -- # read -r var val 00:07:45.979 22:59:49 -- accel/accel.sh@21 -- # val= 00:07:45.979 22:59:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.979 22:59:49 -- accel/accel.sh@20 -- # IFS=: 00:07:45.979 22:59:49 -- accel/accel.sh@20 -- # read -r var val 00:07:45.979 22:59:49 -- accel/accel.sh@21 -- # val= 00:07:45.979 22:59:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.979 22:59:49 -- accel/accel.sh@20 -- # IFS=: 00:07:45.979 22:59:49 -- accel/accel.sh@20 -- # read -r var val 00:07:45.979 22:59:49 -- accel/accel.sh@21 -- # val=0x1 00:07:45.979 22:59:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.979 22:59:49 -- accel/accel.sh@20 -- # IFS=: 00:07:45.979 22:59:49 -- accel/accel.sh@20 -- # read -r var val 00:07:45.979 22:59:49 -- accel/accel.sh@21 -- # val= 00:07:45.979 22:59:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.979 22:59:49 -- accel/accel.sh@20 -- # IFS=: 00:07:45.979 22:59:49 -- accel/accel.sh@20 -- # read -r var val 00:07:45.979 22:59:49 -- accel/accel.sh@21 -- # val= 00:07:45.979 22:59:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.979 22:59:49 -- accel/accel.sh@20 -- # IFS=: 00:07:45.979 22:59:49 -- accel/accel.sh@20 -- # read -r var val 00:07:45.979 22:59:49 -- accel/accel.sh@21 -- # val=compress 00:07:45.979 22:59:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.979 22:59:49 -- accel/accel.sh@24 -- # accel_opc=compress 00:07:45.979 22:59:49 -- accel/accel.sh@20 -- # IFS=: 00:07:45.979 22:59:49 -- accel/accel.sh@20 -- # read -r var val 00:07:45.979 22:59:49 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:45.979 22:59:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.979 22:59:49 -- accel/accel.sh@20 -- # IFS=: 00:07:45.979 22:59:49 -- accel/accel.sh@20 -- # read -r var val 00:07:45.979 22:59:49 -- accel/accel.sh@21 -- # val= 00:07:45.979 22:59:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.979 22:59:49 -- accel/accel.sh@20 -- # IFS=: 00:07:45.979 22:59:49 -- accel/accel.sh@20 -- # read -r var val 00:07:45.979 22:59:49 -- accel/accel.sh@21 -- # val=software 00:07:45.979 22:59:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.979 22:59:49 -- accel/accel.sh@23 -- # accel_module=software 00:07:45.979 22:59:49 -- accel/accel.sh@20 -- # IFS=: 00:07:45.979 22:59:49 -- accel/accel.sh@20 -- # read -r var val 00:07:45.979 22:59:49 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:45.979 22:59:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.979 22:59:49 -- accel/accel.sh@20 -- # IFS=: 00:07:45.979 22:59:49 -- accel/accel.sh@20 -- # read -r var val 00:07:45.979 22:59:49 -- accel/accel.sh@21 -- # val=32 00:07:45.979 22:59:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.979 22:59:49 -- accel/accel.sh@20 -- # IFS=: 00:07:45.979 22:59:49 -- accel/accel.sh@20 -- # read -r var val 00:07:45.979 22:59:49 -- accel/accel.sh@21 -- # val=32 00:07:45.979 22:59:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.979 22:59:49 -- accel/accel.sh@20 -- # IFS=: 00:07:45.979 22:59:49 -- accel/accel.sh@20 -- # read -r var val 00:07:45.979 22:59:49 -- accel/accel.sh@21 -- # val=1 00:07:45.979 22:59:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.979 22:59:49 -- accel/accel.sh@20 -- # IFS=: 00:07:45.979 22:59:49 -- accel/accel.sh@20 -- # read -r var val 00:07:45.979 22:59:49 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:45.979 22:59:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.979 22:59:49 -- accel/accel.sh@20 -- # IFS=: 00:07:45.979 22:59:49 -- accel/accel.sh@20 -- # read -r var val 00:07:45.979 22:59:49 -- accel/accel.sh@21 -- # val=No 00:07:45.979 22:59:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.979 22:59:49 -- accel/accel.sh@20 -- # IFS=: 00:07:45.979 22:59:49 -- accel/accel.sh@20 -- # read -r var val 00:07:45.979 22:59:49 -- accel/accel.sh@21 -- # val= 00:07:45.979 22:59:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.979 22:59:49 -- accel/accel.sh@20 -- # IFS=: 00:07:45.979 22:59:49 -- accel/accel.sh@20 -- # read -r var val 00:07:45.979 22:59:49 -- accel/accel.sh@21 -- # val= 00:07:45.979 22:59:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.979 22:59:49 -- accel/accel.sh@20 -- # IFS=: 00:07:45.979 22:59:49 -- accel/accel.sh@20 -- # read -r var val 00:07:46.913 22:59:50 -- accel/accel.sh@21 -- # val= 00:07:46.913 22:59:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.913 22:59:50 -- accel/accel.sh@20 -- # IFS=: 00:07:46.913 22:59:50 -- accel/accel.sh@20 -- # read -r var val 00:07:46.913 22:59:50 -- accel/accel.sh@21 -- # val= 00:07:46.913 22:59:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.913 22:59:50 -- accel/accel.sh@20 -- # IFS=: 00:07:46.913 22:59:50 -- accel/accel.sh@20 -- # read -r var val 00:07:46.913 22:59:50 -- accel/accel.sh@21 -- # val= 00:07:46.913 22:59:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.913 22:59:50 -- accel/accel.sh@20 -- # IFS=: 00:07:46.913 22:59:50 -- accel/accel.sh@20 -- # read -r var val 00:07:46.913 22:59:50 -- accel/accel.sh@21 -- # val= 00:07:46.913 22:59:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.913 22:59:50 -- accel/accel.sh@20 -- # IFS=: 00:07:46.913 22:59:50 -- accel/accel.sh@20 -- # read -r var val 00:07:46.913 22:59:50 -- accel/accel.sh@21 -- # val= 00:07:46.913 22:59:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.913 22:59:50 -- accel/accel.sh@20 -- # IFS=: 00:07:46.913 22:59:50 -- accel/accel.sh@20 -- # read -r var val 00:07:46.913 22:59:50 -- accel/accel.sh@21 -- # val= 00:07:46.913 22:59:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.913 22:59:50 -- accel/accel.sh@20 -- # IFS=: 00:07:46.913 22:59:50 -- accel/accel.sh@20 -- # read -r var val 00:07:46.913 22:59:50 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:46.913 22:59:50 -- accel/accel.sh@28 -- # [[ -n compress ]] 00:07:46.913 22:59:50 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:46.913 00:07:46.913 real 0m2.826s 00:07:46.913 user 0m2.528s 00:07:46.913 sys 0m0.291s 00:07:46.913 22:59:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:46.913 22:59:50 -- common/autotest_common.sh@10 -- # set +x 00:07:46.913 ************************************ 00:07:46.913 END TEST accel_comp 00:07:46.913 ************************************ 00:07:47.172 22:59:50 -- accel/accel.sh@109 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:47.172 22:59:50 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:47.172 22:59:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:47.172 22:59:50 -- common/autotest_common.sh@10 -- # set +x 00:07:47.172 ************************************ 00:07:47.172 START TEST accel_decomp 00:07:47.172 ************************************ 00:07:47.172 22:59:50 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:47.172 22:59:50 -- accel/accel.sh@16 -- # local accel_opc 00:07:47.172 22:59:50 -- accel/accel.sh@17 -- # local accel_module 00:07:47.172 22:59:50 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:47.172 22:59:50 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:47.172 22:59:50 -- accel/accel.sh@12 -- # build_accel_config 00:07:47.172 22:59:50 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:47.172 22:59:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:47.172 22:59:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:47.172 22:59:50 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:47.172 22:59:50 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:47.172 22:59:50 -- accel/accel.sh@41 -- # local IFS=, 00:07:47.172 22:59:50 -- accel/accel.sh@42 -- # jq -r . 00:07:47.172 [2024-11-28 22:59:50.558873] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:47.172 [2024-11-28 22:59:50.558956] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2340189 ] 00:07:47.172 EAL: No free 2048 kB hugepages reported on node 1 00:07:47.172 [2024-11-28 22:59:50.622457] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:47.172 [2024-11-28 22:59:50.713777] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:48.546 22:59:51 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:48.546 00:07:48.546 SPDK Configuration: 00:07:48.546 Core mask: 0x1 00:07:48.546 00:07:48.546 Accel Perf Configuration: 00:07:48.546 Workload Type: decompress 00:07:48.546 Transfer size: 4096 bytes 00:07:48.546 Vector count 1 00:07:48.546 Module: software 00:07:48.546 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:48.546 Queue depth: 32 00:07:48.546 Allocate depth: 32 00:07:48.546 # threads/core: 1 00:07:48.546 Run time: 1 seconds 00:07:48.546 Verify: Yes 00:07:48.546 00:07:48.546 Running for 1 seconds... 00:07:48.546 00:07:48.546 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:48.546 ------------------------------------------------------------------------------------ 00:07:48.546 0,0 55296/s 101 MiB/s 0 0 00:07:48.546 ==================================================================================== 00:07:48.546 Total 55296/s 216 MiB/s 0 0' 00:07:48.546 22:59:51 -- accel/accel.sh@20 -- # IFS=: 00:07:48.546 22:59:51 -- accel/accel.sh@20 -- # read -r var val 00:07:48.546 22:59:51 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:48.546 22:59:51 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:48.546 22:59:51 -- accel/accel.sh@12 -- # build_accel_config 00:07:48.546 22:59:51 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:48.546 22:59:51 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:48.546 22:59:51 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:48.546 22:59:51 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:48.546 22:59:51 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:48.546 22:59:51 -- accel/accel.sh@41 -- # local IFS=, 00:07:48.546 22:59:51 -- accel/accel.sh@42 -- # jq -r . 00:07:48.546 [2024-11-28 22:59:51.955232] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:48.546 [2024-11-28 22:59:51.955311] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2340337 ] 00:07:48.546 EAL: No free 2048 kB hugepages reported on node 1 00:07:48.546 [2024-11-28 22:59:52.017115] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:48.546 [2024-11-28 22:59:52.106982] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:48.805 22:59:52 -- accel/accel.sh@21 -- # val= 00:07:48.805 22:59:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.805 22:59:52 -- accel/accel.sh@20 -- # IFS=: 00:07:48.805 22:59:52 -- accel/accel.sh@20 -- # read -r var val 00:07:48.805 22:59:52 -- accel/accel.sh@21 -- # val= 00:07:48.805 22:59:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.805 22:59:52 -- accel/accel.sh@20 -- # IFS=: 00:07:48.805 22:59:52 -- accel/accel.sh@20 -- # read -r var val 00:07:48.805 22:59:52 -- accel/accel.sh@21 -- # val= 00:07:48.805 22:59:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.805 22:59:52 -- accel/accel.sh@20 -- # IFS=: 00:07:48.805 22:59:52 -- accel/accel.sh@20 -- # read -r var val 00:07:48.805 22:59:52 -- accel/accel.sh@21 -- # val=0x1 00:07:48.805 22:59:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.805 22:59:52 -- accel/accel.sh@20 -- # IFS=: 00:07:48.805 22:59:52 -- accel/accel.sh@20 -- # read -r var val 00:07:48.805 22:59:52 -- accel/accel.sh@21 -- # val= 00:07:48.805 22:59:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.805 22:59:52 -- accel/accel.sh@20 -- # IFS=: 00:07:48.805 22:59:52 -- accel/accel.sh@20 -- # read -r var val 00:07:48.805 22:59:52 -- accel/accel.sh@21 -- # val= 00:07:48.805 22:59:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.805 22:59:52 -- accel/accel.sh@20 -- # IFS=: 00:07:48.805 22:59:52 -- accel/accel.sh@20 -- # read -r var val 00:07:48.805 22:59:52 -- accel/accel.sh@21 -- # val=decompress 00:07:48.805 22:59:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.805 22:59:52 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:48.805 22:59:52 -- accel/accel.sh@20 -- # IFS=: 00:07:48.805 22:59:52 -- accel/accel.sh@20 -- # read -r var val 00:07:48.805 22:59:52 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:48.805 22:59:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.805 22:59:52 -- accel/accel.sh@20 -- # IFS=: 00:07:48.805 22:59:52 -- accel/accel.sh@20 -- # read -r var val 00:07:48.805 22:59:52 -- accel/accel.sh@21 -- # val= 00:07:48.805 22:59:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.805 22:59:52 -- accel/accel.sh@20 -- # IFS=: 00:07:48.805 22:59:52 -- accel/accel.sh@20 -- # read -r var val 00:07:48.805 22:59:52 -- accel/accel.sh@21 -- # val=software 00:07:48.805 22:59:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.805 22:59:52 -- accel/accel.sh@23 -- # accel_module=software 00:07:48.805 22:59:52 -- accel/accel.sh@20 -- # IFS=: 00:07:48.805 22:59:52 -- accel/accel.sh@20 -- # read -r var val 00:07:48.805 22:59:52 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:48.805 22:59:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.805 22:59:52 -- accel/accel.sh@20 -- # IFS=: 00:07:48.805 22:59:52 -- accel/accel.sh@20 -- # read -r var val 00:07:48.805 22:59:52 -- accel/accel.sh@21 -- # val=32 00:07:48.805 22:59:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.805 22:59:52 -- accel/accel.sh@20 -- # IFS=: 00:07:48.805 22:59:52 -- accel/accel.sh@20 -- # read -r var val 00:07:48.805 22:59:52 -- accel/accel.sh@21 -- # val=32 00:07:48.805 22:59:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.805 22:59:52 -- accel/accel.sh@20 -- # IFS=: 00:07:48.805 22:59:52 -- accel/accel.sh@20 -- # read -r var val 00:07:48.805 22:59:52 -- accel/accel.sh@21 -- # val=1 00:07:48.805 22:59:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.805 22:59:52 -- accel/accel.sh@20 -- # IFS=: 00:07:48.805 22:59:52 -- accel/accel.sh@20 -- # read -r var val 00:07:48.805 22:59:52 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:48.805 22:59:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.805 22:59:52 -- accel/accel.sh@20 -- # IFS=: 00:07:48.805 22:59:52 -- accel/accel.sh@20 -- # read -r var val 00:07:48.805 22:59:52 -- accel/accel.sh@21 -- # val=Yes 00:07:48.805 22:59:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.805 22:59:52 -- accel/accel.sh@20 -- # IFS=: 00:07:48.805 22:59:52 -- accel/accel.sh@20 -- # read -r var val 00:07:48.805 22:59:52 -- accel/accel.sh@21 -- # val= 00:07:48.805 22:59:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.805 22:59:52 -- accel/accel.sh@20 -- # IFS=: 00:07:48.805 22:59:52 -- accel/accel.sh@20 -- # read -r var val 00:07:48.805 22:59:52 -- accel/accel.sh@21 -- # val= 00:07:48.805 22:59:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.805 22:59:52 -- accel/accel.sh@20 -- # IFS=: 00:07:48.806 22:59:52 -- accel/accel.sh@20 -- # read -r var val 00:07:49.742 22:59:53 -- accel/accel.sh@21 -- # val= 00:07:49.742 22:59:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.742 22:59:53 -- accel/accel.sh@20 -- # IFS=: 00:07:49.742 22:59:53 -- accel/accel.sh@20 -- # read -r var val 00:07:49.742 22:59:53 -- accel/accel.sh@21 -- # val= 00:07:49.742 22:59:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.742 22:59:53 -- accel/accel.sh@20 -- # IFS=: 00:07:49.742 22:59:53 -- accel/accel.sh@20 -- # read -r var val 00:07:49.742 22:59:53 -- accel/accel.sh@21 -- # val= 00:07:49.742 22:59:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.742 22:59:53 -- accel/accel.sh@20 -- # IFS=: 00:07:49.742 22:59:53 -- accel/accel.sh@20 -- # read -r var val 00:07:49.742 22:59:53 -- accel/accel.sh@21 -- # val= 00:07:49.742 22:59:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.742 22:59:53 -- accel/accel.sh@20 -- # IFS=: 00:07:49.742 22:59:53 -- accel/accel.sh@20 -- # read -r var val 00:07:49.742 22:59:53 -- accel/accel.sh@21 -- # val= 00:07:49.742 22:59:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.742 22:59:53 -- accel/accel.sh@20 -- # IFS=: 00:07:49.742 22:59:53 -- accel/accel.sh@20 -- # read -r var val 00:07:49.742 22:59:53 -- accel/accel.sh@21 -- # val= 00:07:49.742 22:59:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.742 22:59:53 -- accel/accel.sh@20 -- # IFS=: 00:07:49.742 22:59:53 -- accel/accel.sh@20 -- # read -r var val 00:07:49.742 22:59:53 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:49.742 22:59:53 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:49.742 22:59:53 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:49.742 00:07:49.742 real 0m2.803s 00:07:49.742 user 0m2.508s 00:07:49.742 sys 0m0.288s 00:07:49.742 22:59:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:49.742 22:59:53 -- common/autotest_common.sh@10 -- # set +x 00:07:49.742 ************************************ 00:07:49.742 END TEST accel_decomp 00:07:49.742 ************************************ 00:07:50.002 22:59:53 -- accel/accel.sh@110 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:50.002 22:59:53 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:50.002 22:59:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:50.002 22:59:53 -- common/autotest_common.sh@10 -- # set +x 00:07:50.002 ************************************ 00:07:50.002 START TEST accel_decmop_full 00:07:50.002 ************************************ 00:07:50.002 22:59:53 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:50.002 22:59:53 -- accel/accel.sh@16 -- # local accel_opc 00:07:50.002 22:59:53 -- accel/accel.sh@17 -- # local accel_module 00:07:50.002 22:59:53 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:50.002 22:59:53 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:50.002 22:59:53 -- accel/accel.sh@12 -- # build_accel_config 00:07:50.002 22:59:53 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:50.002 22:59:53 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:50.002 22:59:53 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:50.002 22:59:53 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:50.002 22:59:53 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:50.002 22:59:53 -- accel/accel.sh@41 -- # local IFS=, 00:07:50.002 22:59:53 -- accel/accel.sh@42 -- # jq -r . 00:07:50.002 [2024-11-28 22:59:53.392119] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:50.002 [2024-11-28 22:59:53.392196] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2340510 ] 00:07:50.002 EAL: No free 2048 kB hugepages reported on node 1 00:07:50.002 [2024-11-28 22:59:53.456117] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:50.002 [2024-11-28 22:59:53.547287] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:51.379 22:59:54 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:51.379 00:07:51.379 SPDK Configuration: 00:07:51.379 Core mask: 0x1 00:07:51.379 00:07:51.379 Accel Perf Configuration: 00:07:51.379 Workload Type: decompress 00:07:51.379 Transfer size: 111250 bytes 00:07:51.379 Vector count 1 00:07:51.379 Module: software 00:07:51.379 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:51.379 Queue depth: 32 00:07:51.379 Allocate depth: 32 00:07:51.379 # threads/core: 1 00:07:51.379 Run time: 1 seconds 00:07:51.379 Verify: Yes 00:07:51.379 00:07:51.379 Running for 1 seconds... 00:07:51.379 00:07:51.379 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:51.379 ------------------------------------------------------------------------------------ 00:07:51.379 0,0 3808/s 157 MiB/s 0 0 00:07:51.379 ==================================================================================== 00:07:51.379 Total 3808/s 404 MiB/s 0 0' 00:07:51.379 22:59:54 -- accel/accel.sh@20 -- # IFS=: 00:07:51.379 22:59:54 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:51.379 22:59:54 -- accel/accel.sh@20 -- # read -r var val 00:07:51.379 22:59:54 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:51.379 22:59:54 -- accel/accel.sh@12 -- # build_accel_config 00:07:51.379 22:59:54 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:51.379 22:59:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:51.379 22:59:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:51.379 22:59:54 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:51.379 22:59:54 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:51.379 22:59:54 -- accel/accel.sh@41 -- # local IFS=, 00:07:51.379 22:59:54 -- accel/accel.sh@42 -- # jq -r . 00:07:51.379 [2024-11-28 22:59:54.811851] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:51.379 [2024-11-28 22:59:54.811936] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2340756 ] 00:07:51.379 EAL: No free 2048 kB hugepages reported on node 1 00:07:51.379 [2024-11-28 22:59:54.874281] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:51.379 [2024-11-28 22:59:54.964460] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:51.639 22:59:55 -- accel/accel.sh@21 -- # val= 00:07:51.639 22:59:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.639 22:59:55 -- accel/accel.sh@20 -- # IFS=: 00:07:51.639 22:59:55 -- accel/accel.sh@20 -- # read -r var val 00:07:51.639 22:59:55 -- accel/accel.sh@21 -- # val= 00:07:51.639 22:59:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.639 22:59:55 -- accel/accel.sh@20 -- # IFS=: 00:07:51.639 22:59:55 -- accel/accel.sh@20 -- # read -r var val 00:07:51.639 22:59:55 -- accel/accel.sh@21 -- # val= 00:07:51.639 22:59:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.639 22:59:55 -- accel/accel.sh@20 -- # IFS=: 00:07:51.639 22:59:55 -- accel/accel.sh@20 -- # read -r var val 00:07:51.639 22:59:55 -- accel/accel.sh@21 -- # val=0x1 00:07:51.639 22:59:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.639 22:59:55 -- accel/accel.sh@20 -- # IFS=: 00:07:51.639 22:59:55 -- accel/accel.sh@20 -- # read -r var val 00:07:51.639 22:59:55 -- accel/accel.sh@21 -- # val= 00:07:51.639 22:59:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.639 22:59:55 -- accel/accel.sh@20 -- # IFS=: 00:07:51.639 22:59:55 -- accel/accel.sh@20 -- # read -r var val 00:07:51.639 22:59:55 -- accel/accel.sh@21 -- # val= 00:07:51.639 22:59:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.639 22:59:55 -- accel/accel.sh@20 -- # IFS=: 00:07:51.639 22:59:55 -- accel/accel.sh@20 -- # read -r var val 00:07:51.639 22:59:55 -- accel/accel.sh@21 -- # val=decompress 00:07:51.639 22:59:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.639 22:59:55 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:51.639 22:59:55 -- accel/accel.sh@20 -- # IFS=: 00:07:51.639 22:59:55 -- accel/accel.sh@20 -- # read -r var val 00:07:51.639 22:59:55 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:51.639 22:59:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.639 22:59:55 -- accel/accel.sh@20 -- # IFS=: 00:07:51.639 22:59:55 -- accel/accel.sh@20 -- # read -r var val 00:07:51.639 22:59:55 -- accel/accel.sh@21 -- # val= 00:07:51.639 22:59:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.639 22:59:55 -- accel/accel.sh@20 -- # IFS=: 00:07:51.639 22:59:55 -- accel/accel.sh@20 -- # read -r var val 00:07:51.639 22:59:55 -- accel/accel.sh@21 -- # val=software 00:07:51.639 22:59:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.639 22:59:55 -- accel/accel.sh@23 -- # accel_module=software 00:07:51.639 22:59:55 -- accel/accel.sh@20 -- # IFS=: 00:07:51.639 22:59:55 -- accel/accel.sh@20 -- # read -r var val 00:07:51.639 22:59:55 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:51.639 22:59:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.639 22:59:55 -- accel/accel.sh@20 -- # IFS=: 00:07:51.639 22:59:55 -- accel/accel.sh@20 -- # read -r var val 00:07:51.639 22:59:55 -- accel/accel.sh@21 -- # val=32 00:07:51.639 22:59:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.639 22:59:55 -- accel/accel.sh@20 -- # IFS=: 00:07:51.639 22:59:55 -- accel/accel.sh@20 -- # read -r var val 00:07:51.639 22:59:55 -- accel/accel.sh@21 -- # val=32 00:07:51.639 22:59:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.639 22:59:55 -- accel/accel.sh@20 -- # IFS=: 00:07:51.639 22:59:55 -- accel/accel.sh@20 -- # read -r var val 00:07:51.639 22:59:55 -- accel/accel.sh@21 -- # val=1 00:07:51.639 22:59:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.639 22:59:55 -- accel/accel.sh@20 -- # IFS=: 00:07:51.639 22:59:55 -- accel/accel.sh@20 -- # read -r var val 00:07:51.639 22:59:55 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:51.639 22:59:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.639 22:59:55 -- accel/accel.sh@20 -- # IFS=: 00:07:51.639 22:59:55 -- accel/accel.sh@20 -- # read -r var val 00:07:51.639 22:59:55 -- accel/accel.sh@21 -- # val=Yes 00:07:51.639 22:59:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.639 22:59:55 -- accel/accel.sh@20 -- # IFS=: 00:07:51.639 22:59:55 -- accel/accel.sh@20 -- # read -r var val 00:07:51.639 22:59:55 -- accel/accel.sh@21 -- # val= 00:07:51.639 22:59:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.639 22:59:55 -- accel/accel.sh@20 -- # IFS=: 00:07:51.639 22:59:55 -- accel/accel.sh@20 -- # read -r var val 00:07:51.639 22:59:55 -- accel/accel.sh@21 -- # val= 00:07:51.639 22:59:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.639 22:59:55 -- accel/accel.sh@20 -- # IFS=: 00:07:51.639 22:59:55 -- accel/accel.sh@20 -- # read -r var val 00:07:53.015 22:59:56 -- accel/accel.sh@21 -- # val= 00:07:53.015 22:59:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.015 22:59:56 -- accel/accel.sh@20 -- # IFS=: 00:07:53.015 22:59:56 -- accel/accel.sh@20 -- # read -r var val 00:07:53.015 22:59:56 -- accel/accel.sh@21 -- # val= 00:07:53.015 22:59:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.015 22:59:56 -- accel/accel.sh@20 -- # IFS=: 00:07:53.015 22:59:56 -- accel/accel.sh@20 -- # read -r var val 00:07:53.015 22:59:56 -- accel/accel.sh@21 -- # val= 00:07:53.015 22:59:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.015 22:59:56 -- accel/accel.sh@20 -- # IFS=: 00:07:53.015 22:59:56 -- accel/accel.sh@20 -- # read -r var val 00:07:53.015 22:59:56 -- accel/accel.sh@21 -- # val= 00:07:53.015 22:59:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.015 22:59:56 -- accel/accel.sh@20 -- # IFS=: 00:07:53.015 22:59:56 -- accel/accel.sh@20 -- # read -r var val 00:07:53.015 22:59:56 -- accel/accel.sh@21 -- # val= 00:07:53.015 22:59:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.015 22:59:56 -- accel/accel.sh@20 -- # IFS=: 00:07:53.015 22:59:56 -- accel/accel.sh@20 -- # read -r var val 00:07:53.015 22:59:56 -- accel/accel.sh@21 -- # val= 00:07:53.015 22:59:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.015 22:59:56 -- accel/accel.sh@20 -- # IFS=: 00:07:53.015 22:59:56 -- accel/accel.sh@20 -- # read -r var val 00:07:53.015 22:59:56 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:53.015 22:59:56 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:53.015 22:59:56 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:53.015 00:07:53.015 real 0m2.839s 00:07:53.015 user 0m2.544s 00:07:53.015 sys 0m0.286s 00:07:53.015 22:59:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:53.015 22:59:56 -- common/autotest_common.sh@10 -- # set +x 00:07:53.015 ************************************ 00:07:53.015 END TEST accel_decmop_full 00:07:53.015 ************************************ 00:07:53.015 22:59:56 -- accel/accel.sh@111 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:53.015 22:59:56 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:53.015 22:59:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:53.015 22:59:56 -- common/autotest_common.sh@10 -- # set +x 00:07:53.015 ************************************ 00:07:53.015 START TEST accel_decomp_mcore 00:07:53.015 ************************************ 00:07:53.015 22:59:56 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:53.015 22:59:56 -- accel/accel.sh@16 -- # local accel_opc 00:07:53.015 22:59:56 -- accel/accel.sh@17 -- # local accel_module 00:07:53.015 22:59:56 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:53.015 22:59:56 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:53.015 22:59:56 -- accel/accel.sh@12 -- # build_accel_config 00:07:53.015 22:59:56 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:53.015 22:59:56 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:53.015 22:59:56 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:53.015 22:59:56 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:53.015 22:59:56 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:53.015 22:59:56 -- accel/accel.sh@41 -- # local IFS=, 00:07:53.015 22:59:56 -- accel/accel.sh@42 -- # jq -r . 00:07:53.015 [2024-11-28 22:59:56.254931] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:53.015 [2024-11-28 22:59:56.255012] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2340909 ] 00:07:53.015 EAL: No free 2048 kB hugepages reported on node 1 00:07:53.015 [2024-11-28 22:59:56.317205] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:53.015 [2024-11-28 22:59:56.409607] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:53.015 [2024-11-28 22:59:56.409628] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:53.015 [2024-11-28 22:59:56.409651] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:53.015 [2024-11-28 22:59:56.409654] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:54.392 22:59:57 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:54.392 00:07:54.392 SPDK Configuration: 00:07:54.392 Core mask: 0xf 00:07:54.392 00:07:54.392 Accel Perf Configuration: 00:07:54.392 Workload Type: decompress 00:07:54.392 Transfer size: 4096 bytes 00:07:54.392 Vector count 1 00:07:54.392 Module: software 00:07:54.392 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:54.392 Queue depth: 32 00:07:54.392 Allocate depth: 32 00:07:54.392 # threads/core: 1 00:07:54.392 Run time: 1 seconds 00:07:54.392 Verify: Yes 00:07:54.392 00:07:54.392 Running for 1 seconds... 00:07:54.393 00:07:54.393 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:54.393 ------------------------------------------------------------------------------------ 00:07:54.393 0,0 56992/s 105 MiB/s 0 0 00:07:54.393 3,0 57600/s 106 MiB/s 0 0 00:07:54.393 2,0 57408/s 105 MiB/s 0 0 00:07:54.393 1,0 57280/s 105 MiB/s 0 0 00:07:54.393 ==================================================================================== 00:07:54.393 Total 229280/s 895 MiB/s 0 0' 00:07:54.393 22:59:57 -- accel/accel.sh@20 -- # IFS=: 00:07:54.393 22:59:57 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:54.393 22:59:57 -- accel/accel.sh@20 -- # read -r var val 00:07:54.393 22:59:57 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:54.393 22:59:57 -- accel/accel.sh@12 -- # build_accel_config 00:07:54.393 22:59:57 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:54.393 22:59:57 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:54.393 22:59:57 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:54.393 22:59:57 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:54.393 22:59:57 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:54.393 22:59:57 -- accel/accel.sh@41 -- # local IFS=, 00:07:54.393 22:59:57 -- accel/accel.sh@42 -- # jq -r . 00:07:54.393 [2024-11-28 22:59:57.655092] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:54.393 [2024-11-28 22:59:57.655171] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2341062 ] 00:07:54.393 EAL: No free 2048 kB hugepages reported on node 1 00:07:54.393 [2024-11-28 22:59:57.717039] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:54.393 [2024-11-28 22:59:57.808229] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:54.393 [2024-11-28 22:59:57.808284] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:54.393 [2024-11-28 22:59:57.808433] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:54.393 [2024-11-28 22:59:57.808414] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:54.393 22:59:57 -- accel/accel.sh@21 -- # val= 00:07:54.393 22:59:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.393 22:59:57 -- accel/accel.sh@20 -- # IFS=: 00:07:54.393 22:59:57 -- accel/accel.sh@20 -- # read -r var val 00:07:54.393 22:59:57 -- accel/accel.sh@21 -- # val= 00:07:54.393 22:59:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.393 22:59:57 -- accel/accel.sh@20 -- # IFS=: 00:07:54.393 22:59:57 -- accel/accel.sh@20 -- # read -r var val 00:07:54.393 22:59:57 -- accel/accel.sh@21 -- # val= 00:07:54.393 22:59:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.393 22:59:57 -- accel/accel.sh@20 -- # IFS=: 00:07:54.393 22:59:57 -- accel/accel.sh@20 -- # read -r var val 00:07:54.393 22:59:57 -- accel/accel.sh@21 -- # val=0xf 00:07:54.393 22:59:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.393 22:59:57 -- accel/accel.sh@20 -- # IFS=: 00:07:54.393 22:59:57 -- accel/accel.sh@20 -- # read -r var val 00:07:54.393 22:59:57 -- accel/accel.sh@21 -- # val= 00:07:54.393 22:59:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.393 22:59:57 -- accel/accel.sh@20 -- # IFS=: 00:07:54.393 22:59:57 -- accel/accel.sh@20 -- # read -r var val 00:07:54.393 22:59:57 -- accel/accel.sh@21 -- # val= 00:07:54.393 22:59:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.393 22:59:57 -- accel/accel.sh@20 -- # IFS=: 00:07:54.393 22:59:57 -- accel/accel.sh@20 -- # read -r var val 00:07:54.393 22:59:57 -- accel/accel.sh@21 -- # val=decompress 00:07:54.393 22:59:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.393 22:59:57 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:54.393 22:59:57 -- accel/accel.sh@20 -- # IFS=: 00:07:54.393 22:59:57 -- accel/accel.sh@20 -- # read -r var val 00:07:54.393 22:59:57 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:54.393 22:59:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.393 22:59:57 -- accel/accel.sh@20 -- # IFS=: 00:07:54.393 22:59:57 -- accel/accel.sh@20 -- # read -r var val 00:07:54.393 22:59:57 -- accel/accel.sh@21 -- # val= 00:07:54.393 22:59:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.393 22:59:57 -- accel/accel.sh@20 -- # IFS=: 00:07:54.393 22:59:57 -- accel/accel.sh@20 -- # read -r var val 00:07:54.393 22:59:57 -- accel/accel.sh@21 -- # val=software 00:07:54.393 22:59:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.393 22:59:57 -- accel/accel.sh@23 -- # accel_module=software 00:07:54.393 22:59:57 -- accel/accel.sh@20 -- # IFS=: 00:07:54.393 22:59:57 -- accel/accel.sh@20 -- # read -r var val 00:07:54.393 22:59:57 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:54.393 22:59:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.393 22:59:57 -- accel/accel.sh@20 -- # IFS=: 00:07:54.393 22:59:57 -- accel/accel.sh@20 -- # read -r var val 00:07:54.393 22:59:57 -- accel/accel.sh@21 -- # val=32 00:07:54.393 22:59:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.393 22:59:57 -- accel/accel.sh@20 -- # IFS=: 00:07:54.393 22:59:57 -- accel/accel.sh@20 -- # read -r var val 00:07:54.393 22:59:57 -- accel/accel.sh@21 -- # val=32 00:07:54.393 22:59:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.393 22:59:57 -- accel/accel.sh@20 -- # IFS=: 00:07:54.393 22:59:57 -- accel/accel.sh@20 -- # read -r var val 00:07:54.393 22:59:57 -- accel/accel.sh@21 -- # val=1 00:07:54.393 22:59:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.393 22:59:57 -- accel/accel.sh@20 -- # IFS=: 00:07:54.393 22:59:57 -- accel/accel.sh@20 -- # read -r var val 00:07:54.393 22:59:57 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:54.393 22:59:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.393 22:59:57 -- accel/accel.sh@20 -- # IFS=: 00:07:54.393 22:59:57 -- accel/accel.sh@20 -- # read -r var val 00:07:54.393 22:59:57 -- accel/accel.sh@21 -- # val=Yes 00:07:54.393 22:59:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.393 22:59:57 -- accel/accel.sh@20 -- # IFS=: 00:07:54.393 22:59:57 -- accel/accel.sh@20 -- # read -r var val 00:07:54.393 22:59:57 -- accel/accel.sh@21 -- # val= 00:07:54.393 22:59:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.393 22:59:57 -- accel/accel.sh@20 -- # IFS=: 00:07:54.393 22:59:57 -- accel/accel.sh@20 -- # read -r var val 00:07:54.393 22:59:57 -- accel/accel.sh@21 -- # val= 00:07:54.393 22:59:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.393 22:59:57 -- accel/accel.sh@20 -- # IFS=: 00:07:54.393 22:59:57 -- accel/accel.sh@20 -- # read -r var val 00:07:55.772 22:59:59 -- accel/accel.sh@21 -- # val= 00:07:55.772 22:59:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:55.772 22:59:59 -- accel/accel.sh@20 -- # IFS=: 00:07:55.772 22:59:59 -- accel/accel.sh@20 -- # read -r var val 00:07:55.772 22:59:59 -- accel/accel.sh@21 -- # val= 00:07:55.772 22:59:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:55.772 22:59:59 -- accel/accel.sh@20 -- # IFS=: 00:07:55.772 22:59:59 -- accel/accel.sh@20 -- # read -r var val 00:07:55.772 22:59:59 -- accel/accel.sh@21 -- # val= 00:07:55.772 22:59:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:55.772 22:59:59 -- accel/accel.sh@20 -- # IFS=: 00:07:55.772 22:59:59 -- accel/accel.sh@20 -- # read -r var val 00:07:55.772 22:59:59 -- accel/accel.sh@21 -- # val= 00:07:55.772 22:59:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:55.772 22:59:59 -- accel/accel.sh@20 -- # IFS=: 00:07:55.772 22:59:59 -- accel/accel.sh@20 -- # read -r var val 00:07:55.772 22:59:59 -- accel/accel.sh@21 -- # val= 00:07:55.772 22:59:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:55.772 22:59:59 -- accel/accel.sh@20 -- # IFS=: 00:07:55.772 22:59:59 -- accel/accel.sh@20 -- # read -r var val 00:07:55.772 22:59:59 -- accel/accel.sh@21 -- # val= 00:07:55.772 22:59:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:55.772 22:59:59 -- accel/accel.sh@20 -- # IFS=: 00:07:55.772 22:59:59 -- accel/accel.sh@20 -- # read -r var val 00:07:55.772 22:59:59 -- accel/accel.sh@21 -- # val= 00:07:55.772 22:59:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:55.772 22:59:59 -- accel/accel.sh@20 -- # IFS=: 00:07:55.772 22:59:59 -- accel/accel.sh@20 -- # read -r var val 00:07:55.772 22:59:59 -- accel/accel.sh@21 -- # val= 00:07:55.772 22:59:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:55.772 22:59:59 -- accel/accel.sh@20 -- # IFS=: 00:07:55.772 22:59:59 -- accel/accel.sh@20 -- # read -r var val 00:07:55.772 22:59:59 -- accel/accel.sh@21 -- # val= 00:07:55.772 22:59:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:55.772 22:59:59 -- accel/accel.sh@20 -- # IFS=: 00:07:55.772 22:59:59 -- accel/accel.sh@20 -- # read -r var val 00:07:55.772 22:59:59 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:55.772 22:59:59 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:55.772 22:59:59 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:55.772 00:07:55.772 real 0m2.808s 00:07:55.772 user 0m9.352s 00:07:55.772 sys 0m0.301s 00:07:55.772 22:59:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:55.772 22:59:59 -- common/autotest_common.sh@10 -- # set +x 00:07:55.772 ************************************ 00:07:55.772 END TEST accel_decomp_mcore 00:07:55.772 ************************************ 00:07:55.772 22:59:59 -- accel/accel.sh@112 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:55.772 22:59:59 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:07:55.772 22:59:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:55.772 22:59:59 -- common/autotest_common.sh@10 -- # set +x 00:07:55.772 ************************************ 00:07:55.772 START TEST accel_decomp_full_mcore 00:07:55.772 ************************************ 00:07:55.772 22:59:59 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:55.772 22:59:59 -- accel/accel.sh@16 -- # local accel_opc 00:07:55.772 22:59:59 -- accel/accel.sh@17 -- # local accel_module 00:07:55.772 22:59:59 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:55.772 22:59:59 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:55.772 22:59:59 -- accel/accel.sh@12 -- # build_accel_config 00:07:55.772 22:59:59 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:55.772 22:59:59 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:55.772 22:59:59 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:55.772 22:59:59 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:55.772 22:59:59 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:55.772 22:59:59 -- accel/accel.sh@41 -- # local IFS=, 00:07:55.772 22:59:59 -- accel/accel.sh@42 -- # jq -r . 00:07:55.772 [2024-11-28 22:59:59.086919] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:55.772 [2024-11-28 22:59:59.087003] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2341247 ] 00:07:55.772 EAL: No free 2048 kB hugepages reported on node 1 00:07:55.772 [2024-11-28 22:59:59.150741] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:55.772 [2024-11-28 22:59:59.244750] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:55.772 [2024-11-28 22:59:59.244796] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:55.772 [2024-11-28 22:59:59.244916] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:55.772 [2024-11-28 22:59:59.244919] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:57.149 23:00:00 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:57.149 00:07:57.149 SPDK Configuration: 00:07:57.149 Core mask: 0xf 00:07:57.149 00:07:57.149 Accel Perf Configuration: 00:07:57.149 Workload Type: decompress 00:07:57.149 Transfer size: 111250 bytes 00:07:57.149 Vector count 1 00:07:57.149 Module: software 00:07:57.149 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:57.149 Queue depth: 32 00:07:57.149 Allocate depth: 32 00:07:57.149 # threads/core: 1 00:07:57.149 Run time: 1 seconds 00:07:57.149 Verify: Yes 00:07:57.149 00:07:57.149 Running for 1 seconds... 00:07:57.149 00:07:57.149 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:57.149 ------------------------------------------------------------------------------------ 00:07:57.149 0,0 4224/s 174 MiB/s 0 0 00:07:57.149 3,0 4224/s 174 MiB/s 0 0 00:07:57.149 2,0 4224/s 174 MiB/s 0 0 00:07:57.149 1,0 4256/s 175 MiB/s 0 0 00:07:57.149 ==================================================================================== 00:07:57.149 Total 16928/s 1795 MiB/s 0 0' 00:07:57.149 23:00:00 -- accel/accel.sh@20 -- # IFS=: 00:07:57.149 23:00:00 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:57.149 23:00:00 -- accel/accel.sh@20 -- # read -r var val 00:07:57.149 23:00:00 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:57.149 23:00:00 -- accel/accel.sh@12 -- # build_accel_config 00:07:57.149 23:00:00 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:57.149 23:00:00 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:57.149 23:00:00 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:57.149 23:00:00 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:57.149 23:00:00 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:57.149 23:00:00 -- accel/accel.sh@41 -- # local IFS=, 00:07:57.149 23:00:00 -- accel/accel.sh@42 -- # jq -r . 00:07:57.149 [2024-11-28 23:00:00.509149] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:57.149 [2024-11-28 23:00:00.509236] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2341527 ] 00:07:57.149 EAL: No free 2048 kB hugepages reported on node 1 00:07:57.149 [2024-11-28 23:00:00.571546] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:57.149 [2024-11-28 23:00:00.668406] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:57.149 [2024-11-28 23:00:00.668471] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:57.149 [2024-11-28 23:00:00.668509] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:57.149 [2024-11-28 23:00:00.668513] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:57.149 23:00:00 -- accel/accel.sh@21 -- # val= 00:07:57.149 23:00:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:57.149 23:00:00 -- accel/accel.sh@20 -- # IFS=: 00:07:57.149 23:00:00 -- accel/accel.sh@20 -- # read -r var val 00:07:57.149 23:00:00 -- accel/accel.sh@21 -- # val= 00:07:57.149 23:00:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:57.149 23:00:00 -- accel/accel.sh@20 -- # IFS=: 00:07:57.149 23:00:00 -- accel/accel.sh@20 -- # read -r var val 00:07:57.150 23:00:00 -- accel/accel.sh@21 -- # val= 00:07:57.150 23:00:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:57.150 23:00:00 -- accel/accel.sh@20 -- # IFS=: 00:07:57.150 23:00:00 -- accel/accel.sh@20 -- # read -r var val 00:07:57.150 23:00:00 -- accel/accel.sh@21 -- # val=0xf 00:07:57.150 23:00:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:57.150 23:00:00 -- accel/accel.sh@20 -- # IFS=: 00:07:57.150 23:00:00 -- accel/accel.sh@20 -- # read -r var val 00:07:57.150 23:00:00 -- accel/accel.sh@21 -- # val= 00:07:57.150 23:00:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:57.150 23:00:00 -- accel/accel.sh@20 -- # IFS=: 00:07:57.150 23:00:00 -- accel/accel.sh@20 -- # read -r var val 00:07:57.150 23:00:00 -- accel/accel.sh@21 -- # val= 00:07:57.150 23:00:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:57.150 23:00:00 -- accel/accel.sh@20 -- # IFS=: 00:07:57.150 23:00:00 -- accel/accel.sh@20 -- # read -r var val 00:07:57.150 23:00:00 -- accel/accel.sh@21 -- # val=decompress 00:07:57.150 23:00:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:57.150 23:00:00 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:57.150 23:00:00 -- accel/accel.sh@20 -- # IFS=: 00:07:57.150 23:00:00 -- accel/accel.sh@20 -- # read -r var val 00:07:57.150 23:00:00 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:57.150 23:00:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:57.150 23:00:00 -- accel/accel.sh@20 -- # IFS=: 00:07:57.150 23:00:00 -- accel/accel.sh@20 -- # read -r var val 00:07:57.150 23:00:00 -- accel/accel.sh@21 -- # val= 00:07:57.150 23:00:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:57.150 23:00:00 -- accel/accel.sh@20 -- # IFS=: 00:07:57.150 23:00:00 -- accel/accel.sh@20 -- # read -r var val 00:07:57.150 23:00:00 -- accel/accel.sh@21 -- # val=software 00:07:57.150 23:00:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:57.150 23:00:00 -- accel/accel.sh@23 -- # accel_module=software 00:07:57.150 23:00:00 -- accel/accel.sh@20 -- # IFS=: 00:07:57.150 23:00:00 -- accel/accel.sh@20 -- # read -r var val 00:07:57.150 23:00:00 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:57.150 23:00:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:57.150 23:00:00 -- accel/accel.sh@20 -- # IFS=: 00:07:57.150 23:00:00 -- accel/accel.sh@20 -- # read -r var val 00:07:57.150 23:00:00 -- accel/accel.sh@21 -- # val=32 00:07:57.150 23:00:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:57.150 23:00:00 -- accel/accel.sh@20 -- # IFS=: 00:07:57.150 23:00:00 -- accel/accel.sh@20 -- # read -r var val 00:07:57.150 23:00:00 -- accel/accel.sh@21 -- # val=32 00:07:57.150 23:00:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:57.150 23:00:00 -- accel/accel.sh@20 -- # IFS=: 00:07:57.150 23:00:00 -- accel/accel.sh@20 -- # read -r var val 00:07:57.150 23:00:00 -- accel/accel.sh@21 -- # val=1 00:07:57.150 23:00:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:57.150 23:00:00 -- accel/accel.sh@20 -- # IFS=: 00:07:57.150 23:00:00 -- accel/accel.sh@20 -- # read -r var val 00:07:57.150 23:00:00 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:57.150 23:00:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:57.150 23:00:00 -- accel/accel.sh@20 -- # IFS=: 00:07:57.150 23:00:00 -- accel/accel.sh@20 -- # read -r var val 00:07:57.150 23:00:00 -- accel/accel.sh@21 -- # val=Yes 00:07:57.150 23:00:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:57.150 23:00:00 -- accel/accel.sh@20 -- # IFS=: 00:07:57.150 23:00:00 -- accel/accel.sh@20 -- # read -r var val 00:07:57.150 23:00:00 -- accel/accel.sh@21 -- # val= 00:07:57.150 23:00:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:57.150 23:00:00 -- accel/accel.sh@20 -- # IFS=: 00:07:57.150 23:00:00 -- accel/accel.sh@20 -- # read -r var val 00:07:57.150 23:00:00 -- accel/accel.sh@21 -- # val= 00:07:57.150 23:00:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:57.150 23:00:00 -- accel/accel.sh@20 -- # IFS=: 00:07:57.150 23:00:00 -- accel/accel.sh@20 -- # read -r var val 00:07:58.527 23:00:01 -- accel/accel.sh@21 -- # val= 00:07:58.527 23:00:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.527 23:00:01 -- accel/accel.sh@20 -- # IFS=: 00:07:58.527 23:00:01 -- accel/accel.sh@20 -- # read -r var val 00:07:58.527 23:00:01 -- accel/accel.sh@21 -- # val= 00:07:58.527 23:00:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.527 23:00:01 -- accel/accel.sh@20 -- # IFS=: 00:07:58.527 23:00:01 -- accel/accel.sh@20 -- # read -r var val 00:07:58.527 23:00:01 -- accel/accel.sh@21 -- # val= 00:07:58.527 23:00:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.527 23:00:01 -- accel/accel.sh@20 -- # IFS=: 00:07:58.527 23:00:01 -- accel/accel.sh@20 -- # read -r var val 00:07:58.527 23:00:01 -- accel/accel.sh@21 -- # val= 00:07:58.527 23:00:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.527 23:00:01 -- accel/accel.sh@20 -- # IFS=: 00:07:58.527 23:00:01 -- accel/accel.sh@20 -- # read -r var val 00:07:58.527 23:00:01 -- accel/accel.sh@21 -- # val= 00:07:58.527 23:00:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.527 23:00:01 -- accel/accel.sh@20 -- # IFS=: 00:07:58.527 23:00:01 -- accel/accel.sh@20 -- # read -r var val 00:07:58.527 23:00:01 -- accel/accel.sh@21 -- # val= 00:07:58.527 23:00:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.527 23:00:01 -- accel/accel.sh@20 -- # IFS=: 00:07:58.527 23:00:01 -- accel/accel.sh@20 -- # read -r var val 00:07:58.527 23:00:01 -- accel/accel.sh@21 -- # val= 00:07:58.527 23:00:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.527 23:00:01 -- accel/accel.sh@20 -- # IFS=: 00:07:58.527 23:00:01 -- accel/accel.sh@20 -- # read -r var val 00:07:58.527 23:00:01 -- accel/accel.sh@21 -- # val= 00:07:58.527 23:00:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.527 23:00:01 -- accel/accel.sh@20 -- # IFS=: 00:07:58.527 23:00:01 -- accel/accel.sh@20 -- # read -r var val 00:07:58.527 23:00:01 -- accel/accel.sh@21 -- # val= 00:07:58.527 23:00:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.527 23:00:01 -- accel/accel.sh@20 -- # IFS=: 00:07:58.527 23:00:01 -- accel/accel.sh@20 -- # read -r var val 00:07:58.527 23:00:01 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:58.527 23:00:01 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:58.527 23:00:01 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:58.527 00:07:58.527 real 0m2.849s 00:07:58.527 user 0m9.497s 00:07:58.527 sys 0m0.310s 00:07:58.527 23:00:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:58.528 23:00:01 -- common/autotest_common.sh@10 -- # set +x 00:07:58.528 ************************************ 00:07:58.528 END TEST accel_decomp_full_mcore 00:07:58.528 ************************************ 00:07:58.528 23:00:01 -- accel/accel.sh@113 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:58.528 23:00:01 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:58.528 23:00:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:58.528 23:00:01 -- common/autotest_common.sh@10 -- # set +x 00:07:58.528 ************************************ 00:07:58.528 START TEST accel_decomp_mthread 00:07:58.528 ************************************ 00:07:58.528 23:00:01 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:58.528 23:00:01 -- accel/accel.sh@16 -- # local accel_opc 00:07:58.528 23:00:01 -- accel/accel.sh@17 -- # local accel_module 00:07:58.528 23:00:01 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:58.528 23:00:01 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:58.528 23:00:01 -- accel/accel.sh@12 -- # build_accel_config 00:07:58.528 23:00:01 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:58.528 23:00:01 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:58.528 23:00:01 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:58.528 23:00:01 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:58.528 23:00:01 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:58.528 23:00:01 -- accel/accel.sh@41 -- # local IFS=, 00:07:58.528 23:00:01 -- accel/accel.sh@42 -- # jq -r . 00:07:58.528 [2024-11-28 23:00:01.968843] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:58.528 [2024-11-28 23:00:01.968945] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2341761 ] 00:07:58.528 EAL: No free 2048 kB hugepages reported on node 1 00:07:58.528 [2024-11-28 23:00:02.030152] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:58.528 [2024-11-28 23:00:02.121027] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:59.903 23:00:03 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:59.903 00:07:59.903 SPDK Configuration: 00:07:59.903 Core mask: 0x1 00:07:59.903 00:07:59.903 Accel Perf Configuration: 00:07:59.903 Workload Type: decompress 00:07:59.903 Transfer size: 4096 bytes 00:07:59.903 Vector count 1 00:07:59.903 Module: software 00:07:59.903 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:59.903 Queue depth: 32 00:07:59.903 Allocate depth: 32 00:07:59.903 # threads/core: 2 00:07:59.903 Run time: 1 seconds 00:07:59.903 Verify: Yes 00:07:59.903 00:07:59.903 Running for 1 seconds... 00:07:59.903 00:07:59.903 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:59.903 ------------------------------------------------------------------------------------ 00:07:59.904 0,1 28032/s 51 MiB/s 0 0 00:07:59.904 0,0 27904/s 51 MiB/s 0 0 00:07:59.904 ==================================================================================== 00:07:59.904 Total 55936/s 218 MiB/s 0 0' 00:07:59.904 23:00:03 -- accel/accel.sh@20 -- # IFS=: 00:07:59.904 23:00:03 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:59.904 23:00:03 -- accel/accel.sh@20 -- # read -r var val 00:07:59.904 23:00:03 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:59.904 23:00:03 -- accel/accel.sh@12 -- # build_accel_config 00:07:59.904 23:00:03 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:59.904 23:00:03 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:59.904 23:00:03 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:59.904 23:00:03 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:59.904 23:00:03 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:59.904 23:00:03 -- accel/accel.sh@41 -- # local IFS=, 00:07:59.904 23:00:03 -- accel/accel.sh@42 -- # jq -r . 00:07:59.904 [2024-11-28 23:00:03.381952] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:59.904 [2024-11-28 23:00:03.382034] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2341903 ] 00:07:59.904 EAL: No free 2048 kB hugepages reported on node 1 00:07:59.904 [2024-11-28 23:00:03.440342] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:00.162 [2024-11-28 23:00:03.528709] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:00.162 23:00:03 -- accel/accel.sh@21 -- # val= 00:08:00.162 23:00:03 -- accel/accel.sh@22 -- # case "$var" in 00:08:00.162 23:00:03 -- accel/accel.sh@20 -- # IFS=: 00:08:00.162 23:00:03 -- accel/accel.sh@20 -- # read -r var val 00:08:00.162 23:00:03 -- accel/accel.sh@21 -- # val= 00:08:00.162 23:00:03 -- accel/accel.sh@22 -- # case "$var" in 00:08:00.162 23:00:03 -- accel/accel.sh@20 -- # IFS=: 00:08:00.162 23:00:03 -- accel/accel.sh@20 -- # read -r var val 00:08:00.162 23:00:03 -- accel/accel.sh@21 -- # val= 00:08:00.162 23:00:03 -- accel/accel.sh@22 -- # case "$var" in 00:08:00.162 23:00:03 -- accel/accel.sh@20 -- # IFS=: 00:08:00.162 23:00:03 -- accel/accel.sh@20 -- # read -r var val 00:08:00.162 23:00:03 -- accel/accel.sh@21 -- # val=0x1 00:08:00.162 23:00:03 -- accel/accel.sh@22 -- # case "$var" in 00:08:00.162 23:00:03 -- accel/accel.sh@20 -- # IFS=: 00:08:00.162 23:00:03 -- accel/accel.sh@20 -- # read -r var val 00:08:00.162 23:00:03 -- accel/accel.sh@21 -- # val= 00:08:00.162 23:00:03 -- accel/accel.sh@22 -- # case "$var" in 00:08:00.162 23:00:03 -- accel/accel.sh@20 -- # IFS=: 00:08:00.162 23:00:03 -- accel/accel.sh@20 -- # read -r var val 00:08:00.162 23:00:03 -- accel/accel.sh@21 -- # val= 00:08:00.162 23:00:03 -- accel/accel.sh@22 -- # case "$var" in 00:08:00.162 23:00:03 -- accel/accel.sh@20 -- # IFS=: 00:08:00.162 23:00:03 -- accel/accel.sh@20 -- # read -r var val 00:08:00.162 23:00:03 -- accel/accel.sh@21 -- # val=decompress 00:08:00.162 23:00:03 -- accel/accel.sh@22 -- # case "$var" in 00:08:00.162 23:00:03 -- accel/accel.sh@24 -- # accel_opc=decompress 00:08:00.162 23:00:03 -- accel/accel.sh@20 -- # IFS=: 00:08:00.162 23:00:03 -- accel/accel.sh@20 -- # read -r var val 00:08:00.162 23:00:03 -- accel/accel.sh@21 -- # val='4096 bytes' 00:08:00.162 23:00:03 -- accel/accel.sh@22 -- # case "$var" in 00:08:00.162 23:00:03 -- accel/accel.sh@20 -- # IFS=: 00:08:00.163 23:00:03 -- accel/accel.sh@20 -- # read -r var val 00:08:00.163 23:00:03 -- accel/accel.sh@21 -- # val= 00:08:00.163 23:00:03 -- accel/accel.sh@22 -- # case "$var" in 00:08:00.163 23:00:03 -- accel/accel.sh@20 -- # IFS=: 00:08:00.163 23:00:03 -- accel/accel.sh@20 -- # read -r var val 00:08:00.163 23:00:03 -- accel/accel.sh@21 -- # val=software 00:08:00.163 23:00:03 -- accel/accel.sh@22 -- # case "$var" in 00:08:00.163 23:00:03 -- accel/accel.sh@23 -- # accel_module=software 00:08:00.163 23:00:03 -- accel/accel.sh@20 -- # IFS=: 00:08:00.163 23:00:03 -- accel/accel.sh@20 -- # read -r var val 00:08:00.163 23:00:03 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:08:00.163 23:00:03 -- accel/accel.sh@22 -- # case "$var" in 00:08:00.163 23:00:03 -- accel/accel.sh@20 -- # IFS=: 00:08:00.163 23:00:03 -- accel/accel.sh@20 -- # read -r var val 00:08:00.163 23:00:03 -- accel/accel.sh@21 -- # val=32 00:08:00.163 23:00:03 -- accel/accel.sh@22 -- # case "$var" in 00:08:00.163 23:00:03 -- accel/accel.sh@20 -- # IFS=: 00:08:00.163 23:00:03 -- accel/accel.sh@20 -- # read -r var val 00:08:00.163 23:00:03 -- accel/accel.sh@21 -- # val=32 00:08:00.163 23:00:03 -- accel/accel.sh@22 -- # case "$var" in 00:08:00.163 23:00:03 -- accel/accel.sh@20 -- # IFS=: 00:08:00.163 23:00:03 -- accel/accel.sh@20 -- # read -r var val 00:08:00.163 23:00:03 -- accel/accel.sh@21 -- # val=2 00:08:00.163 23:00:03 -- accel/accel.sh@22 -- # case "$var" in 00:08:00.163 23:00:03 -- accel/accel.sh@20 -- # IFS=: 00:08:00.163 23:00:03 -- accel/accel.sh@20 -- # read -r var val 00:08:00.163 23:00:03 -- accel/accel.sh@21 -- # val='1 seconds' 00:08:00.163 23:00:03 -- accel/accel.sh@22 -- # case "$var" in 00:08:00.163 23:00:03 -- accel/accel.sh@20 -- # IFS=: 00:08:00.163 23:00:03 -- accel/accel.sh@20 -- # read -r var val 00:08:00.163 23:00:03 -- accel/accel.sh@21 -- # val=Yes 00:08:00.163 23:00:03 -- accel/accel.sh@22 -- # case "$var" in 00:08:00.163 23:00:03 -- accel/accel.sh@20 -- # IFS=: 00:08:00.163 23:00:03 -- accel/accel.sh@20 -- # read -r var val 00:08:00.163 23:00:03 -- accel/accel.sh@21 -- # val= 00:08:00.163 23:00:03 -- accel/accel.sh@22 -- # case "$var" in 00:08:00.163 23:00:03 -- accel/accel.sh@20 -- # IFS=: 00:08:00.163 23:00:03 -- accel/accel.sh@20 -- # read -r var val 00:08:00.163 23:00:03 -- accel/accel.sh@21 -- # val= 00:08:00.163 23:00:03 -- accel/accel.sh@22 -- # case "$var" in 00:08:00.163 23:00:03 -- accel/accel.sh@20 -- # IFS=: 00:08:00.163 23:00:03 -- accel/accel.sh@20 -- # read -r var val 00:08:01.538 23:00:04 -- accel/accel.sh@21 -- # val= 00:08:01.538 23:00:04 -- accel/accel.sh@22 -- # case "$var" in 00:08:01.538 23:00:04 -- accel/accel.sh@20 -- # IFS=: 00:08:01.538 23:00:04 -- accel/accel.sh@20 -- # read -r var val 00:08:01.538 23:00:04 -- accel/accel.sh@21 -- # val= 00:08:01.538 23:00:04 -- accel/accel.sh@22 -- # case "$var" in 00:08:01.538 23:00:04 -- accel/accel.sh@20 -- # IFS=: 00:08:01.538 23:00:04 -- accel/accel.sh@20 -- # read -r var val 00:08:01.538 23:00:04 -- accel/accel.sh@21 -- # val= 00:08:01.538 23:00:04 -- accel/accel.sh@22 -- # case "$var" in 00:08:01.538 23:00:04 -- accel/accel.sh@20 -- # IFS=: 00:08:01.538 23:00:04 -- accel/accel.sh@20 -- # read -r var val 00:08:01.538 23:00:04 -- accel/accel.sh@21 -- # val= 00:08:01.538 23:00:04 -- accel/accel.sh@22 -- # case "$var" in 00:08:01.538 23:00:04 -- accel/accel.sh@20 -- # IFS=: 00:08:01.538 23:00:04 -- accel/accel.sh@20 -- # read -r var val 00:08:01.538 23:00:04 -- accel/accel.sh@21 -- # val= 00:08:01.538 23:00:04 -- accel/accel.sh@22 -- # case "$var" in 00:08:01.538 23:00:04 -- accel/accel.sh@20 -- # IFS=: 00:08:01.538 23:00:04 -- accel/accel.sh@20 -- # read -r var val 00:08:01.538 23:00:04 -- accel/accel.sh@21 -- # val= 00:08:01.538 23:00:04 -- accel/accel.sh@22 -- # case "$var" in 00:08:01.538 23:00:04 -- accel/accel.sh@20 -- # IFS=: 00:08:01.538 23:00:04 -- accel/accel.sh@20 -- # read -r var val 00:08:01.538 23:00:04 -- accel/accel.sh@21 -- # val= 00:08:01.538 23:00:04 -- accel/accel.sh@22 -- # case "$var" in 00:08:01.538 23:00:04 -- accel/accel.sh@20 -- # IFS=: 00:08:01.538 23:00:04 -- accel/accel.sh@20 -- # read -r var val 00:08:01.538 23:00:04 -- accel/accel.sh@28 -- # [[ -n software ]] 00:08:01.538 23:00:04 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:08:01.538 23:00:04 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:08:01.538 00:08:01.538 real 0m2.801s 00:08:01.538 user 0m2.512s 00:08:01.538 sys 0m0.280s 00:08:01.538 23:00:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:01.538 23:00:04 -- common/autotest_common.sh@10 -- # set +x 00:08:01.538 ************************************ 00:08:01.538 END TEST accel_decomp_mthread 00:08:01.538 ************************************ 00:08:01.538 23:00:04 -- accel/accel.sh@114 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:08:01.538 23:00:04 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:08:01.538 23:00:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:01.538 23:00:04 -- common/autotest_common.sh@10 -- # set +x 00:08:01.538 ************************************ 00:08:01.538 START TEST accel_deomp_full_mthread 00:08:01.538 ************************************ 00:08:01.538 23:00:04 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:08:01.538 23:00:04 -- accel/accel.sh@16 -- # local accel_opc 00:08:01.538 23:00:04 -- accel/accel.sh@17 -- # local accel_module 00:08:01.538 23:00:04 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:08:01.538 23:00:04 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:08:01.538 23:00:04 -- accel/accel.sh@12 -- # build_accel_config 00:08:01.538 23:00:04 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:08:01.538 23:00:04 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:01.538 23:00:04 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:01.538 23:00:04 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:08:01.538 23:00:04 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:08:01.538 23:00:04 -- accel/accel.sh@41 -- # local IFS=, 00:08:01.538 23:00:04 -- accel/accel.sh@42 -- # jq -r . 00:08:01.538 [2024-11-28 23:00:04.797191] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:08:01.538 [2024-11-28 23:00:04.797281] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2342159 ] 00:08:01.538 EAL: No free 2048 kB hugepages reported on node 1 00:08:01.538 [2024-11-28 23:00:04.859923] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:01.538 [2024-11-28 23:00:04.950574] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:02.911 23:00:06 -- accel/accel.sh@18 -- # out='Preparing input file... 00:08:02.911 00:08:02.911 SPDK Configuration: 00:08:02.911 Core mask: 0x1 00:08:02.911 00:08:02.911 Accel Perf Configuration: 00:08:02.911 Workload Type: decompress 00:08:02.911 Transfer size: 111250 bytes 00:08:02.911 Vector count 1 00:08:02.911 Module: software 00:08:02.911 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:08:02.911 Queue depth: 32 00:08:02.911 Allocate depth: 32 00:08:02.911 # threads/core: 2 00:08:02.911 Run time: 1 seconds 00:08:02.911 Verify: Yes 00:08:02.911 00:08:02.911 Running for 1 seconds... 00:08:02.911 00:08:02.911 Core,Thread Transfers Bandwidth Failed Miscompares 00:08:02.911 ------------------------------------------------------------------------------------ 00:08:02.911 0,1 1952/s 80 MiB/s 0 0 00:08:02.911 0,0 1920/s 79 MiB/s 0 0 00:08:02.911 ==================================================================================== 00:08:02.911 Total 3872/s 410 MiB/s 0 0' 00:08:02.911 23:00:06 -- accel/accel.sh@20 -- # IFS=: 00:08:02.911 23:00:06 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:08:02.911 23:00:06 -- accel/accel.sh@20 -- # read -r var val 00:08:02.911 23:00:06 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:08:02.911 23:00:06 -- accel/accel.sh@12 -- # build_accel_config 00:08:02.911 23:00:06 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:08:02.911 23:00:06 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:02.911 23:00:06 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:02.911 23:00:06 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:08:02.911 23:00:06 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:08:02.911 23:00:06 -- accel/accel.sh@41 -- # local IFS=, 00:08:02.911 23:00:06 -- accel/accel.sh@42 -- # jq -r . 00:08:02.911 [2024-11-28 23:00:06.247351] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:08:02.911 [2024-11-28 23:00:06.247446] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2342329 ] 00:08:02.911 EAL: No free 2048 kB hugepages reported on node 1 00:08:02.911 [2024-11-28 23:00:06.308108] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:02.911 [2024-11-28 23:00:06.398779] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:02.911 23:00:06 -- accel/accel.sh@21 -- # val= 00:08:02.911 23:00:06 -- accel/accel.sh@22 -- # case "$var" in 00:08:02.911 23:00:06 -- accel/accel.sh@20 -- # IFS=: 00:08:02.911 23:00:06 -- accel/accel.sh@20 -- # read -r var val 00:08:02.911 23:00:06 -- accel/accel.sh@21 -- # val= 00:08:02.911 23:00:06 -- accel/accel.sh@22 -- # case "$var" in 00:08:02.911 23:00:06 -- accel/accel.sh@20 -- # IFS=: 00:08:02.911 23:00:06 -- accel/accel.sh@20 -- # read -r var val 00:08:02.911 23:00:06 -- accel/accel.sh@21 -- # val= 00:08:02.911 23:00:06 -- accel/accel.sh@22 -- # case "$var" in 00:08:02.911 23:00:06 -- accel/accel.sh@20 -- # IFS=: 00:08:02.911 23:00:06 -- accel/accel.sh@20 -- # read -r var val 00:08:02.911 23:00:06 -- accel/accel.sh@21 -- # val=0x1 00:08:02.911 23:00:06 -- accel/accel.sh@22 -- # case "$var" in 00:08:02.911 23:00:06 -- accel/accel.sh@20 -- # IFS=: 00:08:02.911 23:00:06 -- accel/accel.sh@20 -- # read -r var val 00:08:02.911 23:00:06 -- accel/accel.sh@21 -- # val= 00:08:02.911 23:00:06 -- accel/accel.sh@22 -- # case "$var" in 00:08:02.911 23:00:06 -- accel/accel.sh@20 -- # IFS=: 00:08:02.911 23:00:06 -- accel/accel.sh@20 -- # read -r var val 00:08:02.911 23:00:06 -- accel/accel.sh@21 -- # val= 00:08:02.911 23:00:06 -- accel/accel.sh@22 -- # case "$var" in 00:08:02.911 23:00:06 -- accel/accel.sh@20 -- # IFS=: 00:08:02.911 23:00:06 -- accel/accel.sh@20 -- # read -r var val 00:08:02.911 23:00:06 -- accel/accel.sh@21 -- # val=decompress 00:08:02.911 23:00:06 -- accel/accel.sh@22 -- # case "$var" in 00:08:02.911 23:00:06 -- accel/accel.sh@24 -- # accel_opc=decompress 00:08:02.911 23:00:06 -- accel/accel.sh@20 -- # IFS=: 00:08:02.911 23:00:06 -- accel/accel.sh@20 -- # read -r var val 00:08:02.911 23:00:06 -- accel/accel.sh@21 -- # val='111250 bytes' 00:08:02.911 23:00:06 -- accel/accel.sh@22 -- # case "$var" in 00:08:02.911 23:00:06 -- accel/accel.sh@20 -- # IFS=: 00:08:02.911 23:00:06 -- accel/accel.sh@20 -- # read -r var val 00:08:02.911 23:00:06 -- accel/accel.sh@21 -- # val= 00:08:02.911 23:00:06 -- accel/accel.sh@22 -- # case "$var" in 00:08:02.911 23:00:06 -- accel/accel.sh@20 -- # IFS=: 00:08:02.911 23:00:06 -- accel/accel.sh@20 -- # read -r var val 00:08:02.911 23:00:06 -- accel/accel.sh@21 -- # val=software 00:08:02.911 23:00:06 -- accel/accel.sh@22 -- # case "$var" in 00:08:02.911 23:00:06 -- accel/accel.sh@23 -- # accel_module=software 00:08:02.911 23:00:06 -- accel/accel.sh@20 -- # IFS=: 00:08:02.911 23:00:06 -- accel/accel.sh@20 -- # read -r var val 00:08:02.911 23:00:06 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:08:02.911 23:00:06 -- accel/accel.sh@22 -- # case "$var" in 00:08:02.911 23:00:06 -- accel/accel.sh@20 -- # IFS=: 00:08:02.911 23:00:06 -- accel/accel.sh@20 -- # read -r var val 00:08:02.911 23:00:06 -- accel/accel.sh@21 -- # val=32 00:08:02.911 23:00:06 -- accel/accel.sh@22 -- # case "$var" in 00:08:02.911 23:00:06 -- accel/accel.sh@20 -- # IFS=: 00:08:02.911 23:00:06 -- accel/accel.sh@20 -- # read -r var val 00:08:02.911 23:00:06 -- accel/accel.sh@21 -- # val=32 00:08:02.911 23:00:06 -- accel/accel.sh@22 -- # case "$var" in 00:08:02.911 23:00:06 -- accel/accel.sh@20 -- # IFS=: 00:08:02.911 23:00:06 -- accel/accel.sh@20 -- # read -r var val 00:08:02.911 23:00:06 -- accel/accel.sh@21 -- # val=2 00:08:02.911 23:00:06 -- accel/accel.sh@22 -- # case "$var" in 00:08:02.911 23:00:06 -- accel/accel.sh@20 -- # IFS=: 00:08:02.911 23:00:06 -- accel/accel.sh@20 -- # read -r var val 00:08:02.911 23:00:06 -- accel/accel.sh@21 -- # val='1 seconds' 00:08:02.911 23:00:06 -- accel/accel.sh@22 -- # case "$var" in 00:08:02.911 23:00:06 -- accel/accel.sh@20 -- # IFS=: 00:08:02.911 23:00:06 -- accel/accel.sh@20 -- # read -r var val 00:08:02.911 23:00:06 -- accel/accel.sh@21 -- # val=Yes 00:08:02.911 23:00:06 -- accel/accel.sh@22 -- # case "$var" in 00:08:02.911 23:00:06 -- accel/accel.sh@20 -- # IFS=: 00:08:02.911 23:00:06 -- accel/accel.sh@20 -- # read -r var val 00:08:02.911 23:00:06 -- accel/accel.sh@21 -- # val= 00:08:02.911 23:00:06 -- accel/accel.sh@22 -- # case "$var" in 00:08:02.911 23:00:06 -- accel/accel.sh@20 -- # IFS=: 00:08:02.911 23:00:06 -- accel/accel.sh@20 -- # read -r var val 00:08:02.911 23:00:06 -- accel/accel.sh@21 -- # val= 00:08:02.911 23:00:06 -- accel/accel.sh@22 -- # case "$var" in 00:08:02.911 23:00:06 -- accel/accel.sh@20 -- # IFS=: 00:08:02.911 23:00:06 -- accel/accel.sh@20 -- # read -r var val 00:08:04.286 23:00:07 -- accel/accel.sh@21 -- # val= 00:08:04.286 23:00:07 -- accel/accel.sh@22 -- # case "$var" in 00:08:04.286 23:00:07 -- accel/accel.sh@20 -- # IFS=: 00:08:04.286 23:00:07 -- accel/accel.sh@20 -- # read -r var val 00:08:04.286 23:00:07 -- accel/accel.sh@21 -- # val= 00:08:04.286 23:00:07 -- accel/accel.sh@22 -- # case "$var" in 00:08:04.286 23:00:07 -- accel/accel.sh@20 -- # IFS=: 00:08:04.286 23:00:07 -- accel/accel.sh@20 -- # read -r var val 00:08:04.286 23:00:07 -- accel/accel.sh@21 -- # val= 00:08:04.286 23:00:07 -- accel/accel.sh@22 -- # case "$var" in 00:08:04.286 23:00:07 -- accel/accel.sh@20 -- # IFS=: 00:08:04.286 23:00:07 -- accel/accel.sh@20 -- # read -r var val 00:08:04.286 23:00:07 -- accel/accel.sh@21 -- # val= 00:08:04.286 23:00:07 -- accel/accel.sh@22 -- # case "$var" in 00:08:04.286 23:00:07 -- accel/accel.sh@20 -- # IFS=: 00:08:04.286 23:00:07 -- accel/accel.sh@20 -- # read -r var val 00:08:04.286 23:00:07 -- accel/accel.sh@21 -- # val= 00:08:04.286 23:00:07 -- accel/accel.sh@22 -- # case "$var" in 00:08:04.286 23:00:07 -- accel/accel.sh@20 -- # IFS=: 00:08:04.286 23:00:07 -- accel/accel.sh@20 -- # read -r var val 00:08:04.286 23:00:07 -- accel/accel.sh@21 -- # val= 00:08:04.286 23:00:07 -- accel/accel.sh@22 -- # case "$var" in 00:08:04.286 23:00:07 -- accel/accel.sh@20 -- # IFS=: 00:08:04.286 23:00:07 -- accel/accel.sh@20 -- # read -r var val 00:08:04.286 23:00:07 -- accel/accel.sh@21 -- # val= 00:08:04.286 23:00:07 -- accel/accel.sh@22 -- # case "$var" in 00:08:04.286 23:00:07 -- accel/accel.sh@20 -- # IFS=: 00:08:04.286 23:00:07 -- accel/accel.sh@20 -- # read -r var val 00:08:04.286 23:00:07 -- accel/accel.sh@28 -- # [[ -n software ]] 00:08:04.286 23:00:07 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:08:04.286 23:00:07 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:08:04.286 00:08:04.286 real 0m2.895s 00:08:04.286 user 0m2.596s 00:08:04.286 sys 0m0.290s 00:08:04.286 23:00:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:04.286 23:00:07 -- common/autotest_common.sh@10 -- # set +x 00:08:04.286 ************************************ 00:08:04.286 END TEST accel_deomp_full_mthread 00:08:04.286 ************************************ 00:08:04.286 23:00:07 -- accel/accel.sh@116 -- # [[ n == y ]] 00:08:04.286 23:00:07 -- accel/accel.sh@129 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:08:04.286 23:00:07 -- accel/accel.sh@129 -- # build_accel_config 00:08:04.286 23:00:07 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:08:04.286 23:00:07 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:04.286 23:00:07 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:04.286 23:00:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:04.286 23:00:07 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:04.286 23:00:07 -- common/autotest_common.sh@10 -- # set +x 00:08:04.286 23:00:07 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:08:04.286 23:00:07 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:08:04.286 23:00:07 -- accel/accel.sh@41 -- # local IFS=, 00:08:04.286 23:00:07 -- accel/accel.sh@42 -- # jq -r . 00:08:04.286 ************************************ 00:08:04.286 START TEST accel_dif_functional_tests 00:08:04.286 ************************************ 00:08:04.286 23:00:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:08:04.286 [2024-11-28 23:00:07.738592] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:08:04.286 [2024-11-28 23:00:07.738695] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2342717 ] 00:08:04.286 EAL: No free 2048 kB hugepages reported on node 1 00:08:04.286 [2024-11-28 23:00:07.801130] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:08:04.546 [2024-11-28 23:00:07.898542] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:04.546 [2024-11-28 23:00:07.898597] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:04.546 [2024-11-28 23:00:07.898601] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:04.546 00:08:04.546 00:08:04.546 CUnit - A unit testing framework for C - Version 2.1-3 00:08:04.546 http://cunit.sourceforge.net/ 00:08:04.546 00:08:04.546 00:08:04.546 Suite: accel_dif 00:08:04.546 Test: verify: DIF generated, GUARD check ...passed 00:08:04.546 Test: verify: DIF generated, APPTAG check ...passed 00:08:04.546 Test: verify: DIF generated, REFTAG check ...passed 00:08:04.546 Test: verify: DIF not generated, GUARD check ...[2024-11-28 23:00:07.993572] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:08:04.546 [2024-11-28 23:00:07.993638] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:08:04.546 passed 00:08:04.546 Test: verify: DIF not generated, APPTAG check ...[2024-11-28 23:00:07.993680] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:08:04.546 [2024-11-28 23:00:07.993710] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:08:04.546 passed 00:08:04.546 Test: verify: DIF not generated, REFTAG check ...[2024-11-28 23:00:07.993744] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:08:04.546 [2024-11-28 23:00:07.993772] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:08:04.546 passed 00:08:04.546 Test: verify: APPTAG correct, APPTAG check ...passed 00:08:04.546 Test: verify: APPTAG incorrect, APPTAG check ...[2024-11-28 23:00:07.993838] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:08:04.546 passed 00:08:04.546 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:08:04.546 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:08:04.546 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:08:04.546 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-11-28 23:00:07.993989] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:08:04.546 passed 00:08:04.546 Test: generate copy: DIF generated, GUARD check ...passed 00:08:04.546 Test: generate copy: DIF generated, APTTAG check ...passed 00:08:04.546 Test: generate copy: DIF generated, REFTAG check ...passed 00:08:04.546 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:08:04.546 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:08:04.546 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:08:04.546 Test: generate copy: iovecs-len validate ...[2024-11-28 23:00:07.994240] dif.c:1167:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:08:04.546 passed 00:08:04.546 Test: generate copy: buffer alignment validate ...passed 00:08:04.546 00:08:04.546 Run Summary: Type Total Ran Passed Failed Inactive 00:08:04.546 suites 1 1 n/a 0 0 00:08:04.546 tests 20 20 20 0 0 00:08:04.546 asserts 204 204 204 0 n/a 00:08:04.546 00:08:04.546 Elapsed time = 0.003 seconds 00:08:04.805 00:08:04.805 real 0m0.502s 00:08:04.805 user 0m0.784s 00:08:04.805 sys 0m0.174s 00:08:04.805 23:00:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:04.805 23:00:08 -- common/autotest_common.sh@10 -- # set +x 00:08:04.805 ************************************ 00:08:04.805 END TEST accel_dif_functional_tests 00:08:04.805 ************************************ 00:08:04.805 00:08:04.805 real 1m0.026s 00:08:04.805 user 1m7.709s 00:08:04.805 sys 0m7.285s 00:08:04.805 23:00:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:04.805 23:00:08 -- common/autotest_common.sh@10 -- # set +x 00:08:04.805 ************************************ 00:08:04.805 END TEST accel 00:08:04.805 ************************************ 00:08:04.805 23:00:08 -- spdk/autotest.sh@177 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:08:04.805 23:00:08 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:08:04.805 23:00:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:04.805 23:00:08 -- common/autotest_common.sh@10 -- # set +x 00:08:04.805 ************************************ 00:08:04.805 START TEST accel_rpc 00:08:04.805 ************************************ 00:08:04.805 23:00:08 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:08:04.805 * Looking for test storage... 00:08:04.805 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:08:04.805 23:00:08 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:04.805 23:00:08 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:04.805 23:00:08 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:04.805 23:00:08 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:04.805 23:00:08 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:04.805 23:00:08 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:04.805 23:00:08 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:04.805 23:00:08 -- scripts/common.sh@335 -- # IFS=.-: 00:08:04.805 23:00:08 -- scripts/common.sh@335 -- # read -ra ver1 00:08:04.805 23:00:08 -- scripts/common.sh@336 -- # IFS=.-: 00:08:04.805 23:00:08 -- scripts/common.sh@336 -- # read -ra ver2 00:08:04.805 23:00:08 -- scripts/common.sh@337 -- # local 'op=<' 00:08:04.805 23:00:08 -- scripts/common.sh@339 -- # ver1_l=2 00:08:04.805 23:00:08 -- scripts/common.sh@340 -- # ver2_l=1 00:08:04.805 23:00:08 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:04.805 23:00:08 -- scripts/common.sh@343 -- # case "$op" in 00:08:04.805 23:00:08 -- scripts/common.sh@344 -- # : 1 00:08:04.805 23:00:08 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:04.805 23:00:08 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:04.805 23:00:08 -- scripts/common.sh@364 -- # decimal 1 00:08:04.805 23:00:08 -- scripts/common.sh@352 -- # local d=1 00:08:04.805 23:00:08 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:04.805 23:00:08 -- scripts/common.sh@354 -- # echo 1 00:08:04.805 23:00:08 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:04.805 23:00:08 -- scripts/common.sh@365 -- # decimal 2 00:08:04.805 23:00:08 -- scripts/common.sh@352 -- # local d=2 00:08:04.805 23:00:08 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:04.805 23:00:08 -- scripts/common.sh@354 -- # echo 2 00:08:04.805 23:00:08 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:04.805 23:00:08 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:04.805 23:00:08 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:04.805 23:00:08 -- scripts/common.sh@367 -- # return 0 00:08:04.805 23:00:08 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:04.805 23:00:08 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:04.805 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:04.805 --rc genhtml_branch_coverage=1 00:08:04.805 --rc genhtml_function_coverage=1 00:08:04.805 --rc genhtml_legend=1 00:08:04.805 --rc geninfo_all_blocks=1 00:08:04.805 --rc geninfo_unexecuted_blocks=1 00:08:04.805 00:08:04.805 ' 00:08:04.805 23:00:08 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:04.805 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:04.805 --rc genhtml_branch_coverage=1 00:08:04.805 --rc genhtml_function_coverage=1 00:08:04.805 --rc genhtml_legend=1 00:08:04.805 --rc geninfo_all_blocks=1 00:08:04.805 --rc geninfo_unexecuted_blocks=1 00:08:04.805 00:08:04.805 ' 00:08:04.805 23:00:08 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:04.805 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:04.805 --rc genhtml_branch_coverage=1 00:08:04.805 --rc genhtml_function_coverage=1 00:08:04.805 --rc genhtml_legend=1 00:08:04.805 --rc geninfo_all_blocks=1 00:08:04.805 --rc geninfo_unexecuted_blocks=1 00:08:04.805 00:08:04.805 ' 00:08:04.805 23:00:08 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:04.805 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:04.805 --rc genhtml_branch_coverage=1 00:08:04.805 --rc genhtml_function_coverage=1 00:08:04.805 --rc genhtml_legend=1 00:08:04.805 --rc geninfo_all_blocks=1 00:08:04.805 --rc geninfo_unexecuted_blocks=1 00:08:04.805 00:08:04.805 ' 00:08:04.805 23:00:08 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:08:04.805 23:00:08 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=2343045 00:08:04.805 23:00:08 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:08:04.805 23:00:08 -- accel/accel_rpc.sh@15 -- # waitforlisten 2343045 00:08:04.805 23:00:08 -- common/autotest_common.sh@829 -- # '[' -z 2343045 ']' 00:08:04.805 23:00:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:04.805 23:00:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:04.805 23:00:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:04.805 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:04.805 23:00:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:04.805 23:00:08 -- common/autotest_common.sh@10 -- # set +x 00:08:05.065 [2024-11-28 23:00:08.428112] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:08:05.065 [2024-11-28 23:00:08.428205] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2343045 ] 00:08:05.065 EAL: No free 2048 kB hugepages reported on node 1 00:08:05.065 [2024-11-28 23:00:08.488229] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:05.065 [2024-11-28 23:00:08.578145] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:05.065 [2024-11-28 23:00:08.578324] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:05.065 23:00:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:05.065 23:00:08 -- common/autotest_common.sh@862 -- # return 0 00:08:05.065 23:00:08 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:08:05.065 23:00:08 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:08:05.065 23:00:08 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:08:05.065 23:00:08 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:08:05.065 23:00:08 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:08:05.065 23:00:08 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:08:05.065 23:00:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:05.065 23:00:08 -- common/autotest_common.sh@10 -- # set +x 00:08:05.065 ************************************ 00:08:05.065 START TEST accel_assign_opcode 00:08:05.065 ************************************ 00:08:05.065 23:00:08 -- common/autotest_common.sh@1114 -- # accel_assign_opcode_test_suite 00:08:05.065 23:00:08 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:08:05.065 23:00:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:05.065 23:00:08 -- common/autotest_common.sh@10 -- # set +x 00:08:05.065 [2024-11-28 23:00:08.646944] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:08:05.065 23:00:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:05.065 23:00:08 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:08:05.065 23:00:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:05.065 23:00:08 -- common/autotest_common.sh@10 -- # set +x 00:08:05.065 [2024-11-28 23:00:08.654956] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:08:05.065 23:00:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:05.065 23:00:08 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:08:05.065 23:00:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:05.065 23:00:08 -- common/autotest_common.sh@10 -- # set +x 00:08:05.400 23:00:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:05.400 23:00:08 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:08:05.400 23:00:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:05.400 23:00:08 -- common/autotest_common.sh@10 -- # set +x 00:08:05.400 23:00:08 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:08:05.400 23:00:08 -- accel/accel_rpc.sh@42 -- # grep software 00:08:05.400 23:00:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:05.400 software 00:08:05.400 00:08:05.400 real 0m0.298s 00:08:05.400 user 0m0.039s 00:08:05.400 sys 0m0.008s 00:08:05.400 23:00:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:05.400 23:00:08 -- common/autotest_common.sh@10 -- # set +x 00:08:05.400 ************************************ 00:08:05.400 END TEST accel_assign_opcode 00:08:05.400 ************************************ 00:08:05.400 23:00:08 -- accel/accel_rpc.sh@55 -- # killprocess 2343045 00:08:05.400 23:00:08 -- common/autotest_common.sh@936 -- # '[' -z 2343045 ']' 00:08:05.400 23:00:08 -- common/autotest_common.sh@940 -- # kill -0 2343045 00:08:05.400 23:00:08 -- common/autotest_common.sh@941 -- # uname 00:08:05.400 23:00:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:05.400 23:00:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2343045 00:08:05.697 23:00:08 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:05.697 23:00:08 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:05.697 23:00:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2343045' 00:08:05.697 killing process with pid 2343045 00:08:05.697 23:00:08 -- common/autotest_common.sh@955 -- # kill 2343045 00:08:05.697 23:00:08 -- common/autotest_common.sh@960 -- # wait 2343045 00:08:05.963 00:08:05.963 real 0m1.144s 00:08:05.963 user 0m1.058s 00:08:05.963 sys 0m0.435s 00:08:05.963 23:00:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:05.963 23:00:09 -- common/autotest_common.sh@10 -- # set +x 00:08:05.963 ************************************ 00:08:05.963 END TEST accel_rpc 00:08:05.963 ************************************ 00:08:05.963 23:00:09 -- spdk/autotest.sh@178 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:08:05.963 23:00:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:08:05.963 23:00:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:05.963 23:00:09 -- common/autotest_common.sh@10 -- # set +x 00:08:05.963 ************************************ 00:08:05.963 START TEST app_cmdline 00:08:05.964 ************************************ 00:08:05.964 23:00:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:08:05.964 * Looking for test storage... 00:08:05.964 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:08:05.964 23:00:09 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:05.964 23:00:09 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:05.964 23:00:09 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:05.964 23:00:09 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:05.964 23:00:09 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:05.964 23:00:09 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:05.964 23:00:09 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:05.964 23:00:09 -- scripts/common.sh@335 -- # IFS=.-: 00:08:05.964 23:00:09 -- scripts/common.sh@335 -- # read -ra ver1 00:08:05.964 23:00:09 -- scripts/common.sh@336 -- # IFS=.-: 00:08:05.964 23:00:09 -- scripts/common.sh@336 -- # read -ra ver2 00:08:05.964 23:00:09 -- scripts/common.sh@337 -- # local 'op=<' 00:08:05.964 23:00:09 -- scripts/common.sh@339 -- # ver1_l=2 00:08:05.964 23:00:09 -- scripts/common.sh@340 -- # ver2_l=1 00:08:05.964 23:00:09 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:05.964 23:00:09 -- scripts/common.sh@343 -- # case "$op" in 00:08:05.964 23:00:09 -- scripts/common.sh@344 -- # : 1 00:08:05.964 23:00:09 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:05.964 23:00:09 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:05.964 23:00:09 -- scripts/common.sh@364 -- # decimal 1 00:08:05.964 23:00:09 -- scripts/common.sh@352 -- # local d=1 00:08:05.964 23:00:09 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:05.964 23:00:09 -- scripts/common.sh@354 -- # echo 1 00:08:05.964 23:00:09 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:05.964 23:00:09 -- scripts/common.sh@365 -- # decimal 2 00:08:05.964 23:00:09 -- scripts/common.sh@352 -- # local d=2 00:08:05.964 23:00:09 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:05.964 23:00:09 -- scripts/common.sh@354 -- # echo 2 00:08:05.964 23:00:09 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:05.964 23:00:09 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:05.964 23:00:09 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:05.964 23:00:09 -- scripts/common.sh@367 -- # return 0 00:08:05.964 23:00:09 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:05.964 23:00:09 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:05.964 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:05.964 --rc genhtml_branch_coverage=1 00:08:05.964 --rc genhtml_function_coverage=1 00:08:05.964 --rc genhtml_legend=1 00:08:05.964 --rc geninfo_all_blocks=1 00:08:05.964 --rc geninfo_unexecuted_blocks=1 00:08:05.964 00:08:05.964 ' 00:08:05.964 23:00:09 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:05.964 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:05.964 --rc genhtml_branch_coverage=1 00:08:05.964 --rc genhtml_function_coverage=1 00:08:05.964 --rc genhtml_legend=1 00:08:05.964 --rc geninfo_all_blocks=1 00:08:05.964 --rc geninfo_unexecuted_blocks=1 00:08:05.964 00:08:05.964 ' 00:08:05.964 23:00:09 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:05.964 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:05.964 --rc genhtml_branch_coverage=1 00:08:05.964 --rc genhtml_function_coverage=1 00:08:05.964 --rc genhtml_legend=1 00:08:05.964 --rc geninfo_all_blocks=1 00:08:05.964 --rc geninfo_unexecuted_blocks=1 00:08:05.964 00:08:05.964 ' 00:08:05.964 23:00:09 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:05.964 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:05.964 --rc genhtml_branch_coverage=1 00:08:05.964 --rc genhtml_function_coverage=1 00:08:05.964 --rc genhtml_legend=1 00:08:05.964 --rc geninfo_all_blocks=1 00:08:05.964 --rc geninfo_unexecuted_blocks=1 00:08:05.964 00:08:05.964 ' 00:08:05.964 23:00:09 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:08:05.964 23:00:09 -- app/cmdline.sh@17 -- # spdk_tgt_pid=2343409 00:08:05.964 23:00:09 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:08:05.964 23:00:09 -- app/cmdline.sh@18 -- # waitforlisten 2343409 00:08:05.964 23:00:09 -- common/autotest_common.sh@829 -- # '[' -z 2343409 ']' 00:08:05.964 23:00:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:05.964 23:00:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:05.964 23:00:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:05.964 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:05.964 23:00:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:05.964 23:00:09 -- common/autotest_common.sh@10 -- # set +x 00:08:06.223 [2024-11-28 23:00:09.600181] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:08:06.223 [2024-11-28 23:00:09.600272] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2343409 ] 00:08:06.223 EAL: No free 2048 kB hugepages reported on node 1 00:08:06.223 [2024-11-28 23:00:09.658701] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:06.223 [2024-11-28 23:00:09.742118] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:06.223 [2024-11-28 23:00:09.742295] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:07.158 23:00:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:07.158 23:00:10 -- common/autotest_common.sh@862 -- # return 0 00:08:07.158 23:00:10 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:08:07.417 { 00:08:07.417 "version": "SPDK v24.01.1-pre git sha1 c13c99a5e", 00:08:07.417 "fields": { 00:08:07.417 "major": 24, 00:08:07.417 "minor": 1, 00:08:07.417 "patch": 1, 00:08:07.417 "suffix": "-pre", 00:08:07.417 "commit": "c13c99a5e" 00:08:07.417 } 00:08:07.417 } 00:08:07.417 23:00:10 -- app/cmdline.sh@22 -- # expected_methods=() 00:08:07.417 23:00:10 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:08:07.417 23:00:10 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:08:07.417 23:00:10 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:08:07.417 23:00:10 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:08:07.417 23:00:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:07.417 23:00:10 -- common/autotest_common.sh@10 -- # set +x 00:08:07.417 23:00:10 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:08:07.417 23:00:10 -- app/cmdline.sh@26 -- # sort 00:08:07.417 23:00:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:07.417 23:00:10 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:08:07.417 23:00:10 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:08:07.417 23:00:10 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:08:07.417 23:00:10 -- common/autotest_common.sh@650 -- # local es=0 00:08:07.417 23:00:10 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:08:07.417 23:00:10 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:08:07.417 23:00:10 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:07.417 23:00:10 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:08:07.417 23:00:10 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:07.417 23:00:10 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:08:07.417 23:00:10 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:07.417 23:00:10 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:08:07.417 23:00:10 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:08:07.417 23:00:10 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:08:07.675 request: 00:08:07.675 { 00:08:07.675 "method": "env_dpdk_get_mem_stats", 00:08:07.675 "req_id": 1 00:08:07.675 } 00:08:07.675 Got JSON-RPC error response 00:08:07.675 response: 00:08:07.675 { 00:08:07.675 "code": -32601, 00:08:07.675 "message": "Method not found" 00:08:07.675 } 00:08:07.675 23:00:11 -- common/autotest_common.sh@653 -- # es=1 00:08:07.675 23:00:11 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:08:07.675 23:00:11 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:08:07.675 23:00:11 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:08:07.675 23:00:11 -- app/cmdline.sh@1 -- # killprocess 2343409 00:08:07.675 23:00:11 -- common/autotest_common.sh@936 -- # '[' -z 2343409 ']' 00:08:07.675 23:00:11 -- common/autotest_common.sh@940 -- # kill -0 2343409 00:08:07.675 23:00:11 -- common/autotest_common.sh@941 -- # uname 00:08:07.675 23:00:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:07.675 23:00:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2343409 00:08:07.675 23:00:11 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:07.675 23:00:11 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:07.675 23:00:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2343409' 00:08:07.675 killing process with pid 2343409 00:08:07.675 23:00:11 -- common/autotest_common.sh@955 -- # kill 2343409 00:08:07.675 23:00:11 -- common/autotest_common.sh@960 -- # wait 2343409 00:08:08.241 00:08:08.241 real 0m2.180s 00:08:08.241 user 0m2.734s 00:08:08.241 sys 0m0.537s 00:08:08.241 23:00:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:08.241 23:00:11 -- common/autotest_common.sh@10 -- # set +x 00:08:08.241 ************************************ 00:08:08.241 END TEST app_cmdline 00:08:08.241 ************************************ 00:08:08.241 23:00:11 -- spdk/autotest.sh@179 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:08:08.241 23:00:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:08:08.241 23:00:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:08.241 23:00:11 -- common/autotest_common.sh@10 -- # set +x 00:08:08.241 ************************************ 00:08:08.241 START TEST version 00:08:08.241 ************************************ 00:08:08.241 23:00:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:08:08.241 * Looking for test storage... 00:08:08.241 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:08:08.241 23:00:11 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:08.241 23:00:11 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:08.241 23:00:11 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:08.241 23:00:11 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:08.241 23:00:11 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:08.241 23:00:11 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:08.241 23:00:11 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:08.241 23:00:11 -- scripts/common.sh@335 -- # IFS=.-: 00:08:08.241 23:00:11 -- scripts/common.sh@335 -- # read -ra ver1 00:08:08.241 23:00:11 -- scripts/common.sh@336 -- # IFS=.-: 00:08:08.241 23:00:11 -- scripts/common.sh@336 -- # read -ra ver2 00:08:08.241 23:00:11 -- scripts/common.sh@337 -- # local 'op=<' 00:08:08.241 23:00:11 -- scripts/common.sh@339 -- # ver1_l=2 00:08:08.241 23:00:11 -- scripts/common.sh@340 -- # ver2_l=1 00:08:08.241 23:00:11 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:08.241 23:00:11 -- scripts/common.sh@343 -- # case "$op" in 00:08:08.241 23:00:11 -- scripts/common.sh@344 -- # : 1 00:08:08.241 23:00:11 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:08.241 23:00:11 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:08.241 23:00:11 -- scripts/common.sh@364 -- # decimal 1 00:08:08.241 23:00:11 -- scripts/common.sh@352 -- # local d=1 00:08:08.241 23:00:11 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:08.241 23:00:11 -- scripts/common.sh@354 -- # echo 1 00:08:08.241 23:00:11 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:08.241 23:00:11 -- scripts/common.sh@365 -- # decimal 2 00:08:08.241 23:00:11 -- scripts/common.sh@352 -- # local d=2 00:08:08.241 23:00:11 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:08.241 23:00:11 -- scripts/common.sh@354 -- # echo 2 00:08:08.241 23:00:11 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:08.241 23:00:11 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:08.241 23:00:11 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:08.241 23:00:11 -- scripts/common.sh@367 -- # return 0 00:08:08.241 23:00:11 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:08.241 23:00:11 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:08.241 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:08.242 --rc genhtml_branch_coverage=1 00:08:08.242 --rc genhtml_function_coverage=1 00:08:08.242 --rc genhtml_legend=1 00:08:08.242 --rc geninfo_all_blocks=1 00:08:08.242 --rc geninfo_unexecuted_blocks=1 00:08:08.242 00:08:08.242 ' 00:08:08.242 23:00:11 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:08.242 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:08.242 --rc genhtml_branch_coverage=1 00:08:08.242 --rc genhtml_function_coverage=1 00:08:08.242 --rc genhtml_legend=1 00:08:08.242 --rc geninfo_all_blocks=1 00:08:08.242 --rc geninfo_unexecuted_blocks=1 00:08:08.242 00:08:08.242 ' 00:08:08.242 23:00:11 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:08.242 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:08.242 --rc genhtml_branch_coverage=1 00:08:08.242 --rc genhtml_function_coverage=1 00:08:08.242 --rc genhtml_legend=1 00:08:08.242 --rc geninfo_all_blocks=1 00:08:08.242 --rc geninfo_unexecuted_blocks=1 00:08:08.242 00:08:08.242 ' 00:08:08.242 23:00:11 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:08.242 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:08.242 --rc genhtml_branch_coverage=1 00:08:08.242 --rc genhtml_function_coverage=1 00:08:08.242 --rc genhtml_legend=1 00:08:08.242 --rc geninfo_all_blocks=1 00:08:08.242 --rc geninfo_unexecuted_blocks=1 00:08:08.242 00:08:08.242 ' 00:08:08.242 23:00:11 -- app/version.sh@17 -- # get_header_version major 00:08:08.242 23:00:11 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:08:08.242 23:00:11 -- app/version.sh@14 -- # cut -f2 00:08:08.242 23:00:11 -- app/version.sh@14 -- # tr -d '"' 00:08:08.242 23:00:11 -- app/version.sh@17 -- # major=24 00:08:08.242 23:00:11 -- app/version.sh@18 -- # get_header_version minor 00:08:08.242 23:00:11 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:08:08.242 23:00:11 -- app/version.sh@14 -- # cut -f2 00:08:08.242 23:00:11 -- app/version.sh@14 -- # tr -d '"' 00:08:08.242 23:00:11 -- app/version.sh@18 -- # minor=1 00:08:08.242 23:00:11 -- app/version.sh@19 -- # get_header_version patch 00:08:08.242 23:00:11 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:08:08.242 23:00:11 -- app/version.sh@14 -- # cut -f2 00:08:08.242 23:00:11 -- app/version.sh@14 -- # tr -d '"' 00:08:08.242 23:00:11 -- app/version.sh@19 -- # patch=1 00:08:08.242 23:00:11 -- app/version.sh@20 -- # get_header_version suffix 00:08:08.242 23:00:11 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:08:08.242 23:00:11 -- app/version.sh@14 -- # cut -f2 00:08:08.242 23:00:11 -- app/version.sh@14 -- # tr -d '"' 00:08:08.242 23:00:11 -- app/version.sh@20 -- # suffix=-pre 00:08:08.242 23:00:11 -- app/version.sh@22 -- # version=24.1 00:08:08.242 23:00:11 -- app/version.sh@25 -- # (( patch != 0 )) 00:08:08.242 23:00:11 -- app/version.sh@25 -- # version=24.1.1 00:08:08.242 23:00:11 -- app/version.sh@28 -- # version=24.1.1rc0 00:08:08.242 23:00:11 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:08:08.242 23:00:11 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:08:08.242 23:00:11 -- app/version.sh@30 -- # py_version=24.1.1rc0 00:08:08.242 23:00:11 -- app/version.sh@31 -- # [[ 24.1.1rc0 == \2\4\.\1\.\1\r\c\0 ]] 00:08:08.242 00:08:08.242 real 0m0.184s 00:08:08.242 user 0m0.115s 00:08:08.242 sys 0m0.094s 00:08:08.242 23:00:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:08.242 23:00:11 -- common/autotest_common.sh@10 -- # set +x 00:08:08.242 ************************************ 00:08:08.242 END TEST version 00:08:08.242 ************************************ 00:08:08.242 23:00:11 -- spdk/autotest.sh@181 -- # '[' 0 -eq 1 ']' 00:08:08.242 23:00:11 -- spdk/autotest.sh@191 -- # uname -s 00:08:08.242 23:00:11 -- spdk/autotest.sh@191 -- # [[ Linux == Linux ]] 00:08:08.242 23:00:11 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:08:08.242 23:00:11 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:08:08.242 23:00:11 -- spdk/autotest.sh@204 -- # '[' 0 -eq 1 ']' 00:08:08.242 23:00:11 -- spdk/autotest.sh@251 -- # '[' 0 -eq 1 ']' 00:08:08.242 23:00:11 -- spdk/autotest.sh@255 -- # timing_exit lib 00:08:08.242 23:00:11 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:08.242 23:00:11 -- common/autotest_common.sh@10 -- # set +x 00:08:08.501 23:00:11 -- spdk/autotest.sh@257 -- # '[' 0 -eq 1 ']' 00:08:08.501 23:00:11 -- spdk/autotest.sh@265 -- # '[' 0 -eq 1 ']' 00:08:08.501 23:00:11 -- spdk/autotest.sh@274 -- # '[' 1 -eq 1 ']' 00:08:08.501 23:00:11 -- spdk/autotest.sh@275 -- # export NET_TYPE 00:08:08.501 23:00:11 -- spdk/autotest.sh@278 -- # '[' tcp = rdma ']' 00:08:08.501 23:00:11 -- spdk/autotest.sh@281 -- # '[' tcp = tcp ']' 00:08:08.501 23:00:11 -- spdk/autotest.sh@282 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:08:08.501 23:00:11 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:08.501 23:00:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:08.501 23:00:11 -- common/autotest_common.sh@10 -- # set +x 00:08:08.501 ************************************ 00:08:08.501 START TEST nvmf_tcp 00:08:08.501 ************************************ 00:08:08.501 23:00:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:08:08.501 * Looking for test storage... 00:08:08.501 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:08:08.501 23:00:11 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:08.501 23:00:11 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:08.501 23:00:11 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:08.501 23:00:11 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:08.501 23:00:11 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:08.501 23:00:11 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:08.501 23:00:11 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:08.501 23:00:11 -- scripts/common.sh@335 -- # IFS=.-: 00:08:08.501 23:00:11 -- scripts/common.sh@335 -- # read -ra ver1 00:08:08.501 23:00:11 -- scripts/common.sh@336 -- # IFS=.-: 00:08:08.501 23:00:11 -- scripts/common.sh@336 -- # read -ra ver2 00:08:08.501 23:00:11 -- scripts/common.sh@337 -- # local 'op=<' 00:08:08.501 23:00:11 -- scripts/common.sh@339 -- # ver1_l=2 00:08:08.501 23:00:11 -- scripts/common.sh@340 -- # ver2_l=1 00:08:08.501 23:00:11 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:08.501 23:00:11 -- scripts/common.sh@343 -- # case "$op" in 00:08:08.501 23:00:11 -- scripts/common.sh@344 -- # : 1 00:08:08.501 23:00:11 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:08.501 23:00:11 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:08.501 23:00:11 -- scripts/common.sh@364 -- # decimal 1 00:08:08.501 23:00:11 -- scripts/common.sh@352 -- # local d=1 00:08:08.501 23:00:11 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:08.501 23:00:11 -- scripts/common.sh@354 -- # echo 1 00:08:08.501 23:00:11 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:08.501 23:00:11 -- scripts/common.sh@365 -- # decimal 2 00:08:08.501 23:00:11 -- scripts/common.sh@352 -- # local d=2 00:08:08.501 23:00:11 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:08.501 23:00:11 -- scripts/common.sh@354 -- # echo 2 00:08:08.501 23:00:11 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:08.501 23:00:11 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:08.501 23:00:11 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:08.501 23:00:11 -- scripts/common.sh@367 -- # return 0 00:08:08.501 23:00:11 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:08.501 23:00:12 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:08.501 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:08.501 --rc genhtml_branch_coverage=1 00:08:08.501 --rc genhtml_function_coverage=1 00:08:08.501 --rc genhtml_legend=1 00:08:08.501 --rc geninfo_all_blocks=1 00:08:08.501 --rc geninfo_unexecuted_blocks=1 00:08:08.501 00:08:08.501 ' 00:08:08.501 23:00:12 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:08.501 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:08.501 --rc genhtml_branch_coverage=1 00:08:08.501 --rc genhtml_function_coverage=1 00:08:08.501 --rc genhtml_legend=1 00:08:08.502 --rc geninfo_all_blocks=1 00:08:08.502 --rc geninfo_unexecuted_blocks=1 00:08:08.502 00:08:08.502 ' 00:08:08.502 23:00:12 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:08.502 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:08.502 --rc genhtml_branch_coverage=1 00:08:08.502 --rc genhtml_function_coverage=1 00:08:08.502 --rc genhtml_legend=1 00:08:08.502 --rc geninfo_all_blocks=1 00:08:08.502 --rc geninfo_unexecuted_blocks=1 00:08:08.502 00:08:08.502 ' 00:08:08.502 23:00:12 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:08.502 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:08.502 --rc genhtml_branch_coverage=1 00:08:08.502 --rc genhtml_function_coverage=1 00:08:08.502 --rc genhtml_legend=1 00:08:08.502 --rc geninfo_all_blocks=1 00:08:08.502 --rc geninfo_unexecuted_blocks=1 00:08:08.502 00:08:08.502 ' 00:08:08.502 23:00:12 -- nvmf/nvmf.sh@10 -- # uname -s 00:08:08.502 23:00:12 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:08:08.502 23:00:12 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:08.502 23:00:12 -- nvmf/common.sh@7 -- # uname -s 00:08:08.502 23:00:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:08.502 23:00:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:08.502 23:00:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:08.502 23:00:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:08.502 23:00:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:08.502 23:00:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:08.502 23:00:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:08.502 23:00:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:08.502 23:00:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:08.502 23:00:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:08.502 23:00:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:08.502 23:00:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:08.502 23:00:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:08.502 23:00:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:08.502 23:00:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:08.502 23:00:12 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:08.502 23:00:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:08.502 23:00:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:08.502 23:00:12 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:08.502 23:00:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:08.502 23:00:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:08.502 23:00:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:08.502 23:00:12 -- paths/export.sh@5 -- # export PATH 00:08:08.502 23:00:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:08.502 23:00:12 -- nvmf/common.sh@46 -- # : 0 00:08:08.502 23:00:12 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:08.502 23:00:12 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:08.502 23:00:12 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:08.502 23:00:12 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:08.502 23:00:12 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:08.502 23:00:12 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:08.502 23:00:12 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:08.502 23:00:12 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:08.502 23:00:12 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:08:08.502 23:00:12 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:08:08.502 23:00:12 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:08:08.502 23:00:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:08.502 23:00:12 -- common/autotest_common.sh@10 -- # set +x 00:08:08.502 23:00:12 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:08:08.502 23:00:12 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:08:08.502 23:00:12 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:08.502 23:00:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:08.502 23:00:12 -- common/autotest_common.sh@10 -- # set +x 00:08:08.502 ************************************ 00:08:08.502 START TEST nvmf_example 00:08:08.502 ************************************ 00:08:08.502 23:00:12 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:08:08.502 * Looking for test storage... 00:08:08.502 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:08.502 23:00:12 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:08.502 23:00:12 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:08.502 23:00:12 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:08.761 23:00:12 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:08.761 23:00:12 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:08.761 23:00:12 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:08.761 23:00:12 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:08.761 23:00:12 -- scripts/common.sh@335 -- # IFS=.-: 00:08:08.761 23:00:12 -- scripts/common.sh@335 -- # read -ra ver1 00:08:08.761 23:00:12 -- scripts/common.sh@336 -- # IFS=.-: 00:08:08.761 23:00:12 -- scripts/common.sh@336 -- # read -ra ver2 00:08:08.761 23:00:12 -- scripts/common.sh@337 -- # local 'op=<' 00:08:08.761 23:00:12 -- scripts/common.sh@339 -- # ver1_l=2 00:08:08.761 23:00:12 -- scripts/common.sh@340 -- # ver2_l=1 00:08:08.761 23:00:12 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:08.761 23:00:12 -- scripts/common.sh@343 -- # case "$op" in 00:08:08.761 23:00:12 -- scripts/common.sh@344 -- # : 1 00:08:08.761 23:00:12 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:08.761 23:00:12 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:08.761 23:00:12 -- scripts/common.sh@364 -- # decimal 1 00:08:08.761 23:00:12 -- scripts/common.sh@352 -- # local d=1 00:08:08.761 23:00:12 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:08.761 23:00:12 -- scripts/common.sh@354 -- # echo 1 00:08:08.761 23:00:12 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:08.761 23:00:12 -- scripts/common.sh@365 -- # decimal 2 00:08:08.761 23:00:12 -- scripts/common.sh@352 -- # local d=2 00:08:08.761 23:00:12 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:08.761 23:00:12 -- scripts/common.sh@354 -- # echo 2 00:08:08.761 23:00:12 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:08.761 23:00:12 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:08.761 23:00:12 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:08.761 23:00:12 -- scripts/common.sh@367 -- # return 0 00:08:08.761 23:00:12 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:08.761 23:00:12 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:08.761 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:08.761 --rc genhtml_branch_coverage=1 00:08:08.761 --rc genhtml_function_coverage=1 00:08:08.761 --rc genhtml_legend=1 00:08:08.761 --rc geninfo_all_blocks=1 00:08:08.761 --rc geninfo_unexecuted_blocks=1 00:08:08.761 00:08:08.761 ' 00:08:08.761 23:00:12 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:08.761 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:08.761 --rc genhtml_branch_coverage=1 00:08:08.761 --rc genhtml_function_coverage=1 00:08:08.761 --rc genhtml_legend=1 00:08:08.761 --rc geninfo_all_blocks=1 00:08:08.761 --rc geninfo_unexecuted_blocks=1 00:08:08.761 00:08:08.761 ' 00:08:08.761 23:00:12 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:08.761 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:08.761 --rc genhtml_branch_coverage=1 00:08:08.761 --rc genhtml_function_coverage=1 00:08:08.761 --rc genhtml_legend=1 00:08:08.761 --rc geninfo_all_blocks=1 00:08:08.761 --rc geninfo_unexecuted_blocks=1 00:08:08.761 00:08:08.761 ' 00:08:08.761 23:00:12 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:08.761 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:08.761 --rc genhtml_branch_coverage=1 00:08:08.761 --rc genhtml_function_coverage=1 00:08:08.761 --rc genhtml_legend=1 00:08:08.761 --rc geninfo_all_blocks=1 00:08:08.761 --rc geninfo_unexecuted_blocks=1 00:08:08.761 00:08:08.761 ' 00:08:08.761 23:00:12 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:08.761 23:00:12 -- nvmf/common.sh@7 -- # uname -s 00:08:08.761 23:00:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:08.761 23:00:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:08.761 23:00:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:08.761 23:00:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:08.761 23:00:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:08.761 23:00:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:08.761 23:00:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:08.761 23:00:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:08.761 23:00:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:08.761 23:00:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:08.761 23:00:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:08.761 23:00:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:08.761 23:00:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:08.761 23:00:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:08.761 23:00:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:08.761 23:00:12 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:08.761 23:00:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:08.761 23:00:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:08.761 23:00:12 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:08.761 23:00:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:08.761 23:00:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:08.761 23:00:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:08.761 23:00:12 -- paths/export.sh@5 -- # export PATH 00:08:08.761 23:00:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:08.761 23:00:12 -- nvmf/common.sh@46 -- # : 0 00:08:08.761 23:00:12 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:08.761 23:00:12 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:08.761 23:00:12 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:08.761 23:00:12 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:08.761 23:00:12 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:08.761 23:00:12 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:08.761 23:00:12 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:08.761 23:00:12 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:08.761 23:00:12 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:08:08.761 23:00:12 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:08:08.762 23:00:12 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:08:08.762 23:00:12 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:08:08.762 23:00:12 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:08:08.762 23:00:12 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:08:08.762 23:00:12 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:08:08.762 23:00:12 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:08:08.762 23:00:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:08.762 23:00:12 -- common/autotest_common.sh@10 -- # set +x 00:08:08.762 23:00:12 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:08:08.762 23:00:12 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:08.762 23:00:12 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:08.762 23:00:12 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:08.762 23:00:12 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:08.762 23:00:12 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:08.762 23:00:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:08.762 23:00:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:08.762 23:00:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:08.762 23:00:12 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:08.762 23:00:12 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:08.762 23:00:12 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:08.762 23:00:12 -- common/autotest_common.sh@10 -- # set +x 00:08:10.665 23:00:14 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:10.665 23:00:14 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:10.665 23:00:14 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:10.665 23:00:14 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:10.665 23:00:14 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:10.665 23:00:14 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:10.665 23:00:14 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:10.665 23:00:14 -- nvmf/common.sh@294 -- # net_devs=() 00:08:10.665 23:00:14 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:10.665 23:00:14 -- nvmf/common.sh@295 -- # e810=() 00:08:10.665 23:00:14 -- nvmf/common.sh@295 -- # local -ga e810 00:08:10.665 23:00:14 -- nvmf/common.sh@296 -- # x722=() 00:08:10.665 23:00:14 -- nvmf/common.sh@296 -- # local -ga x722 00:08:10.665 23:00:14 -- nvmf/common.sh@297 -- # mlx=() 00:08:10.665 23:00:14 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:10.665 23:00:14 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:10.665 23:00:14 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:10.665 23:00:14 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:10.665 23:00:14 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:10.665 23:00:14 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:10.665 23:00:14 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:10.665 23:00:14 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:10.665 23:00:14 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:10.665 23:00:14 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:10.665 23:00:14 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:10.665 23:00:14 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:10.665 23:00:14 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:10.665 23:00:14 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:10.665 23:00:14 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:10.665 23:00:14 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:10.665 23:00:14 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:10.665 23:00:14 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:10.665 23:00:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:10.665 23:00:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:10.665 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:10.665 23:00:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:10.665 23:00:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:10.665 23:00:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:10.665 23:00:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:10.665 23:00:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:10.665 23:00:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:10.665 23:00:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:10.665 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:10.665 23:00:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:10.665 23:00:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:10.665 23:00:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:10.665 23:00:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:10.665 23:00:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:10.665 23:00:14 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:10.665 23:00:14 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:10.665 23:00:14 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:10.665 23:00:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:10.665 23:00:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:10.665 23:00:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:10.665 23:00:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:10.665 23:00:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:10.665 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:10.665 23:00:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:10.665 23:00:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:10.665 23:00:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:10.665 23:00:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:10.665 23:00:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:10.665 23:00:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:10.665 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:10.665 23:00:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:10.665 23:00:14 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:10.665 23:00:14 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:10.665 23:00:14 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:10.665 23:00:14 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:10.665 23:00:14 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:10.665 23:00:14 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:10.665 23:00:14 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:10.665 23:00:14 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:10.665 23:00:14 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:10.665 23:00:14 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:10.665 23:00:14 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:10.665 23:00:14 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:10.665 23:00:14 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:10.665 23:00:14 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:10.665 23:00:14 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:10.665 23:00:14 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:10.665 23:00:14 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:10.665 23:00:14 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:10.924 23:00:14 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:10.924 23:00:14 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:10.924 23:00:14 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:10.924 23:00:14 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:10.924 23:00:14 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:10.924 23:00:14 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:10.924 23:00:14 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:10.924 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:10.924 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.338 ms 00:08:10.924 00:08:10.924 --- 10.0.0.2 ping statistics --- 00:08:10.924 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:10.924 rtt min/avg/max/mdev = 0.338/0.338/0.338/0.000 ms 00:08:10.924 23:00:14 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:10.924 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:10.924 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.132 ms 00:08:10.924 00:08:10.924 --- 10.0.0.1 ping statistics --- 00:08:10.924 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:10.924 rtt min/avg/max/mdev = 0.132/0.132/0.132/0.000 ms 00:08:10.924 23:00:14 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:10.924 23:00:14 -- nvmf/common.sh@410 -- # return 0 00:08:10.924 23:00:14 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:10.924 23:00:14 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:10.924 23:00:14 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:10.924 23:00:14 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:10.924 23:00:14 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:10.924 23:00:14 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:10.924 23:00:14 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:10.924 23:00:14 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:08:10.924 23:00:14 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:08:10.924 23:00:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:10.924 23:00:14 -- common/autotest_common.sh@10 -- # set +x 00:08:10.924 23:00:14 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:08:10.924 23:00:14 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:08:10.924 23:00:14 -- target/nvmf_example.sh@34 -- # nvmfpid=2345469 00:08:10.924 23:00:14 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:08:10.924 23:00:14 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:08:10.924 23:00:14 -- target/nvmf_example.sh@36 -- # waitforlisten 2345469 00:08:10.924 23:00:14 -- common/autotest_common.sh@829 -- # '[' -z 2345469 ']' 00:08:10.924 23:00:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:10.924 23:00:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:10.924 23:00:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:10.924 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:10.924 23:00:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:10.924 23:00:14 -- common/autotest_common.sh@10 -- # set +x 00:08:10.924 EAL: No free 2048 kB hugepages reported on node 1 00:08:11.182 23:00:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:11.182 23:00:14 -- common/autotest_common.sh@862 -- # return 0 00:08:11.182 23:00:14 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:08:11.182 23:00:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:11.182 23:00:14 -- common/autotest_common.sh@10 -- # set +x 00:08:11.182 23:00:14 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:08:11.182 23:00:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:11.182 23:00:14 -- common/autotest_common.sh@10 -- # set +x 00:08:11.182 23:00:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:11.182 23:00:14 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:08:11.182 23:00:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:11.182 23:00:14 -- common/autotest_common.sh@10 -- # set +x 00:08:11.182 23:00:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:11.182 23:00:14 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:08:11.182 23:00:14 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:08:11.182 23:00:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:11.182 23:00:14 -- common/autotest_common.sh@10 -- # set +x 00:08:11.182 23:00:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:11.182 23:00:14 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:08:11.182 23:00:14 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:08:11.182 23:00:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:11.182 23:00:14 -- common/autotest_common.sh@10 -- # set +x 00:08:11.182 23:00:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:11.182 23:00:14 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:11.182 23:00:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:11.182 23:00:14 -- common/autotest_common.sh@10 -- # set +x 00:08:11.440 23:00:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:11.440 23:00:14 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:08:11.440 23:00:14 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:08:11.440 EAL: No free 2048 kB hugepages reported on node 1 00:08:23.649 Initializing NVMe Controllers 00:08:23.649 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:08:23.649 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:08:23.649 Initialization complete. Launching workers. 00:08:23.649 ======================================================== 00:08:23.649 Latency(us) 00:08:23.649 Device Information : IOPS MiB/s Average min max 00:08:23.649 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 15359.52 60.00 4166.28 934.31 15711.77 00:08:23.649 ======================================================== 00:08:23.649 Total : 15359.52 60.00 4166.28 934.31 15711.77 00:08:23.649 00:08:23.649 23:00:25 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:08:23.649 23:00:25 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:08:23.649 23:00:25 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:23.649 23:00:25 -- nvmf/common.sh@116 -- # sync 00:08:23.649 23:00:25 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:23.649 23:00:25 -- nvmf/common.sh@119 -- # set +e 00:08:23.649 23:00:25 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:23.649 23:00:25 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:23.649 rmmod nvme_tcp 00:08:23.649 rmmod nvme_fabrics 00:08:23.649 rmmod nvme_keyring 00:08:23.649 23:00:25 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:23.649 23:00:25 -- nvmf/common.sh@123 -- # set -e 00:08:23.649 23:00:25 -- nvmf/common.sh@124 -- # return 0 00:08:23.649 23:00:25 -- nvmf/common.sh@477 -- # '[' -n 2345469 ']' 00:08:23.649 23:00:25 -- nvmf/common.sh@478 -- # killprocess 2345469 00:08:23.649 23:00:25 -- common/autotest_common.sh@936 -- # '[' -z 2345469 ']' 00:08:23.649 23:00:25 -- common/autotest_common.sh@940 -- # kill -0 2345469 00:08:23.649 23:00:25 -- common/autotest_common.sh@941 -- # uname 00:08:23.649 23:00:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:23.649 23:00:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2345469 00:08:23.649 23:00:25 -- common/autotest_common.sh@942 -- # process_name=nvmf 00:08:23.649 23:00:25 -- common/autotest_common.sh@946 -- # '[' nvmf = sudo ']' 00:08:23.649 23:00:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2345469' 00:08:23.649 killing process with pid 2345469 00:08:23.649 23:00:25 -- common/autotest_common.sh@955 -- # kill 2345469 00:08:23.649 23:00:25 -- common/autotest_common.sh@960 -- # wait 2345469 00:08:23.649 nvmf threads initialize successfully 00:08:23.649 bdev subsystem init successfully 00:08:23.649 created a nvmf target service 00:08:23.649 create targets's poll groups done 00:08:23.649 all subsystems of target started 00:08:23.649 nvmf target is running 00:08:23.649 all subsystems of target stopped 00:08:23.649 destroy targets's poll groups done 00:08:23.649 destroyed the nvmf target service 00:08:23.649 bdev subsystem finish successfully 00:08:23.649 nvmf threads destroy successfully 00:08:23.649 23:00:25 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:23.649 23:00:25 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:23.649 23:00:25 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:23.649 23:00:25 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:23.649 23:00:25 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:23.649 23:00:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:23.649 23:00:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:23.649 23:00:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:23.908 23:00:27 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:23.908 23:00:27 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:08:23.908 23:00:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:23.908 23:00:27 -- common/autotest_common.sh@10 -- # set +x 00:08:23.908 00:08:23.908 real 0m15.455s 00:08:23.908 user 0m41.794s 00:08:23.908 sys 0m3.690s 00:08:23.908 23:00:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:23.908 23:00:27 -- common/autotest_common.sh@10 -- # set +x 00:08:23.908 ************************************ 00:08:23.908 END TEST nvmf_example 00:08:23.908 ************************************ 00:08:23.908 23:00:27 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:08:23.908 23:00:27 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:23.908 23:00:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:23.908 23:00:27 -- common/autotest_common.sh@10 -- # set +x 00:08:24.168 ************************************ 00:08:24.169 START TEST nvmf_filesystem 00:08:24.169 ************************************ 00:08:24.169 23:00:27 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:08:24.169 * Looking for test storage... 00:08:24.169 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:24.169 23:00:27 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:24.169 23:00:27 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:24.169 23:00:27 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:24.169 23:00:27 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:24.169 23:00:27 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:24.169 23:00:27 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:24.169 23:00:27 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:24.169 23:00:27 -- scripts/common.sh@335 -- # IFS=.-: 00:08:24.169 23:00:27 -- scripts/common.sh@335 -- # read -ra ver1 00:08:24.169 23:00:27 -- scripts/common.sh@336 -- # IFS=.-: 00:08:24.169 23:00:27 -- scripts/common.sh@336 -- # read -ra ver2 00:08:24.169 23:00:27 -- scripts/common.sh@337 -- # local 'op=<' 00:08:24.169 23:00:27 -- scripts/common.sh@339 -- # ver1_l=2 00:08:24.169 23:00:27 -- scripts/common.sh@340 -- # ver2_l=1 00:08:24.169 23:00:27 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:24.169 23:00:27 -- scripts/common.sh@343 -- # case "$op" in 00:08:24.169 23:00:27 -- scripts/common.sh@344 -- # : 1 00:08:24.169 23:00:27 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:24.169 23:00:27 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:24.169 23:00:27 -- scripts/common.sh@364 -- # decimal 1 00:08:24.169 23:00:27 -- scripts/common.sh@352 -- # local d=1 00:08:24.169 23:00:27 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:24.169 23:00:27 -- scripts/common.sh@354 -- # echo 1 00:08:24.169 23:00:27 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:24.169 23:00:27 -- scripts/common.sh@365 -- # decimal 2 00:08:24.169 23:00:27 -- scripts/common.sh@352 -- # local d=2 00:08:24.169 23:00:27 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:24.169 23:00:27 -- scripts/common.sh@354 -- # echo 2 00:08:24.169 23:00:27 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:24.169 23:00:27 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:24.169 23:00:27 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:24.169 23:00:27 -- scripts/common.sh@367 -- # return 0 00:08:24.169 23:00:27 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:24.169 23:00:27 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:24.169 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:24.169 --rc genhtml_branch_coverage=1 00:08:24.169 --rc genhtml_function_coverage=1 00:08:24.169 --rc genhtml_legend=1 00:08:24.169 --rc geninfo_all_blocks=1 00:08:24.169 --rc geninfo_unexecuted_blocks=1 00:08:24.169 00:08:24.169 ' 00:08:24.169 23:00:27 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:24.169 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:24.169 --rc genhtml_branch_coverage=1 00:08:24.169 --rc genhtml_function_coverage=1 00:08:24.169 --rc genhtml_legend=1 00:08:24.169 --rc geninfo_all_blocks=1 00:08:24.169 --rc geninfo_unexecuted_blocks=1 00:08:24.169 00:08:24.169 ' 00:08:24.169 23:00:27 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:24.169 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:24.169 --rc genhtml_branch_coverage=1 00:08:24.169 --rc genhtml_function_coverage=1 00:08:24.169 --rc genhtml_legend=1 00:08:24.169 --rc geninfo_all_blocks=1 00:08:24.169 --rc geninfo_unexecuted_blocks=1 00:08:24.169 00:08:24.169 ' 00:08:24.169 23:00:27 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:24.169 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:24.169 --rc genhtml_branch_coverage=1 00:08:24.169 --rc genhtml_function_coverage=1 00:08:24.169 --rc genhtml_legend=1 00:08:24.169 --rc geninfo_all_blocks=1 00:08:24.169 --rc geninfo_unexecuted_blocks=1 00:08:24.169 00:08:24.169 ' 00:08:24.169 23:00:27 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:08:24.169 23:00:27 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:08:24.169 23:00:27 -- common/autotest_common.sh@34 -- # set -e 00:08:24.169 23:00:27 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:08:24.169 23:00:27 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:08:24.169 23:00:27 -- common/autotest_common.sh@38 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:08:24.169 23:00:27 -- common/autotest_common.sh@39 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:08:24.169 23:00:27 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:08:24.169 23:00:27 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:08:24.169 23:00:27 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:08:24.169 23:00:27 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:08:24.169 23:00:27 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:08:24.169 23:00:27 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:08:24.169 23:00:27 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:08:24.169 23:00:27 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:08:24.169 23:00:27 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:08:24.169 23:00:27 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:08:24.169 23:00:27 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:08:24.169 23:00:27 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:08:24.169 23:00:27 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:08:24.169 23:00:27 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:08:24.169 23:00:27 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:08:24.169 23:00:27 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:08:24.169 23:00:27 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:08:24.169 23:00:27 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:08:24.169 23:00:27 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:08:24.169 23:00:27 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:08:24.169 23:00:27 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:08:24.169 23:00:27 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:08:24.169 23:00:27 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:08:24.169 23:00:27 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:08:24.169 23:00:27 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:08:24.169 23:00:27 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:08:24.169 23:00:27 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:08:24.169 23:00:27 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:08:24.169 23:00:27 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:08:24.169 23:00:27 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:08:24.169 23:00:27 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:08:24.169 23:00:27 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:08:24.169 23:00:27 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:08:24.169 23:00:27 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:08:24.169 23:00:27 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:08:24.169 23:00:27 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:08:24.169 23:00:27 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:08:24.169 23:00:27 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:08:24.169 23:00:27 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:08:24.169 23:00:27 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:08:24.169 23:00:27 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR=//var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:08:24.169 23:00:27 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:08:24.169 23:00:27 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:08:24.169 23:00:27 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:08:24.169 23:00:27 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:08:24.169 23:00:27 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:08:24.169 23:00:27 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:08:24.169 23:00:27 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:08:24.169 23:00:27 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:08:24.169 23:00:27 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:08:24.169 23:00:27 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=y 00:08:24.169 23:00:27 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:08:24.169 23:00:27 -- common/build_config.sh@53 -- # CONFIG_URING_ZNS=n 00:08:24.169 23:00:27 -- common/build_config.sh@54 -- # CONFIG_WERROR=y 00:08:24.169 23:00:27 -- common/build_config.sh@55 -- # CONFIG_HAVE_LIBBSD=n 00:08:24.169 23:00:27 -- common/build_config.sh@56 -- # CONFIG_UBSAN=y 00:08:24.169 23:00:27 -- common/build_config.sh@57 -- # CONFIG_IPSEC_MB_DIR= 00:08:24.169 23:00:27 -- common/build_config.sh@58 -- # CONFIG_GOLANG=n 00:08:24.169 23:00:27 -- common/build_config.sh@59 -- # CONFIG_ISAL=y 00:08:24.169 23:00:27 -- common/build_config.sh@60 -- # CONFIG_IDXD_KERNEL=y 00:08:24.169 23:00:27 -- common/build_config.sh@61 -- # CONFIG_DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:24.169 23:00:27 -- common/build_config.sh@62 -- # CONFIG_RDMA_PROV=verbs 00:08:24.169 23:00:27 -- common/build_config.sh@63 -- # CONFIG_APPS=y 00:08:24.169 23:00:27 -- common/build_config.sh@64 -- # CONFIG_SHARED=y 00:08:24.169 23:00:27 -- common/build_config.sh@65 -- # CONFIG_FC_PATH= 00:08:24.169 23:00:27 -- common/build_config.sh@66 -- # CONFIG_DPDK_PKG_CONFIG=n 00:08:24.169 23:00:27 -- common/build_config.sh@67 -- # CONFIG_FC=n 00:08:24.169 23:00:27 -- common/build_config.sh@68 -- # CONFIG_AVAHI=n 00:08:24.169 23:00:27 -- common/build_config.sh@69 -- # CONFIG_FIO_PLUGIN=y 00:08:24.169 23:00:27 -- common/build_config.sh@70 -- # CONFIG_RAID5F=n 00:08:24.169 23:00:27 -- common/build_config.sh@71 -- # CONFIG_EXAMPLES=y 00:08:24.169 23:00:27 -- common/build_config.sh@72 -- # CONFIG_TESTS=y 00:08:24.169 23:00:27 -- common/build_config.sh@73 -- # CONFIG_CRYPTO_MLX5=n 00:08:24.169 23:00:27 -- common/build_config.sh@74 -- # CONFIG_MAX_LCORES= 00:08:24.169 23:00:27 -- common/build_config.sh@75 -- # CONFIG_IPSEC_MB=n 00:08:24.170 23:00:27 -- common/build_config.sh@76 -- # CONFIG_DEBUG=y 00:08:24.170 23:00:27 -- common/build_config.sh@77 -- # CONFIG_DPDK_COMPRESSDEV=n 00:08:24.170 23:00:27 -- common/build_config.sh@78 -- # CONFIG_CROSS_PREFIX= 00:08:24.170 23:00:27 -- common/build_config.sh@79 -- # CONFIG_URING=n 00:08:24.170 23:00:27 -- common/autotest_common.sh@48 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:08:24.170 23:00:27 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:08:24.170 23:00:27 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:08:24.170 23:00:27 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:08:24.170 23:00:27 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:08:24.170 23:00:27 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:08:24.170 23:00:27 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:08:24.170 23:00:27 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:08:24.170 23:00:27 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:08:24.170 23:00:27 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:08:24.170 23:00:27 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:08:24.170 23:00:27 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:08:24.170 23:00:27 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:08:24.170 23:00:27 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:08:24.170 23:00:27 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:08:24.170 23:00:27 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:08:24.170 #define SPDK_CONFIG_H 00:08:24.170 #define SPDK_CONFIG_APPS 1 00:08:24.170 #define SPDK_CONFIG_ARCH native 00:08:24.170 #undef SPDK_CONFIG_ASAN 00:08:24.170 #undef SPDK_CONFIG_AVAHI 00:08:24.170 #undef SPDK_CONFIG_CET 00:08:24.170 #define SPDK_CONFIG_COVERAGE 1 00:08:24.170 #define SPDK_CONFIG_CROSS_PREFIX 00:08:24.170 #undef SPDK_CONFIG_CRYPTO 00:08:24.170 #undef SPDK_CONFIG_CRYPTO_MLX5 00:08:24.170 #undef SPDK_CONFIG_CUSTOMOCF 00:08:24.170 #undef SPDK_CONFIG_DAOS 00:08:24.170 #define SPDK_CONFIG_DAOS_DIR 00:08:24.170 #define SPDK_CONFIG_DEBUG 1 00:08:24.170 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:08:24.170 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:08:24.170 #define SPDK_CONFIG_DPDK_INC_DIR //var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:08:24.170 #define SPDK_CONFIG_DPDK_LIB_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:24.170 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:08:24.170 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:08:24.170 #define SPDK_CONFIG_EXAMPLES 1 00:08:24.170 #undef SPDK_CONFIG_FC 00:08:24.170 #define SPDK_CONFIG_FC_PATH 00:08:24.170 #define SPDK_CONFIG_FIO_PLUGIN 1 00:08:24.170 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:08:24.170 #undef SPDK_CONFIG_FUSE 00:08:24.170 #undef SPDK_CONFIG_FUZZER 00:08:24.170 #define SPDK_CONFIG_FUZZER_LIB 00:08:24.170 #undef SPDK_CONFIG_GOLANG 00:08:24.170 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:08:24.170 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:08:24.170 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:08:24.170 #undef SPDK_CONFIG_HAVE_LIBBSD 00:08:24.170 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:08:24.170 #define SPDK_CONFIG_IDXD 1 00:08:24.170 #define SPDK_CONFIG_IDXD_KERNEL 1 00:08:24.170 #undef SPDK_CONFIG_IPSEC_MB 00:08:24.170 #define SPDK_CONFIG_IPSEC_MB_DIR 00:08:24.170 #define SPDK_CONFIG_ISAL 1 00:08:24.170 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:08:24.170 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:08:24.170 #define SPDK_CONFIG_LIBDIR 00:08:24.170 #undef SPDK_CONFIG_LTO 00:08:24.170 #define SPDK_CONFIG_MAX_LCORES 00:08:24.170 #define SPDK_CONFIG_NVME_CUSE 1 00:08:24.170 #undef SPDK_CONFIG_OCF 00:08:24.170 #define SPDK_CONFIG_OCF_PATH 00:08:24.170 #define SPDK_CONFIG_OPENSSL_PATH 00:08:24.170 #undef SPDK_CONFIG_PGO_CAPTURE 00:08:24.170 #undef SPDK_CONFIG_PGO_USE 00:08:24.170 #define SPDK_CONFIG_PREFIX /usr/local 00:08:24.170 #undef SPDK_CONFIG_RAID5F 00:08:24.170 #undef SPDK_CONFIG_RBD 00:08:24.170 #define SPDK_CONFIG_RDMA 1 00:08:24.170 #define SPDK_CONFIG_RDMA_PROV verbs 00:08:24.170 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:08:24.170 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:08:24.170 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:08:24.170 #define SPDK_CONFIG_SHARED 1 00:08:24.170 #undef SPDK_CONFIG_SMA 00:08:24.170 #define SPDK_CONFIG_TESTS 1 00:08:24.170 #undef SPDK_CONFIG_TSAN 00:08:24.170 #define SPDK_CONFIG_UBLK 1 00:08:24.170 #define SPDK_CONFIG_UBSAN 1 00:08:24.170 #undef SPDK_CONFIG_UNIT_TESTS 00:08:24.170 #undef SPDK_CONFIG_URING 00:08:24.170 #define SPDK_CONFIG_URING_PATH 00:08:24.170 #undef SPDK_CONFIG_URING_ZNS 00:08:24.170 #undef SPDK_CONFIG_USDT 00:08:24.170 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:08:24.170 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:08:24.170 #define SPDK_CONFIG_VFIO_USER 1 00:08:24.170 #define SPDK_CONFIG_VFIO_USER_DIR 00:08:24.170 #define SPDK_CONFIG_VHOST 1 00:08:24.170 #define SPDK_CONFIG_VIRTIO 1 00:08:24.170 #undef SPDK_CONFIG_VTUNE 00:08:24.170 #define SPDK_CONFIG_VTUNE_DIR 00:08:24.170 #define SPDK_CONFIG_WERROR 1 00:08:24.170 #define SPDK_CONFIG_WPDK_DIR 00:08:24.170 #undef SPDK_CONFIG_XNVME 00:08:24.170 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:08:24.170 23:00:27 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:08:24.170 23:00:27 -- common/autotest_common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:24.170 23:00:27 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:24.170 23:00:27 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:24.170 23:00:27 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:24.170 23:00:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:24.170 23:00:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:24.170 23:00:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:24.170 23:00:27 -- paths/export.sh@5 -- # export PATH 00:08:24.170 23:00:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:24.170 23:00:27 -- common/autotest_common.sh@50 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:08:24.170 23:00:27 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:08:24.170 23:00:27 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:08:24.170 23:00:27 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:08:24.170 23:00:27 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:08:24.170 23:00:27 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:08:24.170 23:00:27 -- pm/common@16 -- # TEST_TAG=N/A 00:08:24.170 23:00:27 -- pm/common@17 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:08:24.170 23:00:27 -- common/autotest_common.sh@52 -- # : 1 00:08:24.170 23:00:27 -- common/autotest_common.sh@53 -- # export RUN_NIGHTLY 00:08:24.170 23:00:27 -- common/autotest_common.sh@56 -- # : 0 00:08:24.170 23:00:27 -- common/autotest_common.sh@57 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:08:24.170 23:00:27 -- common/autotest_common.sh@58 -- # : 0 00:08:24.170 23:00:27 -- common/autotest_common.sh@59 -- # export SPDK_RUN_VALGRIND 00:08:24.170 23:00:27 -- common/autotest_common.sh@60 -- # : 1 00:08:24.170 23:00:27 -- common/autotest_common.sh@61 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:08:24.170 23:00:27 -- common/autotest_common.sh@62 -- # : 0 00:08:24.170 23:00:27 -- common/autotest_common.sh@63 -- # export SPDK_TEST_UNITTEST 00:08:24.170 23:00:27 -- common/autotest_common.sh@64 -- # : 00:08:24.170 23:00:27 -- common/autotest_common.sh@65 -- # export SPDK_TEST_AUTOBUILD 00:08:24.170 23:00:27 -- common/autotest_common.sh@66 -- # : 0 00:08:24.170 23:00:27 -- common/autotest_common.sh@67 -- # export SPDK_TEST_RELEASE_BUILD 00:08:24.170 23:00:27 -- common/autotest_common.sh@68 -- # : 0 00:08:24.170 23:00:27 -- common/autotest_common.sh@69 -- # export SPDK_TEST_ISAL 00:08:24.170 23:00:27 -- common/autotest_common.sh@70 -- # : 0 00:08:24.170 23:00:27 -- common/autotest_common.sh@71 -- # export SPDK_TEST_ISCSI 00:08:24.170 23:00:27 -- common/autotest_common.sh@72 -- # : 0 00:08:24.170 23:00:27 -- common/autotest_common.sh@73 -- # export SPDK_TEST_ISCSI_INITIATOR 00:08:24.170 23:00:27 -- common/autotest_common.sh@74 -- # : 0 00:08:24.170 23:00:27 -- common/autotest_common.sh@75 -- # export SPDK_TEST_NVME 00:08:24.170 23:00:27 -- common/autotest_common.sh@76 -- # : 0 00:08:24.170 23:00:27 -- common/autotest_common.sh@77 -- # export SPDK_TEST_NVME_PMR 00:08:24.170 23:00:27 -- common/autotest_common.sh@78 -- # : 0 00:08:24.170 23:00:27 -- common/autotest_common.sh@79 -- # export SPDK_TEST_NVME_BP 00:08:24.170 23:00:27 -- common/autotest_common.sh@80 -- # : 1 00:08:24.170 23:00:27 -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME_CLI 00:08:24.170 23:00:27 -- common/autotest_common.sh@82 -- # : 0 00:08:24.170 23:00:27 -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_CUSE 00:08:24.170 23:00:27 -- common/autotest_common.sh@84 -- # : 0 00:08:24.170 23:00:27 -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_FDP 00:08:24.171 23:00:27 -- common/autotest_common.sh@86 -- # : 1 00:08:24.171 23:00:27 -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVMF 00:08:24.171 23:00:27 -- common/autotest_common.sh@88 -- # : 1 00:08:24.171 23:00:27 -- common/autotest_common.sh@89 -- # export SPDK_TEST_VFIOUSER 00:08:24.171 23:00:27 -- common/autotest_common.sh@90 -- # : 0 00:08:24.171 23:00:27 -- common/autotest_common.sh@91 -- # export SPDK_TEST_VFIOUSER_QEMU 00:08:24.171 23:00:27 -- common/autotest_common.sh@92 -- # : 0 00:08:24.171 23:00:27 -- common/autotest_common.sh@93 -- # export SPDK_TEST_FUZZER 00:08:24.171 23:00:27 -- common/autotest_common.sh@94 -- # : 0 00:08:24.171 23:00:27 -- common/autotest_common.sh@95 -- # export SPDK_TEST_FUZZER_SHORT 00:08:24.171 23:00:27 -- common/autotest_common.sh@96 -- # : tcp 00:08:24.171 23:00:27 -- common/autotest_common.sh@97 -- # export SPDK_TEST_NVMF_TRANSPORT 00:08:24.171 23:00:27 -- common/autotest_common.sh@98 -- # : 0 00:08:24.171 23:00:27 -- common/autotest_common.sh@99 -- # export SPDK_TEST_RBD 00:08:24.171 23:00:27 -- common/autotest_common.sh@100 -- # : 0 00:08:24.171 23:00:27 -- common/autotest_common.sh@101 -- # export SPDK_TEST_VHOST 00:08:24.171 23:00:27 -- common/autotest_common.sh@102 -- # : 0 00:08:24.171 23:00:27 -- common/autotest_common.sh@103 -- # export SPDK_TEST_BLOCKDEV 00:08:24.171 23:00:27 -- common/autotest_common.sh@104 -- # : 0 00:08:24.171 23:00:27 -- common/autotest_common.sh@105 -- # export SPDK_TEST_IOAT 00:08:24.171 23:00:27 -- common/autotest_common.sh@106 -- # : 0 00:08:24.171 23:00:27 -- common/autotest_common.sh@107 -- # export SPDK_TEST_BLOBFS 00:08:24.171 23:00:27 -- common/autotest_common.sh@108 -- # : 0 00:08:24.171 23:00:27 -- common/autotest_common.sh@109 -- # export SPDK_TEST_VHOST_INIT 00:08:24.171 23:00:27 -- common/autotest_common.sh@110 -- # : 0 00:08:24.171 23:00:27 -- common/autotest_common.sh@111 -- # export SPDK_TEST_LVOL 00:08:24.171 23:00:27 -- common/autotest_common.sh@112 -- # : 0 00:08:24.171 23:00:27 -- common/autotest_common.sh@113 -- # export SPDK_TEST_VBDEV_COMPRESS 00:08:24.171 23:00:27 -- common/autotest_common.sh@114 -- # : 0 00:08:24.171 23:00:27 -- common/autotest_common.sh@115 -- # export SPDK_RUN_ASAN 00:08:24.171 23:00:27 -- common/autotest_common.sh@116 -- # : 1 00:08:24.171 23:00:27 -- common/autotest_common.sh@117 -- # export SPDK_RUN_UBSAN 00:08:24.171 23:00:27 -- common/autotest_common.sh@118 -- # : /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:08:24.171 23:00:27 -- common/autotest_common.sh@119 -- # export SPDK_RUN_EXTERNAL_DPDK 00:08:24.171 23:00:27 -- common/autotest_common.sh@120 -- # : 0 00:08:24.171 23:00:27 -- common/autotest_common.sh@121 -- # export SPDK_RUN_NON_ROOT 00:08:24.171 23:00:27 -- common/autotest_common.sh@122 -- # : 0 00:08:24.171 23:00:27 -- common/autotest_common.sh@123 -- # export SPDK_TEST_CRYPTO 00:08:24.171 23:00:27 -- common/autotest_common.sh@124 -- # : 0 00:08:24.171 23:00:27 -- common/autotest_common.sh@125 -- # export SPDK_TEST_FTL 00:08:24.171 23:00:27 -- common/autotest_common.sh@126 -- # : 0 00:08:24.171 23:00:27 -- common/autotest_common.sh@127 -- # export SPDK_TEST_OCF 00:08:24.171 23:00:27 -- common/autotest_common.sh@128 -- # : 0 00:08:24.171 23:00:27 -- common/autotest_common.sh@129 -- # export SPDK_TEST_VMD 00:08:24.171 23:00:27 -- common/autotest_common.sh@130 -- # : 0 00:08:24.171 23:00:27 -- common/autotest_common.sh@131 -- # export SPDK_TEST_OPAL 00:08:24.171 23:00:27 -- common/autotest_common.sh@132 -- # : v23.11 00:08:24.171 23:00:27 -- common/autotest_common.sh@133 -- # export SPDK_TEST_NATIVE_DPDK 00:08:24.171 23:00:27 -- common/autotest_common.sh@134 -- # : true 00:08:24.171 23:00:27 -- common/autotest_common.sh@135 -- # export SPDK_AUTOTEST_X 00:08:24.171 23:00:27 -- common/autotest_common.sh@136 -- # : 0 00:08:24.171 23:00:27 -- common/autotest_common.sh@137 -- # export SPDK_TEST_RAID5 00:08:24.171 23:00:27 -- common/autotest_common.sh@138 -- # : 0 00:08:24.171 23:00:27 -- common/autotest_common.sh@139 -- # export SPDK_TEST_URING 00:08:24.171 23:00:27 -- common/autotest_common.sh@140 -- # : 0 00:08:24.171 23:00:27 -- common/autotest_common.sh@141 -- # export SPDK_TEST_USDT 00:08:24.171 23:00:27 -- common/autotest_common.sh@142 -- # : 0 00:08:24.171 23:00:27 -- common/autotest_common.sh@143 -- # export SPDK_TEST_USE_IGB_UIO 00:08:24.171 23:00:27 -- common/autotest_common.sh@144 -- # : 0 00:08:24.171 23:00:27 -- common/autotest_common.sh@145 -- # export SPDK_TEST_SCHEDULER 00:08:24.171 23:00:27 -- common/autotest_common.sh@146 -- # : 0 00:08:24.171 23:00:27 -- common/autotest_common.sh@147 -- # export SPDK_TEST_SCANBUILD 00:08:24.171 23:00:27 -- common/autotest_common.sh@148 -- # : e810 00:08:24.171 23:00:27 -- common/autotest_common.sh@149 -- # export SPDK_TEST_NVMF_NICS 00:08:24.171 23:00:27 -- common/autotest_common.sh@150 -- # : 0 00:08:24.171 23:00:27 -- common/autotest_common.sh@151 -- # export SPDK_TEST_SMA 00:08:24.171 23:00:27 -- common/autotest_common.sh@152 -- # : 0 00:08:24.171 23:00:27 -- common/autotest_common.sh@153 -- # export SPDK_TEST_DAOS 00:08:24.171 23:00:27 -- common/autotest_common.sh@154 -- # : 0 00:08:24.171 23:00:27 -- common/autotest_common.sh@155 -- # export SPDK_TEST_XNVME 00:08:24.171 23:00:27 -- common/autotest_common.sh@156 -- # : 0 00:08:24.171 23:00:27 -- common/autotest_common.sh@157 -- # export SPDK_TEST_ACCEL_DSA 00:08:24.171 23:00:27 -- common/autotest_common.sh@158 -- # : 0 00:08:24.171 23:00:27 -- common/autotest_common.sh@159 -- # export SPDK_TEST_ACCEL_IAA 00:08:24.171 23:00:27 -- common/autotest_common.sh@160 -- # : 0 00:08:24.171 23:00:27 -- common/autotest_common.sh@161 -- # export SPDK_TEST_ACCEL_IOAT 00:08:24.171 23:00:27 -- common/autotest_common.sh@163 -- # : 00:08:24.171 23:00:27 -- common/autotest_common.sh@164 -- # export SPDK_TEST_FUZZER_TARGET 00:08:24.171 23:00:27 -- common/autotest_common.sh@165 -- # : 0 00:08:24.171 23:00:27 -- common/autotest_common.sh@166 -- # export SPDK_TEST_NVMF_MDNS 00:08:24.171 23:00:27 -- common/autotest_common.sh@167 -- # : 0 00:08:24.171 23:00:27 -- common/autotest_common.sh@168 -- # export SPDK_JSONRPC_GO_CLIENT 00:08:24.171 23:00:27 -- common/autotest_common.sh@171 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:08:24.171 23:00:27 -- common/autotest_common.sh@171 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:08:24.171 23:00:27 -- common/autotest_common.sh@172 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:24.171 23:00:27 -- common/autotest_common.sh@172 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:24.171 23:00:27 -- common/autotest_common.sh@173 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:24.171 23:00:27 -- common/autotest_common.sh@173 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:24.171 23:00:27 -- common/autotest_common.sh@174 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:24.171 23:00:27 -- common/autotest_common.sh@174 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:24.171 23:00:27 -- common/autotest_common.sh@177 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:08:24.171 23:00:27 -- common/autotest_common.sh@177 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:08:24.171 23:00:27 -- common/autotest_common.sh@181 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:08:24.171 23:00:27 -- common/autotest_common.sh@181 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:08:24.171 23:00:27 -- common/autotest_common.sh@185 -- # export PYTHONDONTWRITEBYTECODE=1 00:08:24.171 23:00:27 -- common/autotest_common.sh@185 -- # PYTHONDONTWRITEBYTECODE=1 00:08:24.171 23:00:27 -- common/autotest_common.sh@189 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:08:24.171 23:00:27 -- common/autotest_common.sh@189 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:08:24.171 23:00:27 -- common/autotest_common.sh@190 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:08:24.171 23:00:27 -- common/autotest_common.sh@190 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:08:24.171 23:00:27 -- common/autotest_common.sh@194 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:08:24.171 23:00:27 -- common/autotest_common.sh@195 -- # rm -rf /var/tmp/asan_suppression_file 00:08:24.171 23:00:27 -- common/autotest_common.sh@196 -- # cat 00:08:24.171 23:00:27 -- common/autotest_common.sh@222 -- # echo leak:libfuse3.so 00:08:24.171 23:00:27 -- common/autotest_common.sh@224 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:08:24.171 23:00:27 -- common/autotest_common.sh@224 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:08:24.171 23:00:27 -- common/autotest_common.sh@226 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:08:24.171 23:00:27 -- common/autotest_common.sh@226 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:08:24.171 23:00:27 -- common/autotest_common.sh@228 -- # '[' -z /var/spdk/dependencies ']' 00:08:24.171 23:00:27 -- common/autotest_common.sh@231 -- # export DEPENDENCY_DIR 00:08:24.171 23:00:27 -- common/autotest_common.sh@235 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:08:24.171 23:00:27 -- common/autotest_common.sh@235 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:08:24.171 23:00:27 -- common/autotest_common.sh@236 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:08:24.172 23:00:27 -- common/autotest_common.sh@236 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:08:24.172 23:00:27 -- common/autotest_common.sh@239 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:08:24.172 23:00:27 -- common/autotest_common.sh@239 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:08:24.172 23:00:27 -- common/autotest_common.sh@240 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:08:24.172 23:00:27 -- common/autotest_common.sh@240 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:08:24.172 23:00:27 -- common/autotest_common.sh@242 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:08:24.172 23:00:27 -- common/autotest_common.sh@242 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:08:24.172 23:00:27 -- common/autotest_common.sh@245 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:08:24.172 23:00:27 -- common/autotest_common.sh@245 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:08:24.172 23:00:27 -- common/autotest_common.sh@247 -- # _LCOV_MAIN=0 00:08:24.172 23:00:27 -- common/autotest_common.sh@248 -- # _LCOV_LLVM=1 00:08:24.172 23:00:27 -- common/autotest_common.sh@249 -- # _LCOV= 00:08:24.172 23:00:27 -- common/autotest_common.sh@250 -- # [[ '' == *clang* ]] 00:08:24.172 23:00:27 -- common/autotest_common.sh@250 -- # [[ 0 -eq 1 ]] 00:08:24.172 23:00:27 -- common/autotest_common.sh@252 -- # _lcov_opt[_LCOV_LLVM]='--gcov-tool /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/fuzz/llvm/llvm-gcov.sh' 00:08:24.172 23:00:27 -- common/autotest_common.sh@253 -- # _lcov_opt[_LCOV_MAIN]= 00:08:24.172 23:00:27 -- common/autotest_common.sh@255 -- # lcov_opt= 00:08:24.172 23:00:27 -- common/autotest_common.sh@258 -- # '[' 0 -eq 0 ']' 00:08:24.172 23:00:27 -- common/autotest_common.sh@259 -- # export valgrind= 00:08:24.172 23:00:27 -- common/autotest_common.sh@259 -- # valgrind= 00:08:24.172 23:00:27 -- common/autotest_common.sh@265 -- # uname -s 00:08:24.172 23:00:27 -- common/autotest_common.sh@265 -- # '[' Linux = Linux ']' 00:08:24.172 23:00:27 -- common/autotest_common.sh@266 -- # HUGEMEM=4096 00:08:24.172 23:00:27 -- common/autotest_common.sh@267 -- # export CLEAR_HUGE=yes 00:08:24.172 23:00:27 -- common/autotest_common.sh@267 -- # CLEAR_HUGE=yes 00:08:24.172 23:00:27 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:08:24.172 23:00:27 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:08:24.172 23:00:27 -- common/autotest_common.sh@275 -- # MAKE=make 00:08:24.172 23:00:27 -- common/autotest_common.sh@276 -- # MAKEFLAGS=-j48 00:08:24.172 23:00:27 -- common/autotest_common.sh@292 -- # export HUGEMEM=4096 00:08:24.172 23:00:27 -- common/autotest_common.sh@292 -- # HUGEMEM=4096 00:08:24.172 23:00:27 -- common/autotest_common.sh@294 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:08:24.172 23:00:27 -- common/autotest_common.sh@299 -- # NO_HUGE=() 00:08:24.172 23:00:27 -- common/autotest_common.sh@300 -- # TEST_MODE= 00:08:24.172 23:00:27 -- common/autotest_common.sh@301 -- # for i in "$@" 00:08:24.172 23:00:27 -- common/autotest_common.sh@302 -- # case "$i" in 00:08:24.172 23:00:27 -- common/autotest_common.sh@307 -- # TEST_TRANSPORT=tcp 00:08:24.172 23:00:27 -- common/autotest_common.sh@319 -- # [[ -z 2347223 ]] 00:08:24.172 23:00:27 -- common/autotest_common.sh@319 -- # kill -0 2347223 00:08:24.172 23:00:27 -- common/autotest_common.sh@1675 -- # set_test_storage 2147483648 00:08:24.172 23:00:27 -- common/autotest_common.sh@329 -- # [[ -v testdir ]] 00:08:24.172 23:00:27 -- common/autotest_common.sh@331 -- # local requested_size=2147483648 00:08:24.172 23:00:27 -- common/autotest_common.sh@332 -- # local mount target_dir 00:08:24.172 23:00:27 -- common/autotest_common.sh@334 -- # local -A mounts fss sizes avails uses 00:08:24.172 23:00:27 -- common/autotest_common.sh@335 -- # local source fs size avail mount use 00:08:24.172 23:00:27 -- common/autotest_common.sh@337 -- # local storage_fallback storage_candidates 00:08:24.172 23:00:27 -- common/autotest_common.sh@339 -- # mktemp -udt spdk.XXXXXX 00:08:24.172 23:00:27 -- common/autotest_common.sh@339 -- # storage_fallback=/tmp/spdk.DJ0cRC 00:08:24.172 23:00:27 -- common/autotest_common.sh@344 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:08:24.172 23:00:27 -- common/autotest_common.sh@346 -- # [[ -n '' ]] 00:08:24.172 23:00:27 -- common/autotest_common.sh@351 -- # [[ -n '' ]] 00:08:24.172 23:00:27 -- common/autotest_common.sh@356 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.DJ0cRC/tests/target /tmp/spdk.DJ0cRC 00:08:24.172 23:00:27 -- common/autotest_common.sh@359 -- # requested_size=2214592512 00:08:24.172 23:00:27 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:24.172 23:00:27 -- common/autotest_common.sh@328 -- # df -T 00:08:24.172 23:00:27 -- common/autotest_common.sh@328 -- # grep -v Filesystem 00:08:24.172 23:00:27 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_devtmpfs 00:08:24.172 23:00:27 -- common/autotest_common.sh@362 -- # fss["$mount"]=devtmpfs 00:08:24.172 23:00:27 -- common/autotest_common.sh@363 -- # avails["$mount"]=67108864 00:08:24.172 23:00:27 -- common/autotest_common.sh@363 -- # sizes["$mount"]=67108864 00:08:24.172 23:00:27 -- common/autotest_common.sh@364 -- # uses["$mount"]=0 00:08:24.172 23:00:27 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:24.172 23:00:27 -- common/autotest_common.sh@362 -- # mounts["$mount"]=/dev/pmem0 00:08:24.172 23:00:27 -- common/autotest_common.sh@362 -- # fss["$mount"]=ext2 00:08:24.172 23:00:27 -- common/autotest_common.sh@363 -- # avails["$mount"]=4096 00:08:24.172 23:00:27 -- common/autotest_common.sh@363 -- # sizes["$mount"]=5284429824 00:08:24.172 23:00:27 -- common/autotest_common.sh@364 -- # uses["$mount"]=5284425728 00:08:24.172 23:00:27 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:24.172 23:00:27 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_root 00:08:24.172 23:00:27 -- common/autotest_common.sh@362 -- # fss["$mount"]=overlay 00:08:24.172 23:00:27 -- common/autotest_common.sh@363 -- # avails["$mount"]=53290561536 00:08:24.172 23:00:27 -- common/autotest_common.sh@363 -- # sizes["$mount"]=61988519936 00:08:24.172 23:00:27 -- common/autotest_common.sh@364 -- # uses["$mount"]=8697958400 00:08:24.172 23:00:27 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:24.172 23:00:27 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:08:24.172 23:00:27 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:08:24.172 23:00:27 -- common/autotest_common.sh@363 -- # avails["$mount"]=30993002496 00:08:24.172 23:00:27 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994259968 00:08:24.172 23:00:27 -- common/autotest_common.sh@364 -- # uses["$mount"]=1257472 00:08:24.172 23:00:27 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:24.172 23:00:27 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:08:24.172 23:00:27 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:08:24.172 23:00:27 -- common/autotest_common.sh@363 -- # avails["$mount"]=12388917248 00:08:24.172 23:00:27 -- common/autotest_common.sh@363 -- # sizes["$mount"]=12397707264 00:08:24.172 23:00:27 -- common/autotest_common.sh@364 -- # uses["$mount"]=8790016 00:08:24.172 23:00:27 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:24.172 23:00:27 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:08:24.172 23:00:27 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:08:24.172 23:00:27 -- common/autotest_common.sh@363 -- # avails["$mount"]=30994006016 00:08:24.172 23:00:27 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994259968 00:08:24.172 23:00:27 -- common/autotest_common.sh@364 -- # uses["$mount"]=253952 00:08:24.172 23:00:27 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:24.172 23:00:27 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:08:24.172 23:00:27 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:08:24.172 23:00:27 -- common/autotest_common.sh@363 -- # avails["$mount"]=6198837248 00:08:24.172 23:00:27 -- common/autotest_common.sh@363 -- # sizes["$mount"]=6198849536 00:08:24.172 23:00:27 -- common/autotest_common.sh@364 -- # uses["$mount"]=12288 00:08:24.172 23:00:27 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:24.172 23:00:27 -- common/autotest_common.sh@367 -- # printf '* Looking for test storage...\n' 00:08:24.172 * Looking for test storage... 00:08:24.172 23:00:27 -- common/autotest_common.sh@369 -- # local target_space new_size 00:08:24.172 23:00:27 -- common/autotest_common.sh@370 -- # for target_dir in "${storage_candidates[@]}" 00:08:24.172 23:00:27 -- common/autotest_common.sh@373 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:24.172 23:00:27 -- common/autotest_common.sh@373 -- # awk '$1 !~ /Filesystem/{print $6}' 00:08:24.172 23:00:27 -- common/autotest_common.sh@373 -- # mount=/ 00:08:24.172 23:00:27 -- common/autotest_common.sh@375 -- # target_space=53290561536 00:08:24.172 23:00:27 -- common/autotest_common.sh@376 -- # (( target_space == 0 || target_space < requested_size )) 00:08:24.172 23:00:27 -- common/autotest_common.sh@379 -- # (( target_space >= requested_size )) 00:08:24.172 23:00:27 -- common/autotest_common.sh@381 -- # [[ overlay == tmpfs ]] 00:08:24.172 23:00:27 -- common/autotest_common.sh@381 -- # [[ overlay == ramfs ]] 00:08:24.172 23:00:27 -- common/autotest_common.sh@381 -- # [[ / == / ]] 00:08:24.172 23:00:27 -- common/autotest_common.sh@382 -- # new_size=10912550912 00:08:24.172 23:00:27 -- common/autotest_common.sh@383 -- # (( new_size * 100 / sizes[/] > 95 )) 00:08:24.172 23:00:27 -- common/autotest_common.sh@388 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:24.172 23:00:27 -- common/autotest_common.sh@388 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:24.172 23:00:27 -- common/autotest_common.sh@389 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:24.172 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:24.172 23:00:27 -- common/autotest_common.sh@390 -- # return 0 00:08:24.172 23:00:27 -- common/autotest_common.sh@1677 -- # set -o errtrace 00:08:24.172 23:00:27 -- common/autotest_common.sh@1678 -- # shopt -s extdebug 00:08:24.172 23:00:27 -- common/autotest_common.sh@1679 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:08:24.172 23:00:27 -- common/autotest_common.sh@1681 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:08:24.172 23:00:27 -- common/autotest_common.sh@1682 -- # true 00:08:24.172 23:00:27 -- common/autotest_common.sh@1684 -- # xtrace_fd 00:08:24.172 23:00:27 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:08:24.172 23:00:27 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:08:24.172 23:00:27 -- common/autotest_common.sh@27 -- # exec 00:08:24.172 23:00:27 -- common/autotest_common.sh@29 -- # exec 00:08:24.172 23:00:27 -- common/autotest_common.sh@31 -- # xtrace_restore 00:08:24.172 23:00:27 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:08:24.172 23:00:27 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:08:24.172 23:00:27 -- common/autotest_common.sh@18 -- # set -x 00:08:24.172 23:00:27 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:24.172 23:00:27 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:24.172 23:00:27 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:24.432 23:00:27 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:24.432 23:00:27 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:24.432 23:00:27 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:24.432 23:00:27 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:24.432 23:00:27 -- scripts/common.sh@335 -- # IFS=.-: 00:08:24.432 23:00:27 -- scripts/common.sh@335 -- # read -ra ver1 00:08:24.432 23:00:27 -- scripts/common.sh@336 -- # IFS=.-: 00:08:24.432 23:00:27 -- scripts/common.sh@336 -- # read -ra ver2 00:08:24.433 23:00:27 -- scripts/common.sh@337 -- # local 'op=<' 00:08:24.433 23:00:27 -- scripts/common.sh@339 -- # ver1_l=2 00:08:24.433 23:00:27 -- scripts/common.sh@340 -- # ver2_l=1 00:08:24.433 23:00:27 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:24.433 23:00:27 -- scripts/common.sh@343 -- # case "$op" in 00:08:24.433 23:00:27 -- scripts/common.sh@344 -- # : 1 00:08:24.433 23:00:27 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:24.433 23:00:27 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:24.433 23:00:27 -- scripts/common.sh@364 -- # decimal 1 00:08:24.433 23:00:27 -- scripts/common.sh@352 -- # local d=1 00:08:24.433 23:00:27 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:24.433 23:00:27 -- scripts/common.sh@354 -- # echo 1 00:08:24.433 23:00:27 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:24.433 23:00:27 -- scripts/common.sh@365 -- # decimal 2 00:08:24.433 23:00:27 -- scripts/common.sh@352 -- # local d=2 00:08:24.433 23:00:27 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:24.433 23:00:27 -- scripts/common.sh@354 -- # echo 2 00:08:24.433 23:00:27 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:24.433 23:00:27 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:24.433 23:00:27 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:24.433 23:00:27 -- scripts/common.sh@367 -- # return 0 00:08:24.433 23:00:27 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:24.433 23:00:27 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:24.433 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:24.433 --rc genhtml_branch_coverage=1 00:08:24.433 --rc genhtml_function_coverage=1 00:08:24.433 --rc genhtml_legend=1 00:08:24.433 --rc geninfo_all_blocks=1 00:08:24.433 --rc geninfo_unexecuted_blocks=1 00:08:24.433 00:08:24.433 ' 00:08:24.433 23:00:27 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:24.433 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:24.433 --rc genhtml_branch_coverage=1 00:08:24.433 --rc genhtml_function_coverage=1 00:08:24.433 --rc genhtml_legend=1 00:08:24.433 --rc geninfo_all_blocks=1 00:08:24.433 --rc geninfo_unexecuted_blocks=1 00:08:24.433 00:08:24.433 ' 00:08:24.433 23:00:27 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:24.433 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:24.433 --rc genhtml_branch_coverage=1 00:08:24.433 --rc genhtml_function_coverage=1 00:08:24.433 --rc genhtml_legend=1 00:08:24.433 --rc geninfo_all_blocks=1 00:08:24.433 --rc geninfo_unexecuted_blocks=1 00:08:24.433 00:08:24.433 ' 00:08:24.433 23:00:27 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:24.433 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:24.433 --rc genhtml_branch_coverage=1 00:08:24.433 --rc genhtml_function_coverage=1 00:08:24.433 --rc genhtml_legend=1 00:08:24.433 --rc geninfo_all_blocks=1 00:08:24.433 --rc geninfo_unexecuted_blocks=1 00:08:24.433 00:08:24.433 ' 00:08:24.433 23:00:27 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:24.433 23:00:27 -- nvmf/common.sh@7 -- # uname -s 00:08:24.433 23:00:27 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:24.433 23:00:27 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:24.433 23:00:27 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:24.433 23:00:27 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:24.433 23:00:27 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:24.433 23:00:27 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:24.433 23:00:27 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:24.433 23:00:27 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:24.433 23:00:27 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:24.433 23:00:27 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:24.433 23:00:27 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:24.433 23:00:27 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:24.433 23:00:27 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:24.433 23:00:27 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:24.433 23:00:27 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:24.433 23:00:27 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:24.433 23:00:27 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:24.433 23:00:27 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:24.433 23:00:27 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:24.433 23:00:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:24.433 23:00:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:24.433 23:00:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:24.433 23:00:27 -- paths/export.sh@5 -- # export PATH 00:08:24.433 23:00:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:24.433 23:00:27 -- nvmf/common.sh@46 -- # : 0 00:08:24.433 23:00:27 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:24.433 23:00:27 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:24.433 23:00:27 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:24.433 23:00:27 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:24.433 23:00:27 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:24.433 23:00:27 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:24.433 23:00:27 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:24.433 23:00:27 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:24.433 23:00:27 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:08:24.433 23:00:27 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:08:24.433 23:00:27 -- target/filesystem.sh@15 -- # nvmftestinit 00:08:24.433 23:00:27 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:24.433 23:00:27 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:24.433 23:00:27 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:24.433 23:00:27 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:24.433 23:00:27 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:24.433 23:00:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:24.433 23:00:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:24.433 23:00:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:24.433 23:00:27 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:24.433 23:00:27 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:24.433 23:00:27 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:24.433 23:00:27 -- common/autotest_common.sh@10 -- # set +x 00:08:26.966 23:00:29 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:26.966 23:00:29 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:26.966 23:00:29 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:26.966 23:00:29 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:26.966 23:00:29 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:26.966 23:00:29 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:26.966 23:00:29 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:26.966 23:00:29 -- nvmf/common.sh@294 -- # net_devs=() 00:08:26.966 23:00:29 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:26.966 23:00:29 -- nvmf/common.sh@295 -- # e810=() 00:08:26.966 23:00:29 -- nvmf/common.sh@295 -- # local -ga e810 00:08:26.966 23:00:29 -- nvmf/common.sh@296 -- # x722=() 00:08:26.966 23:00:29 -- nvmf/common.sh@296 -- # local -ga x722 00:08:26.966 23:00:29 -- nvmf/common.sh@297 -- # mlx=() 00:08:26.966 23:00:29 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:26.966 23:00:29 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:26.966 23:00:29 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:26.966 23:00:29 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:26.966 23:00:29 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:26.966 23:00:30 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:26.966 23:00:30 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:26.966 23:00:30 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:26.966 23:00:30 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:26.966 23:00:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:26.966 23:00:30 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:26.966 23:00:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:26.966 23:00:30 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:26.966 23:00:30 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:26.966 23:00:30 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:26.966 23:00:30 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:26.966 23:00:30 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:26.966 23:00:30 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:26.966 23:00:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:26.966 23:00:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:26.966 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:26.966 23:00:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:26.966 23:00:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:26.966 23:00:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:26.966 23:00:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:26.966 23:00:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:26.966 23:00:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:26.966 23:00:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:26.966 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:26.966 23:00:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:26.966 23:00:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:26.966 23:00:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:26.966 23:00:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:26.966 23:00:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:26.966 23:00:30 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:26.966 23:00:30 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:26.966 23:00:30 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:26.966 23:00:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:26.966 23:00:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:26.966 23:00:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:26.966 23:00:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:26.966 23:00:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:26.966 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:26.966 23:00:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:26.966 23:00:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:26.966 23:00:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:26.966 23:00:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:26.966 23:00:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:26.966 23:00:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:26.966 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:26.966 23:00:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:26.966 23:00:30 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:26.966 23:00:30 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:26.966 23:00:30 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:26.966 23:00:30 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:26.966 23:00:30 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:26.966 23:00:30 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:26.966 23:00:30 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:26.966 23:00:30 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:26.966 23:00:30 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:26.966 23:00:30 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:26.966 23:00:30 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:26.966 23:00:30 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:26.966 23:00:30 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:26.966 23:00:30 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:26.966 23:00:30 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:26.967 23:00:30 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:26.967 23:00:30 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:26.967 23:00:30 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:26.967 23:00:30 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:26.967 23:00:30 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:26.967 23:00:30 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:26.967 23:00:30 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:26.967 23:00:30 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:26.967 23:00:30 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:26.967 23:00:30 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:26.967 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:26.967 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.243 ms 00:08:26.967 00:08:26.967 --- 10.0.0.2 ping statistics --- 00:08:26.967 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:26.967 rtt min/avg/max/mdev = 0.243/0.243/0.243/0.000 ms 00:08:26.967 23:00:30 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:26.967 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:26.967 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.092 ms 00:08:26.967 00:08:26.967 --- 10.0.0.1 ping statistics --- 00:08:26.967 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:26.967 rtt min/avg/max/mdev = 0.092/0.092/0.092/0.000 ms 00:08:26.967 23:00:30 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:26.967 23:00:30 -- nvmf/common.sh@410 -- # return 0 00:08:26.967 23:00:30 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:26.967 23:00:30 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:26.967 23:00:30 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:26.967 23:00:30 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:26.967 23:00:30 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:26.967 23:00:30 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:26.967 23:00:30 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:26.967 23:00:30 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:08:26.967 23:00:30 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:26.967 23:00:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:26.967 23:00:30 -- common/autotest_common.sh@10 -- # set +x 00:08:26.967 ************************************ 00:08:26.967 START TEST nvmf_filesystem_no_in_capsule 00:08:26.967 ************************************ 00:08:26.967 23:00:30 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 0 00:08:26.967 23:00:30 -- target/filesystem.sh@47 -- # in_capsule=0 00:08:26.967 23:00:30 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:08:26.967 23:00:30 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:26.967 23:00:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:26.967 23:00:30 -- common/autotest_common.sh@10 -- # set +x 00:08:26.967 23:00:30 -- nvmf/common.sh@469 -- # nvmfpid=2348878 00:08:26.967 23:00:30 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:26.967 23:00:30 -- nvmf/common.sh@470 -- # waitforlisten 2348878 00:08:26.967 23:00:30 -- common/autotest_common.sh@829 -- # '[' -z 2348878 ']' 00:08:26.967 23:00:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:26.967 23:00:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:26.967 23:00:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:26.967 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:26.967 23:00:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:26.967 23:00:30 -- common/autotest_common.sh@10 -- # set +x 00:08:26.967 [2024-11-28 23:00:30.221213] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:08:26.967 [2024-11-28 23:00:30.221294] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:26.967 EAL: No free 2048 kB hugepages reported on node 1 00:08:26.967 [2024-11-28 23:00:30.292855] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:26.967 [2024-11-28 23:00:30.386920] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:26.967 [2024-11-28 23:00:30.387084] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:26.967 [2024-11-28 23:00:30.387104] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:26.967 [2024-11-28 23:00:30.387118] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:26.967 [2024-11-28 23:00:30.387174] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:26.967 [2024-11-28 23:00:30.387228] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:26.967 [2024-11-28 23:00:30.387281] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:26.967 [2024-11-28 23:00:30.387284] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:27.901 23:00:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:27.901 23:00:31 -- common/autotest_common.sh@862 -- # return 0 00:08:27.901 23:00:31 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:27.901 23:00:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:27.901 23:00:31 -- common/autotest_common.sh@10 -- # set +x 00:08:27.901 23:00:31 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:27.901 23:00:31 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:08:27.901 23:00:31 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:08:27.901 23:00:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:27.901 23:00:31 -- common/autotest_common.sh@10 -- # set +x 00:08:27.901 [2024-11-28 23:00:31.240128] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:27.901 23:00:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:27.901 23:00:31 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:08:27.901 23:00:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:27.901 23:00:31 -- common/autotest_common.sh@10 -- # set +x 00:08:27.901 Malloc1 00:08:27.901 23:00:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:27.901 23:00:31 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:27.901 23:00:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:27.901 23:00:31 -- common/autotest_common.sh@10 -- # set +x 00:08:27.901 23:00:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:27.901 23:00:31 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:27.901 23:00:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:27.901 23:00:31 -- common/autotest_common.sh@10 -- # set +x 00:08:27.901 23:00:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:27.901 23:00:31 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:27.901 23:00:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:27.901 23:00:31 -- common/autotest_common.sh@10 -- # set +x 00:08:27.901 [2024-11-28 23:00:31.425930] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:27.901 23:00:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:27.901 23:00:31 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:08:27.901 23:00:31 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:08:27.901 23:00:31 -- common/autotest_common.sh@1368 -- # local bdev_info 00:08:27.901 23:00:31 -- common/autotest_common.sh@1369 -- # local bs 00:08:27.901 23:00:31 -- common/autotest_common.sh@1370 -- # local nb 00:08:27.901 23:00:31 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:08:27.901 23:00:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:27.901 23:00:31 -- common/autotest_common.sh@10 -- # set +x 00:08:27.901 23:00:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:27.901 23:00:31 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:08:27.901 { 00:08:27.901 "name": "Malloc1", 00:08:27.901 "aliases": [ 00:08:27.901 "d50feac4-c75b-45e1-9f3a-652eb52b2c71" 00:08:27.901 ], 00:08:27.901 "product_name": "Malloc disk", 00:08:27.901 "block_size": 512, 00:08:27.901 "num_blocks": 1048576, 00:08:27.901 "uuid": "d50feac4-c75b-45e1-9f3a-652eb52b2c71", 00:08:27.901 "assigned_rate_limits": { 00:08:27.901 "rw_ios_per_sec": 0, 00:08:27.901 "rw_mbytes_per_sec": 0, 00:08:27.901 "r_mbytes_per_sec": 0, 00:08:27.901 "w_mbytes_per_sec": 0 00:08:27.901 }, 00:08:27.901 "claimed": true, 00:08:27.901 "claim_type": "exclusive_write", 00:08:27.901 "zoned": false, 00:08:27.901 "supported_io_types": { 00:08:27.901 "read": true, 00:08:27.901 "write": true, 00:08:27.901 "unmap": true, 00:08:27.901 "write_zeroes": true, 00:08:27.901 "flush": true, 00:08:27.901 "reset": true, 00:08:27.901 "compare": false, 00:08:27.901 "compare_and_write": false, 00:08:27.901 "abort": true, 00:08:27.901 "nvme_admin": false, 00:08:27.901 "nvme_io": false 00:08:27.901 }, 00:08:27.901 "memory_domains": [ 00:08:27.901 { 00:08:27.901 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:08:27.901 "dma_device_type": 2 00:08:27.901 } 00:08:27.901 ], 00:08:27.901 "driver_specific": {} 00:08:27.901 } 00:08:27.901 ]' 00:08:27.901 23:00:31 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:08:27.901 23:00:31 -- common/autotest_common.sh@1372 -- # bs=512 00:08:27.901 23:00:31 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:08:28.159 23:00:31 -- common/autotest_common.sh@1373 -- # nb=1048576 00:08:28.159 23:00:31 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:08:28.159 23:00:31 -- common/autotest_common.sh@1377 -- # echo 512 00:08:28.159 23:00:31 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:08:28.159 23:00:31 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:08:28.725 23:00:32 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:08:28.725 23:00:32 -- common/autotest_common.sh@1187 -- # local i=0 00:08:28.725 23:00:32 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:08:28.725 23:00:32 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:08:28.725 23:00:32 -- common/autotest_common.sh@1194 -- # sleep 2 00:08:30.652 23:00:34 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:08:30.652 23:00:34 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:08:30.652 23:00:34 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:08:30.652 23:00:34 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:08:30.652 23:00:34 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:08:30.652 23:00:34 -- common/autotest_common.sh@1197 -- # return 0 00:08:30.652 23:00:34 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:08:30.652 23:00:34 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:08:30.652 23:00:34 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:08:30.652 23:00:34 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:08:30.652 23:00:34 -- setup/common.sh@76 -- # local dev=nvme0n1 00:08:30.652 23:00:34 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:08:30.652 23:00:34 -- setup/common.sh@80 -- # echo 536870912 00:08:30.652 23:00:34 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:08:30.652 23:00:34 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:08:30.652 23:00:34 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:08:30.652 23:00:34 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:08:30.909 23:00:34 -- target/filesystem.sh@69 -- # partprobe 00:08:31.473 23:00:34 -- target/filesystem.sh@70 -- # sleep 1 00:08:32.406 23:00:35 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:08:32.406 23:00:35 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:08:32.406 23:00:35 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:32.406 23:00:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:32.406 23:00:35 -- common/autotest_common.sh@10 -- # set +x 00:08:32.406 ************************************ 00:08:32.406 START TEST filesystem_ext4 00:08:32.406 ************************************ 00:08:32.406 23:00:35 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:08:32.406 23:00:35 -- target/filesystem.sh@18 -- # fstype=ext4 00:08:32.406 23:00:35 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:32.406 23:00:35 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:08:32.406 23:00:35 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:08:32.406 23:00:35 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:32.406 23:00:35 -- common/autotest_common.sh@914 -- # local i=0 00:08:32.406 23:00:35 -- common/autotest_common.sh@915 -- # local force 00:08:32.406 23:00:35 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:08:32.406 23:00:35 -- common/autotest_common.sh@918 -- # force=-F 00:08:32.406 23:00:35 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:08:32.406 mke2fs 1.47.0 (5-Feb-2023) 00:08:32.406 Discarding device blocks: 0/522240 done 00:08:32.663 Creating filesystem with 522240 1k blocks and 130560 inodes 00:08:32.663 Filesystem UUID: 6128f334-4035-4a24-9293-6ea6060078de 00:08:32.663 Superblock backups stored on blocks: 00:08:32.663 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:08:32.663 00:08:32.663 Allocating group tables: 0/64 done 00:08:32.663 Writing inode tables: 0/64 done 00:08:35.941 Creating journal (8192 blocks): done 00:08:35.941 Writing superblocks and filesystem accounting information: 0/64 done 00:08:35.941 00:08:35.941 23:00:38 -- common/autotest_common.sh@931 -- # return 0 00:08:35.941 23:00:38 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:41.201 23:00:44 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:41.201 23:00:44 -- target/filesystem.sh@25 -- # sync 00:08:41.201 23:00:44 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:41.201 23:00:44 -- target/filesystem.sh@27 -- # sync 00:08:41.201 23:00:44 -- target/filesystem.sh@29 -- # i=0 00:08:41.201 23:00:44 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:41.201 23:00:44 -- target/filesystem.sh@37 -- # kill -0 2348878 00:08:41.201 23:00:44 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:41.201 23:00:44 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:41.201 23:00:44 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:41.201 23:00:44 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:41.201 00:08:41.201 real 0m8.654s 00:08:41.201 user 0m0.028s 00:08:41.201 sys 0m0.056s 00:08:41.201 23:00:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:41.201 23:00:44 -- common/autotest_common.sh@10 -- # set +x 00:08:41.201 ************************************ 00:08:41.201 END TEST filesystem_ext4 00:08:41.201 ************************************ 00:08:41.201 23:00:44 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:08:41.201 23:00:44 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:41.201 23:00:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:41.201 23:00:44 -- common/autotest_common.sh@10 -- # set +x 00:08:41.201 ************************************ 00:08:41.201 START TEST filesystem_btrfs 00:08:41.201 ************************************ 00:08:41.201 23:00:44 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:08:41.201 23:00:44 -- target/filesystem.sh@18 -- # fstype=btrfs 00:08:41.201 23:00:44 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:41.201 23:00:44 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:08:41.201 23:00:44 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:08:41.201 23:00:44 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:41.201 23:00:44 -- common/autotest_common.sh@914 -- # local i=0 00:08:41.201 23:00:44 -- common/autotest_common.sh@915 -- # local force 00:08:41.201 23:00:44 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:08:41.201 23:00:44 -- common/autotest_common.sh@920 -- # force=-f 00:08:41.201 23:00:44 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:08:41.201 btrfs-progs v6.8.1 00:08:41.201 See https://btrfs.readthedocs.io for more information. 00:08:41.201 00:08:41.201 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:08:41.201 NOTE: several default settings have changed in version 5.15, please make sure 00:08:41.201 this does not affect your deployments: 00:08:41.201 - DUP for metadata (-m dup) 00:08:41.201 - enabled no-holes (-O no-holes) 00:08:41.201 - enabled free-space-tree (-R free-space-tree) 00:08:41.201 00:08:41.201 Label: (null) 00:08:41.201 UUID: 247914f4-7e98-447c-b167-52a3b2cbe974 00:08:41.201 Node size: 16384 00:08:41.201 Sector size: 4096 (CPU page size: 4096) 00:08:41.201 Filesystem size: 510.00MiB 00:08:41.201 Block group profiles: 00:08:41.201 Data: single 8.00MiB 00:08:41.201 Metadata: DUP 32.00MiB 00:08:41.201 System: DUP 8.00MiB 00:08:41.201 SSD detected: yes 00:08:41.201 Zoned device: no 00:08:41.201 Features: extref, skinny-metadata, no-holes, free-space-tree 00:08:41.201 Checksum: crc32c 00:08:41.201 Number of devices: 1 00:08:41.201 Devices: 00:08:41.201 ID SIZE PATH 00:08:41.201 1 510.00MiB /dev/nvme0n1p1 00:08:41.201 00:08:41.201 23:00:44 -- common/autotest_common.sh@931 -- # return 0 00:08:41.201 23:00:44 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:42.132 23:00:45 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:42.132 23:00:45 -- target/filesystem.sh@25 -- # sync 00:08:42.132 23:00:45 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:42.132 23:00:45 -- target/filesystem.sh@27 -- # sync 00:08:42.132 23:00:45 -- target/filesystem.sh@29 -- # i=0 00:08:42.132 23:00:45 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:42.132 23:00:45 -- target/filesystem.sh@37 -- # kill -0 2348878 00:08:42.132 23:00:45 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:42.132 23:00:45 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:42.132 23:00:45 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:42.132 23:00:45 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:42.132 00:08:42.132 real 0m0.925s 00:08:42.132 user 0m0.016s 00:08:42.132 sys 0m0.110s 00:08:42.132 23:00:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:42.132 23:00:45 -- common/autotest_common.sh@10 -- # set +x 00:08:42.132 ************************************ 00:08:42.132 END TEST filesystem_btrfs 00:08:42.132 ************************************ 00:08:42.132 23:00:45 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:08:42.132 23:00:45 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:42.132 23:00:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:42.132 23:00:45 -- common/autotest_common.sh@10 -- # set +x 00:08:42.132 ************************************ 00:08:42.132 START TEST filesystem_xfs 00:08:42.132 ************************************ 00:08:42.132 23:00:45 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:08:42.132 23:00:45 -- target/filesystem.sh@18 -- # fstype=xfs 00:08:42.132 23:00:45 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:42.132 23:00:45 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:08:42.132 23:00:45 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:08:42.132 23:00:45 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:42.132 23:00:45 -- common/autotest_common.sh@914 -- # local i=0 00:08:42.132 23:00:45 -- common/autotest_common.sh@915 -- # local force 00:08:42.132 23:00:45 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:08:42.132 23:00:45 -- common/autotest_common.sh@920 -- # force=-f 00:08:42.132 23:00:45 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:08:42.132 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:08:42.132 = sectsz=512 attr=2, projid32bit=1 00:08:42.132 = crc=1 finobt=1, sparse=1, rmapbt=0 00:08:42.132 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:08:42.132 data = bsize=4096 blocks=130560, imaxpct=25 00:08:42.132 = sunit=0 swidth=0 blks 00:08:42.133 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:08:42.133 log =internal log bsize=4096 blocks=16384, version=2 00:08:42.133 = sectsz=512 sunit=0 blks, lazy-count=1 00:08:42.133 realtime =none extsz=4096 blocks=0, rtextents=0 00:08:43.065 Discarding blocks...Done. 00:08:43.065 23:00:46 -- common/autotest_common.sh@931 -- # return 0 00:08:43.065 23:00:46 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:44.964 23:00:48 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:44.964 23:00:48 -- target/filesystem.sh@25 -- # sync 00:08:44.964 23:00:48 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:44.964 23:00:48 -- target/filesystem.sh@27 -- # sync 00:08:44.964 23:00:48 -- target/filesystem.sh@29 -- # i=0 00:08:44.964 23:00:48 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:44.964 23:00:48 -- target/filesystem.sh@37 -- # kill -0 2348878 00:08:44.964 23:00:48 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:44.964 23:00:48 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:44.964 23:00:48 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:44.964 23:00:48 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:44.964 00:08:44.964 real 0m2.783s 00:08:44.964 user 0m0.020s 00:08:44.964 sys 0m0.060s 00:08:44.964 23:00:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:44.964 23:00:48 -- common/autotest_common.sh@10 -- # set +x 00:08:44.964 ************************************ 00:08:44.964 END TEST filesystem_xfs 00:08:44.964 ************************************ 00:08:44.964 23:00:48 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:08:44.964 23:00:48 -- target/filesystem.sh@93 -- # sync 00:08:44.964 23:00:48 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:44.964 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:44.964 23:00:48 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:44.964 23:00:48 -- common/autotest_common.sh@1208 -- # local i=0 00:08:44.964 23:00:48 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:08:44.964 23:00:48 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:44.964 23:00:48 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:08:44.964 23:00:48 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:44.964 23:00:48 -- common/autotest_common.sh@1220 -- # return 0 00:08:44.964 23:00:48 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:44.964 23:00:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:44.964 23:00:48 -- common/autotest_common.sh@10 -- # set +x 00:08:44.964 23:00:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:44.964 23:00:48 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:08:44.964 23:00:48 -- target/filesystem.sh@101 -- # killprocess 2348878 00:08:44.965 23:00:48 -- common/autotest_common.sh@936 -- # '[' -z 2348878 ']' 00:08:44.965 23:00:48 -- common/autotest_common.sh@940 -- # kill -0 2348878 00:08:44.965 23:00:48 -- common/autotest_common.sh@941 -- # uname 00:08:44.965 23:00:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:44.965 23:00:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2348878 00:08:44.965 23:00:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:44.965 23:00:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:44.965 23:00:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2348878' 00:08:44.965 killing process with pid 2348878 00:08:44.965 23:00:48 -- common/autotest_common.sh@955 -- # kill 2348878 00:08:44.965 23:00:48 -- common/autotest_common.sh@960 -- # wait 2348878 00:08:45.608 23:00:48 -- target/filesystem.sh@102 -- # nvmfpid= 00:08:45.608 00:08:45.608 real 0m18.822s 00:08:45.608 user 1m13.071s 00:08:45.608 sys 0m2.227s 00:08:45.608 23:00:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:45.608 23:00:48 -- common/autotest_common.sh@10 -- # set +x 00:08:45.608 ************************************ 00:08:45.608 END TEST nvmf_filesystem_no_in_capsule 00:08:45.608 ************************************ 00:08:45.608 23:00:49 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:08:45.608 23:00:49 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:45.608 23:00:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:45.608 23:00:49 -- common/autotest_common.sh@10 -- # set +x 00:08:45.608 ************************************ 00:08:45.608 START TEST nvmf_filesystem_in_capsule 00:08:45.608 ************************************ 00:08:45.608 23:00:49 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 4096 00:08:45.608 23:00:49 -- target/filesystem.sh@47 -- # in_capsule=4096 00:08:45.608 23:00:49 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:08:45.608 23:00:49 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:45.608 23:00:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:45.608 23:00:49 -- common/autotest_common.sh@10 -- # set +x 00:08:45.608 23:00:49 -- nvmf/common.sh@469 -- # nvmfpid=2351314 00:08:45.608 23:00:49 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:45.608 23:00:49 -- nvmf/common.sh@470 -- # waitforlisten 2351314 00:08:45.608 23:00:49 -- common/autotest_common.sh@829 -- # '[' -z 2351314 ']' 00:08:45.608 23:00:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:45.608 23:00:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:45.608 23:00:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:45.608 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:45.608 23:00:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:45.608 23:00:49 -- common/autotest_common.sh@10 -- # set +x 00:08:45.608 [2024-11-28 23:00:49.072937] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:08:45.609 [2024-11-28 23:00:49.073016] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:45.609 EAL: No free 2048 kB hugepages reported on node 1 00:08:45.609 [2024-11-28 23:00:49.144858] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:45.878 [2024-11-28 23:00:49.241686] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:45.878 [2024-11-28 23:00:49.241858] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:45.878 [2024-11-28 23:00:49.241879] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:45.878 [2024-11-28 23:00:49.241894] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:45.878 [2024-11-28 23:00:49.241978] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:45.878 [2024-11-28 23:00:49.242032] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:45.878 [2024-11-28 23:00:49.242106] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:45.878 [2024-11-28 23:00:49.242109] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:46.810 23:00:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:46.810 23:00:50 -- common/autotest_common.sh@862 -- # return 0 00:08:46.810 23:00:50 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:46.810 23:00:50 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:46.810 23:00:50 -- common/autotest_common.sh@10 -- # set +x 00:08:46.810 23:00:50 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:46.810 23:00:50 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:08:46.810 23:00:50 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:08:46.810 23:00:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.810 23:00:50 -- common/autotest_common.sh@10 -- # set +x 00:08:46.810 [2024-11-28 23:00:50.119285] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:46.810 23:00:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.810 23:00:50 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:08:46.810 23:00:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.810 23:00:50 -- common/autotest_common.sh@10 -- # set +x 00:08:46.810 Malloc1 00:08:46.810 23:00:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.810 23:00:50 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:46.810 23:00:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.810 23:00:50 -- common/autotest_common.sh@10 -- # set +x 00:08:46.810 23:00:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.810 23:00:50 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:46.810 23:00:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.810 23:00:50 -- common/autotest_common.sh@10 -- # set +x 00:08:46.810 23:00:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.810 23:00:50 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:46.810 23:00:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.810 23:00:50 -- common/autotest_common.sh@10 -- # set +x 00:08:46.810 [2024-11-28 23:00:50.307095] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:46.810 23:00:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.810 23:00:50 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:08:46.810 23:00:50 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:08:46.810 23:00:50 -- common/autotest_common.sh@1368 -- # local bdev_info 00:08:46.810 23:00:50 -- common/autotest_common.sh@1369 -- # local bs 00:08:46.810 23:00:50 -- common/autotest_common.sh@1370 -- # local nb 00:08:46.810 23:00:50 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:08:46.810 23:00:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.810 23:00:50 -- common/autotest_common.sh@10 -- # set +x 00:08:46.810 23:00:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.810 23:00:50 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:08:46.810 { 00:08:46.810 "name": "Malloc1", 00:08:46.810 "aliases": [ 00:08:46.810 "0c3a4191-937b-43a2-b1c6-3175355a1611" 00:08:46.810 ], 00:08:46.810 "product_name": "Malloc disk", 00:08:46.810 "block_size": 512, 00:08:46.810 "num_blocks": 1048576, 00:08:46.810 "uuid": "0c3a4191-937b-43a2-b1c6-3175355a1611", 00:08:46.810 "assigned_rate_limits": { 00:08:46.810 "rw_ios_per_sec": 0, 00:08:46.810 "rw_mbytes_per_sec": 0, 00:08:46.810 "r_mbytes_per_sec": 0, 00:08:46.810 "w_mbytes_per_sec": 0 00:08:46.810 }, 00:08:46.810 "claimed": true, 00:08:46.810 "claim_type": "exclusive_write", 00:08:46.810 "zoned": false, 00:08:46.810 "supported_io_types": { 00:08:46.810 "read": true, 00:08:46.810 "write": true, 00:08:46.810 "unmap": true, 00:08:46.810 "write_zeroes": true, 00:08:46.810 "flush": true, 00:08:46.810 "reset": true, 00:08:46.810 "compare": false, 00:08:46.810 "compare_and_write": false, 00:08:46.810 "abort": true, 00:08:46.810 "nvme_admin": false, 00:08:46.810 "nvme_io": false 00:08:46.810 }, 00:08:46.810 "memory_domains": [ 00:08:46.810 { 00:08:46.810 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:08:46.810 "dma_device_type": 2 00:08:46.810 } 00:08:46.810 ], 00:08:46.810 "driver_specific": {} 00:08:46.810 } 00:08:46.810 ]' 00:08:46.810 23:00:50 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:08:46.810 23:00:50 -- common/autotest_common.sh@1372 -- # bs=512 00:08:46.810 23:00:50 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:08:46.810 23:00:50 -- common/autotest_common.sh@1373 -- # nb=1048576 00:08:46.810 23:00:50 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:08:46.810 23:00:50 -- common/autotest_common.sh@1377 -- # echo 512 00:08:46.810 23:00:50 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:08:46.810 23:00:50 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:08:47.741 23:00:51 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:08:47.741 23:00:51 -- common/autotest_common.sh@1187 -- # local i=0 00:08:47.742 23:00:51 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:08:47.742 23:00:51 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:08:47.742 23:00:51 -- common/autotest_common.sh@1194 -- # sleep 2 00:08:49.636 23:00:53 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:08:49.636 23:00:53 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:08:49.636 23:00:53 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:08:49.636 23:00:53 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:08:49.636 23:00:53 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:08:49.636 23:00:53 -- common/autotest_common.sh@1197 -- # return 0 00:08:49.636 23:00:53 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:08:49.636 23:00:53 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:08:49.636 23:00:53 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:08:49.636 23:00:53 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:08:49.636 23:00:53 -- setup/common.sh@76 -- # local dev=nvme0n1 00:08:49.636 23:00:53 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:08:49.636 23:00:53 -- setup/common.sh@80 -- # echo 536870912 00:08:49.636 23:00:53 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:08:49.636 23:00:53 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:08:49.636 23:00:53 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:08:49.636 23:00:53 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:08:49.894 23:00:53 -- target/filesystem.sh@69 -- # partprobe 00:08:50.826 23:00:54 -- target/filesystem.sh@70 -- # sleep 1 00:08:51.757 23:00:55 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:08:51.757 23:00:55 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:08:51.757 23:00:55 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:51.757 23:00:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:51.757 23:00:55 -- common/autotest_common.sh@10 -- # set +x 00:08:51.757 ************************************ 00:08:51.757 START TEST filesystem_in_capsule_ext4 00:08:51.757 ************************************ 00:08:51.757 23:00:55 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:08:51.757 23:00:55 -- target/filesystem.sh@18 -- # fstype=ext4 00:08:51.757 23:00:55 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:51.757 23:00:55 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:08:51.757 23:00:55 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:08:51.757 23:00:55 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:51.757 23:00:55 -- common/autotest_common.sh@914 -- # local i=0 00:08:51.757 23:00:55 -- common/autotest_common.sh@915 -- # local force 00:08:51.757 23:00:55 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:08:51.757 23:00:55 -- common/autotest_common.sh@918 -- # force=-F 00:08:51.757 23:00:55 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:08:51.757 mke2fs 1.47.0 (5-Feb-2023) 00:08:51.757 Discarding device blocks: 0/522240 done 00:08:51.757 Creating filesystem with 522240 1k blocks and 130560 inodes 00:08:51.757 Filesystem UUID: c1efe48b-158a-42bc-9f2a-e0c13ad84c04 00:08:51.757 Superblock backups stored on blocks: 00:08:51.757 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:08:51.757 00:08:51.757 Allocating group tables: 0/64 done 00:08:51.757 Writing inode tables: 0/64 done 00:08:51.757 Creating journal (8192 blocks): done 00:08:53.251 Writing superblocks and filesystem accounting information: 0/64 done 00:08:53.251 00:08:53.251 23:00:56 -- common/autotest_common.sh@931 -- # return 0 00:08:53.251 23:00:56 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:59.806 23:01:02 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:59.806 23:01:02 -- target/filesystem.sh@25 -- # sync 00:08:59.806 23:01:02 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:59.806 23:01:02 -- target/filesystem.sh@27 -- # sync 00:08:59.806 23:01:02 -- target/filesystem.sh@29 -- # i=0 00:08:59.806 23:01:02 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:59.806 23:01:02 -- target/filesystem.sh@37 -- # kill -0 2351314 00:08:59.806 23:01:02 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:59.806 23:01:02 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:59.806 23:01:02 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:59.806 23:01:02 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:59.806 00:08:59.806 real 0m7.244s 00:08:59.806 user 0m0.032s 00:08:59.806 sys 0m0.062s 00:08:59.806 23:01:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:59.806 23:01:02 -- common/autotest_common.sh@10 -- # set +x 00:08:59.806 ************************************ 00:08:59.806 END TEST filesystem_in_capsule_ext4 00:08:59.806 ************************************ 00:08:59.806 23:01:02 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:08:59.806 23:01:02 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:59.806 23:01:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:59.806 23:01:02 -- common/autotest_common.sh@10 -- # set +x 00:08:59.806 ************************************ 00:08:59.806 START TEST filesystem_in_capsule_btrfs 00:08:59.806 ************************************ 00:08:59.806 23:01:02 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:08:59.806 23:01:02 -- target/filesystem.sh@18 -- # fstype=btrfs 00:08:59.806 23:01:02 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:59.806 23:01:02 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:08:59.806 23:01:02 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:08:59.806 23:01:02 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:59.806 23:01:02 -- common/autotest_common.sh@914 -- # local i=0 00:08:59.806 23:01:02 -- common/autotest_common.sh@915 -- # local force 00:08:59.806 23:01:02 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:08:59.806 23:01:02 -- common/autotest_common.sh@920 -- # force=-f 00:08:59.806 23:01:02 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:08:59.806 btrfs-progs v6.8.1 00:08:59.806 See https://btrfs.readthedocs.io for more information. 00:08:59.806 00:08:59.806 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:08:59.806 NOTE: several default settings have changed in version 5.15, please make sure 00:08:59.806 this does not affect your deployments: 00:08:59.806 - DUP for metadata (-m dup) 00:08:59.806 - enabled no-holes (-O no-holes) 00:08:59.806 - enabled free-space-tree (-R free-space-tree) 00:08:59.806 00:08:59.806 Label: (null) 00:08:59.806 UUID: 9a35b585-2a8c-4a17-ae6f-995ad7fbfc32 00:08:59.806 Node size: 16384 00:08:59.806 Sector size: 4096 (CPU page size: 4096) 00:08:59.806 Filesystem size: 510.00MiB 00:08:59.806 Block group profiles: 00:08:59.806 Data: single 8.00MiB 00:08:59.806 Metadata: DUP 32.00MiB 00:08:59.806 System: DUP 8.00MiB 00:08:59.806 SSD detected: yes 00:08:59.806 Zoned device: no 00:08:59.806 Features: extref, skinny-metadata, no-holes, free-space-tree 00:08:59.806 Checksum: crc32c 00:08:59.806 Number of devices: 1 00:08:59.806 Devices: 00:08:59.806 ID SIZE PATH 00:08:59.806 1 510.00MiB /dev/nvme0n1p1 00:08:59.806 00:08:59.806 23:01:02 -- common/autotest_common.sh@931 -- # return 0 00:08:59.806 23:01:02 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:09:00.372 23:01:03 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:09:00.372 23:01:03 -- target/filesystem.sh@25 -- # sync 00:09:00.372 23:01:03 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:09:00.372 23:01:03 -- target/filesystem.sh@27 -- # sync 00:09:00.372 23:01:03 -- target/filesystem.sh@29 -- # i=0 00:09:00.372 23:01:03 -- target/filesystem.sh@30 -- # umount /mnt/device 00:09:00.372 23:01:03 -- target/filesystem.sh@37 -- # kill -0 2351314 00:09:00.372 23:01:03 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:09:00.372 23:01:03 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:09:00.372 23:01:03 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:09:00.372 23:01:03 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:09:00.372 00:09:00.372 real 0m1.418s 00:09:00.372 user 0m0.018s 00:09:00.372 sys 0m0.112s 00:09:00.372 23:01:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:09:00.372 23:01:03 -- common/autotest_common.sh@10 -- # set +x 00:09:00.372 ************************************ 00:09:00.372 END TEST filesystem_in_capsule_btrfs 00:09:00.372 ************************************ 00:09:00.372 23:01:03 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:09:00.372 23:01:03 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:09:00.372 23:01:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:09:00.372 23:01:03 -- common/autotest_common.sh@10 -- # set +x 00:09:00.372 ************************************ 00:09:00.372 START TEST filesystem_in_capsule_xfs 00:09:00.372 ************************************ 00:09:00.372 23:01:03 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:09:00.372 23:01:03 -- target/filesystem.sh@18 -- # fstype=xfs 00:09:00.372 23:01:03 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:09:00.372 23:01:03 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:09:00.372 23:01:03 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:09:00.372 23:01:03 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:09:00.372 23:01:03 -- common/autotest_common.sh@914 -- # local i=0 00:09:00.372 23:01:03 -- common/autotest_common.sh@915 -- # local force 00:09:00.372 23:01:03 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:09:00.372 23:01:03 -- common/autotest_common.sh@920 -- # force=-f 00:09:00.372 23:01:03 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:09:00.372 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:09:00.372 = sectsz=512 attr=2, projid32bit=1 00:09:00.372 = crc=1 finobt=1, sparse=1, rmapbt=0 00:09:00.372 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:09:00.372 data = bsize=4096 blocks=130560, imaxpct=25 00:09:00.372 = sunit=0 swidth=0 blks 00:09:00.372 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:09:00.372 log =internal log bsize=4096 blocks=16384, version=2 00:09:00.372 = sectsz=512 sunit=0 blks, lazy-count=1 00:09:00.372 realtime =none extsz=4096 blocks=0, rtextents=0 00:09:01.305 Discarding blocks...Done. 00:09:01.305 23:01:04 -- common/autotest_common.sh@931 -- # return 0 00:09:01.305 23:01:04 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:09:03.203 23:01:06 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:09:03.203 23:01:06 -- target/filesystem.sh@25 -- # sync 00:09:03.203 23:01:06 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:09:03.203 23:01:06 -- target/filesystem.sh@27 -- # sync 00:09:03.203 23:01:06 -- target/filesystem.sh@29 -- # i=0 00:09:03.203 23:01:06 -- target/filesystem.sh@30 -- # umount /mnt/device 00:09:03.203 23:01:06 -- target/filesystem.sh@37 -- # kill -0 2351314 00:09:03.203 23:01:06 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:09:03.203 23:01:06 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:09:03.203 23:01:06 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:09:03.203 23:01:06 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:09:03.203 00:09:03.203 real 0m2.624s 00:09:03.203 user 0m0.019s 00:09:03.203 sys 0m0.052s 00:09:03.203 23:01:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:09:03.203 23:01:06 -- common/autotest_common.sh@10 -- # set +x 00:09:03.203 ************************************ 00:09:03.203 END TEST filesystem_in_capsule_xfs 00:09:03.203 ************************************ 00:09:03.203 23:01:06 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:09:03.203 23:01:06 -- target/filesystem.sh@93 -- # sync 00:09:03.203 23:01:06 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:09:03.461 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:03.461 23:01:06 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:09:03.461 23:01:06 -- common/autotest_common.sh@1208 -- # local i=0 00:09:03.461 23:01:06 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:09:03.461 23:01:06 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:03.461 23:01:06 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:09:03.461 23:01:06 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:03.461 23:01:06 -- common/autotest_common.sh@1220 -- # return 0 00:09:03.461 23:01:06 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:09:03.461 23:01:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:03.461 23:01:06 -- common/autotest_common.sh@10 -- # set +x 00:09:03.462 23:01:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:03.462 23:01:06 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:09:03.462 23:01:06 -- target/filesystem.sh@101 -- # killprocess 2351314 00:09:03.462 23:01:06 -- common/autotest_common.sh@936 -- # '[' -z 2351314 ']' 00:09:03.462 23:01:06 -- common/autotest_common.sh@940 -- # kill -0 2351314 00:09:03.462 23:01:06 -- common/autotest_common.sh@941 -- # uname 00:09:03.462 23:01:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:09:03.462 23:01:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2351314 00:09:03.462 23:01:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:09:03.462 23:01:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:09:03.462 23:01:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2351314' 00:09:03.462 killing process with pid 2351314 00:09:03.462 23:01:06 -- common/autotest_common.sh@955 -- # kill 2351314 00:09:03.462 23:01:06 -- common/autotest_common.sh@960 -- # wait 2351314 00:09:04.029 23:01:07 -- target/filesystem.sh@102 -- # nvmfpid= 00:09:04.029 00:09:04.029 real 0m18.385s 00:09:04.029 user 1m11.347s 00:09:04.030 sys 0m2.220s 00:09:04.030 23:01:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:09:04.030 23:01:07 -- common/autotest_common.sh@10 -- # set +x 00:09:04.030 ************************************ 00:09:04.030 END TEST nvmf_filesystem_in_capsule 00:09:04.030 ************************************ 00:09:04.030 23:01:07 -- target/filesystem.sh@108 -- # nvmftestfini 00:09:04.030 23:01:07 -- nvmf/common.sh@476 -- # nvmfcleanup 00:09:04.030 23:01:07 -- nvmf/common.sh@116 -- # sync 00:09:04.030 23:01:07 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:09:04.030 23:01:07 -- nvmf/common.sh@119 -- # set +e 00:09:04.030 23:01:07 -- nvmf/common.sh@120 -- # for i in {1..20} 00:09:04.030 23:01:07 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:09:04.030 rmmod nvme_tcp 00:09:04.030 rmmod nvme_fabrics 00:09:04.030 rmmod nvme_keyring 00:09:04.030 23:01:07 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:09:04.030 23:01:07 -- nvmf/common.sh@123 -- # set -e 00:09:04.030 23:01:07 -- nvmf/common.sh@124 -- # return 0 00:09:04.030 23:01:07 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:09:04.030 23:01:07 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:09:04.030 23:01:07 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:09:04.030 23:01:07 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:09:04.030 23:01:07 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:09:04.030 23:01:07 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:09:04.030 23:01:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:04.030 23:01:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:04.030 23:01:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:05.936 23:01:09 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:09:05.937 00:09:05.937 real 0m42.018s 00:09:05.937 user 2m25.519s 00:09:05.937 sys 0m6.163s 00:09:05.937 23:01:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:09:05.937 23:01:09 -- common/autotest_common.sh@10 -- # set +x 00:09:05.937 ************************************ 00:09:05.937 END TEST nvmf_filesystem 00:09:05.937 ************************************ 00:09:06.197 23:01:09 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:09:06.197 23:01:09 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:09:06.197 23:01:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:09:06.197 23:01:09 -- common/autotest_common.sh@10 -- # set +x 00:09:06.197 ************************************ 00:09:06.197 START TEST nvmf_discovery 00:09:06.197 ************************************ 00:09:06.197 23:01:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:09:06.197 * Looking for test storage... 00:09:06.197 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:09:06.197 23:01:09 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:09:06.197 23:01:09 -- common/autotest_common.sh@1690 -- # lcov --version 00:09:06.197 23:01:09 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:09:06.197 23:01:09 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:09:06.197 23:01:09 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:09:06.197 23:01:09 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:09:06.197 23:01:09 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:09:06.197 23:01:09 -- scripts/common.sh@335 -- # IFS=.-: 00:09:06.197 23:01:09 -- scripts/common.sh@335 -- # read -ra ver1 00:09:06.197 23:01:09 -- scripts/common.sh@336 -- # IFS=.-: 00:09:06.197 23:01:09 -- scripts/common.sh@336 -- # read -ra ver2 00:09:06.197 23:01:09 -- scripts/common.sh@337 -- # local 'op=<' 00:09:06.197 23:01:09 -- scripts/common.sh@339 -- # ver1_l=2 00:09:06.197 23:01:09 -- scripts/common.sh@340 -- # ver2_l=1 00:09:06.197 23:01:09 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:09:06.197 23:01:09 -- scripts/common.sh@343 -- # case "$op" in 00:09:06.197 23:01:09 -- scripts/common.sh@344 -- # : 1 00:09:06.197 23:01:09 -- scripts/common.sh@363 -- # (( v = 0 )) 00:09:06.197 23:01:09 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:09:06.197 23:01:09 -- scripts/common.sh@364 -- # decimal 1 00:09:06.197 23:01:09 -- scripts/common.sh@352 -- # local d=1 00:09:06.197 23:01:09 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:09:06.197 23:01:09 -- scripts/common.sh@354 -- # echo 1 00:09:06.197 23:01:09 -- scripts/common.sh@364 -- # ver1[v]=1 00:09:06.197 23:01:09 -- scripts/common.sh@365 -- # decimal 2 00:09:06.197 23:01:09 -- scripts/common.sh@352 -- # local d=2 00:09:06.197 23:01:09 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:09:06.197 23:01:09 -- scripts/common.sh@354 -- # echo 2 00:09:06.197 23:01:09 -- scripts/common.sh@365 -- # ver2[v]=2 00:09:06.197 23:01:09 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:09:06.197 23:01:09 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:09:06.197 23:01:09 -- scripts/common.sh@367 -- # return 0 00:09:06.197 23:01:09 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:09:06.197 23:01:09 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:09:06.197 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:06.197 --rc genhtml_branch_coverage=1 00:09:06.197 --rc genhtml_function_coverage=1 00:09:06.197 --rc genhtml_legend=1 00:09:06.197 --rc geninfo_all_blocks=1 00:09:06.197 --rc geninfo_unexecuted_blocks=1 00:09:06.197 00:09:06.197 ' 00:09:06.197 23:01:09 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:09:06.197 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:06.197 --rc genhtml_branch_coverage=1 00:09:06.197 --rc genhtml_function_coverage=1 00:09:06.197 --rc genhtml_legend=1 00:09:06.197 --rc geninfo_all_blocks=1 00:09:06.197 --rc geninfo_unexecuted_blocks=1 00:09:06.197 00:09:06.197 ' 00:09:06.197 23:01:09 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:09:06.197 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:06.197 --rc genhtml_branch_coverage=1 00:09:06.197 --rc genhtml_function_coverage=1 00:09:06.197 --rc genhtml_legend=1 00:09:06.197 --rc geninfo_all_blocks=1 00:09:06.197 --rc geninfo_unexecuted_blocks=1 00:09:06.197 00:09:06.197 ' 00:09:06.197 23:01:09 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:09:06.197 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:06.197 --rc genhtml_branch_coverage=1 00:09:06.197 --rc genhtml_function_coverage=1 00:09:06.197 --rc genhtml_legend=1 00:09:06.197 --rc geninfo_all_blocks=1 00:09:06.197 --rc geninfo_unexecuted_blocks=1 00:09:06.197 00:09:06.197 ' 00:09:06.197 23:01:09 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:09:06.197 23:01:09 -- nvmf/common.sh@7 -- # uname -s 00:09:06.197 23:01:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:06.197 23:01:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:06.197 23:01:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:06.197 23:01:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:06.197 23:01:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:06.197 23:01:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:06.197 23:01:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:06.197 23:01:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:06.197 23:01:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:06.197 23:01:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:06.197 23:01:09 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:09:06.197 23:01:09 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:09:06.197 23:01:09 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:06.197 23:01:09 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:06.197 23:01:09 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:09:06.197 23:01:09 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:09:06.197 23:01:09 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:06.197 23:01:09 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:06.197 23:01:09 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:06.197 23:01:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:06.197 23:01:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:06.197 23:01:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:06.197 23:01:09 -- paths/export.sh@5 -- # export PATH 00:09:06.198 23:01:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:06.198 23:01:09 -- nvmf/common.sh@46 -- # : 0 00:09:06.198 23:01:09 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:09:06.198 23:01:09 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:09:06.198 23:01:09 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:09:06.198 23:01:09 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:06.198 23:01:09 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:06.198 23:01:09 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:09:06.198 23:01:09 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:09:06.198 23:01:09 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:09:06.198 23:01:09 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:09:06.198 23:01:09 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:09:06.198 23:01:09 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:09:06.198 23:01:09 -- target/discovery.sh@15 -- # hash nvme 00:09:06.198 23:01:09 -- target/discovery.sh@20 -- # nvmftestinit 00:09:06.198 23:01:09 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:09:06.198 23:01:09 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:06.198 23:01:09 -- nvmf/common.sh@436 -- # prepare_net_devs 00:09:06.198 23:01:09 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:09:06.198 23:01:09 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:09:06.198 23:01:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:06.198 23:01:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:06.198 23:01:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:06.198 23:01:09 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:09:06.198 23:01:09 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:09:06.198 23:01:09 -- nvmf/common.sh@284 -- # xtrace_disable 00:09:06.198 23:01:09 -- common/autotest_common.sh@10 -- # set +x 00:09:08.101 23:01:11 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:09:08.101 23:01:11 -- nvmf/common.sh@290 -- # pci_devs=() 00:09:08.101 23:01:11 -- nvmf/common.sh@290 -- # local -a pci_devs 00:09:08.101 23:01:11 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:09:08.101 23:01:11 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:09:08.101 23:01:11 -- nvmf/common.sh@292 -- # pci_drivers=() 00:09:08.101 23:01:11 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:09:08.101 23:01:11 -- nvmf/common.sh@294 -- # net_devs=() 00:09:08.101 23:01:11 -- nvmf/common.sh@294 -- # local -ga net_devs 00:09:08.101 23:01:11 -- nvmf/common.sh@295 -- # e810=() 00:09:08.101 23:01:11 -- nvmf/common.sh@295 -- # local -ga e810 00:09:08.101 23:01:11 -- nvmf/common.sh@296 -- # x722=() 00:09:08.101 23:01:11 -- nvmf/common.sh@296 -- # local -ga x722 00:09:08.101 23:01:11 -- nvmf/common.sh@297 -- # mlx=() 00:09:08.101 23:01:11 -- nvmf/common.sh@297 -- # local -ga mlx 00:09:08.101 23:01:11 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:08.101 23:01:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:08.101 23:01:11 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:08.101 23:01:11 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:08.101 23:01:11 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:08.101 23:01:11 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:08.101 23:01:11 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:08.101 23:01:11 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:08.101 23:01:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:08.101 23:01:11 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:08.101 23:01:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:08.101 23:01:11 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:09:08.101 23:01:11 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:09:08.101 23:01:11 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:09:08.101 23:01:11 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:09:08.101 23:01:11 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:09:08.101 23:01:11 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:09:08.101 23:01:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:08.102 23:01:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:09:08.102 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:09:08.102 23:01:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:08.102 23:01:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:08.102 23:01:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:08.102 23:01:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:08.102 23:01:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:08.102 23:01:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:08.102 23:01:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:09:08.102 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:09:08.102 23:01:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:08.102 23:01:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:08.102 23:01:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:08.102 23:01:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:08.102 23:01:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:08.102 23:01:11 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:09:08.102 23:01:11 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:09:08.102 23:01:11 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:09:08.102 23:01:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:08.102 23:01:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:08.102 23:01:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:08.102 23:01:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:08.102 23:01:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:09:08.102 Found net devices under 0000:0a:00.0: cvl_0_0 00:09:08.102 23:01:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:08.102 23:01:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:08.102 23:01:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:08.102 23:01:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:08.102 23:01:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:08.102 23:01:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:09:08.102 Found net devices under 0000:0a:00.1: cvl_0_1 00:09:08.102 23:01:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:08.102 23:01:11 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:09:08.102 23:01:11 -- nvmf/common.sh@402 -- # is_hw=yes 00:09:08.102 23:01:11 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:09:08.102 23:01:11 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:09:08.102 23:01:11 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:09:08.102 23:01:11 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:09:08.102 23:01:11 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:09:08.102 23:01:11 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:09:08.102 23:01:11 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:09:08.102 23:01:11 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:09:08.102 23:01:11 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:09:08.102 23:01:11 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:09:08.102 23:01:11 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:09:08.102 23:01:11 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:09:08.102 23:01:11 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:09:08.102 23:01:11 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:09:08.102 23:01:11 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:09:08.102 23:01:11 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:09:08.102 23:01:11 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:09:08.102 23:01:11 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:09:08.361 23:01:11 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:09:08.361 23:01:11 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:09:08.361 23:01:11 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:09:08.361 23:01:11 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:09:08.361 23:01:11 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:09:08.361 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:09:08.361 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.205 ms 00:09:08.361 00:09:08.361 --- 10.0.0.2 ping statistics --- 00:09:08.361 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:08.361 rtt min/avg/max/mdev = 0.205/0.205/0.205/0.000 ms 00:09:08.361 23:01:11 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:09:08.361 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:09:08.361 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.052 ms 00:09:08.361 00:09:08.361 --- 10.0.0.1 ping statistics --- 00:09:08.361 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:08.361 rtt min/avg/max/mdev = 0.052/0.052/0.052/0.000 ms 00:09:08.361 23:01:11 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:09:08.361 23:01:11 -- nvmf/common.sh@410 -- # return 0 00:09:08.361 23:01:11 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:09:08.361 23:01:11 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:09:08.361 23:01:11 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:09:08.361 23:01:11 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:09:08.361 23:01:11 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:09:08.361 23:01:11 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:09:08.361 23:01:11 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:09:08.361 23:01:11 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:09:08.361 23:01:11 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:09:08.361 23:01:11 -- common/autotest_common.sh@722 -- # xtrace_disable 00:09:08.361 23:01:11 -- common/autotest_common.sh@10 -- # set +x 00:09:08.361 23:01:11 -- nvmf/common.sh@469 -- # nvmfpid=2355688 00:09:08.361 23:01:11 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:09:08.361 23:01:11 -- nvmf/common.sh@470 -- # waitforlisten 2355688 00:09:08.361 23:01:11 -- common/autotest_common.sh@829 -- # '[' -z 2355688 ']' 00:09:08.361 23:01:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:08.361 23:01:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:09:08.361 23:01:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:08.361 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:08.361 23:01:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:09:08.361 23:01:11 -- common/autotest_common.sh@10 -- # set +x 00:09:08.361 [2024-11-28 23:01:11.850665] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:09:08.361 [2024-11-28 23:01:11.850749] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:08.361 EAL: No free 2048 kB hugepages reported on node 1 00:09:08.361 [2024-11-28 23:01:11.924407] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:08.620 [2024-11-28 23:01:12.020605] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:09:08.620 [2024-11-28 23:01:12.020782] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:08.620 [2024-11-28 23:01:12.020803] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:08.620 [2024-11-28 23:01:12.020817] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:08.620 [2024-11-28 23:01:12.020896] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:08.620 [2024-11-28 23:01:12.020949] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:09:08.620 [2024-11-28 23:01:12.021014] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:08.620 [2024-11-28 23:01:12.021017] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:09:09.553 23:01:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:09:09.553 23:01:12 -- common/autotest_common.sh@862 -- # return 0 00:09:09.553 23:01:12 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:09:09.553 23:01:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:09:09.553 23:01:12 -- common/autotest_common.sh@10 -- # set +x 00:09:09.553 23:01:12 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:09.553 23:01:12 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:09:09.553 23:01:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:09.553 23:01:12 -- common/autotest_common.sh@10 -- # set +x 00:09:09.553 [2024-11-28 23:01:12.838089] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:09:09.553 23:01:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:09.553 23:01:12 -- target/discovery.sh@26 -- # seq 1 4 00:09:09.553 23:01:12 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:09:09.553 23:01:12 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:09:09.553 23:01:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:09.553 23:01:12 -- common/autotest_common.sh@10 -- # set +x 00:09:09.553 Null1 00:09:09.553 23:01:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:09.553 23:01:12 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:09:09.553 23:01:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:09.553 23:01:12 -- common/autotest_common.sh@10 -- # set +x 00:09:09.553 23:01:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:09.553 23:01:12 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:09:09.553 23:01:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:09.553 23:01:12 -- common/autotest_common.sh@10 -- # set +x 00:09:09.553 23:01:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:09.553 23:01:12 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:09:09.553 23:01:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:09.553 23:01:12 -- common/autotest_common.sh@10 -- # set +x 00:09:09.553 [2024-11-28 23:01:12.878359] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:09:09.553 23:01:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:09.553 23:01:12 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:09:09.553 23:01:12 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:09:09.554 23:01:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:09.554 23:01:12 -- common/autotest_common.sh@10 -- # set +x 00:09:09.554 Null2 00:09:09.554 23:01:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:09.554 23:01:12 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:09:09.554 23:01:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:09.554 23:01:12 -- common/autotest_common.sh@10 -- # set +x 00:09:09.554 23:01:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:09.554 23:01:12 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:09:09.554 23:01:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:09.554 23:01:12 -- common/autotest_common.sh@10 -- # set +x 00:09:09.554 23:01:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:09.554 23:01:12 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:09:09.554 23:01:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:09.554 23:01:12 -- common/autotest_common.sh@10 -- # set +x 00:09:09.554 23:01:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:09.554 23:01:12 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:09:09.554 23:01:12 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:09:09.554 23:01:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:09.554 23:01:12 -- common/autotest_common.sh@10 -- # set +x 00:09:09.554 Null3 00:09:09.554 23:01:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:09.554 23:01:12 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:09:09.554 23:01:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:09.554 23:01:12 -- common/autotest_common.sh@10 -- # set +x 00:09:09.554 23:01:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:09.554 23:01:12 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:09:09.554 23:01:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:09.554 23:01:12 -- common/autotest_common.sh@10 -- # set +x 00:09:09.554 23:01:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:09.554 23:01:12 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:09:09.554 23:01:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:09.554 23:01:12 -- common/autotest_common.sh@10 -- # set +x 00:09:09.554 23:01:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:09.554 23:01:12 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:09:09.554 23:01:12 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:09:09.554 23:01:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:09.554 23:01:12 -- common/autotest_common.sh@10 -- # set +x 00:09:09.554 Null4 00:09:09.554 23:01:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:09.554 23:01:12 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:09:09.554 23:01:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:09.554 23:01:12 -- common/autotest_common.sh@10 -- # set +x 00:09:09.554 23:01:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:09.554 23:01:12 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:09:09.554 23:01:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:09.554 23:01:12 -- common/autotest_common.sh@10 -- # set +x 00:09:09.554 23:01:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:09.554 23:01:12 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:09:09.554 23:01:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:09.554 23:01:12 -- common/autotest_common.sh@10 -- # set +x 00:09:09.554 23:01:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:09.554 23:01:12 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:09:09.554 23:01:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:09.554 23:01:12 -- common/autotest_common.sh@10 -- # set +x 00:09:09.554 23:01:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:09.554 23:01:12 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:09:09.554 23:01:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:09.554 23:01:12 -- common/autotest_common.sh@10 -- # set +x 00:09:09.554 23:01:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:09.554 23:01:12 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:09:09.816 00:09:09.816 Discovery Log Number of Records 6, Generation counter 6 00:09:09.816 =====Discovery Log Entry 0====== 00:09:09.816 trtype: tcp 00:09:09.816 adrfam: ipv4 00:09:09.816 subtype: current discovery subsystem 00:09:09.816 treq: not required 00:09:09.816 portid: 0 00:09:09.816 trsvcid: 4420 00:09:09.816 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:09:09.816 traddr: 10.0.0.2 00:09:09.816 eflags: explicit discovery connections, duplicate discovery information 00:09:09.816 sectype: none 00:09:09.816 =====Discovery Log Entry 1====== 00:09:09.816 trtype: tcp 00:09:09.816 adrfam: ipv4 00:09:09.816 subtype: nvme subsystem 00:09:09.816 treq: not required 00:09:09.816 portid: 0 00:09:09.816 trsvcid: 4420 00:09:09.816 subnqn: nqn.2016-06.io.spdk:cnode1 00:09:09.816 traddr: 10.0.0.2 00:09:09.816 eflags: none 00:09:09.816 sectype: none 00:09:09.816 =====Discovery Log Entry 2====== 00:09:09.816 trtype: tcp 00:09:09.816 adrfam: ipv4 00:09:09.816 subtype: nvme subsystem 00:09:09.816 treq: not required 00:09:09.816 portid: 0 00:09:09.816 trsvcid: 4420 00:09:09.816 subnqn: nqn.2016-06.io.spdk:cnode2 00:09:09.816 traddr: 10.0.0.2 00:09:09.816 eflags: none 00:09:09.816 sectype: none 00:09:09.816 =====Discovery Log Entry 3====== 00:09:09.816 trtype: tcp 00:09:09.816 adrfam: ipv4 00:09:09.816 subtype: nvme subsystem 00:09:09.816 treq: not required 00:09:09.816 portid: 0 00:09:09.816 trsvcid: 4420 00:09:09.816 subnqn: nqn.2016-06.io.spdk:cnode3 00:09:09.816 traddr: 10.0.0.2 00:09:09.816 eflags: none 00:09:09.816 sectype: none 00:09:09.816 =====Discovery Log Entry 4====== 00:09:09.816 trtype: tcp 00:09:09.816 adrfam: ipv4 00:09:09.816 subtype: nvme subsystem 00:09:09.816 treq: not required 00:09:09.816 portid: 0 00:09:09.816 trsvcid: 4420 00:09:09.816 subnqn: nqn.2016-06.io.spdk:cnode4 00:09:09.816 traddr: 10.0.0.2 00:09:09.816 eflags: none 00:09:09.816 sectype: none 00:09:09.816 =====Discovery Log Entry 5====== 00:09:09.816 trtype: tcp 00:09:09.816 adrfam: ipv4 00:09:09.816 subtype: discovery subsystem referral 00:09:09.816 treq: not required 00:09:09.816 portid: 0 00:09:09.816 trsvcid: 4430 00:09:09.816 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:09:09.816 traddr: 10.0.0.2 00:09:09.816 eflags: none 00:09:09.816 sectype: none 00:09:09.816 23:01:13 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:09:09.816 Perform nvmf subsystem discovery via RPC 00:09:09.816 23:01:13 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:09:09.816 23:01:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:09.816 23:01:13 -- common/autotest_common.sh@10 -- # set +x 00:09:09.816 [2024-11-28 23:01:13.211343] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:09:09.816 [ 00:09:09.816 { 00:09:09.816 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:09:09.816 "subtype": "Discovery", 00:09:09.816 "listen_addresses": [ 00:09:09.816 { 00:09:09.816 "transport": "TCP", 00:09:09.816 "trtype": "TCP", 00:09:09.816 "adrfam": "IPv4", 00:09:09.816 "traddr": "10.0.0.2", 00:09:09.816 "trsvcid": "4420" 00:09:09.816 } 00:09:09.816 ], 00:09:09.816 "allow_any_host": true, 00:09:09.816 "hosts": [] 00:09:09.816 }, 00:09:09.816 { 00:09:09.816 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:09:09.816 "subtype": "NVMe", 00:09:09.816 "listen_addresses": [ 00:09:09.816 { 00:09:09.816 "transport": "TCP", 00:09:09.816 "trtype": "TCP", 00:09:09.816 "adrfam": "IPv4", 00:09:09.816 "traddr": "10.0.0.2", 00:09:09.816 "trsvcid": "4420" 00:09:09.816 } 00:09:09.816 ], 00:09:09.816 "allow_any_host": true, 00:09:09.816 "hosts": [], 00:09:09.816 "serial_number": "SPDK00000000000001", 00:09:09.816 "model_number": "SPDK bdev Controller", 00:09:09.816 "max_namespaces": 32, 00:09:09.816 "min_cntlid": 1, 00:09:09.816 "max_cntlid": 65519, 00:09:09.816 "namespaces": [ 00:09:09.816 { 00:09:09.816 "nsid": 1, 00:09:09.816 "bdev_name": "Null1", 00:09:09.816 "name": "Null1", 00:09:09.816 "nguid": "89993116E2B441D3AE99962E22941CCE", 00:09:09.816 "uuid": "89993116-e2b4-41d3-ae99-962e22941cce" 00:09:09.816 } 00:09:09.816 ] 00:09:09.816 }, 00:09:09.816 { 00:09:09.816 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:09:09.816 "subtype": "NVMe", 00:09:09.816 "listen_addresses": [ 00:09:09.816 { 00:09:09.816 "transport": "TCP", 00:09:09.816 "trtype": "TCP", 00:09:09.816 "adrfam": "IPv4", 00:09:09.816 "traddr": "10.0.0.2", 00:09:09.816 "trsvcid": "4420" 00:09:09.816 } 00:09:09.816 ], 00:09:09.816 "allow_any_host": true, 00:09:09.816 "hosts": [], 00:09:09.816 "serial_number": "SPDK00000000000002", 00:09:09.816 "model_number": "SPDK bdev Controller", 00:09:09.816 "max_namespaces": 32, 00:09:09.816 "min_cntlid": 1, 00:09:09.816 "max_cntlid": 65519, 00:09:09.816 "namespaces": [ 00:09:09.816 { 00:09:09.816 "nsid": 1, 00:09:09.816 "bdev_name": "Null2", 00:09:09.816 "name": "Null2", 00:09:09.816 "nguid": "8DEF179399204EE7A49D608B5A36EE67", 00:09:09.816 "uuid": "8def1793-9920-4ee7-a49d-608b5a36ee67" 00:09:09.816 } 00:09:09.816 ] 00:09:09.816 }, 00:09:09.816 { 00:09:09.816 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:09:09.816 "subtype": "NVMe", 00:09:09.816 "listen_addresses": [ 00:09:09.816 { 00:09:09.816 "transport": "TCP", 00:09:09.816 "trtype": "TCP", 00:09:09.816 "adrfam": "IPv4", 00:09:09.816 "traddr": "10.0.0.2", 00:09:09.816 "trsvcid": "4420" 00:09:09.816 } 00:09:09.816 ], 00:09:09.816 "allow_any_host": true, 00:09:09.816 "hosts": [], 00:09:09.816 "serial_number": "SPDK00000000000003", 00:09:09.816 "model_number": "SPDK bdev Controller", 00:09:09.816 "max_namespaces": 32, 00:09:09.816 "min_cntlid": 1, 00:09:09.816 "max_cntlid": 65519, 00:09:09.816 "namespaces": [ 00:09:09.816 { 00:09:09.816 "nsid": 1, 00:09:09.816 "bdev_name": "Null3", 00:09:09.816 "name": "Null3", 00:09:09.816 "nguid": "62EEC9F98E544B218547C75BD94CF163", 00:09:09.816 "uuid": "62eec9f9-8e54-4b21-8547-c75bd94cf163" 00:09:09.816 } 00:09:09.816 ] 00:09:09.816 }, 00:09:09.816 { 00:09:09.816 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:09:09.816 "subtype": "NVMe", 00:09:09.816 "listen_addresses": [ 00:09:09.816 { 00:09:09.816 "transport": "TCP", 00:09:09.816 "trtype": "TCP", 00:09:09.816 "adrfam": "IPv4", 00:09:09.816 "traddr": "10.0.0.2", 00:09:09.816 "trsvcid": "4420" 00:09:09.816 } 00:09:09.816 ], 00:09:09.816 "allow_any_host": true, 00:09:09.816 "hosts": [], 00:09:09.816 "serial_number": "SPDK00000000000004", 00:09:09.816 "model_number": "SPDK bdev Controller", 00:09:09.816 "max_namespaces": 32, 00:09:09.816 "min_cntlid": 1, 00:09:09.816 "max_cntlid": 65519, 00:09:09.816 "namespaces": [ 00:09:09.816 { 00:09:09.816 "nsid": 1, 00:09:09.816 "bdev_name": "Null4", 00:09:09.817 "name": "Null4", 00:09:09.817 "nguid": "00994BA6BDF34EF59CE0016AFDC7BCA1", 00:09:09.817 "uuid": "00994ba6-bdf3-4ef5-9ce0-016afdc7bca1" 00:09:09.817 } 00:09:09.817 ] 00:09:09.817 } 00:09:09.817 ] 00:09:09.817 23:01:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:09.817 23:01:13 -- target/discovery.sh@42 -- # seq 1 4 00:09:09.817 23:01:13 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:09:09.817 23:01:13 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:09:09.817 23:01:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:09.817 23:01:13 -- common/autotest_common.sh@10 -- # set +x 00:09:09.817 23:01:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:09.817 23:01:13 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:09:09.817 23:01:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:09.817 23:01:13 -- common/autotest_common.sh@10 -- # set +x 00:09:09.817 23:01:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:09.817 23:01:13 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:09:09.817 23:01:13 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:09:09.817 23:01:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:09.817 23:01:13 -- common/autotest_common.sh@10 -- # set +x 00:09:09.817 23:01:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:09.817 23:01:13 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:09:09.817 23:01:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:09.817 23:01:13 -- common/autotest_common.sh@10 -- # set +x 00:09:09.817 23:01:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:09.817 23:01:13 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:09:09.817 23:01:13 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:09:09.817 23:01:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:09.817 23:01:13 -- common/autotest_common.sh@10 -- # set +x 00:09:09.817 23:01:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:09.817 23:01:13 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:09:09.817 23:01:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:09.817 23:01:13 -- common/autotest_common.sh@10 -- # set +x 00:09:09.817 23:01:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:09.817 23:01:13 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:09:09.817 23:01:13 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:09:09.817 23:01:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:09.817 23:01:13 -- common/autotest_common.sh@10 -- # set +x 00:09:09.817 23:01:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:09.817 23:01:13 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:09:09.817 23:01:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:09.817 23:01:13 -- common/autotest_common.sh@10 -- # set +x 00:09:09.817 23:01:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:09.817 23:01:13 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:09:09.817 23:01:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:09.817 23:01:13 -- common/autotest_common.sh@10 -- # set +x 00:09:09.817 23:01:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:09.817 23:01:13 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:09:09.817 23:01:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:09.817 23:01:13 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:09:09.817 23:01:13 -- common/autotest_common.sh@10 -- # set +x 00:09:09.817 23:01:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:09.817 23:01:13 -- target/discovery.sh@49 -- # check_bdevs= 00:09:09.817 23:01:13 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:09:09.817 23:01:13 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:09:09.817 23:01:13 -- target/discovery.sh@57 -- # nvmftestfini 00:09:09.817 23:01:13 -- nvmf/common.sh@476 -- # nvmfcleanup 00:09:09.817 23:01:13 -- nvmf/common.sh@116 -- # sync 00:09:09.817 23:01:13 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:09:09.817 23:01:13 -- nvmf/common.sh@119 -- # set +e 00:09:09.817 23:01:13 -- nvmf/common.sh@120 -- # for i in {1..20} 00:09:09.817 23:01:13 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:09:09.817 rmmod nvme_tcp 00:09:09.817 rmmod nvme_fabrics 00:09:09.817 rmmod nvme_keyring 00:09:10.075 23:01:13 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:09:10.075 23:01:13 -- nvmf/common.sh@123 -- # set -e 00:09:10.075 23:01:13 -- nvmf/common.sh@124 -- # return 0 00:09:10.075 23:01:13 -- nvmf/common.sh@477 -- # '[' -n 2355688 ']' 00:09:10.075 23:01:13 -- nvmf/common.sh@478 -- # killprocess 2355688 00:09:10.075 23:01:13 -- common/autotest_common.sh@936 -- # '[' -z 2355688 ']' 00:09:10.075 23:01:13 -- common/autotest_common.sh@940 -- # kill -0 2355688 00:09:10.075 23:01:13 -- common/autotest_common.sh@941 -- # uname 00:09:10.075 23:01:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:09:10.075 23:01:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2355688 00:09:10.075 23:01:13 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:09:10.075 23:01:13 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:09:10.075 23:01:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2355688' 00:09:10.075 killing process with pid 2355688 00:09:10.075 23:01:13 -- common/autotest_common.sh@955 -- # kill 2355688 00:09:10.075 [2024-11-28 23:01:13.484105] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:09:10.075 23:01:13 -- common/autotest_common.sh@960 -- # wait 2355688 00:09:10.334 23:01:13 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:09:10.334 23:01:13 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:09:10.334 23:01:13 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:09:10.334 23:01:13 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:09:10.334 23:01:13 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:09:10.334 23:01:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:10.334 23:01:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:10.334 23:01:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:12.236 23:01:15 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:09:12.236 00:09:12.236 real 0m6.176s 00:09:12.236 user 0m7.683s 00:09:12.236 sys 0m1.891s 00:09:12.236 23:01:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:09:12.236 23:01:15 -- common/autotest_common.sh@10 -- # set +x 00:09:12.236 ************************************ 00:09:12.236 END TEST nvmf_discovery 00:09:12.236 ************************************ 00:09:12.236 23:01:15 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:09:12.236 23:01:15 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:09:12.236 23:01:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:09:12.236 23:01:15 -- common/autotest_common.sh@10 -- # set +x 00:09:12.236 ************************************ 00:09:12.236 START TEST nvmf_referrals 00:09:12.236 ************************************ 00:09:12.236 23:01:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:09:12.236 * Looking for test storage... 00:09:12.236 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:09:12.236 23:01:15 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:09:12.236 23:01:15 -- common/autotest_common.sh@1690 -- # lcov --version 00:09:12.236 23:01:15 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:09:12.496 23:01:15 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:09:12.496 23:01:15 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:09:12.496 23:01:15 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:09:12.496 23:01:15 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:09:12.496 23:01:15 -- scripts/common.sh@335 -- # IFS=.-: 00:09:12.496 23:01:15 -- scripts/common.sh@335 -- # read -ra ver1 00:09:12.496 23:01:15 -- scripts/common.sh@336 -- # IFS=.-: 00:09:12.496 23:01:15 -- scripts/common.sh@336 -- # read -ra ver2 00:09:12.496 23:01:15 -- scripts/common.sh@337 -- # local 'op=<' 00:09:12.496 23:01:15 -- scripts/common.sh@339 -- # ver1_l=2 00:09:12.496 23:01:15 -- scripts/common.sh@340 -- # ver2_l=1 00:09:12.496 23:01:15 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:09:12.496 23:01:15 -- scripts/common.sh@343 -- # case "$op" in 00:09:12.496 23:01:15 -- scripts/common.sh@344 -- # : 1 00:09:12.496 23:01:15 -- scripts/common.sh@363 -- # (( v = 0 )) 00:09:12.496 23:01:15 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:09:12.496 23:01:15 -- scripts/common.sh@364 -- # decimal 1 00:09:12.496 23:01:15 -- scripts/common.sh@352 -- # local d=1 00:09:12.496 23:01:15 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:09:12.496 23:01:15 -- scripts/common.sh@354 -- # echo 1 00:09:12.496 23:01:15 -- scripts/common.sh@364 -- # ver1[v]=1 00:09:12.496 23:01:15 -- scripts/common.sh@365 -- # decimal 2 00:09:12.496 23:01:15 -- scripts/common.sh@352 -- # local d=2 00:09:12.496 23:01:15 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:09:12.496 23:01:15 -- scripts/common.sh@354 -- # echo 2 00:09:12.496 23:01:15 -- scripts/common.sh@365 -- # ver2[v]=2 00:09:12.496 23:01:15 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:09:12.496 23:01:15 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:09:12.496 23:01:15 -- scripts/common.sh@367 -- # return 0 00:09:12.496 23:01:15 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:09:12.496 23:01:15 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:09:12.496 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:12.496 --rc genhtml_branch_coverage=1 00:09:12.496 --rc genhtml_function_coverage=1 00:09:12.496 --rc genhtml_legend=1 00:09:12.496 --rc geninfo_all_blocks=1 00:09:12.496 --rc geninfo_unexecuted_blocks=1 00:09:12.496 00:09:12.496 ' 00:09:12.496 23:01:15 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:09:12.496 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:12.496 --rc genhtml_branch_coverage=1 00:09:12.496 --rc genhtml_function_coverage=1 00:09:12.496 --rc genhtml_legend=1 00:09:12.496 --rc geninfo_all_blocks=1 00:09:12.496 --rc geninfo_unexecuted_blocks=1 00:09:12.496 00:09:12.496 ' 00:09:12.496 23:01:15 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:09:12.496 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:12.496 --rc genhtml_branch_coverage=1 00:09:12.496 --rc genhtml_function_coverage=1 00:09:12.496 --rc genhtml_legend=1 00:09:12.496 --rc geninfo_all_blocks=1 00:09:12.496 --rc geninfo_unexecuted_blocks=1 00:09:12.496 00:09:12.496 ' 00:09:12.496 23:01:15 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:09:12.496 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:12.496 --rc genhtml_branch_coverage=1 00:09:12.496 --rc genhtml_function_coverage=1 00:09:12.496 --rc genhtml_legend=1 00:09:12.496 --rc geninfo_all_blocks=1 00:09:12.496 --rc geninfo_unexecuted_blocks=1 00:09:12.496 00:09:12.496 ' 00:09:12.496 23:01:15 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:09:12.496 23:01:15 -- nvmf/common.sh@7 -- # uname -s 00:09:12.496 23:01:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:12.496 23:01:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:12.496 23:01:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:12.496 23:01:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:12.496 23:01:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:12.496 23:01:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:12.496 23:01:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:12.496 23:01:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:12.496 23:01:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:12.496 23:01:15 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:12.496 23:01:15 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:09:12.496 23:01:15 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:09:12.496 23:01:15 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:12.496 23:01:15 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:12.496 23:01:15 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:09:12.496 23:01:15 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:09:12.496 23:01:15 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:12.496 23:01:15 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:12.496 23:01:15 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:12.496 23:01:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:12.496 23:01:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:12.496 23:01:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:12.496 23:01:15 -- paths/export.sh@5 -- # export PATH 00:09:12.496 23:01:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:12.496 23:01:15 -- nvmf/common.sh@46 -- # : 0 00:09:12.496 23:01:15 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:09:12.496 23:01:15 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:09:12.496 23:01:15 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:09:12.496 23:01:15 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:12.496 23:01:15 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:12.496 23:01:15 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:09:12.496 23:01:15 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:09:12.496 23:01:15 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:09:12.496 23:01:15 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:09:12.496 23:01:15 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:09:12.496 23:01:15 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:09:12.496 23:01:15 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:09:12.496 23:01:15 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:09:12.496 23:01:15 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:09:12.496 23:01:15 -- target/referrals.sh@37 -- # nvmftestinit 00:09:12.496 23:01:15 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:09:12.496 23:01:15 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:12.496 23:01:15 -- nvmf/common.sh@436 -- # prepare_net_devs 00:09:12.496 23:01:15 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:09:12.496 23:01:15 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:09:12.496 23:01:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:12.496 23:01:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:12.496 23:01:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:12.496 23:01:15 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:09:12.496 23:01:15 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:09:12.496 23:01:15 -- nvmf/common.sh@284 -- # xtrace_disable 00:09:12.496 23:01:15 -- common/autotest_common.sh@10 -- # set +x 00:09:15.033 23:01:18 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:09:15.033 23:01:18 -- nvmf/common.sh@290 -- # pci_devs=() 00:09:15.033 23:01:18 -- nvmf/common.sh@290 -- # local -a pci_devs 00:09:15.033 23:01:18 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:09:15.033 23:01:18 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:09:15.033 23:01:18 -- nvmf/common.sh@292 -- # pci_drivers=() 00:09:15.033 23:01:18 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:09:15.033 23:01:18 -- nvmf/common.sh@294 -- # net_devs=() 00:09:15.033 23:01:18 -- nvmf/common.sh@294 -- # local -ga net_devs 00:09:15.033 23:01:18 -- nvmf/common.sh@295 -- # e810=() 00:09:15.033 23:01:18 -- nvmf/common.sh@295 -- # local -ga e810 00:09:15.033 23:01:18 -- nvmf/common.sh@296 -- # x722=() 00:09:15.033 23:01:18 -- nvmf/common.sh@296 -- # local -ga x722 00:09:15.033 23:01:18 -- nvmf/common.sh@297 -- # mlx=() 00:09:15.033 23:01:18 -- nvmf/common.sh@297 -- # local -ga mlx 00:09:15.033 23:01:18 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:15.033 23:01:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:15.033 23:01:18 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:15.033 23:01:18 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:15.033 23:01:18 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:15.033 23:01:18 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:15.033 23:01:18 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:15.033 23:01:18 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:15.033 23:01:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:15.033 23:01:18 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:15.033 23:01:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:15.033 23:01:18 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:09:15.033 23:01:18 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:09:15.033 23:01:18 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:09:15.033 23:01:18 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:09:15.033 23:01:18 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:09:15.033 23:01:18 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:09:15.033 23:01:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:15.033 23:01:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:09:15.033 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:09:15.033 23:01:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:15.033 23:01:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:15.033 23:01:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:15.033 23:01:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:15.033 23:01:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:15.033 23:01:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:15.033 23:01:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:09:15.033 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:09:15.033 23:01:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:15.033 23:01:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:15.033 23:01:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:15.033 23:01:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:15.033 23:01:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:15.033 23:01:18 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:09:15.033 23:01:18 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:09:15.033 23:01:18 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:09:15.033 23:01:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:15.033 23:01:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:15.033 23:01:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:15.034 23:01:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:15.034 23:01:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:09:15.034 Found net devices under 0000:0a:00.0: cvl_0_0 00:09:15.034 23:01:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:15.034 23:01:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:15.034 23:01:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:15.034 23:01:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:15.034 23:01:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:15.034 23:01:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:09:15.034 Found net devices under 0000:0a:00.1: cvl_0_1 00:09:15.034 23:01:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:15.034 23:01:18 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:09:15.034 23:01:18 -- nvmf/common.sh@402 -- # is_hw=yes 00:09:15.034 23:01:18 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:09:15.034 23:01:18 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:09:15.034 23:01:18 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:09:15.034 23:01:18 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:09:15.034 23:01:18 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:09:15.034 23:01:18 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:09:15.034 23:01:18 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:09:15.034 23:01:18 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:09:15.034 23:01:18 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:09:15.034 23:01:18 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:09:15.034 23:01:18 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:09:15.034 23:01:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:09:15.034 23:01:18 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:09:15.034 23:01:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:09:15.034 23:01:18 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:09:15.034 23:01:18 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:09:15.034 23:01:18 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:09:15.034 23:01:18 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:09:15.034 23:01:18 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:09:15.034 23:01:18 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:09:15.034 23:01:18 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:09:15.034 23:01:18 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:09:15.034 23:01:18 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:09:15.034 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:09:15.034 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.268 ms 00:09:15.034 00:09:15.034 --- 10.0.0.2 ping statistics --- 00:09:15.034 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:15.034 rtt min/avg/max/mdev = 0.268/0.268/0.268/0.000 ms 00:09:15.034 23:01:18 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:09:15.034 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:09:15.034 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.142 ms 00:09:15.034 00:09:15.034 --- 10.0.0.1 ping statistics --- 00:09:15.034 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:15.034 rtt min/avg/max/mdev = 0.142/0.142/0.142/0.000 ms 00:09:15.034 23:01:18 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:09:15.034 23:01:18 -- nvmf/common.sh@410 -- # return 0 00:09:15.034 23:01:18 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:09:15.034 23:01:18 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:09:15.034 23:01:18 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:09:15.034 23:01:18 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:09:15.034 23:01:18 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:09:15.034 23:01:18 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:09:15.034 23:01:18 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:09:15.034 23:01:18 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:09:15.034 23:01:18 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:09:15.034 23:01:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:09:15.034 23:01:18 -- common/autotest_common.sh@10 -- # set +x 00:09:15.034 23:01:18 -- nvmf/common.sh@469 -- # nvmfpid=2357933 00:09:15.034 23:01:18 -- nvmf/common.sh@470 -- # waitforlisten 2357933 00:09:15.034 23:01:18 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:09:15.034 23:01:18 -- common/autotest_common.sh@829 -- # '[' -z 2357933 ']' 00:09:15.034 23:01:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:15.034 23:01:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:09:15.034 23:01:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:15.034 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:15.034 23:01:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:09:15.034 23:01:18 -- common/autotest_common.sh@10 -- # set +x 00:09:15.034 [2024-11-28 23:01:18.335917] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:09:15.034 [2024-11-28 23:01:18.336010] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:15.034 EAL: No free 2048 kB hugepages reported on node 1 00:09:15.034 [2024-11-28 23:01:18.415924] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:15.034 [2024-11-28 23:01:18.510457] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:09:15.034 [2024-11-28 23:01:18.510612] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:15.034 [2024-11-28 23:01:18.510640] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:15.034 [2024-11-28 23:01:18.510656] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:15.034 [2024-11-28 23:01:18.510713] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:15.034 [2024-11-28 23:01:18.510767] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:09:15.034 [2024-11-28 23:01:18.510822] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:15.034 [2024-11-28 23:01:18.510825] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:09:15.967 23:01:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:09:15.967 23:01:19 -- common/autotest_common.sh@862 -- # return 0 00:09:15.967 23:01:19 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:09:15.967 23:01:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:09:15.967 23:01:19 -- common/autotest_common.sh@10 -- # set +x 00:09:15.967 23:01:19 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:15.967 23:01:19 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:09:15.967 23:01:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:15.967 23:01:19 -- common/autotest_common.sh@10 -- # set +x 00:09:15.967 [2024-11-28 23:01:19.413345] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:09:15.967 23:01:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:15.967 23:01:19 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:09:15.967 23:01:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:15.967 23:01:19 -- common/autotest_common.sh@10 -- # set +x 00:09:15.967 [2024-11-28 23:01:19.425608] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:09:15.967 23:01:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:15.967 23:01:19 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:09:15.967 23:01:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:15.967 23:01:19 -- common/autotest_common.sh@10 -- # set +x 00:09:15.967 23:01:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:15.967 23:01:19 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:09:15.967 23:01:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:15.968 23:01:19 -- common/autotest_common.sh@10 -- # set +x 00:09:15.968 23:01:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:15.968 23:01:19 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:09:15.968 23:01:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:15.968 23:01:19 -- common/autotest_common.sh@10 -- # set +x 00:09:15.968 23:01:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:15.968 23:01:19 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:15.968 23:01:19 -- target/referrals.sh@48 -- # jq length 00:09:15.968 23:01:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:15.968 23:01:19 -- common/autotest_common.sh@10 -- # set +x 00:09:15.968 23:01:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:15.968 23:01:19 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:09:15.968 23:01:19 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:09:15.968 23:01:19 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:09:15.968 23:01:19 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:15.968 23:01:19 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:09:15.968 23:01:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:15.968 23:01:19 -- common/autotest_common.sh@10 -- # set +x 00:09:15.968 23:01:19 -- target/referrals.sh@21 -- # sort 00:09:15.968 23:01:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:15.968 23:01:19 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:09:15.968 23:01:19 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:09:15.968 23:01:19 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:09:15.968 23:01:19 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:15.968 23:01:19 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:15.968 23:01:19 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:15.968 23:01:19 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:15.968 23:01:19 -- target/referrals.sh@26 -- # sort 00:09:16.226 23:01:19 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:09:16.226 23:01:19 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:09:16.226 23:01:19 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:09:16.226 23:01:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:16.226 23:01:19 -- common/autotest_common.sh@10 -- # set +x 00:09:16.226 23:01:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:16.226 23:01:19 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:09:16.226 23:01:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:16.226 23:01:19 -- common/autotest_common.sh@10 -- # set +x 00:09:16.226 23:01:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:16.226 23:01:19 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:09:16.226 23:01:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:16.226 23:01:19 -- common/autotest_common.sh@10 -- # set +x 00:09:16.226 23:01:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:16.226 23:01:19 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:16.226 23:01:19 -- target/referrals.sh@56 -- # jq length 00:09:16.226 23:01:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:16.226 23:01:19 -- common/autotest_common.sh@10 -- # set +x 00:09:16.226 23:01:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:16.226 23:01:19 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:09:16.226 23:01:19 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:09:16.226 23:01:19 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:16.226 23:01:19 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:16.226 23:01:19 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:16.226 23:01:19 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:16.226 23:01:19 -- target/referrals.sh@26 -- # sort 00:09:16.485 23:01:19 -- target/referrals.sh@26 -- # echo 00:09:16.485 23:01:19 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:09:16.485 23:01:19 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:09:16.485 23:01:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:16.485 23:01:19 -- common/autotest_common.sh@10 -- # set +x 00:09:16.485 23:01:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:16.485 23:01:19 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:09:16.485 23:01:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:16.485 23:01:19 -- common/autotest_common.sh@10 -- # set +x 00:09:16.485 23:01:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:16.485 23:01:20 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:09:16.485 23:01:20 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:09:16.485 23:01:20 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:16.485 23:01:20 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:09:16.485 23:01:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:16.485 23:01:20 -- target/referrals.sh@21 -- # sort 00:09:16.485 23:01:20 -- common/autotest_common.sh@10 -- # set +x 00:09:16.485 23:01:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:16.485 23:01:20 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:09:16.485 23:01:20 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:09:16.485 23:01:20 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:09:16.485 23:01:20 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:16.485 23:01:20 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:16.485 23:01:20 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:16.485 23:01:20 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:16.485 23:01:20 -- target/referrals.sh@26 -- # sort 00:09:16.743 23:01:20 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:09:16.743 23:01:20 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:09:16.743 23:01:20 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:09:16.743 23:01:20 -- target/referrals.sh@67 -- # jq -r .subnqn 00:09:16.743 23:01:20 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:09:16.743 23:01:20 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:16.743 23:01:20 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:09:16.743 23:01:20 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:09:16.743 23:01:20 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:09:16.743 23:01:20 -- target/referrals.sh@68 -- # jq -r .subnqn 00:09:16.743 23:01:20 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:09:16.743 23:01:20 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:16.743 23:01:20 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:09:17.000 23:01:20 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:09:17.001 23:01:20 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:09:17.001 23:01:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:17.001 23:01:20 -- common/autotest_common.sh@10 -- # set +x 00:09:17.001 23:01:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:17.001 23:01:20 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:09:17.001 23:01:20 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:09:17.001 23:01:20 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:17.001 23:01:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:17.001 23:01:20 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:09:17.001 23:01:20 -- common/autotest_common.sh@10 -- # set +x 00:09:17.001 23:01:20 -- target/referrals.sh@21 -- # sort 00:09:17.001 23:01:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:17.001 23:01:20 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:09:17.001 23:01:20 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:09:17.001 23:01:20 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:09:17.001 23:01:20 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:17.001 23:01:20 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:17.001 23:01:20 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:17.001 23:01:20 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:17.001 23:01:20 -- target/referrals.sh@26 -- # sort 00:09:17.258 23:01:20 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:09:17.258 23:01:20 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:09:17.259 23:01:20 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:09:17.259 23:01:20 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:09:17.259 23:01:20 -- target/referrals.sh@75 -- # jq -r .subnqn 00:09:17.259 23:01:20 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:17.259 23:01:20 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:09:17.516 23:01:20 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:09:17.516 23:01:20 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:09:17.516 23:01:20 -- target/referrals.sh@76 -- # jq -r .subnqn 00:09:17.516 23:01:20 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:09:17.516 23:01:20 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:17.517 23:01:20 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:09:17.517 23:01:21 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:09:17.517 23:01:21 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:09:17.517 23:01:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:17.517 23:01:21 -- common/autotest_common.sh@10 -- # set +x 00:09:17.517 23:01:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:17.517 23:01:21 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:17.517 23:01:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:17.517 23:01:21 -- target/referrals.sh@82 -- # jq length 00:09:17.517 23:01:21 -- common/autotest_common.sh@10 -- # set +x 00:09:17.517 23:01:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:17.517 23:01:21 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:09:17.517 23:01:21 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:09:17.517 23:01:21 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:17.517 23:01:21 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:17.517 23:01:21 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:17.517 23:01:21 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:17.517 23:01:21 -- target/referrals.sh@26 -- # sort 00:09:17.774 23:01:21 -- target/referrals.sh@26 -- # echo 00:09:17.774 23:01:21 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:09:17.774 23:01:21 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:09:17.775 23:01:21 -- target/referrals.sh@86 -- # nvmftestfini 00:09:17.775 23:01:21 -- nvmf/common.sh@476 -- # nvmfcleanup 00:09:17.775 23:01:21 -- nvmf/common.sh@116 -- # sync 00:09:17.775 23:01:21 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:09:17.775 23:01:21 -- nvmf/common.sh@119 -- # set +e 00:09:17.775 23:01:21 -- nvmf/common.sh@120 -- # for i in {1..20} 00:09:17.775 23:01:21 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:09:17.775 rmmod nvme_tcp 00:09:17.775 rmmod nvme_fabrics 00:09:17.775 rmmod nvme_keyring 00:09:17.775 23:01:21 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:09:18.033 23:01:21 -- nvmf/common.sh@123 -- # set -e 00:09:18.033 23:01:21 -- nvmf/common.sh@124 -- # return 0 00:09:18.033 23:01:21 -- nvmf/common.sh@477 -- # '[' -n 2357933 ']' 00:09:18.033 23:01:21 -- nvmf/common.sh@478 -- # killprocess 2357933 00:09:18.033 23:01:21 -- common/autotest_common.sh@936 -- # '[' -z 2357933 ']' 00:09:18.033 23:01:21 -- common/autotest_common.sh@940 -- # kill -0 2357933 00:09:18.033 23:01:21 -- common/autotest_common.sh@941 -- # uname 00:09:18.033 23:01:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:09:18.033 23:01:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2357933 00:09:18.033 23:01:21 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:09:18.033 23:01:21 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:09:18.033 23:01:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2357933' 00:09:18.033 killing process with pid 2357933 00:09:18.033 23:01:21 -- common/autotest_common.sh@955 -- # kill 2357933 00:09:18.033 23:01:21 -- common/autotest_common.sh@960 -- # wait 2357933 00:09:18.292 23:01:21 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:09:18.292 23:01:21 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:09:18.292 23:01:21 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:09:18.292 23:01:21 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:09:18.292 23:01:21 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:09:18.292 23:01:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:18.292 23:01:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:18.292 23:01:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:20.196 23:01:23 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:09:20.196 00:09:20.196 real 0m7.930s 00:09:20.196 user 0m14.327s 00:09:20.196 sys 0m2.376s 00:09:20.196 23:01:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:09:20.196 23:01:23 -- common/autotest_common.sh@10 -- # set +x 00:09:20.196 ************************************ 00:09:20.196 END TEST nvmf_referrals 00:09:20.196 ************************************ 00:09:20.196 23:01:23 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:09:20.196 23:01:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:09:20.196 23:01:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:09:20.196 23:01:23 -- common/autotest_common.sh@10 -- # set +x 00:09:20.196 ************************************ 00:09:20.196 START TEST nvmf_connect_disconnect 00:09:20.196 ************************************ 00:09:20.196 23:01:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:09:20.196 * Looking for test storage... 00:09:20.197 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:09:20.197 23:01:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:09:20.197 23:01:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:09:20.197 23:01:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:09:20.455 23:01:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:09:20.455 23:01:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:09:20.455 23:01:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:09:20.455 23:01:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:09:20.455 23:01:23 -- scripts/common.sh@335 -- # IFS=.-: 00:09:20.455 23:01:23 -- scripts/common.sh@335 -- # read -ra ver1 00:09:20.455 23:01:23 -- scripts/common.sh@336 -- # IFS=.-: 00:09:20.455 23:01:23 -- scripts/common.sh@336 -- # read -ra ver2 00:09:20.455 23:01:23 -- scripts/common.sh@337 -- # local 'op=<' 00:09:20.455 23:01:23 -- scripts/common.sh@339 -- # ver1_l=2 00:09:20.455 23:01:23 -- scripts/common.sh@340 -- # ver2_l=1 00:09:20.455 23:01:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:09:20.455 23:01:23 -- scripts/common.sh@343 -- # case "$op" in 00:09:20.455 23:01:23 -- scripts/common.sh@344 -- # : 1 00:09:20.455 23:01:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:09:20.455 23:01:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:09:20.455 23:01:23 -- scripts/common.sh@364 -- # decimal 1 00:09:20.455 23:01:23 -- scripts/common.sh@352 -- # local d=1 00:09:20.455 23:01:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:09:20.455 23:01:23 -- scripts/common.sh@354 -- # echo 1 00:09:20.455 23:01:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:09:20.455 23:01:23 -- scripts/common.sh@365 -- # decimal 2 00:09:20.455 23:01:23 -- scripts/common.sh@352 -- # local d=2 00:09:20.455 23:01:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:09:20.455 23:01:23 -- scripts/common.sh@354 -- # echo 2 00:09:20.455 23:01:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:09:20.455 23:01:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:09:20.455 23:01:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:09:20.455 23:01:23 -- scripts/common.sh@367 -- # return 0 00:09:20.455 23:01:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:09:20.455 23:01:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:09:20.455 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:20.455 --rc genhtml_branch_coverage=1 00:09:20.455 --rc genhtml_function_coverage=1 00:09:20.455 --rc genhtml_legend=1 00:09:20.455 --rc geninfo_all_blocks=1 00:09:20.455 --rc geninfo_unexecuted_blocks=1 00:09:20.455 00:09:20.455 ' 00:09:20.455 23:01:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:09:20.455 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:20.455 --rc genhtml_branch_coverage=1 00:09:20.455 --rc genhtml_function_coverage=1 00:09:20.455 --rc genhtml_legend=1 00:09:20.455 --rc geninfo_all_blocks=1 00:09:20.455 --rc geninfo_unexecuted_blocks=1 00:09:20.455 00:09:20.455 ' 00:09:20.455 23:01:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:09:20.455 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:20.455 --rc genhtml_branch_coverage=1 00:09:20.455 --rc genhtml_function_coverage=1 00:09:20.455 --rc genhtml_legend=1 00:09:20.455 --rc geninfo_all_blocks=1 00:09:20.455 --rc geninfo_unexecuted_blocks=1 00:09:20.455 00:09:20.455 ' 00:09:20.455 23:01:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:09:20.455 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:20.455 --rc genhtml_branch_coverage=1 00:09:20.455 --rc genhtml_function_coverage=1 00:09:20.455 --rc genhtml_legend=1 00:09:20.456 --rc geninfo_all_blocks=1 00:09:20.456 --rc geninfo_unexecuted_blocks=1 00:09:20.456 00:09:20.456 ' 00:09:20.456 23:01:23 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:09:20.456 23:01:23 -- nvmf/common.sh@7 -- # uname -s 00:09:20.456 23:01:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:20.456 23:01:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:20.456 23:01:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:20.456 23:01:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:20.456 23:01:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:20.456 23:01:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:20.456 23:01:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:20.456 23:01:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:20.456 23:01:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:20.456 23:01:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:20.456 23:01:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:09:20.456 23:01:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:09:20.456 23:01:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:20.456 23:01:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:20.456 23:01:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:09:20.456 23:01:23 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:09:20.456 23:01:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:20.456 23:01:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:20.456 23:01:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:20.456 23:01:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:20.456 23:01:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:20.456 23:01:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:20.456 23:01:23 -- paths/export.sh@5 -- # export PATH 00:09:20.456 23:01:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:20.456 23:01:23 -- nvmf/common.sh@46 -- # : 0 00:09:20.456 23:01:23 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:09:20.456 23:01:23 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:09:20.456 23:01:23 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:09:20.456 23:01:23 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:20.456 23:01:23 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:20.456 23:01:23 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:09:20.456 23:01:23 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:09:20.456 23:01:23 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:09:20.456 23:01:23 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:09:20.456 23:01:23 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:09:20.456 23:01:23 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:09:20.456 23:01:23 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:09:20.456 23:01:23 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:20.456 23:01:23 -- nvmf/common.sh@436 -- # prepare_net_devs 00:09:20.456 23:01:23 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:09:20.456 23:01:23 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:09:20.456 23:01:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:20.456 23:01:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:20.456 23:01:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:20.456 23:01:23 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:09:20.456 23:01:23 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:09:20.456 23:01:23 -- nvmf/common.sh@284 -- # xtrace_disable 00:09:20.456 23:01:23 -- common/autotest_common.sh@10 -- # set +x 00:09:22.356 23:01:25 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:09:22.356 23:01:25 -- nvmf/common.sh@290 -- # pci_devs=() 00:09:22.356 23:01:25 -- nvmf/common.sh@290 -- # local -a pci_devs 00:09:22.356 23:01:25 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:09:22.356 23:01:25 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:09:22.356 23:01:25 -- nvmf/common.sh@292 -- # pci_drivers=() 00:09:22.356 23:01:25 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:09:22.356 23:01:25 -- nvmf/common.sh@294 -- # net_devs=() 00:09:22.356 23:01:25 -- nvmf/common.sh@294 -- # local -ga net_devs 00:09:22.356 23:01:25 -- nvmf/common.sh@295 -- # e810=() 00:09:22.356 23:01:25 -- nvmf/common.sh@295 -- # local -ga e810 00:09:22.356 23:01:25 -- nvmf/common.sh@296 -- # x722=() 00:09:22.356 23:01:25 -- nvmf/common.sh@296 -- # local -ga x722 00:09:22.356 23:01:25 -- nvmf/common.sh@297 -- # mlx=() 00:09:22.356 23:01:25 -- nvmf/common.sh@297 -- # local -ga mlx 00:09:22.356 23:01:25 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:22.357 23:01:25 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:22.357 23:01:25 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:22.357 23:01:25 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:22.357 23:01:25 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:22.357 23:01:25 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:22.357 23:01:25 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:22.357 23:01:25 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:22.357 23:01:25 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:22.357 23:01:25 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:22.357 23:01:25 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:22.357 23:01:25 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:09:22.357 23:01:25 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:09:22.357 23:01:25 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:09:22.357 23:01:25 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:09:22.357 23:01:25 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:09:22.357 23:01:25 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:09:22.357 23:01:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:22.357 23:01:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:09:22.357 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:09:22.357 23:01:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:22.357 23:01:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:22.357 23:01:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:22.357 23:01:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:22.357 23:01:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:22.357 23:01:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:22.357 23:01:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:09:22.357 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:09:22.357 23:01:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:22.357 23:01:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:22.357 23:01:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:22.357 23:01:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:22.357 23:01:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:22.357 23:01:25 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:09:22.357 23:01:25 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:09:22.357 23:01:25 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:09:22.357 23:01:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:22.357 23:01:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:22.357 23:01:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:22.357 23:01:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:22.357 23:01:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:09:22.357 Found net devices under 0000:0a:00.0: cvl_0_0 00:09:22.357 23:01:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:22.357 23:01:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:22.357 23:01:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:22.357 23:01:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:22.357 23:01:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:22.357 23:01:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:09:22.357 Found net devices under 0000:0a:00.1: cvl_0_1 00:09:22.357 23:01:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:22.357 23:01:25 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:09:22.357 23:01:25 -- nvmf/common.sh@402 -- # is_hw=yes 00:09:22.357 23:01:25 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:09:22.357 23:01:25 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:09:22.357 23:01:25 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:09:22.357 23:01:25 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:09:22.357 23:01:25 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:09:22.357 23:01:25 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:09:22.357 23:01:25 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:09:22.357 23:01:25 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:09:22.357 23:01:25 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:09:22.357 23:01:25 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:09:22.357 23:01:25 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:09:22.357 23:01:25 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:09:22.357 23:01:25 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:09:22.357 23:01:25 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:09:22.357 23:01:25 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:09:22.357 23:01:25 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:09:22.616 23:01:25 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:09:22.616 23:01:25 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:09:22.616 23:01:25 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:09:22.616 23:01:25 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:09:22.616 23:01:26 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:09:22.616 23:01:26 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:09:22.616 23:01:26 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:09:22.616 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:09:22.616 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.173 ms 00:09:22.616 00:09:22.616 --- 10.0.0.2 ping statistics --- 00:09:22.616 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:22.616 rtt min/avg/max/mdev = 0.173/0.173/0.173/0.000 ms 00:09:22.616 23:01:26 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:09:22.616 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:09:22.616 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.097 ms 00:09:22.616 00:09:22.616 --- 10.0.0.1 ping statistics --- 00:09:22.616 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:22.616 rtt min/avg/max/mdev = 0.097/0.097/0.097/0.000 ms 00:09:22.616 23:01:26 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:09:22.616 23:01:26 -- nvmf/common.sh@410 -- # return 0 00:09:22.616 23:01:26 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:09:22.616 23:01:26 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:09:22.616 23:01:26 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:09:22.616 23:01:26 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:09:22.616 23:01:26 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:09:22.616 23:01:26 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:09:22.616 23:01:26 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:09:22.616 23:01:26 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:09:22.616 23:01:26 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:09:22.616 23:01:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:09:22.616 23:01:26 -- common/autotest_common.sh@10 -- # set +x 00:09:22.616 23:01:26 -- nvmf/common.sh@469 -- # nvmfpid=2360388 00:09:22.616 23:01:26 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:09:22.616 23:01:26 -- nvmf/common.sh@470 -- # waitforlisten 2360388 00:09:22.616 23:01:26 -- common/autotest_common.sh@829 -- # '[' -z 2360388 ']' 00:09:22.616 23:01:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:22.616 23:01:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:09:22.616 23:01:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:22.616 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:22.616 23:01:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:09:22.616 23:01:26 -- common/autotest_common.sh@10 -- # set +x 00:09:22.616 [2024-11-28 23:01:26.116137] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:09:22.616 [2024-11-28 23:01:26.116210] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:22.616 EAL: No free 2048 kB hugepages reported on node 1 00:09:22.616 [2024-11-28 23:01:26.187324] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:22.874 [2024-11-28 23:01:26.281584] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:09:22.874 [2024-11-28 23:01:26.281760] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:22.874 [2024-11-28 23:01:26.281780] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:22.874 [2024-11-28 23:01:26.281795] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:22.874 [2024-11-28 23:01:26.281880] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:22.874 [2024-11-28 23:01:26.281937] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:09:22.874 [2024-11-28 23:01:26.281989] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:22.874 [2024-11-28 23:01:26.281992] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:09:23.808 23:01:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:09:23.808 23:01:27 -- common/autotest_common.sh@862 -- # return 0 00:09:23.808 23:01:27 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:09:23.808 23:01:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:09:23.808 23:01:27 -- common/autotest_common.sh@10 -- # set +x 00:09:23.808 23:01:27 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:23.808 23:01:27 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:09:23.808 23:01:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:23.808 23:01:27 -- common/autotest_common.sh@10 -- # set +x 00:09:23.808 [2024-11-28 23:01:27.109029] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:09:23.808 23:01:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:23.808 23:01:27 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:09:23.808 23:01:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:23.808 23:01:27 -- common/autotest_common.sh@10 -- # set +x 00:09:23.808 23:01:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:23.808 23:01:27 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:09:23.808 23:01:27 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:09:23.808 23:01:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:23.808 23:01:27 -- common/autotest_common.sh@10 -- # set +x 00:09:23.808 23:01:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:23.808 23:01:27 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:09:23.808 23:01:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:23.808 23:01:27 -- common/autotest_common.sh@10 -- # set +x 00:09:23.808 23:01:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:23.808 23:01:27 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:09:23.808 23:01:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:23.808 23:01:27 -- common/autotest_common.sh@10 -- # set +x 00:09:23.808 [2024-11-28 23:01:27.165920] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:09:23.808 23:01:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:23.808 23:01:27 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:09:23.808 23:01:27 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:09:23.808 23:01:27 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:09:23.808 23:01:27 -- target/connect_disconnect.sh@34 -- # set +x 00:09:26.334 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:28.297 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:30.824 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:33.347 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:35.245 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:37.771 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:40.299 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:42.837 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:44.735 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:47.259 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:49.156 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:51.677 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:54.197 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:56.095 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:58.623 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:00.520 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:03.044 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:05.570 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:08.097 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:10.050 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:12.577 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:14.476 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:17.002 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:19.529 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:21.426 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:23.961 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:26.488 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:28.387 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:30.913 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:33.438 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:35.335 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:37.858 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:39.757 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:42.285 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:44.810 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:46.708 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:49.232 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:51.758 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:53.652 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:56.228 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:58.755 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:01.281 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:03.178 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:05.703 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:08.231 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:10.126 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:12.651 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:15.180 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:17.711 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:19.610 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:22.139 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:24.668 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:26.568 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:29.093 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:31.616 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:33.513 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:36.041 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:38.671 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:40.569 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:43.097 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:45.624 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:47.521 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:50.048 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:52.571 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:54.469 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:56.995 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:59.520 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:02.064 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:04.007 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:06.530 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:09.057 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:10.957 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:13.483 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:16.007 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:17.906 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:20.431 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:22.995 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:24.918 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:27.445 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:29.971 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:31.868 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:34.392 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:36.918 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:38.815 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:41.342 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:43.867 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:45.766 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:48.292 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:50.818 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:53.342 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:55.866 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:57.764 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:00.292 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:02.820 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:04.719 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:07.317 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:09.230 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:11.756 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:14.276 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:16.805 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:16.805 23:05:19 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:13:16.805 23:05:19 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:13:16.805 23:05:19 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:16.805 23:05:19 -- nvmf/common.sh@116 -- # sync 00:13:16.805 23:05:19 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:16.805 23:05:19 -- nvmf/common.sh@119 -- # set +e 00:13:16.805 23:05:19 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:16.805 23:05:19 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:16.805 rmmod nvme_tcp 00:13:16.805 rmmod nvme_fabrics 00:13:16.805 rmmod nvme_keyring 00:13:16.805 23:05:19 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:16.805 23:05:19 -- nvmf/common.sh@123 -- # set -e 00:13:16.805 23:05:19 -- nvmf/common.sh@124 -- # return 0 00:13:16.805 23:05:19 -- nvmf/common.sh@477 -- # '[' -n 2360388 ']' 00:13:16.805 23:05:19 -- nvmf/common.sh@478 -- # killprocess 2360388 00:13:16.805 23:05:19 -- common/autotest_common.sh@936 -- # '[' -z 2360388 ']' 00:13:16.805 23:05:19 -- common/autotest_common.sh@940 -- # kill -0 2360388 00:13:16.805 23:05:19 -- common/autotest_common.sh@941 -- # uname 00:13:16.805 23:05:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:16.805 23:05:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2360388 00:13:16.805 23:05:19 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:16.805 23:05:19 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:16.805 23:05:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2360388' 00:13:16.805 killing process with pid 2360388 00:13:16.805 23:05:19 -- common/autotest_common.sh@955 -- # kill 2360388 00:13:16.805 23:05:19 -- common/autotest_common.sh@960 -- # wait 2360388 00:13:16.805 23:05:20 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:16.805 23:05:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:16.805 23:05:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:16.805 23:05:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:16.805 23:05:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:16.805 23:05:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:16.805 23:05:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:16.805 23:05:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:18.711 23:05:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:18.711 00:13:18.711 real 3m58.508s 00:13:18.711 user 15m8.752s 00:13:18.711 sys 0m36.088s 00:13:18.711 23:05:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:18.711 23:05:22 -- common/autotest_common.sh@10 -- # set +x 00:13:18.711 ************************************ 00:13:18.711 END TEST nvmf_connect_disconnect 00:13:18.711 ************************************ 00:13:18.712 23:05:22 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:13:18.712 23:05:22 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:18.712 23:05:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:18.712 23:05:22 -- common/autotest_common.sh@10 -- # set +x 00:13:18.712 ************************************ 00:13:18.712 START TEST nvmf_multitarget 00:13:18.712 ************************************ 00:13:18.712 23:05:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:13:18.712 * Looking for test storage... 00:13:18.971 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:18.971 23:05:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:18.971 23:05:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:18.971 23:05:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:18.971 23:05:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:18.971 23:05:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:18.971 23:05:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:18.971 23:05:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:18.971 23:05:22 -- scripts/common.sh@335 -- # IFS=.-: 00:13:18.971 23:05:22 -- scripts/common.sh@335 -- # read -ra ver1 00:13:18.971 23:05:22 -- scripts/common.sh@336 -- # IFS=.-: 00:13:18.971 23:05:22 -- scripts/common.sh@336 -- # read -ra ver2 00:13:18.971 23:05:22 -- scripts/common.sh@337 -- # local 'op=<' 00:13:18.971 23:05:22 -- scripts/common.sh@339 -- # ver1_l=2 00:13:18.971 23:05:22 -- scripts/common.sh@340 -- # ver2_l=1 00:13:18.971 23:05:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:18.971 23:05:22 -- scripts/common.sh@343 -- # case "$op" in 00:13:18.971 23:05:22 -- scripts/common.sh@344 -- # : 1 00:13:18.971 23:05:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:18.971 23:05:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:18.971 23:05:22 -- scripts/common.sh@364 -- # decimal 1 00:13:18.971 23:05:22 -- scripts/common.sh@352 -- # local d=1 00:13:18.971 23:05:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:18.971 23:05:22 -- scripts/common.sh@354 -- # echo 1 00:13:18.971 23:05:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:18.971 23:05:22 -- scripts/common.sh@365 -- # decimal 2 00:13:18.971 23:05:22 -- scripts/common.sh@352 -- # local d=2 00:13:18.971 23:05:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:18.971 23:05:22 -- scripts/common.sh@354 -- # echo 2 00:13:18.971 23:05:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:18.971 23:05:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:18.971 23:05:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:18.971 23:05:22 -- scripts/common.sh@367 -- # return 0 00:13:18.971 23:05:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:18.971 23:05:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:18.971 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:18.971 --rc genhtml_branch_coverage=1 00:13:18.971 --rc genhtml_function_coverage=1 00:13:18.971 --rc genhtml_legend=1 00:13:18.971 --rc geninfo_all_blocks=1 00:13:18.971 --rc geninfo_unexecuted_blocks=1 00:13:18.971 00:13:18.971 ' 00:13:18.971 23:05:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:18.971 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:18.971 --rc genhtml_branch_coverage=1 00:13:18.971 --rc genhtml_function_coverage=1 00:13:18.971 --rc genhtml_legend=1 00:13:18.971 --rc geninfo_all_blocks=1 00:13:18.971 --rc geninfo_unexecuted_blocks=1 00:13:18.971 00:13:18.971 ' 00:13:18.971 23:05:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:18.971 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:18.971 --rc genhtml_branch_coverage=1 00:13:18.971 --rc genhtml_function_coverage=1 00:13:18.971 --rc genhtml_legend=1 00:13:18.971 --rc geninfo_all_blocks=1 00:13:18.971 --rc geninfo_unexecuted_blocks=1 00:13:18.971 00:13:18.971 ' 00:13:18.971 23:05:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:18.971 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:18.971 --rc genhtml_branch_coverage=1 00:13:18.971 --rc genhtml_function_coverage=1 00:13:18.971 --rc genhtml_legend=1 00:13:18.971 --rc geninfo_all_blocks=1 00:13:18.971 --rc geninfo_unexecuted_blocks=1 00:13:18.971 00:13:18.971 ' 00:13:18.971 23:05:22 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:18.971 23:05:22 -- nvmf/common.sh@7 -- # uname -s 00:13:18.971 23:05:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:18.971 23:05:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:18.971 23:05:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:18.971 23:05:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:18.971 23:05:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:18.971 23:05:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:18.971 23:05:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:18.971 23:05:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:18.971 23:05:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:18.971 23:05:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:18.971 23:05:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:18.971 23:05:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:18.971 23:05:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:18.971 23:05:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:18.971 23:05:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:18.971 23:05:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:18.971 23:05:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:18.971 23:05:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:18.971 23:05:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:18.971 23:05:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:18.971 23:05:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:18.971 23:05:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:18.971 23:05:22 -- paths/export.sh@5 -- # export PATH 00:13:18.971 23:05:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:18.971 23:05:22 -- nvmf/common.sh@46 -- # : 0 00:13:18.971 23:05:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:18.971 23:05:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:18.971 23:05:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:18.971 23:05:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:18.971 23:05:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:18.971 23:05:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:18.971 23:05:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:18.971 23:05:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:18.971 23:05:22 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:13:18.972 23:05:22 -- target/multitarget.sh@15 -- # nvmftestinit 00:13:18.972 23:05:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:18.972 23:05:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:18.972 23:05:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:18.972 23:05:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:18.972 23:05:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:18.972 23:05:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:18.972 23:05:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:18.972 23:05:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:18.972 23:05:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:18.972 23:05:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:18.972 23:05:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:18.972 23:05:22 -- common/autotest_common.sh@10 -- # set +x 00:13:21.504 23:05:24 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:21.504 23:05:24 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:21.504 23:05:24 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:21.504 23:05:24 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:21.504 23:05:24 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:21.504 23:05:24 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:21.504 23:05:24 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:21.504 23:05:24 -- nvmf/common.sh@294 -- # net_devs=() 00:13:21.504 23:05:24 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:21.504 23:05:24 -- nvmf/common.sh@295 -- # e810=() 00:13:21.504 23:05:24 -- nvmf/common.sh@295 -- # local -ga e810 00:13:21.504 23:05:24 -- nvmf/common.sh@296 -- # x722=() 00:13:21.504 23:05:24 -- nvmf/common.sh@296 -- # local -ga x722 00:13:21.504 23:05:24 -- nvmf/common.sh@297 -- # mlx=() 00:13:21.504 23:05:24 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:21.504 23:05:24 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:21.504 23:05:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:21.504 23:05:24 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:21.504 23:05:24 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:21.504 23:05:24 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:21.504 23:05:24 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:21.504 23:05:24 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:21.504 23:05:24 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:21.504 23:05:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:21.504 23:05:24 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:21.504 23:05:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:21.504 23:05:24 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:21.504 23:05:24 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:21.504 23:05:24 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:21.504 23:05:24 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:21.504 23:05:24 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:21.504 23:05:24 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:21.504 23:05:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:21.504 23:05:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:21.504 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:21.504 23:05:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:21.504 23:05:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:21.504 23:05:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:21.504 23:05:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:21.504 23:05:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:21.504 23:05:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:21.504 23:05:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:21.504 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:21.504 23:05:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:21.504 23:05:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:21.504 23:05:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:21.504 23:05:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:21.504 23:05:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:21.504 23:05:24 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:21.504 23:05:24 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:21.504 23:05:24 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:21.504 23:05:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:21.504 23:05:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:21.504 23:05:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:21.504 23:05:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:21.504 23:05:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:21.504 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:21.504 23:05:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:21.504 23:05:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:21.504 23:05:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:21.504 23:05:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:21.504 23:05:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:21.504 23:05:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:21.504 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:21.504 23:05:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:21.504 23:05:24 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:21.504 23:05:24 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:21.504 23:05:24 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:21.504 23:05:24 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:21.504 23:05:24 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:21.504 23:05:24 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:21.504 23:05:24 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:21.504 23:05:24 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:21.504 23:05:24 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:21.504 23:05:24 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:21.504 23:05:24 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:21.504 23:05:24 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:21.504 23:05:24 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:21.504 23:05:24 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:21.504 23:05:24 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:21.504 23:05:24 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:21.504 23:05:24 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:21.504 23:05:24 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:21.504 23:05:24 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:21.504 23:05:24 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:21.504 23:05:24 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:21.504 23:05:24 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:21.504 23:05:24 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:21.504 23:05:24 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:21.504 23:05:24 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:21.504 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:21.504 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.280 ms 00:13:21.504 00:13:21.504 --- 10.0.0.2 ping statistics --- 00:13:21.504 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:21.504 rtt min/avg/max/mdev = 0.280/0.280/0.280/0.000 ms 00:13:21.504 23:05:24 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:21.504 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:21.504 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.098 ms 00:13:21.504 00:13:21.504 --- 10.0.0.1 ping statistics --- 00:13:21.504 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:21.504 rtt min/avg/max/mdev = 0.098/0.098/0.098/0.000 ms 00:13:21.504 23:05:24 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:21.504 23:05:24 -- nvmf/common.sh@410 -- # return 0 00:13:21.504 23:05:24 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:21.504 23:05:24 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:21.504 23:05:24 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:21.504 23:05:24 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:21.504 23:05:24 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:21.504 23:05:24 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:21.504 23:05:24 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:21.504 23:05:24 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:13:21.504 23:05:24 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:21.504 23:05:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:21.504 23:05:24 -- common/autotest_common.sh@10 -- # set +x 00:13:21.504 23:05:24 -- nvmf/common.sh@469 -- # nvmfpid=2392649 00:13:21.504 23:05:24 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:21.504 23:05:24 -- nvmf/common.sh@470 -- # waitforlisten 2392649 00:13:21.504 23:05:24 -- common/autotest_common.sh@829 -- # '[' -z 2392649 ']' 00:13:21.504 23:05:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:21.504 23:05:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:21.504 23:05:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:21.504 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:21.504 23:05:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:21.504 23:05:24 -- common/autotest_common.sh@10 -- # set +x 00:13:21.504 [2024-11-28 23:05:24.740421] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:21.504 [2024-11-28 23:05:24.740516] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:21.504 EAL: No free 2048 kB hugepages reported on node 1 00:13:21.504 [2024-11-28 23:05:24.807874] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:21.504 [2024-11-28 23:05:24.897226] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:21.505 [2024-11-28 23:05:24.897368] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:21.505 [2024-11-28 23:05:24.897386] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:21.505 [2024-11-28 23:05:24.897407] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:21.505 [2024-11-28 23:05:24.897468] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:21.505 [2024-11-28 23:05:24.897581] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:21.505 [2024-11-28 23:05:24.897649] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:21.505 [2024-11-28 23:05:24.897652] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:22.437 23:05:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:22.437 23:05:25 -- common/autotest_common.sh@862 -- # return 0 00:13:22.437 23:05:25 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:22.437 23:05:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:22.437 23:05:25 -- common/autotest_common.sh@10 -- # set +x 00:13:22.437 23:05:25 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:22.437 23:05:25 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:13:22.437 23:05:25 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:13:22.437 23:05:25 -- target/multitarget.sh@21 -- # jq length 00:13:22.437 23:05:25 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:13:22.437 23:05:25 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:13:22.437 "nvmf_tgt_1" 00:13:22.437 23:05:25 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:13:22.694 "nvmf_tgt_2" 00:13:22.694 23:05:26 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:13:22.695 23:05:26 -- target/multitarget.sh@28 -- # jq length 00:13:22.695 23:05:26 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:13:22.695 23:05:26 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:13:22.953 true 00:13:22.953 23:05:26 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:13:22.953 true 00:13:22.953 23:05:26 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:13:22.953 23:05:26 -- target/multitarget.sh@35 -- # jq length 00:13:22.953 23:05:26 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:13:22.953 23:05:26 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:13:22.953 23:05:26 -- target/multitarget.sh@41 -- # nvmftestfini 00:13:22.953 23:05:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:22.953 23:05:26 -- nvmf/common.sh@116 -- # sync 00:13:22.953 23:05:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:22.953 23:05:26 -- nvmf/common.sh@119 -- # set +e 00:13:22.953 23:05:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:22.953 23:05:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:22.953 rmmod nvme_tcp 00:13:23.210 rmmod nvme_fabrics 00:13:23.211 rmmod nvme_keyring 00:13:23.211 23:05:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:23.211 23:05:26 -- nvmf/common.sh@123 -- # set -e 00:13:23.211 23:05:26 -- nvmf/common.sh@124 -- # return 0 00:13:23.211 23:05:26 -- nvmf/common.sh@477 -- # '[' -n 2392649 ']' 00:13:23.211 23:05:26 -- nvmf/common.sh@478 -- # killprocess 2392649 00:13:23.211 23:05:26 -- common/autotest_common.sh@936 -- # '[' -z 2392649 ']' 00:13:23.211 23:05:26 -- common/autotest_common.sh@940 -- # kill -0 2392649 00:13:23.211 23:05:26 -- common/autotest_common.sh@941 -- # uname 00:13:23.211 23:05:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:23.211 23:05:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2392649 00:13:23.211 23:05:26 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:23.211 23:05:26 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:23.211 23:05:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2392649' 00:13:23.211 killing process with pid 2392649 00:13:23.211 23:05:26 -- common/autotest_common.sh@955 -- # kill 2392649 00:13:23.211 23:05:26 -- common/autotest_common.sh@960 -- # wait 2392649 00:13:23.470 23:05:26 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:23.470 23:05:26 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:23.470 23:05:26 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:23.470 23:05:26 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:23.470 23:05:26 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:23.470 23:05:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:23.470 23:05:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:23.470 23:05:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:25.379 23:05:28 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:25.379 00:13:25.379 real 0m6.626s 00:13:25.379 user 0m9.625s 00:13:25.379 sys 0m2.035s 00:13:25.379 23:05:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:25.379 23:05:28 -- common/autotest_common.sh@10 -- # set +x 00:13:25.379 ************************************ 00:13:25.379 END TEST nvmf_multitarget 00:13:25.379 ************************************ 00:13:25.379 23:05:28 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:13:25.379 23:05:28 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:25.379 23:05:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:25.379 23:05:28 -- common/autotest_common.sh@10 -- # set +x 00:13:25.379 ************************************ 00:13:25.379 START TEST nvmf_rpc 00:13:25.379 ************************************ 00:13:25.379 23:05:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:13:25.379 * Looking for test storage... 00:13:25.379 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:25.379 23:05:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:25.379 23:05:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:25.379 23:05:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:25.639 23:05:29 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:25.639 23:05:29 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:25.639 23:05:29 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:25.639 23:05:29 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:25.639 23:05:29 -- scripts/common.sh@335 -- # IFS=.-: 00:13:25.639 23:05:29 -- scripts/common.sh@335 -- # read -ra ver1 00:13:25.639 23:05:29 -- scripts/common.sh@336 -- # IFS=.-: 00:13:25.639 23:05:29 -- scripts/common.sh@336 -- # read -ra ver2 00:13:25.639 23:05:29 -- scripts/common.sh@337 -- # local 'op=<' 00:13:25.639 23:05:29 -- scripts/common.sh@339 -- # ver1_l=2 00:13:25.639 23:05:29 -- scripts/common.sh@340 -- # ver2_l=1 00:13:25.639 23:05:29 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:25.639 23:05:29 -- scripts/common.sh@343 -- # case "$op" in 00:13:25.639 23:05:29 -- scripts/common.sh@344 -- # : 1 00:13:25.639 23:05:29 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:25.639 23:05:29 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:25.639 23:05:29 -- scripts/common.sh@364 -- # decimal 1 00:13:25.639 23:05:29 -- scripts/common.sh@352 -- # local d=1 00:13:25.639 23:05:29 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:25.639 23:05:29 -- scripts/common.sh@354 -- # echo 1 00:13:25.639 23:05:29 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:25.639 23:05:29 -- scripts/common.sh@365 -- # decimal 2 00:13:25.639 23:05:29 -- scripts/common.sh@352 -- # local d=2 00:13:25.639 23:05:29 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:25.639 23:05:29 -- scripts/common.sh@354 -- # echo 2 00:13:25.639 23:05:29 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:25.639 23:05:29 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:25.639 23:05:29 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:25.639 23:05:29 -- scripts/common.sh@367 -- # return 0 00:13:25.639 23:05:29 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:25.639 23:05:29 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:25.639 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:25.639 --rc genhtml_branch_coverage=1 00:13:25.639 --rc genhtml_function_coverage=1 00:13:25.639 --rc genhtml_legend=1 00:13:25.639 --rc geninfo_all_blocks=1 00:13:25.639 --rc geninfo_unexecuted_blocks=1 00:13:25.639 00:13:25.639 ' 00:13:25.639 23:05:29 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:25.639 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:25.639 --rc genhtml_branch_coverage=1 00:13:25.639 --rc genhtml_function_coverage=1 00:13:25.639 --rc genhtml_legend=1 00:13:25.639 --rc geninfo_all_blocks=1 00:13:25.639 --rc geninfo_unexecuted_blocks=1 00:13:25.639 00:13:25.639 ' 00:13:25.639 23:05:29 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:25.639 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:25.639 --rc genhtml_branch_coverage=1 00:13:25.639 --rc genhtml_function_coverage=1 00:13:25.639 --rc genhtml_legend=1 00:13:25.639 --rc geninfo_all_blocks=1 00:13:25.639 --rc geninfo_unexecuted_blocks=1 00:13:25.639 00:13:25.639 ' 00:13:25.639 23:05:29 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:25.639 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:25.639 --rc genhtml_branch_coverage=1 00:13:25.639 --rc genhtml_function_coverage=1 00:13:25.639 --rc genhtml_legend=1 00:13:25.639 --rc geninfo_all_blocks=1 00:13:25.639 --rc geninfo_unexecuted_blocks=1 00:13:25.639 00:13:25.639 ' 00:13:25.639 23:05:29 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:25.639 23:05:29 -- nvmf/common.sh@7 -- # uname -s 00:13:25.639 23:05:29 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:25.639 23:05:29 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:25.639 23:05:29 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:25.639 23:05:29 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:25.639 23:05:29 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:25.639 23:05:29 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:25.639 23:05:29 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:25.639 23:05:29 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:25.639 23:05:29 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:25.639 23:05:29 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:25.639 23:05:29 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:25.639 23:05:29 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:25.639 23:05:29 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:25.639 23:05:29 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:25.639 23:05:29 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:25.639 23:05:29 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:25.639 23:05:29 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:25.639 23:05:29 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:25.639 23:05:29 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:25.639 23:05:29 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:25.639 23:05:29 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:25.639 23:05:29 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:25.639 23:05:29 -- paths/export.sh@5 -- # export PATH 00:13:25.639 23:05:29 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:25.639 23:05:29 -- nvmf/common.sh@46 -- # : 0 00:13:25.639 23:05:29 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:25.639 23:05:29 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:25.639 23:05:29 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:25.639 23:05:29 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:25.639 23:05:29 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:25.639 23:05:29 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:25.639 23:05:29 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:25.639 23:05:29 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:25.639 23:05:29 -- target/rpc.sh@11 -- # loops=5 00:13:25.639 23:05:29 -- target/rpc.sh@23 -- # nvmftestinit 00:13:25.639 23:05:29 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:25.639 23:05:29 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:25.639 23:05:29 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:25.639 23:05:29 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:25.639 23:05:29 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:25.639 23:05:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:25.639 23:05:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:25.639 23:05:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:25.639 23:05:29 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:25.639 23:05:29 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:25.639 23:05:29 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:25.639 23:05:29 -- common/autotest_common.sh@10 -- # set +x 00:13:27.560 23:05:31 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:27.560 23:05:31 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:27.560 23:05:31 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:27.560 23:05:31 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:27.560 23:05:31 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:27.560 23:05:31 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:27.560 23:05:31 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:27.560 23:05:31 -- nvmf/common.sh@294 -- # net_devs=() 00:13:27.560 23:05:31 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:27.560 23:05:31 -- nvmf/common.sh@295 -- # e810=() 00:13:27.560 23:05:31 -- nvmf/common.sh@295 -- # local -ga e810 00:13:27.560 23:05:31 -- nvmf/common.sh@296 -- # x722=() 00:13:27.560 23:05:31 -- nvmf/common.sh@296 -- # local -ga x722 00:13:27.560 23:05:31 -- nvmf/common.sh@297 -- # mlx=() 00:13:27.560 23:05:31 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:27.560 23:05:31 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:27.560 23:05:31 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:27.560 23:05:31 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:27.560 23:05:31 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:27.560 23:05:31 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:27.560 23:05:31 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:27.560 23:05:31 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:27.560 23:05:31 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:27.560 23:05:31 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:27.560 23:05:31 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:27.560 23:05:31 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:27.560 23:05:31 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:27.560 23:05:31 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:27.560 23:05:31 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:27.560 23:05:31 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:27.560 23:05:31 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:27.560 23:05:31 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:27.560 23:05:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:27.560 23:05:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:27.560 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:27.560 23:05:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:27.560 23:05:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:27.560 23:05:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:27.560 23:05:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:27.560 23:05:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:27.560 23:05:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:27.560 23:05:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:27.560 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:27.560 23:05:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:27.560 23:05:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:27.560 23:05:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:27.560 23:05:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:27.560 23:05:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:27.560 23:05:31 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:27.560 23:05:31 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:27.560 23:05:31 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:27.560 23:05:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:27.561 23:05:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:27.561 23:05:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:27.561 23:05:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:27.561 23:05:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:27.561 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:27.561 23:05:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:27.561 23:05:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:27.561 23:05:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:27.561 23:05:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:27.561 23:05:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:27.561 23:05:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:27.561 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:27.561 23:05:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:27.561 23:05:31 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:27.561 23:05:31 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:27.561 23:05:31 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:27.561 23:05:31 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:27.561 23:05:31 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:27.561 23:05:31 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:27.561 23:05:31 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:27.561 23:05:31 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:27.561 23:05:31 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:27.561 23:05:31 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:27.561 23:05:31 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:27.561 23:05:31 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:27.561 23:05:31 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:27.561 23:05:31 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:27.561 23:05:31 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:27.561 23:05:31 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:27.561 23:05:31 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:27.561 23:05:31 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:27.819 23:05:31 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:27.819 23:05:31 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:27.819 23:05:31 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:27.819 23:05:31 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:27.819 23:05:31 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:27.819 23:05:31 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:27.819 23:05:31 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:27.819 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:27.819 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.238 ms 00:13:27.819 00:13:27.819 --- 10.0.0.2 ping statistics --- 00:13:27.819 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:27.819 rtt min/avg/max/mdev = 0.238/0.238/0.238/0.000 ms 00:13:27.819 23:05:31 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:27.819 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:27.819 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.081 ms 00:13:27.819 00:13:27.819 --- 10.0.0.1 ping statistics --- 00:13:27.819 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:27.819 rtt min/avg/max/mdev = 0.081/0.081/0.081/0.000 ms 00:13:27.819 23:05:31 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:27.819 23:05:31 -- nvmf/common.sh@410 -- # return 0 00:13:27.819 23:05:31 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:27.819 23:05:31 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:27.819 23:05:31 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:27.819 23:05:31 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:27.819 23:05:31 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:27.819 23:05:31 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:27.819 23:05:31 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:27.819 23:05:31 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:13:27.819 23:05:31 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:27.819 23:05:31 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:27.819 23:05:31 -- common/autotest_common.sh@10 -- # set +x 00:13:27.819 23:05:31 -- nvmf/common.sh@469 -- # nvmfpid=2394827 00:13:27.819 23:05:31 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:27.819 23:05:31 -- nvmf/common.sh@470 -- # waitforlisten 2394827 00:13:27.819 23:05:31 -- common/autotest_common.sh@829 -- # '[' -z 2394827 ']' 00:13:27.819 23:05:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:27.819 23:05:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:27.819 23:05:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:27.819 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:27.819 23:05:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:27.819 23:05:31 -- common/autotest_common.sh@10 -- # set +x 00:13:28.077 [2024-11-28 23:05:31.441860] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:28.077 [2024-11-28 23:05:31.441955] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:28.077 EAL: No free 2048 kB hugepages reported on node 1 00:13:28.077 [2024-11-28 23:05:31.515830] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:28.077 [2024-11-28 23:05:31.609637] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:28.077 [2024-11-28 23:05:31.609815] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:28.077 [2024-11-28 23:05:31.609835] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:28.077 [2024-11-28 23:05:31.609851] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:28.077 [2024-11-28 23:05:31.609916] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:28.077 [2024-11-28 23:05:31.609977] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:28.077 [2024-11-28 23:05:31.610478] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:28.077 [2024-11-28 23:05:31.610483] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:29.010 23:05:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:29.010 23:05:32 -- common/autotest_common.sh@862 -- # return 0 00:13:29.010 23:05:32 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:29.010 23:05:32 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:29.010 23:05:32 -- common/autotest_common.sh@10 -- # set +x 00:13:29.010 23:05:32 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:29.010 23:05:32 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:13:29.010 23:05:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.010 23:05:32 -- common/autotest_common.sh@10 -- # set +x 00:13:29.010 23:05:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.010 23:05:32 -- target/rpc.sh@26 -- # stats='{ 00:13:29.010 "tick_rate": 2700000000, 00:13:29.010 "poll_groups": [ 00:13:29.010 { 00:13:29.010 "name": "nvmf_tgt_poll_group_0", 00:13:29.010 "admin_qpairs": 0, 00:13:29.010 "io_qpairs": 0, 00:13:29.010 "current_admin_qpairs": 0, 00:13:29.010 "current_io_qpairs": 0, 00:13:29.010 "pending_bdev_io": 0, 00:13:29.010 "completed_nvme_io": 0, 00:13:29.010 "transports": [] 00:13:29.010 }, 00:13:29.010 { 00:13:29.010 "name": "nvmf_tgt_poll_group_1", 00:13:29.010 "admin_qpairs": 0, 00:13:29.010 "io_qpairs": 0, 00:13:29.010 "current_admin_qpairs": 0, 00:13:29.010 "current_io_qpairs": 0, 00:13:29.010 "pending_bdev_io": 0, 00:13:29.010 "completed_nvme_io": 0, 00:13:29.010 "transports": [] 00:13:29.010 }, 00:13:29.010 { 00:13:29.010 "name": "nvmf_tgt_poll_group_2", 00:13:29.010 "admin_qpairs": 0, 00:13:29.010 "io_qpairs": 0, 00:13:29.010 "current_admin_qpairs": 0, 00:13:29.010 "current_io_qpairs": 0, 00:13:29.010 "pending_bdev_io": 0, 00:13:29.010 "completed_nvme_io": 0, 00:13:29.010 "transports": [] 00:13:29.010 }, 00:13:29.010 { 00:13:29.010 "name": "nvmf_tgt_poll_group_3", 00:13:29.010 "admin_qpairs": 0, 00:13:29.010 "io_qpairs": 0, 00:13:29.010 "current_admin_qpairs": 0, 00:13:29.010 "current_io_qpairs": 0, 00:13:29.010 "pending_bdev_io": 0, 00:13:29.010 "completed_nvme_io": 0, 00:13:29.010 "transports": [] 00:13:29.010 } 00:13:29.010 ] 00:13:29.010 }' 00:13:29.010 23:05:32 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:13:29.010 23:05:32 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:13:29.010 23:05:32 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:13:29.010 23:05:32 -- target/rpc.sh@15 -- # wc -l 00:13:29.010 23:05:32 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:13:29.010 23:05:32 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:13:29.010 23:05:32 -- target/rpc.sh@29 -- # [[ null == null ]] 00:13:29.010 23:05:32 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:29.010 23:05:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.010 23:05:32 -- common/autotest_common.sh@10 -- # set +x 00:13:29.010 [2024-11-28 23:05:32.505250] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:29.010 23:05:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.010 23:05:32 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:13:29.010 23:05:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.010 23:05:32 -- common/autotest_common.sh@10 -- # set +x 00:13:29.010 23:05:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.010 23:05:32 -- target/rpc.sh@33 -- # stats='{ 00:13:29.010 "tick_rate": 2700000000, 00:13:29.010 "poll_groups": [ 00:13:29.010 { 00:13:29.010 "name": "nvmf_tgt_poll_group_0", 00:13:29.010 "admin_qpairs": 0, 00:13:29.011 "io_qpairs": 0, 00:13:29.011 "current_admin_qpairs": 0, 00:13:29.011 "current_io_qpairs": 0, 00:13:29.011 "pending_bdev_io": 0, 00:13:29.011 "completed_nvme_io": 0, 00:13:29.011 "transports": [ 00:13:29.011 { 00:13:29.011 "trtype": "TCP" 00:13:29.011 } 00:13:29.011 ] 00:13:29.011 }, 00:13:29.011 { 00:13:29.011 "name": "nvmf_tgt_poll_group_1", 00:13:29.011 "admin_qpairs": 0, 00:13:29.011 "io_qpairs": 0, 00:13:29.011 "current_admin_qpairs": 0, 00:13:29.011 "current_io_qpairs": 0, 00:13:29.011 "pending_bdev_io": 0, 00:13:29.011 "completed_nvme_io": 0, 00:13:29.011 "transports": [ 00:13:29.011 { 00:13:29.011 "trtype": "TCP" 00:13:29.011 } 00:13:29.011 ] 00:13:29.011 }, 00:13:29.011 { 00:13:29.011 "name": "nvmf_tgt_poll_group_2", 00:13:29.011 "admin_qpairs": 0, 00:13:29.011 "io_qpairs": 0, 00:13:29.011 "current_admin_qpairs": 0, 00:13:29.011 "current_io_qpairs": 0, 00:13:29.011 "pending_bdev_io": 0, 00:13:29.011 "completed_nvme_io": 0, 00:13:29.011 "transports": [ 00:13:29.011 { 00:13:29.011 "trtype": "TCP" 00:13:29.011 } 00:13:29.011 ] 00:13:29.011 }, 00:13:29.011 { 00:13:29.011 "name": "nvmf_tgt_poll_group_3", 00:13:29.011 "admin_qpairs": 0, 00:13:29.011 "io_qpairs": 0, 00:13:29.011 "current_admin_qpairs": 0, 00:13:29.011 "current_io_qpairs": 0, 00:13:29.011 "pending_bdev_io": 0, 00:13:29.011 "completed_nvme_io": 0, 00:13:29.011 "transports": [ 00:13:29.011 { 00:13:29.011 "trtype": "TCP" 00:13:29.011 } 00:13:29.011 ] 00:13:29.011 } 00:13:29.011 ] 00:13:29.011 }' 00:13:29.011 23:05:32 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:13:29.011 23:05:32 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:13:29.011 23:05:32 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:13:29.011 23:05:32 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:29.011 23:05:32 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:13:29.011 23:05:32 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:13:29.011 23:05:32 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:13:29.011 23:05:32 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:13:29.011 23:05:32 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:29.011 23:05:32 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:13:29.011 23:05:32 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:13:29.011 23:05:32 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:13:29.011 23:05:32 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:13:29.011 23:05:32 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:13:29.011 23:05:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.011 23:05:32 -- common/autotest_common.sh@10 -- # set +x 00:13:29.270 Malloc1 00:13:29.270 23:05:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.270 23:05:32 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:13:29.270 23:05:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.270 23:05:32 -- common/autotest_common.sh@10 -- # set +x 00:13:29.270 23:05:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.270 23:05:32 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:29.270 23:05:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.270 23:05:32 -- common/autotest_common.sh@10 -- # set +x 00:13:29.270 23:05:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.270 23:05:32 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:13:29.270 23:05:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.270 23:05:32 -- common/autotest_common.sh@10 -- # set +x 00:13:29.270 23:05:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.270 23:05:32 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:29.270 23:05:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.270 23:05:32 -- common/autotest_common.sh@10 -- # set +x 00:13:29.270 [2024-11-28 23:05:32.659558] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:29.270 23:05:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.270 23:05:32 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:13:29.270 23:05:32 -- common/autotest_common.sh@650 -- # local es=0 00:13:29.270 23:05:32 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:13:29.270 23:05:32 -- common/autotest_common.sh@638 -- # local arg=nvme 00:13:29.270 23:05:32 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:29.270 23:05:32 -- common/autotest_common.sh@642 -- # type -t nvme 00:13:29.270 23:05:32 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:29.270 23:05:32 -- common/autotest_common.sh@644 -- # type -P nvme 00:13:29.270 23:05:32 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:29.270 23:05:32 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:13:29.270 23:05:32 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:13:29.270 23:05:32 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:13:29.270 [2024-11-28 23:05:32.681930] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:13:29.270 Failed to write to /dev/nvme-fabrics: Input/output error 00:13:29.270 could not add new controller: failed to write to nvme-fabrics device 00:13:29.270 23:05:32 -- common/autotest_common.sh@653 -- # es=1 00:13:29.270 23:05:32 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:13:29.270 23:05:32 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:13:29.270 23:05:32 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:13:29.270 23:05:32 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:29.270 23:05:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.270 23:05:32 -- common/autotest_common.sh@10 -- # set +x 00:13:29.270 23:05:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.270 23:05:32 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:29.837 23:05:33 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:13:29.837 23:05:33 -- common/autotest_common.sh@1187 -- # local i=0 00:13:29.837 23:05:33 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:29.837 23:05:33 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:29.837 23:05:33 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:31.734 23:05:35 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:31.735 23:05:35 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:31.735 23:05:35 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:31.735 23:05:35 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:31.735 23:05:35 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:31.735 23:05:35 -- common/autotest_common.sh@1197 -- # return 0 00:13:31.735 23:05:35 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:31.992 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:31.992 23:05:35 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:31.992 23:05:35 -- common/autotest_common.sh@1208 -- # local i=0 00:13:31.992 23:05:35 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:31.992 23:05:35 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:31.992 23:05:35 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:31.992 23:05:35 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:31.992 23:05:35 -- common/autotest_common.sh@1220 -- # return 0 00:13:31.992 23:05:35 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:31.992 23:05:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.992 23:05:35 -- common/autotest_common.sh@10 -- # set +x 00:13:31.992 23:05:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.992 23:05:35 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:31.992 23:05:35 -- common/autotest_common.sh@650 -- # local es=0 00:13:31.992 23:05:35 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:31.992 23:05:35 -- common/autotest_common.sh@638 -- # local arg=nvme 00:13:31.992 23:05:35 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:31.992 23:05:35 -- common/autotest_common.sh@642 -- # type -t nvme 00:13:31.992 23:05:35 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:31.992 23:05:35 -- common/autotest_common.sh@644 -- # type -P nvme 00:13:31.992 23:05:35 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:31.993 23:05:35 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:13:31.993 23:05:35 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:13:31.993 23:05:35 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:31.993 [2024-11-28 23:05:35.476200] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:13:31.993 Failed to write to /dev/nvme-fabrics: Input/output error 00:13:31.993 could not add new controller: failed to write to nvme-fabrics device 00:13:31.993 23:05:35 -- common/autotest_common.sh@653 -- # es=1 00:13:31.993 23:05:35 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:13:31.993 23:05:35 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:13:31.993 23:05:35 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:13:31.993 23:05:35 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:13:31.993 23:05:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.993 23:05:35 -- common/autotest_common.sh@10 -- # set +x 00:13:31.993 23:05:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.993 23:05:35 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:32.559 23:05:36 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:13:32.559 23:05:36 -- common/autotest_common.sh@1187 -- # local i=0 00:13:32.559 23:05:36 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:32.559 23:05:36 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:32.559 23:05:36 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:35.088 23:05:38 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:35.088 23:05:38 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:35.088 23:05:38 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:35.088 23:05:38 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:35.088 23:05:38 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:35.088 23:05:38 -- common/autotest_common.sh@1197 -- # return 0 00:13:35.088 23:05:38 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:35.088 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:35.088 23:05:38 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:35.088 23:05:38 -- common/autotest_common.sh@1208 -- # local i=0 00:13:35.088 23:05:38 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:35.088 23:05:38 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:35.088 23:05:38 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:35.088 23:05:38 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:35.088 23:05:38 -- common/autotest_common.sh@1220 -- # return 0 00:13:35.088 23:05:38 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:35.088 23:05:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.088 23:05:38 -- common/autotest_common.sh@10 -- # set +x 00:13:35.088 23:05:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.088 23:05:38 -- target/rpc.sh@81 -- # seq 1 5 00:13:35.088 23:05:38 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:35.088 23:05:38 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:35.088 23:05:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.088 23:05:38 -- common/autotest_common.sh@10 -- # set +x 00:13:35.088 23:05:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.088 23:05:38 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:35.088 23:05:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.088 23:05:38 -- common/autotest_common.sh@10 -- # set +x 00:13:35.088 [2024-11-28 23:05:38.285101] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:35.088 23:05:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.088 23:05:38 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:35.088 23:05:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.088 23:05:38 -- common/autotest_common.sh@10 -- # set +x 00:13:35.088 23:05:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.088 23:05:38 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:35.089 23:05:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.089 23:05:38 -- common/autotest_common.sh@10 -- # set +x 00:13:35.089 23:05:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.089 23:05:38 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:35.655 23:05:38 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:35.655 23:05:38 -- common/autotest_common.sh@1187 -- # local i=0 00:13:35.655 23:05:38 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:35.655 23:05:38 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:35.655 23:05:38 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:37.554 23:05:40 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:37.554 23:05:40 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:37.554 23:05:40 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:37.554 23:05:41 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:37.554 23:05:41 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:37.554 23:05:41 -- common/autotest_common.sh@1197 -- # return 0 00:13:37.554 23:05:41 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:37.554 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:37.554 23:05:41 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:37.554 23:05:41 -- common/autotest_common.sh@1208 -- # local i=0 00:13:37.554 23:05:41 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:37.554 23:05:41 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:37.554 23:05:41 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:37.554 23:05:41 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:37.554 23:05:41 -- common/autotest_common.sh@1220 -- # return 0 00:13:37.554 23:05:41 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:37.554 23:05:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.554 23:05:41 -- common/autotest_common.sh@10 -- # set +x 00:13:37.554 23:05:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.554 23:05:41 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:37.554 23:05:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.554 23:05:41 -- common/autotest_common.sh@10 -- # set +x 00:13:37.554 23:05:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.554 23:05:41 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:37.554 23:05:41 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:37.554 23:05:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.554 23:05:41 -- common/autotest_common.sh@10 -- # set +x 00:13:37.554 23:05:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.554 23:05:41 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:37.554 23:05:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.554 23:05:41 -- common/autotest_common.sh@10 -- # set +x 00:13:37.554 [2024-11-28 23:05:41.110479] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:37.554 23:05:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.554 23:05:41 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:37.554 23:05:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.554 23:05:41 -- common/autotest_common.sh@10 -- # set +x 00:13:37.554 23:05:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.554 23:05:41 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:37.554 23:05:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.554 23:05:41 -- common/autotest_common.sh@10 -- # set +x 00:13:37.554 23:05:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.554 23:05:41 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:38.488 23:05:41 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:38.488 23:05:41 -- common/autotest_common.sh@1187 -- # local i=0 00:13:38.488 23:05:41 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:38.488 23:05:41 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:38.488 23:05:41 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:40.385 23:05:43 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:40.385 23:05:43 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:40.385 23:05:43 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:40.386 23:05:43 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:40.386 23:05:43 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:40.386 23:05:43 -- common/autotest_common.sh@1197 -- # return 0 00:13:40.386 23:05:43 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:40.386 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:40.386 23:05:43 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:40.386 23:05:43 -- common/autotest_common.sh@1208 -- # local i=0 00:13:40.386 23:05:43 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:40.386 23:05:43 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:40.386 23:05:43 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:40.386 23:05:43 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:40.386 23:05:43 -- common/autotest_common.sh@1220 -- # return 0 00:13:40.386 23:05:43 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:40.386 23:05:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.386 23:05:43 -- common/autotest_common.sh@10 -- # set +x 00:13:40.386 23:05:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.386 23:05:43 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:40.386 23:05:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.386 23:05:43 -- common/autotest_common.sh@10 -- # set +x 00:13:40.386 23:05:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.386 23:05:43 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:40.386 23:05:43 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:40.386 23:05:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.386 23:05:43 -- common/autotest_common.sh@10 -- # set +x 00:13:40.386 23:05:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.386 23:05:43 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:40.386 23:05:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.386 23:05:43 -- common/autotest_common.sh@10 -- # set +x 00:13:40.386 [2024-11-28 23:05:43.895210] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:40.386 23:05:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.386 23:05:43 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:40.386 23:05:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.386 23:05:43 -- common/autotest_common.sh@10 -- # set +x 00:13:40.386 23:05:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.386 23:05:43 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:40.386 23:05:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.386 23:05:43 -- common/autotest_common.sh@10 -- # set +x 00:13:40.386 23:05:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.386 23:05:43 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:40.951 23:05:44 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:40.951 23:05:44 -- common/autotest_common.sh@1187 -- # local i=0 00:13:40.951 23:05:44 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:40.951 23:05:44 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:40.951 23:05:44 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:43.479 23:05:46 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:43.479 23:05:46 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:43.479 23:05:46 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:43.479 23:05:46 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:43.479 23:05:46 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:43.479 23:05:46 -- common/autotest_common.sh@1197 -- # return 0 00:13:43.479 23:05:46 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:43.479 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:43.479 23:05:46 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:43.479 23:05:46 -- common/autotest_common.sh@1208 -- # local i=0 00:13:43.479 23:05:46 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:43.479 23:05:46 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:43.479 23:05:46 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:43.479 23:05:46 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:43.479 23:05:46 -- common/autotest_common.sh@1220 -- # return 0 00:13:43.479 23:05:46 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:43.479 23:05:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:43.479 23:05:46 -- common/autotest_common.sh@10 -- # set +x 00:13:43.479 23:05:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:43.479 23:05:46 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:43.479 23:05:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:43.479 23:05:46 -- common/autotest_common.sh@10 -- # set +x 00:13:43.479 23:05:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:43.479 23:05:46 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:43.479 23:05:46 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:43.479 23:05:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:43.479 23:05:46 -- common/autotest_common.sh@10 -- # set +x 00:13:43.479 23:05:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:43.479 23:05:46 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:43.479 23:05:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:43.479 23:05:46 -- common/autotest_common.sh@10 -- # set +x 00:13:43.479 [2024-11-28 23:05:46.677056] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:43.479 23:05:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:43.479 23:05:46 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:43.479 23:05:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:43.479 23:05:46 -- common/autotest_common.sh@10 -- # set +x 00:13:43.479 23:05:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:43.479 23:05:46 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:43.479 23:05:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:43.479 23:05:46 -- common/autotest_common.sh@10 -- # set +x 00:13:43.479 23:05:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:43.479 23:05:46 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:44.045 23:05:47 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:44.045 23:05:47 -- common/autotest_common.sh@1187 -- # local i=0 00:13:44.045 23:05:47 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:44.045 23:05:47 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:44.045 23:05:47 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:45.962 23:05:49 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:45.962 23:05:49 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:45.962 23:05:49 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:45.962 23:05:49 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:45.962 23:05:49 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:45.962 23:05:49 -- common/autotest_common.sh@1197 -- # return 0 00:13:45.962 23:05:49 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:45.962 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:45.962 23:05:49 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:45.962 23:05:49 -- common/autotest_common.sh@1208 -- # local i=0 00:13:45.962 23:05:49 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:45.962 23:05:49 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:45.962 23:05:49 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:45.962 23:05:49 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:45.962 23:05:49 -- common/autotest_common.sh@1220 -- # return 0 00:13:45.962 23:05:49 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:45.962 23:05:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:45.962 23:05:49 -- common/autotest_common.sh@10 -- # set +x 00:13:45.962 23:05:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:45.962 23:05:49 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:45.962 23:05:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:45.962 23:05:49 -- common/autotest_common.sh@10 -- # set +x 00:13:45.962 23:05:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:45.962 23:05:49 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:45.962 23:05:49 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:45.962 23:05:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:45.962 23:05:49 -- common/autotest_common.sh@10 -- # set +x 00:13:45.962 23:05:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:45.962 23:05:49 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:45.962 23:05:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:45.962 23:05:49 -- common/autotest_common.sh@10 -- # set +x 00:13:45.962 [2024-11-28 23:05:49.507496] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:45.962 23:05:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:45.962 23:05:49 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:45.962 23:05:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:45.962 23:05:49 -- common/autotest_common.sh@10 -- # set +x 00:13:45.962 23:05:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:45.962 23:05:49 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:45.962 23:05:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:45.962 23:05:49 -- common/autotest_common.sh@10 -- # set +x 00:13:45.962 23:05:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:45.962 23:05:49 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:47.000 23:05:50 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:47.000 23:05:50 -- common/autotest_common.sh@1187 -- # local i=0 00:13:47.000 23:05:50 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:47.000 23:05:50 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:47.000 23:05:50 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:48.897 23:05:52 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:48.897 23:05:52 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:48.897 23:05:52 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:48.897 23:05:52 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:48.897 23:05:52 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:48.897 23:05:52 -- common/autotest_common.sh@1197 -- # return 0 00:13:48.897 23:05:52 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:48.897 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:48.897 23:05:52 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:48.897 23:05:52 -- common/autotest_common.sh@1208 -- # local i=0 00:13:48.897 23:05:52 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:48.897 23:05:52 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:48.897 23:05:52 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:48.897 23:05:52 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:48.897 23:05:52 -- common/autotest_common.sh@1220 -- # return 0 00:13:48.897 23:05:52 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:48.897 23:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.897 23:05:52 -- common/autotest_common.sh@10 -- # set +x 00:13:48.897 23:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.897 23:05:52 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:48.897 23:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.897 23:05:52 -- common/autotest_common.sh@10 -- # set +x 00:13:48.897 23:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.897 23:05:52 -- target/rpc.sh@99 -- # seq 1 5 00:13:48.897 23:05:52 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:48.897 23:05:52 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:48.897 23:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.897 23:05:52 -- common/autotest_common.sh@10 -- # set +x 00:13:48.897 23:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.897 23:05:52 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:48.897 23:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.897 23:05:52 -- common/autotest_common.sh@10 -- # set +x 00:13:48.897 [2024-11-28 23:05:52.327881] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:48.897 23:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.897 23:05:52 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:48.897 23:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.897 23:05:52 -- common/autotest_common.sh@10 -- # set +x 00:13:48.897 23:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.897 23:05:52 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:48.897 23:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.897 23:05:52 -- common/autotest_common.sh@10 -- # set +x 00:13:48.897 23:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.897 23:05:52 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:48.897 23:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.897 23:05:52 -- common/autotest_common.sh@10 -- # set +x 00:13:48.897 23:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.897 23:05:52 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:48.897 23:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.897 23:05:52 -- common/autotest_common.sh@10 -- # set +x 00:13:48.897 23:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.897 23:05:52 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:48.897 23:05:52 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:48.897 23:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.897 23:05:52 -- common/autotest_common.sh@10 -- # set +x 00:13:48.897 23:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.897 23:05:52 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:48.897 23:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.897 23:05:52 -- common/autotest_common.sh@10 -- # set +x 00:13:48.897 [2024-11-28 23:05:52.375940] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:48.897 23:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.897 23:05:52 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:48.898 23:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.898 23:05:52 -- common/autotest_common.sh@10 -- # set +x 00:13:48.898 23:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.898 23:05:52 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:48.898 23:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.898 23:05:52 -- common/autotest_common.sh@10 -- # set +x 00:13:48.898 23:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.898 23:05:52 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:48.898 23:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.898 23:05:52 -- common/autotest_common.sh@10 -- # set +x 00:13:48.898 23:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.898 23:05:52 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:48.898 23:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.898 23:05:52 -- common/autotest_common.sh@10 -- # set +x 00:13:48.898 23:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.898 23:05:52 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:48.898 23:05:52 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:48.898 23:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.898 23:05:52 -- common/autotest_common.sh@10 -- # set +x 00:13:48.898 23:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.898 23:05:52 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:48.898 23:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.898 23:05:52 -- common/autotest_common.sh@10 -- # set +x 00:13:48.898 [2024-11-28 23:05:52.424104] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:48.898 23:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.898 23:05:52 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:48.898 23:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.898 23:05:52 -- common/autotest_common.sh@10 -- # set +x 00:13:48.898 23:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.898 23:05:52 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:48.898 23:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.898 23:05:52 -- common/autotest_common.sh@10 -- # set +x 00:13:48.898 23:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.898 23:05:52 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:48.898 23:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.898 23:05:52 -- common/autotest_common.sh@10 -- # set +x 00:13:48.898 23:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.898 23:05:52 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:48.898 23:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.898 23:05:52 -- common/autotest_common.sh@10 -- # set +x 00:13:48.898 23:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.898 23:05:52 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:48.898 23:05:52 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:48.898 23:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.898 23:05:52 -- common/autotest_common.sh@10 -- # set +x 00:13:48.898 23:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.898 23:05:52 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:48.898 23:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.898 23:05:52 -- common/autotest_common.sh@10 -- # set +x 00:13:48.898 [2024-11-28 23:05:52.472268] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:48.898 23:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.898 23:05:52 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:48.898 23:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.898 23:05:52 -- common/autotest_common.sh@10 -- # set +x 00:13:48.898 23:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.898 23:05:52 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:48.898 23:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.898 23:05:52 -- common/autotest_common.sh@10 -- # set +x 00:13:48.898 23:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.898 23:05:52 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:48.898 23:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.898 23:05:52 -- common/autotest_common.sh@10 -- # set +x 00:13:48.898 23:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.898 23:05:52 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:48.898 23:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.898 23:05:52 -- common/autotest_common.sh@10 -- # set +x 00:13:49.156 23:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:49.156 23:05:52 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:49.156 23:05:52 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:49.157 23:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:49.157 23:05:52 -- common/autotest_common.sh@10 -- # set +x 00:13:49.157 23:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:49.157 23:05:52 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:49.157 23:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:49.157 23:05:52 -- common/autotest_common.sh@10 -- # set +x 00:13:49.157 [2024-11-28 23:05:52.520449] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:49.157 23:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:49.157 23:05:52 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:49.157 23:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:49.157 23:05:52 -- common/autotest_common.sh@10 -- # set +x 00:13:49.157 23:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:49.157 23:05:52 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:49.157 23:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:49.157 23:05:52 -- common/autotest_common.sh@10 -- # set +x 00:13:49.157 23:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:49.157 23:05:52 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:49.157 23:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:49.157 23:05:52 -- common/autotest_common.sh@10 -- # set +x 00:13:49.157 23:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:49.157 23:05:52 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:49.157 23:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:49.157 23:05:52 -- common/autotest_common.sh@10 -- # set +x 00:13:49.157 23:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:49.157 23:05:52 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:13:49.157 23:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:49.157 23:05:52 -- common/autotest_common.sh@10 -- # set +x 00:13:49.157 23:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:49.157 23:05:52 -- target/rpc.sh@110 -- # stats='{ 00:13:49.157 "tick_rate": 2700000000, 00:13:49.157 "poll_groups": [ 00:13:49.157 { 00:13:49.157 "name": "nvmf_tgt_poll_group_0", 00:13:49.157 "admin_qpairs": 2, 00:13:49.157 "io_qpairs": 84, 00:13:49.157 "current_admin_qpairs": 0, 00:13:49.157 "current_io_qpairs": 0, 00:13:49.157 "pending_bdev_io": 0, 00:13:49.157 "completed_nvme_io": 227, 00:13:49.157 "transports": [ 00:13:49.157 { 00:13:49.157 "trtype": "TCP" 00:13:49.157 } 00:13:49.157 ] 00:13:49.157 }, 00:13:49.157 { 00:13:49.157 "name": "nvmf_tgt_poll_group_1", 00:13:49.157 "admin_qpairs": 2, 00:13:49.157 "io_qpairs": 84, 00:13:49.157 "current_admin_qpairs": 0, 00:13:49.157 "current_io_qpairs": 0, 00:13:49.157 "pending_bdev_io": 0, 00:13:49.157 "completed_nvme_io": 140, 00:13:49.157 "transports": [ 00:13:49.157 { 00:13:49.157 "trtype": "TCP" 00:13:49.157 } 00:13:49.157 ] 00:13:49.157 }, 00:13:49.157 { 00:13:49.157 "name": "nvmf_tgt_poll_group_2", 00:13:49.157 "admin_qpairs": 1, 00:13:49.157 "io_qpairs": 84, 00:13:49.157 "current_admin_qpairs": 0, 00:13:49.157 "current_io_qpairs": 0, 00:13:49.157 "pending_bdev_io": 0, 00:13:49.157 "completed_nvme_io": 179, 00:13:49.157 "transports": [ 00:13:49.157 { 00:13:49.157 "trtype": "TCP" 00:13:49.157 } 00:13:49.157 ] 00:13:49.157 }, 00:13:49.157 { 00:13:49.157 "name": "nvmf_tgt_poll_group_3", 00:13:49.157 "admin_qpairs": 2, 00:13:49.157 "io_qpairs": 84, 00:13:49.157 "current_admin_qpairs": 0, 00:13:49.157 "current_io_qpairs": 0, 00:13:49.157 "pending_bdev_io": 0, 00:13:49.157 "completed_nvme_io": 140, 00:13:49.157 "transports": [ 00:13:49.157 { 00:13:49.157 "trtype": "TCP" 00:13:49.157 } 00:13:49.157 ] 00:13:49.157 } 00:13:49.157 ] 00:13:49.157 }' 00:13:49.157 23:05:52 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:13:49.157 23:05:52 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:13:49.157 23:05:52 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:13:49.157 23:05:52 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:49.157 23:05:52 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:13:49.157 23:05:52 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:13:49.157 23:05:52 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:13:49.157 23:05:52 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:13:49.157 23:05:52 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:49.157 23:05:52 -- target/rpc.sh@113 -- # (( 336 > 0 )) 00:13:49.157 23:05:52 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:13:49.157 23:05:52 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:13:49.157 23:05:52 -- target/rpc.sh@123 -- # nvmftestfini 00:13:49.157 23:05:52 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:49.157 23:05:52 -- nvmf/common.sh@116 -- # sync 00:13:49.157 23:05:52 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:49.157 23:05:52 -- nvmf/common.sh@119 -- # set +e 00:13:49.157 23:05:52 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:49.157 23:05:52 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:49.157 rmmod nvme_tcp 00:13:49.157 rmmod nvme_fabrics 00:13:49.157 rmmod nvme_keyring 00:13:49.157 23:05:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:49.157 23:05:52 -- nvmf/common.sh@123 -- # set -e 00:13:49.157 23:05:52 -- nvmf/common.sh@124 -- # return 0 00:13:49.157 23:05:52 -- nvmf/common.sh@477 -- # '[' -n 2394827 ']' 00:13:49.157 23:05:52 -- nvmf/common.sh@478 -- # killprocess 2394827 00:13:49.157 23:05:52 -- common/autotest_common.sh@936 -- # '[' -z 2394827 ']' 00:13:49.157 23:05:52 -- common/autotest_common.sh@940 -- # kill -0 2394827 00:13:49.157 23:05:52 -- common/autotest_common.sh@941 -- # uname 00:13:49.157 23:05:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:49.157 23:05:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2394827 00:13:49.157 23:05:52 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:49.157 23:05:52 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:49.157 23:05:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2394827' 00:13:49.157 killing process with pid 2394827 00:13:49.157 23:05:52 -- common/autotest_common.sh@955 -- # kill 2394827 00:13:49.157 23:05:52 -- common/autotest_common.sh@960 -- # wait 2394827 00:13:49.417 23:05:52 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:49.417 23:05:52 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:49.417 23:05:52 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:49.417 23:05:52 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:49.417 23:05:52 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:49.417 23:05:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:49.417 23:05:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:49.417 23:05:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:51.950 23:05:55 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:51.950 00:13:51.950 real 0m26.115s 00:13:51.950 user 1m25.078s 00:13:51.950 sys 0m4.180s 00:13:51.950 23:05:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:51.950 23:05:55 -- common/autotest_common.sh@10 -- # set +x 00:13:51.950 ************************************ 00:13:51.950 END TEST nvmf_rpc 00:13:51.950 ************************************ 00:13:51.950 23:05:55 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:13:51.950 23:05:55 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:51.950 23:05:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:51.950 23:05:55 -- common/autotest_common.sh@10 -- # set +x 00:13:51.950 ************************************ 00:13:51.950 START TEST nvmf_invalid 00:13:51.950 ************************************ 00:13:51.950 23:05:55 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:13:51.950 * Looking for test storage... 00:13:51.950 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:51.950 23:05:55 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:51.950 23:05:55 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:51.950 23:05:55 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:51.950 23:05:55 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:51.950 23:05:55 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:51.950 23:05:55 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:51.950 23:05:55 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:51.950 23:05:55 -- scripts/common.sh@335 -- # IFS=.-: 00:13:51.950 23:05:55 -- scripts/common.sh@335 -- # read -ra ver1 00:13:51.950 23:05:55 -- scripts/common.sh@336 -- # IFS=.-: 00:13:51.950 23:05:55 -- scripts/common.sh@336 -- # read -ra ver2 00:13:51.950 23:05:55 -- scripts/common.sh@337 -- # local 'op=<' 00:13:51.950 23:05:55 -- scripts/common.sh@339 -- # ver1_l=2 00:13:51.950 23:05:55 -- scripts/common.sh@340 -- # ver2_l=1 00:13:51.950 23:05:55 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:51.950 23:05:55 -- scripts/common.sh@343 -- # case "$op" in 00:13:51.950 23:05:55 -- scripts/common.sh@344 -- # : 1 00:13:51.950 23:05:55 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:51.950 23:05:55 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:51.950 23:05:55 -- scripts/common.sh@364 -- # decimal 1 00:13:51.950 23:05:55 -- scripts/common.sh@352 -- # local d=1 00:13:51.950 23:05:55 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:51.950 23:05:55 -- scripts/common.sh@354 -- # echo 1 00:13:51.950 23:05:55 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:51.950 23:05:55 -- scripts/common.sh@365 -- # decimal 2 00:13:51.950 23:05:55 -- scripts/common.sh@352 -- # local d=2 00:13:51.950 23:05:55 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:51.950 23:05:55 -- scripts/common.sh@354 -- # echo 2 00:13:51.950 23:05:55 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:51.950 23:05:55 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:51.951 23:05:55 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:51.951 23:05:55 -- scripts/common.sh@367 -- # return 0 00:13:51.951 23:05:55 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:51.951 23:05:55 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:51.951 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:51.951 --rc genhtml_branch_coverage=1 00:13:51.951 --rc genhtml_function_coverage=1 00:13:51.951 --rc genhtml_legend=1 00:13:51.951 --rc geninfo_all_blocks=1 00:13:51.951 --rc geninfo_unexecuted_blocks=1 00:13:51.951 00:13:51.951 ' 00:13:51.951 23:05:55 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:51.951 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:51.951 --rc genhtml_branch_coverage=1 00:13:51.951 --rc genhtml_function_coverage=1 00:13:51.951 --rc genhtml_legend=1 00:13:51.951 --rc geninfo_all_blocks=1 00:13:51.951 --rc geninfo_unexecuted_blocks=1 00:13:51.951 00:13:51.951 ' 00:13:51.951 23:05:55 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:51.951 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:51.951 --rc genhtml_branch_coverage=1 00:13:51.951 --rc genhtml_function_coverage=1 00:13:51.951 --rc genhtml_legend=1 00:13:51.951 --rc geninfo_all_blocks=1 00:13:51.951 --rc geninfo_unexecuted_blocks=1 00:13:51.951 00:13:51.951 ' 00:13:51.951 23:05:55 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:51.951 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:51.951 --rc genhtml_branch_coverage=1 00:13:51.951 --rc genhtml_function_coverage=1 00:13:51.951 --rc genhtml_legend=1 00:13:51.951 --rc geninfo_all_blocks=1 00:13:51.951 --rc geninfo_unexecuted_blocks=1 00:13:51.951 00:13:51.951 ' 00:13:51.951 23:05:55 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:51.951 23:05:55 -- nvmf/common.sh@7 -- # uname -s 00:13:51.951 23:05:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:51.951 23:05:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:51.951 23:05:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:51.951 23:05:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:51.951 23:05:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:51.951 23:05:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:51.951 23:05:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:51.951 23:05:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:51.951 23:05:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:51.951 23:05:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:51.951 23:05:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:51.951 23:05:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:51.951 23:05:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:51.951 23:05:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:51.951 23:05:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:51.951 23:05:55 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:51.951 23:05:55 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:51.951 23:05:55 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:51.951 23:05:55 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:51.951 23:05:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:51.951 23:05:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:51.951 23:05:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:51.951 23:05:55 -- paths/export.sh@5 -- # export PATH 00:13:51.951 23:05:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:51.951 23:05:55 -- nvmf/common.sh@46 -- # : 0 00:13:51.951 23:05:55 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:51.951 23:05:55 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:51.951 23:05:55 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:51.951 23:05:55 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:51.951 23:05:55 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:51.951 23:05:55 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:51.951 23:05:55 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:51.951 23:05:55 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:51.951 23:05:55 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:13:51.951 23:05:55 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:51.951 23:05:55 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:13:51.951 23:05:55 -- target/invalid.sh@14 -- # target=foobar 00:13:51.951 23:05:55 -- target/invalid.sh@16 -- # RANDOM=0 00:13:51.951 23:05:55 -- target/invalid.sh@34 -- # nvmftestinit 00:13:51.951 23:05:55 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:51.951 23:05:55 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:51.951 23:05:55 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:51.951 23:05:55 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:51.951 23:05:55 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:51.951 23:05:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:51.951 23:05:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:51.951 23:05:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:51.951 23:05:55 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:51.951 23:05:55 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:51.951 23:05:55 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:51.951 23:05:55 -- common/autotest_common.sh@10 -- # set +x 00:13:53.853 23:05:57 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:53.853 23:05:57 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:53.853 23:05:57 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:53.853 23:05:57 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:53.853 23:05:57 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:53.853 23:05:57 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:53.853 23:05:57 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:53.853 23:05:57 -- nvmf/common.sh@294 -- # net_devs=() 00:13:53.853 23:05:57 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:53.853 23:05:57 -- nvmf/common.sh@295 -- # e810=() 00:13:53.853 23:05:57 -- nvmf/common.sh@295 -- # local -ga e810 00:13:53.853 23:05:57 -- nvmf/common.sh@296 -- # x722=() 00:13:53.853 23:05:57 -- nvmf/common.sh@296 -- # local -ga x722 00:13:53.853 23:05:57 -- nvmf/common.sh@297 -- # mlx=() 00:13:53.853 23:05:57 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:53.853 23:05:57 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:53.853 23:05:57 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:53.853 23:05:57 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:53.853 23:05:57 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:53.853 23:05:57 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:53.853 23:05:57 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:53.853 23:05:57 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:53.853 23:05:57 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:53.853 23:05:57 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:53.853 23:05:57 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:53.853 23:05:57 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:53.853 23:05:57 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:53.853 23:05:57 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:53.853 23:05:57 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:53.853 23:05:57 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:53.853 23:05:57 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:53.853 23:05:57 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:53.853 23:05:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:53.853 23:05:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:53.853 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:53.853 23:05:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:53.853 23:05:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:53.853 23:05:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:53.853 23:05:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:53.853 23:05:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:53.853 23:05:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:53.853 23:05:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:53.853 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:53.853 23:05:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:53.853 23:05:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:53.853 23:05:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:53.853 23:05:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:53.853 23:05:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:53.853 23:05:57 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:53.853 23:05:57 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:53.853 23:05:57 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:53.853 23:05:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:53.853 23:05:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:53.853 23:05:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:53.853 23:05:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:53.853 23:05:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:53.853 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:53.853 23:05:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:53.853 23:05:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:53.853 23:05:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:53.853 23:05:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:53.853 23:05:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:53.853 23:05:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:53.853 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:53.853 23:05:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:53.853 23:05:57 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:53.853 23:05:57 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:53.853 23:05:57 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:53.853 23:05:57 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:53.853 23:05:57 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:53.853 23:05:57 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:53.853 23:05:57 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:53.853 23:05:57 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:53.853 23:05:57 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:53.853 23:05:57 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:53.853 23:05:57 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:53.853 23:05:57 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:53.853 23:05:57 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:53.853 23:05:57 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:53.853 23:05:57 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:53.853 23:05:57 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:53.853 23:05:57 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:53.853 23:05:57 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:53.853 23:05:57 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:53.853 23:05:57 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:53.853 23:05:57 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:53.853 23:05:57 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:53.853 23:05:57 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:53.853 23:05:57 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:53.853 23:05:57 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:53.853 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:53.853 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.217 ms 00:13:53.853 00:13:53.853 --- 10.0.0.2 ping statistics --- 00:13:53.853 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:53.853 rtt min/avg/max/mdev = 0.217/0.217/0.217/0.000 ms 00:13:53.854 23:05:57 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:53.854 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:53.854 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.051 ms 00:13:53.854 00:13:53.854 --- 10.0.0.1 ping statistics --- 00:13:53.854 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:53.854 rtt min/avg/max/mdev = 0.051/0.051/0.051/0.000 ms 00:13:53.854 23:05:57 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:53.854 23:05:57 -- nvmf/common.sh@410 -- # return 0 00:13:53.854 23:05:57 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:53.854 23:05:57 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:53.854 23:05:57 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:53.854 23:05:57 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:53.854 23:05:57 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:53.854 23:05:57 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:53.854 23:05:57 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:53.854 23:05:57 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:13:53.854 23:05:57 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:53.854 23:05:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:53.854 23:05:57 -- common/autotest_common.sh@10 -- # set +x 00:13:53.854 23:05:57 -- nvmf/common.sh@469 -- # nvmfpid=2399523 00:13:53.854 23:05:57 -- nvmf/common.sh@470 -- # waitforlisten 2399523 00:13:53.854 23:05:57 -- common/autotest_common.sh@829 -- # '[' -z 2399523 ']' 00:13:53.854 23:05:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:53.854 23:05:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:53.854 23:05:57 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:53.854 23:05:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:53.854 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:53.854 23:05:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:53.854 23:05:57 -- common/autotest_common.sh@10 -- # set +x 00:13:53.854 [2024-11-28 23:05:57.442853] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:53.854 [2024-11-28 23:05:57.442934] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:54.113 EAL: No free 2048 kB hugepages reported on node 1 00:13:54.113 [2024-11-28 23:05:57.515236] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:54.113 [2024-11-28 23:05:57.607441] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:54.113 [2024-11-28 23:05:57.607606] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:54.113 [2024-11-28 23:05:57.607626] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:54.113 [2024-11-28 23:05:57.607640] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:54.113 [2024-11-28 23:05:57.607746] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:54.113 [2024-11-28 23:05:57.607793] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:54.113 [2024-11-28 23:05:57.607846] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:54.113 [2024-11-28 23:05:57.607849] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:55.046 23:05:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:55.046 23:05:58 -- common/autotest_common.sh@862 -- # return 0 00:13:55.046 23:05:58 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:55.046 23:05:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:55.046 23:05:58 -- common/autotest_common.sh@10 -- # set +x 00:13:55.046 23:05:58 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:55.046 23:05:58 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:13:55.046 23:05:58 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode17540 00:13:55.304 [2024-11-28 23:05:58.658704] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:13:55.304 23:05:58 -- target/invalid.sh@40 -- # out='request: 00:13:55.304 { 00:13:55.304 "nqn": "nqn.2016-06.io.spdk:cnode17540", 00:13:55.304 "tgt_name": "foobar", 00:13:55.304 "method": "nvmf_create_subsystem", 00:13:55.304 "req_id": 1 00:13:55.304 } 00:13:55.304 Got JSON-RPC error response 00:13:55.304 response: 00:13:55.304 { 00:13:55.304 "code": -32603, 00:13:55.304 "message": "Unable to find target foobar" 00:13:55.304 }' 00:13:55.304 23:05:58 -- target/invalid.sh@41 -- # [[ request: 00:13:55.304 { 00:13:55.304 "nqn": "nqn.2016-06.io.spdk:cnode17540", 00:13:55.304 "tgt_name": "foobar", 00:13:55.304 "method": "nvmf_create_subsystem", 00:13:55.304 "req_id": 1 00:13:55.304 } 00:13:55.304 Got JSON-RPC error response 00:13:55.304 response: 00:13:55.304 { 00:13:55.304 "code": -32603, 00:13:55.304 "message": "Unable to find target foobar" 00:13:55.304 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:13:55.304 23:05:58 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:13:55.304 23:05:58 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode31102 00:13:55.561 [2024-11-28 23:05:58.927598] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode31102: invalid serial number 'SPDKISFASTANDAWESOME' 00:13:55.561 23:05:58 -- target/invalid.sh@45 -- # out='request: 00:13:55.561 { 00:13:55.561 "nqn": "nqn.2016-06.io.spdk:cnode31102", 00:13:55.561 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:13:55.561 "method": "nvmf_create_subsystem", 00:13:55.561 "req_id": 1 00:13:55.561 } 00:13:55.561 Got JSON-RPC error response 00:13:55.561 response: 00:13:55.561 { 00:13:55.561 "code": -32602, 00:13:55.561 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:13:55.561 }' 00:13:55.561 23:05:58 -- target/invalid.sh@46 -- # [[ request: 00:13:55.561 { 00:13:55.561 "nqn": "nqn.2016-06.io.spdk:cnode31102", 00:13:55.561 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:13:55.561 "method": "nvmf_create_subsystem", 00:13:55.561 "req_id": 1 00:13:55.561 } 00:13:55.561 Got JSON-RPC error response 00:13:55.561 response: 00:13:55.561 { 00:13:55.561 "code": -32602, 00:13:55.561 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:13:55.561 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:13:55.561 23:05:58 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:13:55.561 23:05:58 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode30734 00:13:55.819 [2024-11-28 23:05:59.184424] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode30734: invalid model number 'SPDK_Controller' 00:13:55.819 23:05:59 -- target/invalid.sh@50 -- # out='request: 00:13:55.819 { 00:13:55.819 "nqn": "nqn.2016-06.io.spdk:cnode30734", 00:13:55.819 "model_number": "SPDK_Controller\u001f", 00:13:55.819 "method": "nvmf_create_subsystem", 00:13:55.819 "req_id": 1 00:13:55.819 } 00:13:55.819 Got JSON-RPC error response 00:13:55.819 response: 00:13:55.819 { 00:13:55.819 "code": -32602, 00:13:55.819 "message": "Invalid MN SPDK_Controller\u001f" 00:13:55.819 }' 00:13:55.819 23:05:59 -- target/invalid.sh@51 -- # [[ request: 00:13:55.819 { 00:13:55.819 "nqn": "nqn.2016-06.io.spdk:cnode30734", 00:13:55.819 "model_number": "SPDK_Controller\u001f", 00:13:55.819 "method": "nvmf_create_subsystem", 00:13:55.819 "req_id": 1 00:13:55.819 } 00:13:55.819 Got JSON-RPC error response 00:13:55.819 response: 00:13:55.819 { 00:13:55.819 "code": -32602, 00:13:55.819 "message": "Invalid MN SPDK_Controller\u001f" 00:13:55.819 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:13:55.819 23:05:59 -- target/invalid.sh@54 -- # gen_random_s 21 00:13:55.819 23:05:59 -- target/invalid.sh@19 -- # local length=21 ll 00:13:55.820 23:05:59 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:13:55.820 23:05:59 -- target/invalid.sh@21 -- # local chars 00:13:55.820 23:05:59 -- target/invalid.sh@22 -- # local string 00:13:55.820 23:05:59 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:13:55.820 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # printf %x 44 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x2c' 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # string+=, 00:13:55.820 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:55.820 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # printf %x 70 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x46' 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # string+=F 00:13:55.820 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:55.820 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # printf %x 122 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x7a' 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # string+=z 00:13:55.820 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:55.820 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # printf %x 43 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x2b' 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # string+=+ 00:13:55.820 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:55.820 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # printf %x 82 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x52' 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # string+=R 00:13:55.820 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:55.820 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # printf %x 115 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x73' 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # string+=s 00:13:55.820 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:55.820 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # printf %x 81 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x51' 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # string+=Q 00:13:55.820 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:55.820 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # printf %x 32 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x20' 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # string+=' ' 00:13:55.820 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:55.820 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # printf %x 95 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x5f' 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # string+=_ 00:13:55.820 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:55.820 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # printf %x 41 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x29' 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # string+=')' 00:13:55.820 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:55.820 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # printf %x 46 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x2e' 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # string+=. 00:13:55.820 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:55.820 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # printf %x 53 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x35' 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # string+=5 00:13:55.820 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:55.820 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # printf %x 59 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x3b' 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # string+=';' 00:13:55.820 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:55.820 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # printf %x 79 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x4f' 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # string+=O 00:13:55.820 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:55.820 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # printf %x 107 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x6b' 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # string+=k 00:13:55.820 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:55.820 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # printf %x 117 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x75' 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # string+=u 00:13:55.820 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:55.820 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # printf %x 56 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x38' 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # string+=8 00:13:55.820 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:55.820 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # printf %x 119 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x77' 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # string+=w 00:13:55.820 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:55.820 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # printf %x 70 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x46' 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # string+=F 00:13:55.820 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:55.820 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # printf %x 84 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x54' 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # string+=T 00:13:55.820 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:55.820 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # printf %x 48 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x30' 00:13:55.820 23:05:59 -- target/invalid.sh@25 -- # string+=0 00:13:55.820 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:55.820 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:55.820 23:05:59 -- target/invalid.sh@28 -- # [[ , == \- ]] 00:13:55.820 23:05:59 -- target/invalid.sh@31 -- # echo ',Fz+RsQ _).5;Oku8wFT0' 00:13:55.820 23:05:59 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s ',Fz+RsQ _).5;Oku8wFT0' nqn.2016-06.io.spdk:cnode26216 00:13:56.079 [2024-11-28 23:05:59.509459] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode26216: invalid serial number ',Fz+RsQ _).5;Oku8wFT0' 00:13:56.079 23:05:59 -- target/invalid.sh@54 -- # out='request: 00:13:56.079 { 00:13:56.079 "nqn": "nqn.2016-06.io.spdk:cnode26216", 00:13:56.079 "serial_number": ",Fz+RsQ _).5;Oku8wFT0", 00:13:56.079 "method": "nvmf_create_subsystem", 00:13:56.079 "req_id": 1 00:13:56.079 } 00:13:56.079 Got JSON-RPC error response 00:13:56.079 response: 00:13:56.079 { 00:13:56.079 "code": -32602, 00:13:56.079 "message": "Invalid SN ,Fz+RsQ _).5;Oku8wFT0" 00:13:56.079 }' 00:13:56.079 23:05:59 -- target/invalid.sh@55 -- # [[ request: 00:13:56.079 { 00:13:56.079 "nqn": "nqn.2016-06.io.spdk:cnode26216", 00:13:56.079 "serial_number": ",Fz+RsQ _).5;Oku8wFT0", 00:13:56.079 "method": "nvmf_create_subsystem", 00:13:56.079 "req_id": 1 00:13:56.079 } 00:13:56.079 Got JSON-RPC error response 00:13:56.079 response: 00:13:56.079 { 00:13:56.079 "code": -32602, 00:13:56.079 "message": "Invalid SN ,Fz+RsQ _).5;Oku8wFT0" 00:13:56.079 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:13:56.079 23:05:59 -- target/invalid.sh@58 -- # gen_random_s 41 00:13:56.079 23:05:59 -- target/invalid.sh@19 -- # local length=41 ll 00:13:56.079 23:05:59 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:13:56.079 23:05:59 -- target/invalid.sh@21 -- # local chars 00:13:56.079 23:05:59 -- target/invalid.sh@22 -- # local string 00:13:56.079 23:05:59 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:13:56.079 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:56.079 23:05:59 -- target/invalid.sh@25 -- # printf %x 88 00:13:56.079 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x58' 00:13:56.079 23:05:59 -- target/invalid.sh@25 -- # string+=X 00:13:56.079 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:56.079 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:56.079 23:05:59 -- target/invalid.sh@25 -- # printf %x 127 00:13:56.079 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x7f' 00:13:56.079 23:05:59 -- target/invalid.sh@25 -- # string+=$'\177' 00:13:56.079 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:56.079 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:56.079 23:05:59 -- target/invalid.sh@25 -- # printf %x 43 00:13:56.079 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x2b' 00:13:56.079 23:05:59 -- target/invalid.sh@25 -- # string+=+ 00:13:56.079 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:56.079 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:56.079 23:05:59 -- target/invalid.sh@25 -- # printf %x 32 00:13:56.079 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x20' 00:13:56.079 23:05:59 -- target/invalid.sh@25 -- # string+=' ' 00:13:56.079 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:56.079 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # printf %x 45 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x2d' 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # string+=- 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # printf %x 105 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x69' 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # string+=i 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # printf %x 119 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x77' 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # string+=w 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # printf %x 112 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x70' 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # string+=p 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # printf %x 80 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x50' 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # string+=P 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # printf %x 37 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x25' 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # string+=% 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # printf %x 48 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x30' 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # string+=0 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # printf %x 65 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x41' 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # string+=A 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # printf %x 124 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x7c' 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # string+='|' 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # printf %x 101 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x65' 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # string+=e 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # printf %x 118 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x76' 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # string+=v 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # printf %x 86 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x56' 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # string+=V 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # printf %x 105 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x69' 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # string+=i 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # printf %x 53 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x35' 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # string+=5 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # printf %x 38 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x26' 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # string+='&' 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # printf %x 58 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x3a' 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # string+=: 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # printf %x 54 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x36' 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # string+=6 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # printf %x 103 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x67' 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # string+=g 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # printf %x 79 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x4f' 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # string+=O 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # printf %x 54 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x36' 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # string+=6 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # printf %x 54 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x36' 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # string+=6 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # printf %x 68 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x44' 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # string+=D 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # printf %x 32 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x20' 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # string+=' ' 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # printf %x 114 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x72' 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # string+=r 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # printf %x 124 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x7c' 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # string+='|' 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # printf %x 99 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x63' 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # string+=c 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # printf %x 102 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x66' 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # string+=f 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # printf %x 37 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x25' 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # string+=% 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # printf %x 62 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x3e' 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # string+='>' 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # printf %x 90 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x5a' 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # string+=Z 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # printf %x 97 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x61' 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # string+=a 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # printf %x 49 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x31' 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # string+=1 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # printf %x 76 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x4c' 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # string+=L 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # printf %x 113 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x71' 00:13:56.080 23:05:59 -- target/invalid.sh@25 -- # string+=q 00:13:56.080 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:56.081 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:56.081 23:05:59 -- target/invalid.sh@25 -- # printf %x 125 00:13:56.081 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x7d' 00:13:56.081 23:05:59 -- target/invalid.sh@25 -- # string+='}' 00:13:56.081 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:56.081 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:56.081 23:05:59 -- target/invalid.sh@25 -- # printf %x 120 00:13:56.081 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x78' 00:13:56.081 23:05:59 -- target/invalid.sh@25 -- # string+=x 00:13:56.081 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:56.081 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:56.081 23:05:59 -- target/invalid.sh@25 -- # printf %x 115 00:13:56.081 23:05:59 -- target/invalid.sh@25 -- # echo -e '\x73' 00:13:56.081 23:05:59 -- target/invalid.sh@25 -- # string+=s 00:13:56.081 23:05:59 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:56.081 23:05:59 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:56.081 23:05:59 -- target/invalid.sh@28 -- # [[ X == \- ]] 00:13:56.081 23:05:59 -- target/invalid.sh@31 -- # echo 'X+ -iwpP%0A|evVi5&:6gO66D r|cf%>Za1Lq}xs' 00:13:56.081 23:05:59 -- target/invalid.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d 'X+ -iwpP%0A|evVi5&:6gO66D r|cf%>Za1Lq}xs' nqn.2016-06.io.spdk:cnode10098 00:13:56.339 [2024-11-28 23:05:59.910841] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode10098: invalid model number 'X+ -iwpP%0A|evVi5&:6gO66D r|cf%>Za1Lq}xs' 00:13:56.339 23:05:59 -- target/invalid.sh@58 -- # out='request: 00:13:56.339 { 00:13:56.339 "nqn": "nqn.2016-06.io.spdk:cnode10098", 00:13:56.339 "model_number": "X\u007f+ -iwpP%0A|evVi5&:6gO66D r|cf%>Za1Lq}xs", 00:13:56.339 "method": "nvmf_create_subsystem", 00:13:56.339 "req_id": 1 00:13:56.339 } 00:13:56.339 Got JSON-RPC error response 00:13:56.339 response: 00:13:56.339 { 00:13:56.339 "code": -32602, 00:13:56.339 "message": "Invalid MN X\u007f+ -iwpP%0A|evVi5&:6gO66D r|cf%>Za1Lq}xs" 00:13:56.339 }' 00:13:56.339 23:05:59 -- target/invalid.sh@59 -- # [[ request: 00:13:56.339 { 00:13:56.339 "nqn": "nqn.2016-06.io.spdk:cnode10098", 00:13:56.339 "model_number": "X\u007f+ -iwpP%0A|evVi5&:6gO66D r|cf%>Za1Lq}xs", 00:13:56.339 "method": "nvmf_create_subsystem", 00:13:56.339 "req_id": 1 00:13:56.339 } 00:13:56.339 Got JSON-RPC error response 00:13:56.339 response: 00:13:56.339 { 00:13:56.339 "code": -32602, 00:13:56.339 "message": "Invalid MN X\u007f+ -iwpP%0A|evVi5&:6gO66D r|cf%>Za1Lq}xs" 00:13:56.339 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:13:56.339 23:05:59 -- target/invalid.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport --trtype tcp 00:13:56.597 [2024-11-28 23:06:00.183885] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:56.854 23:06:00 -- target/invalid.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode -s SPDK001 -a 00:13:57.112 23:06:00 -- target/invalid.sh@64 -- # [[ tcp == \T\C\P ]] 00:13:57.112 23:06:00 -- target/invalid.sh@67 -- # echo '' 00:13:57.112 23:06:00 -- target/invalid.sh@67 -- # head -n 1 00:13:57.112 23:06:00 -- target/invalid.sh@67 -- # IP= 00:13:57.112 23:06:00 -- target/invalid.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode -t tcp -a '' -s 4421 00:13:57.370 [2024-11-28 23:06:00.721649] nvmf_rpc.c: 783:nvmf_rpc_listen_paused: *ERROR*: Unable to remove listener, rc -2 00:13:57.370 23:06:00 -- target/invalid.sh@69 -- # out='request: 00:13:57.370 { 00:13:57.370 "nqn": "nqn.2016-06.io.spdk:cnode", 00:13:57.370 "listen_address": { 00:13:57.370 "trtype": "tcp", 00:13:57.370 "traddr": "", 00:13:57.370 "trsvcid": "4421" 00:13:57.370 }, 00:13:57.370 "method": "nvmf_subsystem_remove_listener", 00:13:57.370 "req_id": 1 00:13:57.370 } 00:13:57.370 Got JSON-RPC error response 00:13:57.370 response: 00:13:57.370 { 00:13:57.370 "code": -32602, 00:13:57.370 "message": "Invalid parameters" 00:13:57.370 }' 00:13:57.370 23:06:00 -- target/invalid.sh@70 -- # [[ request: 00:13:57.370 { 00:13:57.370 "nqn": "nqn.2016-06.io.spdk:cnode", 00:13:57.370 "listen_address": { 00:13:57.370 "trtype": "tcp", 00:13:57.370 "traddr": "", 00:13:57.370 "trsvcid": "4421" 00:13:57.370 }, 00:13:57.370 "method": "nvmf_subsystem_remove_listener", 00:13:57.370 "req_id": 1 00:13:57.370 } 00:13:57.370 Got JSON-RPC error response 00:13:57.370 response: 00:13:57.370 { 00:13:57.370 "code": -32602, 00:13:57.370 "message": "Invalid parameters" 00:13:57.370 } != *\U\n\a\b\l\e\ \t\o\ \s\t\o\p\ \l\i\s\t\e\n\e\r\.* ]] 00:13:57.370 23:06:00 -- target/invalid.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9348 -i 0 00:13:57.628 [2024-11-28 23:06:00.986487] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode9348: invalid cntlid range [0-65519] 00:13:57.628 23:06:01 -- target/invalid.sh@73 -- # out='request: 00:13:57.628 { 00:13:57.628 "nqn": "nqn.2016-06.io.spdk:cnode9348", 00:13:57.628 "min_cntlid": 0, 00:13:57.628 "method": "nvmf_create_subsystem", 00:13:57.628 "req_id": 1 00:13:57.628 } 00:13:57.628 Got JSON-RPC error response 00:13:57.628 response: 00:13:57.628 { 00:13:57.628 "code": -32602, 00:13:57.628 "message": "Invalid cntlid range [0-65519]" 00:13:57.628 }' 00:13:57.628 23:06:01 -- target/invalid.sh@74 -- # [[ request: 00:13:57.628 { 00:13:57.628 "nqn": "nqn.2016-06.io.spdk:cnode9348", 00:13:57.628 "min_cntlid": 0, 00:13:57.628 "method": "nvmf_create_subsystem", 00:13:57.628 "req_id": 1 00:13:57.628 } 00:13:57.628 Got JSON-RPC error response 00:13:57.628 response: 00:13:57.628 { 00:13:57.628 "code": -32602, 00:13:57.628 "message": "Invalid cntlid range [0-65519]" 00:13:57.628 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:57.628 23:06:01 -- target/invalid.sh@75 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode335 -i 65520 00:13:57.885 [2024-11-28 23:06:01.263464] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode335: invalid cntlid range [65520-65519] 00:13:57.885 23:06:01 -- target/invalid.sh@75 -- # out='request: 00:13:57.885 { 00:13:57.885 "nqn": "nqn.2016-06.io.spdk:cnode335", 00:13:57.885 "min_cntlid": 65520, 00:13:57.885 "method": "nvmf_create_subsystem", 00:13:57.885 "req_id": 1 00:13:57.885 } 00:13:57.885 Got JSON-RPC error response 00:13:57.885 response: 00:13:57.885 { 00:13:57.885 "code": -32602, 00:13:57.885 "message": "Invalid cntlid range [65520-65519]" 00:13:57.885 }' 00:13:57.885 23:06:01 -- target/invalid.sh@76 -- # [[ request: 00:13:57.885 { 00:13:57.885 "nqn": "nqn.2016-06.io.spdk:cnode335", 00:13:57.885 "min_cntlid": 65520, 00:13:57.885 "method": "nvmf_create_subsystem", 00:13:57.885 "req_id": 1 00:13:57.885 } 00:13:57.885 Got JSON-RPC error response 00:13:57.885 response: 00:13:57.885 { 00:13:57.885 "code": -32602, 00:13:57.885 "message": "Invalid cntlid range [65520-65519]" 00:13:57.885 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:57.885 23:06:01 -- target/invalid.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode12977 -I 0 00:13:58.142 [2024-11-28 23:06:01.532336] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode12977: invalid cntlid range [1-0] 00:13:58.142 23:06:01 -- target/invalid.sh@77 -- # out='request: 00:13:58.142 { 00:13:58.142 "nqn": "nqn.2016-06.io.spdk:cnode12977", 00:13:58.142 "max_cntlid": 0, 00:13:58.142 "method": "nvmf_create_subsystem", 00:13:58.142 "req_id": 1 00:13:58.142 } 00:13:58.142 Got JSON-RPC error response 00:13:58.142 response: 00:13:58.142 { 00:13:58.142 "code": -32602, 00:13:58.142 "message": "Invalid cntlid range [1-0]" 00:13:58.142 }' 00:13:58.142 23:06:01 -- target/invalid.sh@78 -- # [[ request: 00:13:58.142 { 00:13:58.142 "nqn": "nqn.2016-06.io.spdk:cnode12977", 00:13:58.142 "max_cntlid": 0, 00:13:58.142 "method": "nvmf_create_subsystem", 00:13:58.142 "req_id": 1 00:13:58.142 } 00:13:58.142 Got JSON-RPC error response 00:13:58.142 response: 00:13:58.142 { 00:13:58.142 "code": -32602, 00:13:58.142 "message": "Invalid cntlid range [1-0]" 00:13:58.142 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:58.142 23:06:01 -- target/invalid.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode24716 -I 65520 00:13:58.400 [2024-11-28 23:06:01.797249] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode24716: invalid cntlid range [1-65520] 00:13:58.400 23:06:01 -- target/invalid.sh@79 -- # out='request: 00:13:58.400 { 00:13:58.400 "nqn": "nqn.2016-06.io.spdk:cnode24716", 00:13:58.400 "max_cntlid": 65520, 00:13:58.400 "method": "nvmf_create_subsystem", 00:13:58.400 "req_id": 1 00:13:58.400 } 00:13:58.400 Got JSON-RPC error response 00:13:58.400 response: 00:13:58.400 { 00:13:58.400 "code": -32602, 00:13:58.400 "message": "Invalid cntlid range [1-65520]" 00:13:58.400 }' 00:13:58.400 23:06:01 -- target/invalid.sh@80 -- # [[ request: 00:13:58.400 { 00:13:58.400 "nqn": "nqn.2016-06.io.spdk:cnode24716", 00:13:58.400 "max_cntlid": 65520, 00:13:58.400 "method": "nvmf_create_subsystem", 00:13:58.400 "req_id": 1 00:13:58.400 } 00:13:58.400 Got JSON-RPC error response 00:13:58.400 response: 00:13:58.400 { 00:13:58.400 "code": -32602, 00:13:58.400 "message": "Invalid cntlid range [1-65520]" 00:13:58.400 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:58.400 23:06:01 -- target/invalid.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4993 -i 6 -I 5 00:13:58.658 [2024-11-28 23:06:02.050109] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode4993: invalid cntlid range [6-5] 00:13:58.658 23:06:02 -- target/invalid.sh@83 -- # out='request: 00:13:58.658 { 00:13:58.658 "nqn": "nqn.2016-06.io.spdk:cnode4993", 00:13:58.658 "min_cntlid": 6, 00:13:58.658 "max_cntlid": 5, 00:13:58.658 "method": "nvmf_create_subsystem", 00:13:58.658 "req_id": 1 00:13:58.658 } 00:13:58.658 Got JSON-RPC error response 00:13:58.658 response: 00:13:58.658 { 00:13:58.658 "code": -32602, 00:13:58.658 "message": "Invalid cntlid range [6-5]" 00:13:58.658 }' 00:13:58.658 23:06:02 -- target/invalid.sh@84 -- # [[ request: 00:13:58.658 { 00:13:58.658 "nqn": "nqn.2016-06.io.spdk:cnode4993", 00:13:58.658 "min_cntlid": 6, 00:13:58.658 "max_cntlid": 5, 00:13:58.658 "method": "nvmf_create_subsystem", 00:13:58.658 "req_id": 1 00:13:58.658 } 00:13:58.658 Got JSON-RPC error response 00:13:58.658 response: 00:13:58.658 { 00:13:58.658 "code": -32602, 00:13:58.658 "message": "Invalid cntlid range [6-5]" 00:13:58.658 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:58.658 23:06:02 -- target/invalid.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target --name foobar 00:13:58.658 23:06:02 -- target/invalid.sh@87 -- # out='request: 00:13:58.658 { 00:13:58.658 "name": "foobar", 00:13:58.658 "method": "nvmf_delete_target", 00:13:58.658 "req_id": 1 00:13:58.658 } 00:13:58.658 Got JSON-RPC error response 00:13:58.658 response: 00:13:58.658 { 00:13:58.658 "code": -32602, 00:13:58.658 "message": "The specified target doesn'\''t exist, cannot delete it." 00:13:58.658 }' 00:13:58.658 23:06:02 -- target/invalid.sh@88 -- # [[ request: 00:13:58.658 { 00:13:58.658 "name": "foobar", 00:13:58.658 "method": "nvmf_delete_target", 00:13:58.658 "req_id": 1 00:13:58.658 } 00:13:58.658 Got JSON-RPC error response 00:13:58.658 response: 00:13:58.658 { 00:13:58.658 "code": -32602, 00:13:58.658 "message": "The specified target doesn't exist, cannot delete it." 00:13:58.658 } == *\T\h\e\ \s\p\e\c\i\f\i\e\d\ \t\a\r\g\e\t\ \d\o\e\s\n\'\t\ \e\x\i\s\t\,\ \c\a\n\n\o\t\ \d\e\l\e\t\e\ \i\t\.* ]] 00:13:58.658 23:06:02 -- target/invalid.sh@90 -- # trap - SIGINT SIGTERM EXIT 00:13:58.658 23:06:02 -- target/invalid.sh@91 -- # nvmftestfini 00:13:58.658 23:06:02 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:58.658 23:06:02 -- nvmf/common.sh@116 -- # sync 00:13:58.658 23:06:02 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:58.658 23:06:02 -- nvmf/common.sh@119 -- # set +e 00:13:58.658 23:06:02 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:58.658 23:06:02 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:58.658 rmmod nvme_tcp 00:13:58.658 rmmod nvme_fabrics 00:13:58.658 rmmod nvme_keyring 00:13:58.658 23:06:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:58.658 23:06:02 -- nvmf/common.sh@123 -- # set -e 00:13:58.658 23:06:02 -- nvmf/common.sh@124 -- # return 0 00:13:58.658 23:06:02 -- nvmf/common.sh@477 -- # '[' -n 2399523 ']' 00:13:58.659 23:06:02 -- nvmf/common.sh@478 -- # killprocess 2399523 00:13:58.659 23:06:02 -- common/autotest_common.sh@936 -- # '[' -z 2399523 ']' 00:13:58.659 23:06:02 -- common/autotest_common.sh@940 -- # kill -0 2399523 00:13:58.659 23:06:02 -- common/autotest_common.sh@941 -- # uname 00:13:58.659 23:06:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:58.659 23:06:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2399523 00:13:58.917 23:06:02 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:58.917 23:06:02 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:58.917 23:06:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2399523' 00:13:58.917 killing process with pid 2399523 00:13:58.917 23:06:02 -- common/autotest_common.sh@955 -- # kill 2399523 00:13:58.917 23:06:02 -- common/autotest_common.sh@960 -- # wait 2399523 00:13:58.917 23:06:02 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:58.917 23:06:02 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:58.917 23:06:02 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:58.917 23:06:02 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:58.917 23:06:02 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:58.917 23:06:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:58.917 23:06:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:58.917 23:06:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:01.453 23:06:04 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:01.453 00:14:01.453 real 0m9.473s 00:14:01.453 user 0m23.574s 00:14:01.453 sys 0m2.484s 00:14:01.453 23:06:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:01.454 23:06:04 -- common/autotest_common.sh@10 -- # set +x 00:14:01.454 ************************************ 00:14:01.454 END TEST nvmf_invalid 00:14:01.454 ************************************ 00:14:01.454 23:06:04 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:14:01.454 23:06:04 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:01.454 23:06:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:01.454 23:06:04 -- common/autotest_common.sh@10 -- # set +x 00:14:01.454 ************************************ 00:14:01.454 START TEST nvmf_abort 00:14:01.454 ************************************ 00:14:01.454 23:06:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:14:01.454 * Looking for test storage... 00:14:01.454 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:01.454 23:06:04 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:01.454 23:06:04 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:01.454 23:06:04 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:01.454 23:06:04 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:01.454 23:06:04 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:01.454 23:06:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:01.454 23:06:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:01.454 23:06:04 -- scripts/common.sh@335 -- # IFS=.-: 00:14:01.454 23:06:04 -- scripts/common.sh@335 -- # read -ra ver1 00:14:01.454 23:06:04 -- scripts/common.sh@336 -- # IFS=.-: 00:14:01.454 23:06:04 -- scripts/common.sh@336 -- # read -ra ver2 00:14:01.454 23:06:04 -- scripts/common.sh@337 -- # local 'op=<' 00:14:01.454 23:06:04 -- scripts/common.sh@339 -- # ver1_l=2 00:14:01.454 23:06:04 -- scripts/common.sh@340 -- # ver2_l=1 00:14:01.454 23:06:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:01.454 23:06:04 -- scripts/common.sh@343 -- # case "$op" in 00:14:01.454 23:06:04 -- scripts/common.sh@344 -- # : 1 00:14:01.454 23:06:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:01.454 23:06:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:01.454 23:06:04 -- scripts/common.sh@364 -- # decimal 1 00:14:01.454 23:06:04 -- scripts/common.sh@352 -- # local d=1 00:14:01.454 23:06:04 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:01.454 23:06:04 -- scripts/common.sh@354 -- # echo 1 00:14:01.454 23:06:04 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:01.454 23:06:04 -- scripts/common.sh@365 -- # decimal 2 00:14:01.454 23:06:04 -- scripts/common.sh@352 -- # local d=2 00:14:01.454 23:06:04 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:01.454 23:06:04 -- scripts/common.sh@354 -- # echo 2 00:14:01.454 23:06:04 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:01.454 23:06:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:01.454 23:06:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:01.454 23:06:04 -- scripts/common.sh@367 -- # return 0 00:14:01.454 23:06:04 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:01.454 23:06:04 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:01.454 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:01.454 --rc genhtml_branch_coverage=1 00:14:01.454 --rc genhtml_function_coverage=1 00:14:01.454 --rc genhtml_legend=1 00:14:01.454 --rc geninfo_all_blocks=1 00:14:01.454 --rc geninfo_unexecuted_blocks=1 00:14:01.454 00:14:01.454 ' 00:14:01.454 23:06:04 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:01.454 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:01.454 --rc genhtml_branch_coverage=1 00:14:01.454 --rc genhtml_function_coverage=1 00:14:01.454 --rc genhtml_legend=1 00:14:01.454 --rc geninfo_all_blocks=1 00:14:01.454 --rc geninfo_unexecuted_blocks=1 00:14:01.454 00:14:01.454 ' 00:14:01.454 23:06:04 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:01.454 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:01.454 --rc genhtml_branch_coverage=1 00:14:01.454 --rc genhtml_function_coverage=1 00:14:01.454 --rc genhtml_legend=1 00:14:01.454 --rc geninfo_all_blocks=1 00:14:01.454 --rc geninfo_unexecuted_blocks=1 00:14:01.454 00:14:01.454 ' 00:14:01.454 23:06:04 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:01.454 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:01.454 --rc genhtml_branch_coverage=1 00:14:01.454 --rc genhtml_function_coverage=1 00:14:01.454 --rc genhtml_legend=1 00:14:01.454 --rc geninfo_all_blocks=1 00:14:01.454 --rc geninfo_unexecuted_blocks=1 00:14:01.454 00:14:01.454 ' 00:14:01.454 23:06:04 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:01.454 23:06:04 -- nvmf/common.sh@7 -- # uname -s 00:14:01.454 23:06:04 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:01.454 23:06:04 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:01.454 23:06:04 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:01.454 23:06:04 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:01.454 23:06:04 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:01.454 23:06:04 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:01.454 23:06:04 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:01.454 23:06:04 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:01.454 23:06:04 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:01.454 23:06:04 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:01.454 23:06:04 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:01.454 23:06:04 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:01.454 23:06:04 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:01.454 23:06:04 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:01.454 23:06:04 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:01.454 23:06:04 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:01.454 23:06:04 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:01.454 23:06:04 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:01.454 23:06:04 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:01.454 23:06:04 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:01.454 23:06:04 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:01.455 23:06:04 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:01.455 23:06:04 -- paths/export.sh@5 -- # export PATH 00:14:01.455 23:06:04 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:01.455 23:06:04 -- nvmf/common.sh@46 -- # : 0 00:14:01.455 23:06:04 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:01.455 23:06:04 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:01.455 23:06:04 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:01.455 23:06:04 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:01.455 23:06:04 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:01.455 23:06:04 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:01.455 23:06:04 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:01.455 23:06:04 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:01.455 23:06:04 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:01.455 23:06:04 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:14:01.455 23:06:04 -- target/abort.sh@14 -- # nvmftestinit 00:14:01.455 23:06:04 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:01.455 23:06:04 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:01.455 23:06:04 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:01.455 23:06:04 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:01.455 23:06:04 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:01.455 23:06:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:01.455 23:06:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:01.455 23:06:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:01.455 23:06:04 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:01.455 23:06:04 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:01.455 23:06:04 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:01.455 23:06:04 -- common/autotest_common.sh@10 -- # set +x 00:14:03.356 23:06:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:03.356 23:06:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:03.356 23:06:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:03.356 23:06:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:03.356 23:06:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:03.356 23:06:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:03.356 23:06:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:03.356 23:06:06 -- nvmf/common.sh@294 -- # net_devs=() 00:14:03.356 23:06:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:03.356 23:06:06 -- nvmf/common.sh@295 -- # e810=() 00:14:03.356 23:06:06 -- nvmf/common.sh@295 -- # local -ga e810 00:14:03.356 23:06:06 -- nvmf/common.sh@296 -- # x722=() 00:14:03.356 23:06:06 -- nvmf/common.sh@296 -- # local -ga x722 00:14:03.356 23:06:06 -- nvmf/common.sh@297 -- # mlx=() 00:14:03.356 23:06:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:03.356 23:06:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:03.356 23:06:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:03.356 23:06:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:03.356 23:06:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:03.356 23:06:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:03.356 23:06:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:03.356 23:06:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:03.356 23:06:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:03.356 23:06:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:03.356 23:06:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:03.356 23:06:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:03.356 23:06:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:03.356 23:06:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:03.356 23:06:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:03.356 23:06:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:03.356 23:06:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:03.356 23:06:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:03.356 23:06:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:03.356 23:06:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:03.356 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:03.356 23:06:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:03.356 23:06:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:03.356 23:06:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:03.356 23:06:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:03.356 23:06:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:03.356 23:06:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:03.356 23:06:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:03.356 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:03.356 23:06:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:03.356 23:06:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:03.356 23:06:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:03.356 23:06:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:03.356 23:06:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:03.356 23:06:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:03.356 23:06:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:03.356 23:06:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:03.356 23:06:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:03.356 23:06:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:03.357 23:06:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:03.357 23:06:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:03.357 23:06:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:03.357 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:03.357 23:06:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:03.357 23:06:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:03.357 23:06:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:03.357 23:06:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:03.357 23:06:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:03.357 23:06:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:03.357 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:03.357 23:06:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:03.357 23:06:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:03.357 23:06:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:03.357 23:06:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:03.357 23:06:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:03.357 23:06:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:03.357 23:06:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:03.357 23:06:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:03.357 23:06:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:03.357 23:06:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:03.357 23:06:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:03.357 23:06:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:03.357 23:06:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:03.357 23:06:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:03.357 23:06:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:03.357 23:06:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:03.357 23:06:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:03.357 23:06:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:03.357 23:06:06 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:03.357 23:06:06 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:03.357 23:06:06 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:03.357 23:06:06 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:03.357 23:06:06 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:03.357 23:06:06 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:03.357 23:06:06 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:03.357 23:06:06 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:03.357 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:03.357 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.294 ms 00:14:03.357 00:14:03.357 --- 10.0.0.2 ping statistics --- 00:14:03.357 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:03.357 rtt min/avg/max/mdev = 0.294/0.294/0.294/0.000 ms 00:14:03.357 23:06:06 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:03.357 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:03.357 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.083 ms 00:14:03.357 00:14:03.357 --- 10.0.0.1 ping statistics --- 00:14:03.357 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:03.357 rtt min/avg/max/mdev = 0.083/0.083/0.083/0.000 ms 00:14:03.357 23:06:06 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:03.357 23:06:06 -- nvmf/common.sh@410 -- # return 0 00:14:03.357 23:06:06 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:03.357 23:06:06 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:03.357 23:06:06 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:03.357 23:06:06 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:03.357 23:06:06 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:03.357 23:06:06 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:03.357 23:06:06 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:03.615 23:06:06 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:14:03.615 23:06:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:03.615 23:06:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:03.615 23:06:06 -- common/autotest_common.sh@10 -- # set +x 00:14:03.615 23:06:06 -- nvmf/common.sh@469 -- # nvmfpid=2402434 00:14:03.615 23:06:06 -- nvmf/common.sh@470 -- # waitforlisten 2402434 00:14:03.615 23:06:06 -- common/autotest_common.sh@829 -- # '[' -z 2402434 ']' 00:14:03.615 23:06:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:14:03.615 23:06:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:03.615 23:06:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:03.615 23:06:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:03.615 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:03.615 23:06:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:03.615 23:06:06 -- common/autotest_common.sh@10 -- # set +x 00:14:03.615 [2024-11-28 23:06:07.030849] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:03.615 [2024-11-28 23:06:07.030929] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:03.615 EAL: No free 2048 kB hugepages reported on node 1 00:14:03.615 [2024-11-28 23:06:07.112633] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:03.615 [2024-11-28 23:06:07.208230] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:03.615 [2024-11-28 23:06:07.208410] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:03.615 [2024-11-28 23:06:07.208432] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:03.615 [2024-11-28 23:06:07.208446] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:03.615 [2024-11-28 23:06:07.208508] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:03.615 [2024-11-28 23:06:07.208563] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:03.615 [2024-11-28 23:06:07.208567] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:04.548 23:06:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:04.548 23:06:08 -- common/autotest_common.sh@862 -- # return 0 00:14:04.548 23:06:08 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:04.548 23:06:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:04.548 23:06:08 -- common/autotest_common.sh@10 -- # set +x 00:14:04.548 23:06:08 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:04.548 23:06:08 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:14:04.548 23:06:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:04.548 23:06:08 -- common/autotest_common.sh@10 -- # set +x 00:14:04.548 [2024-11-28 23:06:08.083880] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:04.548 23:06:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:04.548 23:06:08 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:14:04.548 23:06:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:04.548 23:06:08 -- common/autotest_common.sh@10 -- # set +x 00:14:04.548 Malloc0 00:14:04.548 23:06:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:04.548 23:06:08 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:14:04.548 23:06:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:04.548 23:06:08 -- common/autotest_common.sh@10 -- # set +x 00:14:04.548 Delay0 00:14:04.548 23:06:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:04.548 23:06:08 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:04.548 23:06:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:04.548 23:06:08 -- common/autotest_common.sh@10 -- # set +x 00:14:04.548 23:06:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:04.548 23:06:08 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:14:04.548 23:06:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:04.548 23:06:08 -- common/autotest_common.sh@10 -- # set +x 00:14:04.806 23:06:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:04.806 23:06:08 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:04.806 23:06:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:04.806 23:06:08 -- common/autotest_common.sh@10 -- # set +x 00:14:04.806 [2024-11-28 23:06:08.160966] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:04.806 23:06:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:04.806 23:06:08 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:04.806 23:06:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:04.806 23:06:08 -- common/autotest_common.sh@10 -- # set +x 00:14:04.806 23:06:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:04.806 23:06:08 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:14:04.806 EAL: No free 2048 kB hugepages reported on node 1 00:14:04.806 [2024-11-28 23:06:08.265714] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:14:06.704 Initializing NVMe Controllers 00:14:06.704 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:14:06.704 controller IO queue size 128 less than required 00:14:06.704 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:14:06.704 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:14:06.704 Initialization complete. Launching workers. 00:14:06.704 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 123, failed: 33276 00:14:06.704 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 33337, failed to submit 62 00:14:06.704 success 33276, unsuccess 61, failed 0 00:14:06.704 23:06:10 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:06.704 23:06:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:06.704 23:06:10 -- common/autotest_common.sh@10 -- # set +x 00:14:06.704 23:06:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:06.704 23:06:10 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:14:06.962 23:06:10 -- target/abort.sh@38 -- # nvmftestfini 00:14:06.962 23:06:10 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:06.962 23:06:10 -- nvmf/common.sh@116 -- # sync 00:14:06.962 23:06:10 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:06.962 23:06:10 -- nvmf/common.sh@119 -- # set +e 00:14:06.962 23:06:10 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:06.962 23:06:10 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:06.962 rmmod nvme_tcp 00:14:06.962 rmmod nvme_fabrics 00:14:06.962 rmmod nvme_keyring 00:14:06.962 23:06:10 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:06.962 23:06:10 -- nvmf/common.sh@123 -- # set -e 00:14:06.962 23:06:10 -- nvmf/common.sh@124 -- # return 0 00:14:06.962 23:06:10 -- nvmf/common.sh@477 -- # '[' -n 2402434 ']' 00:14:06.962 23:06:10 -- nvmf/common.sh@478 -- # killprocess 2402434 00:14:06.962 23:06:10 -- common/autotest_common.sh@936 -- # '[' -z 2402434 ']' 00:14:06.962 23:06:10 -- common/autotest_common.sh@940 -- # kill -0 2402434 00:14:06.962 23:06:10 -- common/autotest_common.sh@941 -- # uname 00:14:06.962 23:06:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:06.962 23:06:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2402434 00:14:06.962 23:06:10 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:06.962 23:06:10 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:06.962 23:06:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2402434' 00:14:06.962 killing process with pid 2402434 00:14:06.962 23:06:10 -- common/autotest_common.sh@955 -- # kill 2402434 00:14:06.962 23:06:10 -- common/autotest_common.sh@960 -- # wait 2402434 00:14:07.221 23:06:10 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:07.221 23:06:10 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:07.221 23:06:10 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:07.221 23:06:10 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:07.221 23:06:10 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:07.221 23:06:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:07.221 23:06:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:07.221 23:06:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:09.128 23:06:12 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:09.128 00:14:09.128 real 0m8.143s 00:14:09.128 user 0m12.968s 00:14:09.128 sys 0m2.601s 00:14:09.128 23:06:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:09.128 23:06:12 -- common/autotest_common.sh@10 -- # set +x 00:14:09.128 ************************************ 00:14:09.128 END TEST nvmf_abort 00:14:09.128 ************************************ 00:14:09.387 23:06:12 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:14:09.387 23:06:12 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:09.387 23:06:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:09.387 23:06:12 -- common/autotest_common.sh@10 -- # set +x 00:14:09.387 ************************************ 00:14:09.387 START TEST nvmf_ns_hotplug_stress 00:14:09.387 ************************************ 00:14:09.387 23:06:12 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:14:09.387 * Looking for test storage... 00:14:09.387 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:09.387 23:06:12 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:09.387 23:06:12 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:09.387 23:06:12 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:09.387 23:06:12 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:09.387 23:06:12 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:09.387 23:06:12 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:09.387 23:06:12 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:09.387 23:06:12 -- scripts/common.sh@335 -- # IFS=.-: 00:14:09.387 23:06:12 -- scripts/common.sh@335 -- # read -ra ver1 00:14:09.387 23:06:12 -- scripts/common.sh@336 -- # IFS=.-: 00:14:09.387 23:06:12 -- scripts/common.sh@336 -- # read -ra ver2 00:14:09.387 23:06:12 -- scripts/common.sh@337 -- # local 'op=<' 00:14:09.387 23:06:12 -- scripts/common.sh@339 -- # ver1_l=2 00:14:09.387 23:06:12 -- scripts/common.sh@340 -- # ver2_l=1 00:14:09.387 23:06:12 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:09.387 23:06:12 -- scripts/common.sh@343 -- # case "$op" in 00:14:09.387 23:06:12 -- scripts/common.sh@344 -- # : 1 00:14:09.387 23:06:12 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:09.387 23:06:12 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:09.387 23:06:12 -- scripts/common.sh@364 -- # decimal 1 00:14:09.387 23:06:12 -- scripts/common.sh@352 -- # local d=1 00:14:09.387 23:06:12 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:09.387 23:06:12 -- scripts/common.sh@354 -- # echo 1 00:14:09.387 23:06:12 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:09.387 23:06:12 -- scripts/common.sh@365 -- # decimal 2 00:14:09.387 23:06:12 -- scripts/common.sh@352 -- # local d=2 00:14:09.387 23:06:12 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:09.387 23:06:12 -- scripts/common.sh@354 -- # echo 2 00:14:09.387 23:06:12 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:09.387 23:06:12 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:09.387 23:06:12 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:09.387 23:06:12 -- scripts/common.sh@367 -- # return 0 00:14:09.387 23:06:12 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:09.387 23:06:12 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:09.387 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:09.387 --rc genhtml_branch_coverage=1 00:14:09.387 --rc genhtml_function_coverage=1 00:14:09.387 --rc genhtml_legend=1 00:14:09.387 --rc geninfo_all_blocks=1 00:14:09.387 --rc geninfo_unexecuted_blocks=1 00:14:09.387 00:14:09.387 ' 00:14:09.387 23:06:12 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:09.387 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:09.387 --rc genhtml_branch_coverage=1 00:14:09.387 --rc genhtml_function_coverage=1 00:14:09.387 --rc genhtml_legend=1 00:14:09.387 --rc geninfo_all_blocks=1 00:14:09.387 --rc geninfo_unexecuted_blocks=1 00:14:09.387 00:14:09.387 ' 00:14:09.387 23:06:12 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:09.387 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:09.387 --rc genhtml_branch_coverage=1 00:14:09.387 --rc genhtml_function_coverage=1 00:14:09.387 --rc genhtml_legend=1 00:14:09.387 --rc geninfo_all_blocks=1 00:14:09.387 --rc geninfo_unexecuted_blocks=1 00:14:09.387 00:14:09.387 ' 00:14:09.387 23:06:12 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:09.387 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:09.387 --rc genhtml_branch_coverage=1 00:14:09.387 --rc genhtml_function_coverage=1 00:14:09.387 --rc genhtml_legend=1 00:14:09.387 --rc geninfo_all_blocks=1 00:14:09.387 --rc geninfo_unexecuted_blocks=1 00:14:09.387 00:14:09.387 ' 00:14:09.387 23:06:12 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:09.387 23:06:12 -- nvmf/common.sh@7 -- # uname -s 00:14:09.387 23:06:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:09.387 23:06:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:09.387 23:06:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:09.387 23:06:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:09.387 23:06:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:09.387 23:06:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:09.387 23:06:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:09.387 23:06:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:09.387 23:06:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:09.387 23:06:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:09.387 23:06:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:09.387 23:06:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:09.387 23:06:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:09.387 23:06:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:09.388 23:06:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:09.388 23:06:12 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:09.388 23:06:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:09.388 23:06:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:09.388 23:06:12 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:09.388 23:06:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:09.388 23:06:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:09.388 23:06:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:09.388 23:06:12 -- paths/export.sh@5 -- # export PATH 00:14:09.388 23:06:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:09.388 23:06:12 -- nvmf/common.sh@46 -- # : 0 00:14:09.388 23:06:12 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:09.388 23:06:12 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:09.388 23:06:12 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:09.388 23:06:12 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:09.388 23:06:12 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:09.388 23:06:12 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:09.388 23:06:12 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:09.388 23:06:12 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:09.388 23:06:12 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:09.388 23:06:12 -- target/ns_hotplug_stress.sh@22 -- # nvmftestinit 00:14:09.388 23:06:12 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:09.388 23:06:12 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:09.388 23:06:12 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:09.388 23:06:12 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:09.388 23:06:12 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:09.388 23:06:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:09.388 23:06:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:09.388 23:06:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:09.388 23:06:12 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:09.388 23:06:12 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:09.388 23:06:12 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:09.388 23:06:12 -- common/autotest_common.sh@10 -- # set +x 00:14:11.291 23:06:14 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:11.291 23:06:14 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:11.291 23:06:14 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:11.291 23:06:14 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:11.291 23:06:14 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:11.291 23:06:14 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:11.291 23:06:14 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:11.291 23:06:14 -- nvmf/common.sh@294 -- # net_devs=() 00:14:11.291 23:06:14 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:11.291 23:06:14 -- nvmf/common.sh@295 -- # e810=() 00:14:11.291 23:06:14 -- nvmf/common.sh@295 -- # local -ga e810 00:14:11.291 23:06:14 -- nvmf/common.sh@296 -- # x722=() 00:14:11.291 23:06:14 -- nvmf/common.sh@296 -- # local -ga x722 00:14:11.291 23:06:14 -- nvmf/common.sh@297 -- # mlx=() 00:14:11.291 23:06:14 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:11.291 23:06:14 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:11.291 23:06:14 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:11.291 23:06:14 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:11.291 23:06:14 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:11.291 23:06:14 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:11.291 23:06:14 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:11.291 23:06:14 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:11.291 23:06:14 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:11.291 23:06:14 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:11.291 23:06:14 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:11.291 23:06:14 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:11.291 23:06:14 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:11.291 23:06:14 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:11.291 23:06:14 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:11.291 23:06:14 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:11.291 23:06:14 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:11.291 23:06:14 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:11.291 23:06:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:11.291 23:06:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:11.291 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:11.291 23:06:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:11.291 23:06:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:11.291 23:06:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:11.291 23:06:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:11.291 23:06:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:11.291 23:06:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:11.291 23:06:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:11.291 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:11.291 23:06:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:11.291 23:06:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:11.291 23:06:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:11.291 23:06:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:11.291 23:06:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:11.291 23:06:14 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:11.291 23:06:14 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:11.291 23:06:14 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:11.291 23:06:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:11.291 23:06:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:11.291 23:06:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:11.291 23:06:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:11.291 23:06:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:11.291 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:11.291 23:06:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:11.291 23:06:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:11.291 23:06:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:11.291 23:06:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:11.291 23:06:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:11.291 23:06:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:11.291 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:11.291 23:06:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:11.291 23:06:14 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:11.291 23:06:14 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:11.291 23:06:14 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:11.291 23:06:14 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:11.291 23:06:14 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:11.291 23:06:14 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:11.291 23:06:14 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:11.291 23:06:14 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:11.291 23:06:14 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:11.291 23:06:14 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:11.291 23:06:14 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:11.291 23:06:14 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:11.291 23:06:14 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:11.291 23:06:14 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:11.291 23:06:14 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:11.291 23:06:14 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:11.291 23:06:14 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:11.550 23:06:14 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:11.550 23:06:14 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:11.550 23:06:14 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:11.550 23:06:14 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:11.550 23:06:14 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:11.550 23:06:14 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:11.550 23:06:14 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:11.550 23:06:15 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:11.550 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:11.550 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.171 ms 00:14:11.550 00:14:11.550 --- 10.0.0.2 ping statistics --- 00:14:11.550 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:11.550 rtt min/avg/max/mdev = 0.171/0.171/0.171/0.000 ms 00:14:11.550 23:06:15 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:11.550 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:11.550 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.052 ms 00:14:11.550 00:14:11.550 --- 10.0.0.1 ping statistics --- 00:14:11.550 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:11.550 rtt min/avg/max/mdev = 0.052/0.052/0.052/0.000 ms 00:14:11.550 23:06:15 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:11.550 23:06:15 -- nvmf/common.sh@410 -- # return 0 00:14:11.550 23:06:15 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:11.550 23:06:15 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:11.550 23:06:15 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:11.550 23:06:15 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:11.550 23:06:15 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:11.550 23:06:15 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:11.550 23:06:15 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:11.550 23:06:15 -- target/ns_hotplug_stress.sh@23 -- # nvmfappstart -m 0xE 00:14:11.550 23:06:15 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:11.550 23:06:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:11.550 23:06:15 -- common/autotest_common.sh@10 -- # set +x 00:14:11.550 23:06:15 -- nvmf/common.sh@469 -- # nvmfpid=2405321 00:14:11.550 23:06:15 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:14:11.550 23:06:15 -- nvmf/common.sh@470 -- # waitforlisten 2405321 00:14:11.550 23:06:15 -- common/autotest_common.sh@829 -- # '[' -z 2405321 ']' 00:14:11.550 23:06:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:11.550 23:06:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:11.550 23:06:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:11.550 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:11.550 23:06:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:11.550 23:06:15 -- common/autotest_common.sh@10 -- # set +x 00:14:11.550 [2024-11-28 23:06:15.074920] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:11.550 [2024-11-28 23:06:15.074987] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:11.550 EAL: No free 2048 kB hugepages reported on node 1 00:14:11.550 [2024-11-28 23:06:15.144214] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:11.809 [2024-11-28 23:06:15.237409] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:11.809 [2024-11-28 23:06:15.237586] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:11.809 [2024-11-28 23:06:15.237606] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:11.809 [2024-11-28 23:06:15.237620] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:11.809 [2024-11-28 23:06:15.237686] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:11.809 [2024-11-28 23:06:15.237746] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:11.809 [2024-11-28 23:06:15.237750] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:12.742 23:06:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:12.742 23:06:16 -- common/autotest_common.sh@862 -- # return 0 00:14:12.742 23:06:16 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:12.742 23:06:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:12.742 23:06:16 -- common/autotest_common.sh@10 -- # set +x 00:14:12.742 23:06:16 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:12.742 23:06:16 -- target/ns_hotplug_stress.sh@25 -- # null_size=1000 00:14:12.742 23:06:16 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:13.000 [2024-11-28 23:06:16.399933] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:13.000 23:06:16 -- target/ns_hotplug_stress.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:13.258 23:06:16 -- target/ns_hotplug_stress.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:13.516 [2024-11-28 23:06:16.906820] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:13.516 23:06:16 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:13.774 23:06:17 -- target/ns_hotplug_stress.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:14:14.033 Malloc0 00:14:14.033 23:06:17 -- target/ns_hotplug_stress.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:14:14.291 Delay0 00:14:14.291 23:06:17 -- target/ns_hotplug_stress.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:14.563 23:06:17 -- target/ns_hotplug_stress.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:14:14.824 NULL1 00:14:14.824 23:06:18 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:14:15.082 23:06:18 -- target/ns_hotplug_stress.sh@42 -- # PERF_PID=2405757 00:14:15.082 23:06:18 -- target/ns_hotplug_stress.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:14:15.082 23:06:18 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2405757 00:14:15.082 23:06:18 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:15.082 EAL: No free 2048 kB hugepages reported on node 1 00:14:16.454 Read completed with error (sct=0, sc=11) 00:14:16.454 23:06:19 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:16.454 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:16.454 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:16.454 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:16.454 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:16.454 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:16.454 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:16.454 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:16.454 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:16.454 23:06:19 -- target/ns_hotplug_stress.sh@49 -- # null_size=1001 00:14:16.454 23:06:19 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:14:16.712 true 00:14:16.712 23:06:20 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2405757 00:14:16.712 23:06:20 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:17.644 23:06:20 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:17.902 23:06:21 -- target/ns_hotplug_stress.sh@49 -- # null_size=1002 00:14:17.902 23:06:21 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:14:18.159 true 00:14:18.159 23:06:21 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2405757 00:14:18.159 23:06:21 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:18.417 23:06:21 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:18.674 23:06:22 -- target/ns_hotplug_stress.sh@49 -- # null_size=1003 00:14:18.674 23:06:22 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:14:18.674 true 00:14:18.932 23:06:22 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2405757 00:14:18.932 23:06:22 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:19.190 23:06:22 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:19.448 23:06:22 -- target/ns_hotplug_stress.sh@49 -- # null_size=1004 00:14:19.448 23:06:22 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:14:19.448 true 00:14:19.448 23:06:23 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2405757 00:14:19.448 23:06:23 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:20.889 23:06:24 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:20.889 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:20.889 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:20.889 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:20.889 23:06:24 -- target/ns_hotplug_stress.sh@49 -- # null_size=1005 00:14:20.889 23:06:24 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:14:21.181 true 00:14:21.181 23:06:24 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2405757 00:14:21.181 23:06:24 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:21.438 23:06:24 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:21.695 23:06:25 -- target/ns_hotplug_stress.sh@49 -- # null_size=1006 00:14:21.695 23:06:25 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:14:21.954 true 00:14:21.954 23:06:25 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2405757 00:14:21.954 23:06:25 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:22.882 23:06:26 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:22.882 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:22.882 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:22.882 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:23.138 23:06:26 -- target/ns_hotplug_stress.sh@49 -- # null_size=1007 00:14:23.138 23:06:26 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:14:23.394 true 00:14:23.394 23:06:26 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2405757 00:14:23.394 23:06:26 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:23.650 23:06:27 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:23.906 23:06:27 -- target/ns_hotplug_stress.sh@49 -- # null_size=1008 00:14:23.906 23:06:27 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:14:24.164 true 00:14:24.164 23:06:27 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2405757 00:14:24.164 23:06:27 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:25.096 23:06:28 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:25.353 23:06:28 -- target/ns_hotplug_stress.sh@49 -- # null_size=1009 00:14:25.353 23:06:28 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:14:25.611 true 00:14:25.611 23:06:29 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2405757 00:14:25.611 23:06:29 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:25.868 23:06:29 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:26.125 23:06:29 -- target/ns_hotplug_stress.sh@49 -- # null_size=1010 00:14:26.125 23:06:29 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:14:26.383 true 00:14:26.383 23:06:29 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2405757 00:14:26.383 23:06:29 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:26.641 23:06:30 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:26.898 23:06:30 -- target/ns_hotplug_stress.sh@49 -- # null_size=1011 00:14:26.898 23:06:30 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:14:27.156 true 00:14:27.156 23:06:30 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2405757 00:14:27.156 23:06:30 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:28.089 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:28.089 23:06:31 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:28.347 23:06:31 -- target/ns_hotplug_stress.sh@49 -- # null_size=1012 00:14:28.347 23:06:31 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:14:28.605 true 00:14:28.605 23:06:32 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2405757 00:14:28.605 23:06:32 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:28.862 23:06:32 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:29.120 23:06:32 -- target/ns_hotplug_stress.sh@49 -- # null_size=1013 00:14:29.120 23:06:32 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:14:29.377 true 00:14:29.377 23:06:32 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2405757 00:14:29.377 23:06:32 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:30.310 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:30.310 23:06:33 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:30.310 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:30.568 23:06:34 -- target/ns_hotplug_stress.sh@49 -- # null_size=1014 00:14:30.568 23:06:34 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:14:30.825 true 00:14:30.825 23:06:34 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2405757 00:14:30.825 23:06:34 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:31.084 23:06:34 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:31.342 23:06:34 -- target/ns_hotplug_stress.sh@49 -- # null_size=1015 00:14:31.342 23:06:34 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:14:31.599 true 00:14:31.599 23:06:35 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2405757 00:14:31.599 23:06:35 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:32.530 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:32.530 23:06:35 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:32.530 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:32.530 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:32.787 23:06:36 -- target/ns_hotplug_stress.sh@49 -- # null_size=1016 00:14:32.787 23:06:36 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:14:33.044 true 00:14:33.044 23:06:36 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2405757 00:14:33.044 23:06:36 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:33.302 23:06:36 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:33.560 23:06:36 -- target/ns_hotplug_stress.sh@49 -- # null_size=1017 00:14:33.560 23:06:36 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:14:33.818 true 00:14:33.818 23:06:37 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2405757 00:14:33.818 23:06:37 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:34.751 23:06:38 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:35.009 23:06:38 -- target/ns_hotplug_stress.sh@49 -- # null_size=1018 00:14:35.009 23:06:38 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:14:35.267 true 00:14:35.267 23:06:38 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2405757 00:14:35.267 23:06:38 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:35.524 23:06:38 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:35.782 23:06:39 -- target/ns_hotplug_stress.sh@49 -- # null_size=1019 00:14:35.782 23:06:39 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:14:36.040 true 00:14:36.040 23:06:39 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2405757 00:14:36.040 23:06:39 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:36.972 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:36.972 23:06:40 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:36.972 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:36.972 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:37.229 23:06:40 -- target/ns_hotplug_stress.sh@49 -- # null_size=1020 00:14:37.229 23:06:40 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:14:37.229 true 00:14:37.487 23:06:40 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2405757 00:14:37.487 23:06:40 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:37.487 23:06:41 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:37.744 23:06:41 -- target/ns_hotplug_stress.sh@49 -- # null_size=1021 00:14:37.744 23:06:41 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:14:38.002 true 00:14:38.002 23:06:41 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2405757 00:14:38.002 23:06:41 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:38.935 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:38.935 23:06:42 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:39.193 23:06:42 -- target/ns_hotplug_stress.sh@49 -- # null_size=1022 00:14:39.193 23:06:42 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:14:39.450 true 00:14:39.450 23:06:42 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2405757 00:14:39.450 23:06:42 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:39.707 23:06:43 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:39.965 23:06:43 -- target/ns_hotplug_stress.sh@49 -- # null_size=1023 00:14:39.965 23:06:43 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:14:40.223 true 00:14:40.223 23:06:43 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2405757 00:14:40.223 23:06:43 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:41.156 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:41.156 23:06:44 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:41.156 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:41.413 23:06:44 -- target/ns_hotplug_stress.sh@49 -- # null_size=1024 00:14:41.413 23:06:44 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:14:41.670 true 00:14:41.670 23:06:45 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2405757 00:14:41.670 23:06:45 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:41.926 23:06:45 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:42.183 23:06:45 -- target/ns_hotplug_stress.sh@49 -- # null_size=1025 00:14:42.184 23:06:45 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:14:42.441 true 00:14:42.441 23:06:45 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2405757 00:14:42.441 23:06:45 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:43.373 23:06:46 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:43.373 23:06:46 -- target/ns_hotplug_stress.sh@49 -- # null_size=1026 00:14:43.373 23:06:46 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:14:43.630 true 00:14:43.630 23:06:47 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2405757 00:14:43.630 23:06:47 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:43.888 23:06:47 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:44.146 23:06:47 -- target/ns_hotplug_stress.sh@49 -- # null_size=1027 00:14:44.146 23:06:47 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:14:44.404 true 00:14:44.404 23:06:47 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2405757 00:14:44.404 23:06:47 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:44.660 23:06:48 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:44.917 23:06:48 -- target/ns_hotplug_stress.sh@49 -- # null_size=1028 00:14:44.917 23:06:48 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:14:45.174 true 00:14:45.174 23:06:48 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2405757 00:14:45.174 23:06:48 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:46.546 [2024-11-28 23:06:49.723847] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a19650 is same with the state(5) to be set 00:14:46.546 Initializing NVMe Controllers 00:14:46.546 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:46.546 Controller IO queue size 128, less than required. 00:14:46.546 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:46.546 Controller IO queue size 128, less than required. 00:14:46.546 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:46.546 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:14:46.546 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:14:46.546 Initialization complete. Launching workers. 00:14:46.546 ======================================================== 00:14:46.546 Latency(us) 00:14:46.546 Device Information : IOPS MiB/s Average min max 00:14:46.546 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 936.99 0.46 71935.50 2493.11 1073641.41 00:14:46.546 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 11272.19 5.50 11356.16 1646.84 450923.73 00:14:46.546 ======================================================== 00:14:46.546 Total : 12209.17 5.96 16005.30 1646.84 1073641.41 00:14:46.546 00:14:46.546 23:06:49 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:46.546 23:06:49 -- target/ns_hotplug_stress.sh@49 -- # null_size=1029 00:14:46.546 23:06:49 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:14:46.804 true 00:14:46.804 23:06:50 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2405757 00:14:46.804 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 44: kill: (2405757) - No such process 00:14:46.804 23:06:50 -- target/ns_hotplug_stress.sh@53 -- # wait 2405757 00:14:46.804 23:06:50 -- target/ns_hotplug_stress.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:47.061 23:06:50 -- target/ns_hotplug_stress.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:47.319 23:06:50 -- target/ns_hotplug_stress.sh@58 -- # nthreads=8 00:14:47.319 23:06:50 -- target/ns_hotplug_stress.sh@58 -- # pids=() 00:14:47.319 23:06:50 -- target/ns_hotplug_stress.sh@59 -- # (( i = 0 )) 00:14:47.319 23:06:50 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:47.319 23:06:50 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null0 100 4096 00:14:47.577 null0 00:14:47.577 23:06:51 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:47.577 23:06:51 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:47.577 23:06:51 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null1 100 4096 00:14:47.835 null1 00:14:47.835 23:06:51 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:47.835 23:06:51 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:47.835 23:06:51 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null2 100 4096 00:14:48.093 null2 00:14:48.093 23:06:51 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:48.093 23:06:51 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:48.093 23:06:51 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null3 100 4096 00:14:48.350 null3 00:14:48.350 23:06:51 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:48.350 23:06:51 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:48.350 23:06:51 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null4 100 4096 00:14:48.608 null4 00:14:48.608 23:06:52 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:48.608 23:06:52 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:48.608 23:06:52 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null5 100 4096 00:14:48.866 null5 00:14:48.866 23:06:52 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:48.866 23:06:52 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:48.866 23:06:52 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null6 100 4096 00:14:49.123 null6 00:14:49.123 23:06:52 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:49.123 23:06:52 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:49.123 23:06:52 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null7 100 4096 00:14:49.381 null7 00:14:49.381 23:06:52 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:49.381 23:06:52 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:49.381 23:06:52 -- target/ns_hotplug_stress.sh@62 -- # (( i = 0 )) 00:14:49.381 23:06:52 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:49.381 23:06:52 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:49.381 23:06:52 -- target/ns_hotplug_stress.sh@63 -- # add_remove 1 null0 00:14:49.381 23:06:52 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:49.381 23:06:52 -- target/ns_hotplug_stress.sh@14 -- # local nsid=1 bdev=null0 00:14:49.381 23:06:52 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:49.381 23:06:52 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:49.381 23:06:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:49.381 23:06:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:49.381 23:06:52 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:49.381 23:06:52 -- target/ns_hotplug_stress.sh@63 -- # add_remove 2 null1 00:14:49.381 23:06:52 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:49.381 23:06:52 -- target/ns_hotplug_stress.sh@14 -- # local nsid=2 bdev=null1 00:14:49.381 23:06:52 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@63 -- # add_remove 3 null2 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@14 -- # local nsid=3 bdev=null2 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@63 -- # add_remove 4 null3 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@14 -- # local nsid=4 bdev=null3 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@63 -- # add_remove 5 null4 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@14 -- # local nsid=5 bdev=null4 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@63 -- # add_remove 6 null5 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@14 -- # local nsid=6 bdev=null5 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@63 -- # add_remove 7 null6 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@14 -- # local nsid=7 bdev=null6 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@63 -- # add_remove 8 null7 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@14 -- # local nsid=8 bdev=null7 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@66 -- # wait 2410052 2410053 2410055 2410057 2410059 2410061 2410063 2410065 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:49.382 23:06:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:49.640 23:06:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:49.640 23:06:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:49.640 23:06:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:49.640 23:06:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:49.640 23:06:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:49.640 23:06:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:49.640 23:06:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:49.640 23:06:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:49.927 23:06:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:49.927 23:06:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:49.927 23:06:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:49.927 23:06:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:49.927 23:06:53 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:49.927 23:06:53 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:49.927 23:06:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:49.927 23:06:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:49.927 23:06:53 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:49.927 23:06:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:49.927 23:06:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:49.927 23:06:53 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:49.927 23:06:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:49.927 23:06:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:49.927 23:06:53 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:49.927 23:06:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:49.927 23:06:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:49.927 23:06:53 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:49.927 23:06:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:49.927 23:06:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:49.927 23:06:53 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:49.927 23:06:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:49.927 23:06:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:49.927 23:06:53 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:50.208 23:06:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:50.208 23:06:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:50.208 23:06:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:50.208 23:06:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:50.208 23:06:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:50.208 23:06:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:50.208 23:06:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:50.208 23:06:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:50.467 23:06:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:50.467 23:06:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:50.467 23:06:53 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:50.467 23:06:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:50.467 23:06:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:50.467 23:06:53 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:50.467 23:06:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:50.467 23:06:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:50.467 23:06:53 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:50.467 23:06:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:50.467 23:06:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:50.467 23:06:53 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:50.467 23:06:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:50.467 23:06:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:50.467 23:06:53 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:50.467 23:06:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:50.467 23:06:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:50.467 23:06:53 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:50.467 23:06:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:50.467 23:06:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:50.467 23:06:53 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:50.467 23:06:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:50.467 23:06:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:50.467 23:06:53 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:50.726 23:06:54 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:50.726 23:06:54 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:50.726 23:06:54 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:50.726 23:06:54 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:50.726 23:06:54 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:50.726 23:06:54 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:50.726 23:06:54 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:50.726 23:06:54 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:50.985 23:06:54 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:50.985 23:06:54 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:50.985 23:06:54 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:50.985 23:06:54 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:50.985 23:06:54 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:50.985 23:06:54 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:50.985 23:06:54 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:50.985 23:06:54 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:50.985 23:06:54 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:50.985 23:06:54 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:50.985 23:06:54 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:50.985 23:06:54 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:50.985 23:06:54 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:50.985 23:06:54 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:50.985 23:06:54 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:50.985 23:06:54 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:50.985 23:06:54 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:50.985 23:06:54 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:50.985 23:06:54 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:50.985 23:06:54 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:50.985 23:06:54 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:50.985 23:06:54 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:50.985 23:06:54 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:50.985 23:06:54 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:51.243 23:06:54 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:51.243 23:06:54 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:51.243 23:06:54 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:51.243 23:06:54 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:51.243 23:06:54 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:51.243 23:06:54 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:51.243 23:06:54 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:51.244 23:06:54 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:51.503 23:06:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:51.503 23:06:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:51.503 23:06:55 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:51.503 23:06:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:51.503 23:06:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:51.503 23:06:55 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:51.503 23:06:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:51.503 23:06:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:51.503 23:06:55 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:51.503 23:06:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:51.503 23:06:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:51.503 23:06:55 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:51.503 23:06:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:51.503 23:06:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:51.503 23:06:55 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:51.503 23:06:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:51.503 23:06:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:51.503 23:06:55 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:51.503 23:06:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:51.503 23:06:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:51.503 23:06:55 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:51.503 23:06:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:51.503 23:06:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:51.503 23:06:55 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:51.761 23:06:55 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:51.761 23:06:55 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:51.761 23:06:55 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:51.761 23:06:55 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:51.761 23:06:55 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:51.761 23:06:55 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:51.761 23:06:55 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:51.761 23:06:55 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:52.019 23:06:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:52.019 23:06:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:52.019 23:06:55 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:52.019 23:06:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:52.019 23:06:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:52.019 23:06:55 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:52.019 23:06:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:52.019 23:06:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:52.019 23:06:55 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:52.276 23:06:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:52.276 23:06:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:52.276 23:06:55 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:52.276 23:06:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:52.276 23:06:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:52.276 23:06:55 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:52.276 23:06:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:52.276 23:06:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:52.276 23:06:55 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:52.276 23:06:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:52.276 23:06:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:52.276 23:06:55 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:52.276 23:06:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:52.276 23:06:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:52.276 23:06:55 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:52.535 23:06:55 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:52.535 23:06:55 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:52.535 23:06:55 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:52.535 23:06:55 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:52.535 23:06:55 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:52.535 23:06:55 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:52.535 23:06:55 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:52.535 23:06:55 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:52.793 23:06:56 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:52.793 23:06:56 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:52.793 23:06:56 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:52.793 23:06:56 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:52.793 23:06:56 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:52.793 23:06:56 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:52.793 23:06:56 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:52.793 23:06:56 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:52.793 23:06:56 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:52.793 23:06:56 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:52.793 23:06:56 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:52.793 23:06:56 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:52.793 23:06:56 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:52.793 23:06:56 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:52.793 23:06:56 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:52.793 23:06:56 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:52.793 23:06:56 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:52.793 23:06:56 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:52.793 23:06:56 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:52.793 23:06:56 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:52.793 23:06:56 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:52.793 23:06:56 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:52.793 23:06:56 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:52.793 23:06:56 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:53.051 23:06:56 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:53.051 23:06:56 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:53.051 23:06:56 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:53.051 23:06:56 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:53.051 23:06:56 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:53.051 23:06:56 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:53.051 23:06:56 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:53.051 23:06:56 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:53.310 23:06:56 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:53.310 23:06:56 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:53.310 23:06:56 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:53.310 23:06:56 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:53.310 23:06:56 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:53.310 23:06:56 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:53.310 23:06:56 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:53.310 23:06:56 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:53.310 23:06:56 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:53.310 23:06:56 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:53.310 23:06:56 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:53.310 23:06:56 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:53.310 23:06:56 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:53.310 23:06:56 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:53.310 23:06:56 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:53.310 23:06:56 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:53.310 23:06:56 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:53.310 23:06:56 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:53.310 23:06:56 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:53.310 23:06:56 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:53.310 23:06:56 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:53.310 23:06:56 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:53.310 23:06:56 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:53.310 23:06:56 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:53.568 23:06:57 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:53.568 23:06:57 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:53.568 23:06:57 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:53.568 23:06:57 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:53.568 23:06:57 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:53.568 23:06:57 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:53.568 23:06:57 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:53.568 23:06:57 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:53.828 23:06:57 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:53.828 23:06:57 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:53.828 23:06:57 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:53.828 23:06:57 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:53.828 23:06:57 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:53.828 23:06:57 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:53.828 23:06:57 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:53.828 23:06:57 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:53.828 23:06:57 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:53.828 23:06:57 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:53.828 23:06:57 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:53.828 23:06:57 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:53.828 23:06:57 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:53.828 23:06:57 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:53.828 23:06:57 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:53.828 23:06:57 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:53.828 23:06:57 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:53.828 23:06:57 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:53.828 23:06:57 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:53.828 23:06:57 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:53.828 23:06:57 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:53.828 23:06:57 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:53.828 23:06:57 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:53.828 23:06:57 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:54.087 23:06:57 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:54.087 23:06:57 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:54.087 23:06:57 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:54.087 23:06:57 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:54.087 23:06:57 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:54.087 23:06:57 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:54.087 23:06:57 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:54.087 23:06:57 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:54.346 23:06:57 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:54.346 23:06:57 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:54.346 23:06:57 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:54.346 23:06:57 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:54.346 23:06:57 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:54.346 23:06:57 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:54.346 23:06:57 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:54.346 23:06:57 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:54.346 23:06:57 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:54.346 23:06:57 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:54.346 23:06:57 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:54.346 23:06:57 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:54.346 23:06:57 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:54.346 23:06:57 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:54.346 23:06:57 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:54.346 23:06:57 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:54.346 23:06:57 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:54.346 23:06:57 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:54.346 23:06:57 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:54.346 23:06:57 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:54.346 23:06:57 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:54.346 23:06:57 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:54.346 23:06:57 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:54.346 23:06:57 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:54.605 23:06:58 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:54.605 23:06:58 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:54.605 23:06:58 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:54.605 23:06:58 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:54.605 23:06:58 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:54.605 23:06:58 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:54.605 23:06:58 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:54.605 23:06:58 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:54.863 23:06:58 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:54.863 23:06:58 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:54.863 23:06:58 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:54.863 23:06:58 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:54.863 23:06:58 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:54.863 23:06:58 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:54.863 23:06:58 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:54.863 23:06:58 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:54.863 23:06:58 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:54.863 23:06:58 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:54.863 23:06:58 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:54.863 23:06:58 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:54.863 23:06:58 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:54.863 23:06:58 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:54.863 23:06:58 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:54.863 23:06:58 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:54.863 23:06:58 -- target/ns_hotplug_stress.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:14:54.863 23:06:58 -- target/ns_hotplug_stress.sh@70 -- # nvmftestfini 00:14:54.863 23:06:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:54.863 23:06:58 -- nvmf/common.sh@116 -- # sync 00:14:54.863 23:06:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:54.863 23:06:58 -- nvmf/common.sh@119 -- # set +e 00:14:54.863 23:06:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:54.863 23:06:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:54.863 rmmod nvme_tcp 00:14:54.863 rmmod nvme_fabrics 00:14:54.863 rmmod nvme_keyring 00:14:54.863 23:06:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:55.121 23:06:58 -- nvmf/common.sh@123 -- # set -e 00:14:55.121 23:06:58 -- nvmf/common.sh@124 -- # return 0 00:14:55.121 23:06:58 -- nvmf/common.sh@477 -- # '[' -n 2405321 ']' 00:14:55.121 23:06:58 -- nvmf/common.sh@478 -- # killprocess 2405321 00:14:55.121 23:06:58 -- common/autotest_common.sh@936 -- # '[' -z 2405321 ']' 00:14:55.121 23:06:58 -- common/autotest_common.sh@940 -- # kill -0 2405321 00:14:55.121 23:06:58 -- common/autotest_common.sh@941 -- # uname 00:14:55.121 23:06:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:55.121 23:06:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2405321 00:14:55.121 23:06:58 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:55.121 23:06:58 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:55.121 23:06:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2405321' 00:14:55.121 killing process with pid 2405321 00:14:55.121 23:06:58 -- common/autotest_common.sh@955 -- # kill 2405321 00:14:55.121 23:06:58 -- common/autotest_common.sh@960 -- # wait 2405321 00:14:55.378 23:06:58 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:55.378 23:06:58 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:55.378 23:06:58 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:55.378 23:06:58 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:55.378 23:06:58 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:55.378 23:06:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:55.378 23:06:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:55.378 23:06:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:57.280 23:07:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:57.280 00:14:57.280 real 0m48.050s 00:14:57.280 user 3m40.134s 00:14:57.280 sys 0m15.230s 00:14:57.280 23:07:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:57.280 23:07:00 -- common/autotest_common.sh@10 -- # set +x 00:14:57.280 ************************************ 00:14:57.280 END TEST nvmf_ns_hotplug_stress 00:14:57.280 ************************************ 00:14:57.280 23:07:00 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:14:57.280 23:07:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:57.280 23:07:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:57.280 23:07:00 -- common/autotest_common.sh@10 -- # set +x 00:14:57.280 ************************************ 00:14:57.280 START TEST nvmf_connect_stress 00:14:57.280 ************************************ 00:14:57.280 23:07:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:14:57.280 * Looking for test storage... 00:14:57.280 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:57.280 23:07:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:57.280 23:07:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:57.280 23:07:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:57.539 23:07:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:57.539 23:07:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:57.539 23:07:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:57.539 23:07:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:57.539 23:07:00 -- scripts/common.sh@335 -- # IFS=.-: 00:14:57.539 23:07:00 -- scripts/common.sh@335 -- # read -ra ver1 00:14:57.539 23:07:00 -- scripts/common.sh@336 -- # IFS=.-: 00:14:57.539 23:07:00 -- scripts/common.sh@336 -- # read -ra ver2 00:14:57.539 23:07:00 -- scripts/common.sh@337 -- # local 'op=<' 00:14:57.539 23:07:00 -- scripts/common.sh@339 -- # ver1_l=2 00:14:57.539 23:07:00 -- scripts/common.sh@340 -- # ver2_l=1 00:14:57.539 23:07:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:57.539 23:07:00 -- scripts/common.sh@343 -- # case "$op" in 00:14:57.539 23:07:00 -- scripts/common.sh@344 -- # : 1 00:14:57.539 23:07:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:57.539 23:07:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:57.539 23:07:00 -- scripts/common.sh@364 -- # decimal 1 00:14:57.539 23:07:00 -- scripts/common.sh@352 -- # local d=1 00:14:57.539 23:07:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:57.539 23:07:00 -- scripts/common.sh@354 -- # echo 1 00:14:57.539 23:07:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:57.539 23:07:00 -- scripts/common.sh@365 -- # decimal 2 00:14:57.539 23:07:00 -- scripts/common.sh@352 -- # local d=2 00:14:57.539 23:07:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:57.539 23:07:00 -- scripts/common.sh@354 -- # echo 2 00:14:57.539 23:07:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:57.539 23:07:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:57.539 23:07:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:57.539 23:07:00 -- scripts/common.sh@367 -- # return 0 00:14:57.539 23:07:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:57.539 23:07:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:57.539 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:57.539 --rc genhtml_branch_coverage=1 00:14:57.539 --rc genhtml_function_coverage=1 00:14:57.539 --rc genhtml_legend=1 00:14:57.539 --rc geninfo_all_blocks=1 00:14:57.539 --rc geninfo_unexecuted_blocks=1 00:14:57.539 00:14:57.539 ' 00:14:57.539 23:07:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:57.539 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:57.539 --rc genhtml_branch_coverage=1 00:14:57.539 --rc genhtml_function_coverage=1 00:14:57.539 --rc genhtml_legend=1 00:14:57.539 --rc geninfo_all_blocks=1 00:14:57.539 --rc geninfo_unexecuted_blocks=1 00:14:57.539 00:14:57.539 ' 00:14:57.539 23:07:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:57.539 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:57.539 --rc genhtml_branch_coverage=1 00:14:57.539 --rc genhtml_function_coverage=1 00:14:57.539 --rc genhtml_legend=1 00:14:57.539 --rc geninfo_all_blocks=1 00:14:57.539 --rc geninfo_unexecuted_blocks=1 00:14:57.539 00:14:57.539 ' 00:14:57.539 23:07:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:57.539 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:57.539 --rc genhtml_branch_coverage=1 00:14:57.539 --rc genhtml_function_coverage=1 00:14:57.539 --rc genhtml_legend=1 00:14:57.539 --rc geninfo_all_blocks=1 00:14:57.539 --rc geninfo_unexecuted_blocks=1 00:14:57.539 00:14:57.539 ' 00:14:57.539 23:07:00 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:57.539 23:07:00 -- nvmf/common.sh@7 -- # uname -s 00:14:57.539 23:07:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:57.539 23:07:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:57.539 23:07:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:57.539 23:07:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:57.539 23:07:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:57.539 23:07:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:57.539 23:07:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:57.539 23:07:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:57.539 23:07:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:57.539 23:07:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:57.539 23:07:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:57.539 23:07:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:57.539 23:07:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:57.539 23:07:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:57.539 23:07:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:57.539 23:07:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:57.539 23:07:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:57.539 23:07:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:57.539 23:07:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:57.539 23:07:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:57.539 23:07:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:57.539 23:07:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:57.539 23:07:00 -- paths/export.sh@5 -- # export PATH 00:14:57.539 23:07:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:57.539 23:07:00 -- nvmf/common.sh@46 -- # : 0 00:14:57.539 23:07:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:57.539 23:07:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:57.539 23:07:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:57.539 23:07:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:57.539 23:07:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:57.539 23:07:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:57.539 23:07:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:57.539 23:07:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:57.539 23:07:00 -- target/connect_stress.sh@12 -- # nvmftestinit 00:14:57.539 23:07:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:57.539 23:07:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:57.539 23:07:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:57.539 23:07:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:57.539 23:07:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:57.539 23:07:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:57.539 23:07:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:57.540 23:07:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:57.540 23:07:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:57.540 23:07:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:57.540 23:07:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:57.540 23:07:00 -- common/autotest_common.sh@10 -- # set +x 00:14:59.441 23:07:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:59.441 23:07:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:59.441 23:07:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:59.441 23:07:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:59.441 23:07:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:59.441 23:07:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:59.441 23:07:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:59.441 23:07:03 -- nvmf/common.sh@294 -- # net_devs=() 00:14:59.441 23:07:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:59.441 23:07:03 -- nvmf/common.sh@295 -- # e810=() 00:14:59.441 23:07:03 -- nvmf/common.sh@295 -- # local -ga e810 00:14:59.441 23:07:03 -- nvmf/common.sh@296 -- # x722=() 00:14:59.441 23:07:03 -- nvmf/common.sh@296 -- # local -ga x722 00:14:59.441 23:07:03 -- nvmf/common.sh@297 -- # mlx=() 00:14:59.441 23:07:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:59.441 23:07:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:59.441 23:07:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:59.441 23:07:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:59.441 23:07:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:59.441 23:07:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:59.441 23:07:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:59.441 23:07:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:59.441 23:07:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:59.441 23:07:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:59.441 23:07:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:59.441 23:07:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:59.441 23:07:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:59.441 23:07:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:59.441 23:07:03 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:59.441 23:07:03 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:59.441 23:07:03 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:59.441 23:07:03 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:59.441 23:07:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:59.441 23:07:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:59.441 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:59.441 23:07:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:59.441 23:07:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:59.441 23:07:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:59.441 23:07:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:59.441 23:07:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:59.441 23:07:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:59.441 23:07:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:59.441 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:59.441 23:07:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:59.441 23:07:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:59.441 23:07:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:59.441 23:07:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:59.441 23:07:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:59.441 23:07:03 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:59.441 23:07:03 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:59.441 23:07:03 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:59.441 23:07:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:59.441 23:07:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:59.441 23:07:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:59.441 23:07:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:59.441 23:07:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:59.441 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:59.441 23:07:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:59.441 23:07:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:59.441 23:07:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:59.441 23:07:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:59.441 23:07:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:59.441 23:07:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:59.441 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:59.441 23:07:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:59.441 23:07:03 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:59.441 23:07:03 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:59.441 23:07:03 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:59.441 23:07:03 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:59.441 23:07:03 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:59.441 23:07:03 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:59.441 23:07:03 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:59.441 23:07:03 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:59.441 23:07:03 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:59.441 23:07:03 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:59.441 23:07:03 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:59.441 23:07:03 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:59.441 23:07:03 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:59.441 23:07:03 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:59.441 23:07:03 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:59.441 23:07:03 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:59.441 23:07:03 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:59.441 23:07:03 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:59.699 23:07:03 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:59.700 23:07:03 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:59.700 23:07:03 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:59.700 23:07:03 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:59.700 23:07:03 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:59.700 23:07:03 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:59.700 23:07:03 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:59.700 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:59.700 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.252 ms 00:14:59.700 00:14:59.700 --- 10.0.0.2 ping statistics --- 00:14:59.700 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:59.700 rtt min/avg/max/mdev = 0.252/0.252/0.252/0.000 ms 00:14:59.700 23:07:03 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:59.700 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:59.700 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.079 ms 00:14:59.700 00:14:59.700 --- 10.0.0.1 ping statistics --- 00:14:59.700 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:59.700 rtt min/avg/max/mdev = 0.079/0.079/0.079/0.000 ms 00:14:59.700 23:07:03 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:59.700 23:07:03 -- nvmf/common.sh@410 -- # return 0 00:14:59.700 23:07:03 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:59.700 23:07:03 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:59.700 23:07:03 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:59.700 23:07:03 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:59.700 23:07:03 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:59.700 23:07:03 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:59.700 23:07:03 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:59.700 23:07:03 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:14:59.700 23:07:03 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:59.700 23:07:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:59.700 23:07:03 -- common/autotest_common.sh@10 -- # set +x 00:14:59.700 23:07:03 -- nvmf/common.sh@469 -- # nvmfpid=2412853 00:14:59.700 23:07:03 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:14:59.700 23:07:03 -- nvmf/common.sh@470 -- # waitforlisten 2412853 00:14:59.700 23:07:03 -- common/autotest_common.sh@829 -- # '[' -z 2412853 ']' 00:14:59.700 23:07:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:59.700 23:07:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:59.700 23:07:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:59.700 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:59.700 23:07:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:59.700 23:07:03 -- common/autotest_common.sh@10 -- # set +x 00:14:59.700 [2024-11-28 23:07:03.215858] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:59.700 [2024-11-28 23:07:03.215926] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:59.700 EAL: No free 2048 kB hugepages reported on node 1 00:14:59.700 [2024-11-28 23:07:03.281975] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:59.958 [2024-11-28 23:07:03.369790] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:59.958 [2024-11-28 23:07:03.369965] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:59.958 [2024-11-28 23:07:03.369998] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:59.958 [2024-11-28 23:07:03.370011] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:59.958 [2024-11-28 23:07:03.370107] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:59.958 [2024-11-28 23:07:03.370161] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:59.958 [2024-11-28 23:07:03.370164] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:00.892 23:07:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:00.892 23:07:04 -- common/autotest_common.sh@862 -- # return 0 00:15:00.892 23:07:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:00.892 23:07:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:00.892 23:07:04 -- common/autotest_common.sh@10 -- # set +x 00:15:00.892 23:07:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:00.892 23:07:04 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:00.892 23:07:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.892 23:07:04 -- common/autotest_common.sh@10 -- # set +x 00:15:00.892 [2024-11-28 23:07:04.213896] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:00.892 23:07:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:00.892 23:07:04 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:00.892 23:07:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.892 23:07:04 -- common/autotest_common.sh@10 -- # set +x 00:15:00.892 23:07:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:00.892 23:07:04 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:00.892 23:07:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.892 23:07:04 -- common/autotest_common.sh@10 -- # set +x 00:15:00.892 [2024-11-28 23:07:04.247534] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:00.892 23:07:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:00.892 23:07:04 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:15:00.892 23:07:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.892 23:07:04 -- common/autotest_common.sh@10 -- # set +x 00:15:00.892 NULL1 00:15:00.892 23:07:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:00.892 23:07:04 -- target/connect_stress.sh@21 -- # PERF_PID=2413008 00:15:00.892 23:07:04 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:15:00.892 23:07:04 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:15:00.892 23:07:04 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:15:00.892 23:07:04 -- target/connect_stress.sh@27 -- # seq 1 20 00:15:00.892 23:07:04 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:00.892 23:07:04 -- target/connect_stress.sh@28 -- # cat 00:15:00.892 23:07:04 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:00.892 23:07:04 -- target/connect_stress.sh@28 -- # cat 00:15:00.892 23:07:04 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:00.892 23:07:04 -- target/connect_stress.sh@28 -- # cat 00:15:00.892 23:07:04 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:00.892 23:07:04 -- target/connect_stress.sh@28 -- # cat 00:15:00.892 23:07:04 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:00.892 23:07:04 -- target/connect_stress.sh@28 -- # cat 00:15:00.892 23:07:04 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:00.892 23:07:04 -- target/connect_stress.sh@28 -- # cat 00:15:00.892 23:07:04 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:00.892 23:07:04 -- target/connect_stress.sh@28 -- # cat 00:15:00.892 23:07:04 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:00.892 23:07:04 -- target/connect_stress.sh@28 -- # cat 00:15:00.892 23:07:04 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:00.892 23:07:04 -- target/connect_stress.sh@28 -- # cat 00:15:00.892 23:07:04 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:00.892 23:07:04 -- target/connect_stress.sh@28 -- # cat 00:15:00.892 23:07:04 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:00.892 23:07:04 -- target/connect_stress.sh@28 -- # cat 00:15:00.892 EAL: No free 2048 kB hugepages reported on node 1 00:15:00.892 23:07:04 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:00.892 23:07:04 -- target/connect_stress.sh@28 -- # cat 00:15:00.892 23:07:04 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:00.892 23:07:04 -- target/connect_stress.sh@28 -- # cat 00:15:00.892 23:07:04 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:00.892 23:07:04 -- target/connect_stress.sh@28 -- # cat 00:15:00.892 23:07:04 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:00.892 23:07:04 -- target/connect_stress.sh@28 -- # cat 00:15:00.892 23:07:04 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:00.892 23:07:04 -- target/connect_stress.sh@28 -- # cat 00:15:00.892 23:07:04 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:00.892 23:07:04 -- target/connect_stress.sh@28 -- # cat 00:15:00.892 23:07:04 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:00.892 23:07:04 -- target/connect_stress.sh@28 -- # cat 00:15:00.892 23:07:04 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:00.892 23:07:04 -- target/connect_stress.sh@28 -- # cat 00:15:00.892 23:07:04 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:00.892 23:07:04 -- target/connect_stress.sh@28 -- # cat 00:15:00.892 23:07:04 -- target/connect_stress.sh@34 -- # kill -0 2413008 00:15:00.892 23:07:04 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:00.892 23:07:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.892 23:07:04 -- common/autotest_common.sh@10 -- # set +x 00:15:01.150 23:07:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:01.150 23:07:04 -- target/connect_stress.sh@34 -- # kill -0 2413008 00:15:01.150 23:07:04 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:01.150 23:07:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:01.150 23:07:04 -- common/autotest_common.sh@10 -- # set +x 00:15:01.408 23:07:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:01.408 23:07:04 -- target/connect_stress.sh@34 -- # kill -0 2413008 00:15:01.408 23:07:04 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:01.408 23:07:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:01.408 23:07:04 -- common/autotest_common.sh@10 -- # set +x 00:15:01.671 23:07:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:01.671 23:07:05 -- target/connect_stress.sh@34 -- # kill -0 2413008 00:15:01.671 23:07:05 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:01.671 23:07:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:01.671 23:07:05 -- common/autotest_common.sh@10 -- # set +x 00:15:02.239 23:07:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:02.239 23:07:05 -- target/connect_stress.sh@34 -- # kill -0 2413008 00:15:02.239 23:07:05 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:02.239 23:07:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:02.239 23:07:05 -- common/autotest_common.sh@10 -- # set +x 00:15:02.497 23:07:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:02.497 23:07:05 -- target/connect_stress.sh@34 -- # kill -0 2413008 00:15:02.497 23:07:05 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:02.497 23:07:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:02.497 23:07:05 -- common/autotest_common.sh@10 -- # set +x 00:15:02.755 23:07:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:02.755 23:07:06 -- target/connect_stress.sh@34 -- # kill -0 2413008 00:15:02.755 23:07:06 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:02.755 23:07:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:02.755 23:07:06 -- common/autotest_common.sh@10 -- # set +x 00:15:03.013 23:07:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:03.013 23:07:06 -- target/connect_stress.sh@34 -- # kill -0 2413008 00:15:03.013 23:07:06 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:03.013 23:07:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:03.013 23:07:06 -- common/autotest_common.sh@10 -- # set +x 00:15:03.580 23:07:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:03.580 23:07:06 -- target/connect_stress.sh@34 -- # kill -0 2413008 00:15:03.580 23:07:06 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:03.580 23:07:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:03.580 23:07:06 -- common/autotest_common.sh@10 -- # set +x 00:15:03.838 23:07:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:03.838 23:07:07 -- target/connect_stress.sh@34 -- # kill -0 2413008 00:15:03.838 23:07:07 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:03.838 23:07:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:03.838 23:07:07 -- common/autotest_common.sh@10 -- # set +x 00:15:04.096 23:07:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:04.096 23:07:07 -- target/connect_stress.sh@34 -- # kill -0 2413008 00:15:04.096 23:07:07 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:04.096 23:07:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:04.096 23:07:07 -- common/autotest_common.sh@10 -- # set +x 00:15:04.353 23:07:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:04.353 23:07:07 -- target/connect_stress.sh@34 -- # kill -0 2413008 00:15:04.353 23:07:07 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:04.353 23:07:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:04.353 23:07:07 -- common/autotest_common.sh@10 -- # set +x 00:15:04.610 23:07:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:04.610 23:07:08 -- target/connect_stress.sh@34 -- # kill -0 2413008 00:15:04.610 23:07:08 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:04.610 23:07:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:04.610 23:07:08 -- common/autotest_common.sh@10 -- # set +x 00:15:05.176 23:07:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:05.176 23:07:08 -- target/connect_stress.sh@34 -- # kill -0 2413008 00:15:05.176 23:07:08 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:05.176 23:07:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:05.176 23:07:08 -- common/autotest_common.sh@10 -- # set +x 00:15:05.433 23:07:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:05.433 23:07:08 -- target/connect_stress.sh@34 -- # kill -0 2413008 00:15:05.433 23:07:08 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:05.433 23:07:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:05.433 23:07:08 -- common/autotest_common.sh@10 -- # set +x 00:15:05.692 23:07:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:05.692 23:07:09 -- target/connect_stress.sh@34 -- # kill -0 2413008 00:15:05.692 23:07:09 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:05.692 23:07:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:05.692 23:07:09 -- common/autotest_common.sh@10 -- # set +x 00:15:05.950 23:07:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:05.950 23:07:09 -- target/connect_stress.sh@34 -- # kill -0 2413008 00:15:05.950 23:07:09 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:05.950 23:07:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:05.950 23:07:09 -- common/autotest_common.sh@10 -- # set +x 00:15:06.208 23:07:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:06.208 23:07:09 -- target/connect_stress.sh@34 -- # kill -0 2413008 00:15:06.208 23:07:09 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:06.208 23:07:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:06.208 23:07:09 -- common/autotest_common.sh@10 -- # set +x 00:15:06.773 23:07:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:06.773 23:07:10 -- target/connect_stress.sh@34 -- # kill -0 2413008 00:15:06.773 23:07:10 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:06.773 23:07:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:06.773 23:07:10 -- common/autotest_common.sh@10 -- # set +x 00:15:07.031 23:07:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:07.031 23:07:10 -- target/connect_stress.sh@34 -- # kill -0 2413008 00:15:07.031 23:07:10 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:07.031 23:07:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:07.031 23:07:10 -- common/autotest_common.sh@10 -- # set +x 00:15:07.288 23:07:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:07.288 23:07:10 -- target/connect_stress.sh@34 -- # kill -0 2413008 00:15:07.288 23:07:10 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:07.288 23:07:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:07.288 23:07:10 -- common/autotest_common.sh@10 -- # set +x 00:15:07.545 23:07:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:07.545 23:07:11 -- target/connect_stress.sh@34 -- # kill -0 2413008 00:15:07.545 23:07:11 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:07.545 23:07:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:07.545 23:07:11 -- common/autotest_common.sh@10 -- # set +x 00:15:07.803 23:07:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:07.803 23:07:11 -- target/connect_stress.sh@34 -- # kill -0 2413008 00:15:07.803 23:07:11 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:07.803 23:07:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:07.803 23:07:11 -- common/autotest_common.sh@10 -- # set +x 00:15:08.368 23:07:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:08.368 23:07:11 -- target/connect_stress.sh@34 -- # kill -0 2413008 00:15:08.368 23:07:11 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:08.368 23:07:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:08.368 23:07:11 -- common/autotest_common.sh@10 -- # set +x 00:15:08.626 23:07:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:08.626 23:07:12 -- target/connect_stress.sh@34 -- # kill -0 2413008 00:15:08.626 23:07:12 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:08.626 23:07:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:08.626 23:07:12 -- common/autotest_common.sh@10 -- # set +x 00:15:08.884 23:07:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:08.884 23:07:12 -- target/connect_stress.sh@34 -- # kill -0 2413008 00:15:08.884 23:07:12 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:08.884 23:07:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:08.884 23:07:12 -- common/autotest_common.sh@10 -- # set +x 00:15:09.141 23:07:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:09.141 23:07:12 -- target/connect_stress.sh@34 -- # kill -0 2413008 00:15:09.141 23:07:12 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:09.141 23:07:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:09.141 23:07:12 -- common/autotest_common.sh@10 -- # set +x 00:15:09.399 23:07:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:09.399 23:07:12 -- target/connect_stress.sh@34 -- # kill -0 2413008 00:15:09.399 23:07:12 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:09.399 23:07:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:09.399 23:07:12 -- common/autotest_common.sh@10 -- # set +x 00:15:09.964 23:07:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:09.964 23:07:13 -- target/connect_stress.sh@34 -- # kill -0 2413008 00:15:09.964 23:07:13 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:09.964 23:07:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:09.964 23:07:13 -- common/autotest_common.sh@10 -- # set +x 00:15:10.221 23:07:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:10.221 23:07:13 -- target/connect_stress.sh@34 -- # kill -0 2413008 00:15:10.221 23:07:13 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:10.221 23:07:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:10.221 23:07:13 -- common/autotest_common.sh@10 -- # set +x 00:15:10.479 23:07:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:10.479 23:07:13 -- target/connect_stress.sh@34 -- # kill -0 2413008 00:15:10.479 23:07:13 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:10.479 23:07:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:10.479 23:07:13 -- common/autotest_common.sh@10 -- # set +x 00:15:10.737 23:07:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:10.737 23:07:14 -- target/connect_stress.sh@34 -- # kill -0 2413008 00:15:10.737 23:07:14 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:10.737 23:07:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:10.737 23:07:14 -- common/autotest_common.sh@10 -- # set +x 00:15:10.994 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:15:10.994 23:07:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:10.994 23:07:14 -- target/connect_stress.sh@34 -- # kill -0 2413008 00:15:10.994 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (2413008) - No such process 00:15:10.994 23:07:14 -- target/connect_stress.sh@38 -- # wait 2413008 00:15:10.994 23:07:14 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:15:10.994 23:07:14 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:15:10.994 23:07:14 -- target/connect_stress.sh@43 -- # nvmftestfini 00:15:10.994 23:07:14 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:10.994 23:07:14 -- nvmf/common.sh@116 -- # sync 00:15:10.994 23:07:14 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:10.994 23:07:14 -- nvmf/common.sh@119 -- # set +e 00:15:10.994 23:07:14 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:10.994 23:07:14 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:10.994 rmmod nvme_tcp 00:15:11.253 rmmod nvme_fabrics 00:15:11.253 rmmod nvme_keyring 00:15:11.253 23:07:14 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:11.253 23:07:14 -- nvmf/common.sh@123 -- # set -e 00:15:11.253 23:07:14 -- nvmf/common.sh@124 -- # return 0 00:15:11.253 23:07:14 -- nvmf/common.sh@477 -- # '[' -n 2412853 ']' 00:15:11.253 23:07:14 -- nvmf/common.sh@478 -- # killprocess 2412853 00:15:11.253 23:07:14 -- common/autotest_common.sh@936 -- # '[' -z 2412853 ']' 00:15:11.253 23:07:14 -- common/autotest_common.sh@940 -- # kill -0 2412853 00:15:11.253 23:07:14 -- common/autotest_common.sh@941 -- # uname 00:15:11.253 23:07:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:11.253 23:07:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2412853 00:15:11.253 23:07:14 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:11.253 23:07:14 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:11.253 23:07:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2412853' 00:15:11.253 killing process with pid 2412853 00:15:11.253 23:07:14 -- common/autotest_common.sh@955 -- # kill 2412853 00:15:11.253 23:07:14 -- common/autotest_common.sh@960 -- # wait 2412853 00:15:11.512 23:07:14 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:11.512 23:07:14 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:11.512 23:07:14 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:11.512 23:07:14 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:11.512 23:07:14 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:11.512 23:07:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:11.512 23:07:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:11.512 23:07:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:13.411 23:07:16 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:13.411 00:15:13.411 real 0m16.136s 00:15:13.411 user 0m40.899s 00:15:13.411 sys 0m5.879s 00:15:13.411 23:07:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:13.411 23:07:16 -- common/autotest_common.sh@10 -- # set +x 00:15:13.411 ************************************ 00:15:13.411 END TEST nvmf_connect_stress 00:15:13.411 ************************************ 00:15:13.411 23:07:16 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:15:13.411 23:07:16 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:13.411 23:07:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:13.411 23:07:16 -- common/autotest_common.sh@10 -- # set +x 00:15:13.411 ************************************ 00:15:13.411 START TEST nvmf_fused_ordering 00:15:13.411 ************************************ 00:15:13.411 23:07:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:15:13.670 * Looking for test storage... 00:15:13.670 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:13.670 23:07:17 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:13.670 23:07:17 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:13.670 23:07:17 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:13.670 23:07:17 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:13.670 23:07:17 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:13.670 23:07:17 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:13.670 23:07:17 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:13.670 23:07:17 -- scripts/common.sh@335 -- # IFS=.-: 00:15:13.670 23:07:17 -- scripts/common.sh@335 -- # read -ra ver1 00:15:13.670 23:07:17 -- scripts/common.sh@336 -- # IFS=.-: 00:15:13.670 23:07:17 -- scripts/common.sh@336 -- # read -ra ver2 00:15:13.670 23:07:17 -- scripts/common.sh@337 -- # local 'op=<' 00:15:13.670 23:07:17 -- scripts/common.sh@339 -- # ver1_l=2 00:15:13.670 23:07:17 -- scripts/common.sh@340 -- # ver2_l=1 00:15:13.670 23:07:17 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:13.670 23:07:17 -- scripts/common.sh@343 -- # case "$op" in 00:15:13.670 23:07:17 -- scripts/common.sh@344 -- # : 1 00:15:13.670 23:07:17 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:13.670 23:07:17 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:13.670 23:07:17 -- scripts/common.sh@364 -- # decimal 1 00:15:13.670 23:07:17 -- scripts/common.sh@352 -- # local d=1 00:15:13.670 23:07:17 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:13.670 23:07:17 -- scripts/common.sh@354 -- # echo 1 00:15:13.670 23:07:17 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:13.670 23:07:17 -- scripts/common.sh@365 -- # decimal 2 00:15:13.670 23:07:17 -- scripts/common.sh@352 -- # local d=2 00:15:13.671 23:07:17 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:13.671 23:07:17 -- scripts/common.sh@354 -- # echo 2 00:15:13.671 23:07:17 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:13.671 23:07:17 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:13.671 23:07:17 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:13.671 23:07:17 -- scripts/common.sh@367 -- # return 0 00:15:13.671 23:07:17 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:13.671 23:07:17 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:13.671 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:13.671 --rc genhtml_branch_coverage=1 00:15:13.671 --rc genhtml_function_coverage=1 00:15:13.671 --rc genhtml_legend=1 00:15:13.671 --rc geninfo_all_blocks=1 00:15:13.671 --rc geninfo_unexecuted_blocks=1 00:15:13.671 00:15:13.671 ' 00:15:13.671 23:07:17 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:13.671 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:13.671 --rc genhtml_branch_coverage=1 00:15:13.671 --rc genhtml_function_coverage=1 00:15:13.671 --rc genhtml_legend=1 00:15:13.671 --rc geninfo_all_blocks=1 00:15:13.671 --rc geninfo_unexecuted_blocks=1 00:15:13.671 00:15:13.671 ' 00:15:13.671 23:07:17 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:13.671 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:13.671 --rc genhtml_branch_coverage=1 00:15:13.671 --rc genhtml_function_coverage=1 00:15:13.671 --rc genhtml_legend=1 00:15:13.671 --rc geninfo_all_blocks=1 00:15:13.671 --rc geninfo_unexecuted_blocks=1 00:15:13.671 00:15:13.671 ' 00:15:13.671 23:07:17 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:13.671 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:13.671 --rc genhtml_branch_coverage=1 00:15:13.671 --rc genhtml_function_coverage=1 00:15:13.671 --rc genhtml_legend=1 00:15:13.671 --rc geninfo_all_blocks=1 00:15:13.671 --rc geninfo_unexecuted_blocks=1 00:15:13.671 00:15:13.671 ' 00:15:13.671 23:07:17 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:13.671 23:07:17 -- nvmf/common.sh@7 -- # uname -s 00:15:13.671 23:07:17 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:13.671 23:07:17 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:13.671 23:07:17 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:13.671 23:07:17 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:13.671 23:07:17 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:13.671 23:07:17 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:13.671 23:07:17 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:13.671 23:07:17 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:13.671 23:07:17 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:13.671 23:07:17 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:13.671 23:07:17 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:13.671 23:07:17 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:13.671 23:07:17 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:13.671 23:07:17 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:13.671 23:07:17 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:13.671 23:07:17 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:13.671 23:07:17 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:13.671 23:07:17 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:13.671 23:07:17 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:13.671 23:07:17 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:13.671 23:07:17 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:13.671 23:07:17 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:13.671 23:07:17 -- paths/export.sh@5 -- # export PATH 00:15:13.671 23:07:17 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:13.671 23:07:17 -- nvmf/common.sh@46 -- # : 0 00:15:13.671 23:07:17 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:13.671 23:07:17 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:13.671 23:07:17 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:13.671 23:07:17 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:13.671 23:07:17 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:13.671 23:07:17 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:13.671 23:07:17 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:13.671 23:07:17 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:13.671 23:07:17 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:15:13.671 23:07:17 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:13.671 23:07:17 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:13.671 23:07:17 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:13.671 23:07:17 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:13.671 23:07:17 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:13.671 23:07:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:13.671 23:07:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:13.671 23:07:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:13.671 23:07:17 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:13.671 23:07:17 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:13.671 23:07:17 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:13.671 23:07:17 -- common/autotest_common.sh@10 -- # set +x 00:15:15.572 23:07:19 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:15.572 23:07:19 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:15.572 23:07:19 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:15.572 23:07:19 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:15.572 23:07:19 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:15.572 23:07:19 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:15.572 23:07:19 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:15.572 23:07:19 -- nvmf/common.sh@294 -- # net_devs=() 00:15:15.572 23:07:19 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:15.572 23:07:19 -- nvmf/common.sh@295 -- # e810=() 00:15:15.572 23:07:19 -- nvmf/common.sh@295 -- # local -ga e810 00:15:15.572 23:07:19 -- nvmf/common.sh@296 -- # x722=() 00:15:15.572 23:07:19 -- nvmf/common.sh@296 -- # local -ga x722 00:15:15.572 23:07:19 -- nvmf/common.sh@297 -- # mlx=() 00:15:15.572 23:07:19 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:15.572 23:07:19 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:15.572 23:07:19 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:15.572 23:07:19 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:15.572 23:07:19 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:15.572 23:07:19 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:15.572 23:07:19 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:15.572 23:07:19 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:15.572 23:07:19 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:15.572 23:07:19 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:15.572 23:07:19 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:15.572 23:07:19 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:15.572 23:07:19 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:15.572 23:07:19 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:15.572 23:07:19 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:15.572 23:07:19 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:15.572 23:07:19 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:15.572 23:07:19 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:15.572 23:07:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:15.572 23:07:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:15.572 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:15.572 23:07:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:15.572 23:07:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:15.572 23:07:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:15.572 23:07:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:15.572 23:07:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:15.572 23:07:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:15.572 23:07:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:15.572 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:15.572 23:07:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:15.572 23:07:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:15.572 23:07:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:15.572 23:07:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:15.572 23:07:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:15.572 23:07:19 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:15.572 23:07:19 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:15.572 23:07:19 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:15.572 23:07:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:15.572 23:07:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:15.572 23:07:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:15.572 23:07:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:15.572 23:07:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:15.572 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:15.572 23:07:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:15.572 23:07:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:15.572 23:07:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:15.572 23:07:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:15.572 23:07:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:15.572 23:07:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:15.572 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:15.572 23:07:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:15.572 23:07:19 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:15.572 23:07:19 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:15.572 23:07:19 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:15.572 23:07:19 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:15.572 23:07:19 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:15.572 23:07:19 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:15.572 23:07:19 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:15.572 23:07:19 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:15.572 23:07:19 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:15.572 23:07:19 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:15.572 23:07:19 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:15.572 23:07:19 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:15.572 23:07:19 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:15.572 23:07:19 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:15.572 23:07:19 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:15.572 23:07:19 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:15.572 23:07:19 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:15.572 23:07:19 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:15.831 23:07:19 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:15.831 23:07:19 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:15.831 23:07:19 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:15.831 23:07:19 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:15.831 23:07:19 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:15.831 23:07:19 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:15.831 23:07:19 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:15.831 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:15.831 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.214 ms 00:15:15.831 00:15:15.831 --- 10.0.0.2 ping statistics --- 00:15:15.831 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:15.831 rtt min/avg/max/mdev = 0.214/0.214/0.214/0.000 ms 00:15:15.831 23:07:19 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:15.831 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:15.831 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.056 ms 00:15:15.831 00:15:15.831 --- 10.0.0.1 ping statistics --- 00:15:15.831 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:15.831 rtt min/avg/max/mdev = 0.056/0.056/0.056/0.000 ms 00:15:15.831 23:07:19 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:15.831 23:07:19 -- nvmf/common.sh@410 -- # return 0 00:15:15.831 23:07:19 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:15.831 23:07:19 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:15.831 23:07:19 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:15.831 23:07:19 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:15.831 23:07:19 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:15.831 23:07:19 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:15.831 23:07:19 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:15.831 23:07:19 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:15:15.831 23:07:19 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:15.831 23:07:19 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:15.831 23:07:19 -- common/autotest_common.sh@10 -- # set +x 00:15:15.831 23:07:19 -- nvmf/common.sh@469 -- # nvmfpid=2416211 00:15:15.831 23:07:19 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:15.831 23:07:19 -- nvmf/common.sh@470 -- # waitforlisten 2416211 00:15:15.831 23:07:19 -- common/autotest_common.sh@829 -- # '[' -z 2416211 ']' 00:15:15.831 23:07:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:15.831 23:07:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:15.831 23:07:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:15.831 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:15.831 23:07:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:15.831 23:07:19 -- common/autotest_common.sh@10 -- # set +x 00:15:16.089 [2024-11-28 23:07:19.436815] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:16.089 [2024-11-28 23:07:19.436889] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:16.089 EAL: No free 2048 kB hugepages reported on node 1 00:15:16.089 [2024-11-28 23:07:19.507631] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:16.089 [2024-11-28 23:07:19.598038] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:16.089 [2024-11-28 23:07:19.598206] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:16.089 [2024-11-28 23:07:19.598225] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:16.089 [2024-11-28 23:07:19.598249] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:16.089 [2024-11-28 23:07:19.598281] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:17.022 23:07:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:17.022 23:07:20 -- common/autotest_common.sh@862 -- # return 0 00:15:17.022 23:07:20 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:17.022 23:07:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:17.022 23:07:20 -- common/autotest_common.sh@10 -- # set +x 00:15:17.023 23:07:20 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:17.023 23:07:20 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:17.023 23:07:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:17.023 23:07:20 -- common/autotest_common.sh@10 -- # set +x 00:15:17.023 [2024-11-28 23:07:20.471932] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:17.023 23:07:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:17.023 23:07:20 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:17.023 23:07:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:17.023 23:07:20 -- common/autotest_common.sh@10 -- # set +x 00:15:17.023 23:07:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:17.023 23:07:20 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:17.023 23:07:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:17.023 23:07:20 -- common/autotest_common.sh@10 -- # set +x 00:15:17.023 [2024-11-28 23:07:20.488084] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:17.023 23:07:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:17.023 23:07:20 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:15:17.023 23:07:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:17.023 23:07:20 -- common/autotest_common.sh@10 -- # set +x 00:15:17.023 NULL1 00:15:17.023 23:07:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:17.023 23:07:20 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:15:17.023 23:07:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:17.023 23:07:20 -- common/autotest_common.sh@10 -- # set +x 00:15:17.023 23:07:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:17.023 23:07:20 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:15:17.023 23:07:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:17.023 23:07:20 -- common/autotest_common.sh@10 -- # set +x 00:15:17.023 23:07:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:17.023 23:07:20 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:15:17.023 [2024-11-28 23:07:20.532823] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:17.023 [2024-11-28 23:07:20.532865] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2416372 ] 00:15:17.023 EAL: No free 2048 kB hugepages reported on node 1 00:15:17.589 Attached to nqn.2016-06.io.spdk:cnode1 00:15:17.589 Namespace ID: 1 size: 1GB 00:15:17.589 fused_ordering(0) 00:15:17.589 fused_ordering(1) 00:15:17.589 fused_ordering(2) 00:15:17.589 fused_ordering(3) 00:15:17.589 fused_ordering(4) 00:15:17.590 fused_ordering(5) 00:15:17.590 fused_ordering(6) 00:15:17.590 fused_ordering(7) 00:15:17.590 fused_ordering(8) 00:15:17.590 fused_ordering(9) 00:15:17.590 fused_ordering(10) 00:15:17.590 fused_ordering(11) 00:15:17.590 fused_ordering(12) 00:15:17.590 fused_ordering(13) 00:15:17.590 fused_ordering(14) 00:15:17.590 fused_ordering(15) 00:15:17.590 fused_ordering(16) 00:15:17.590 fused_ordering(17) 00:15:17.590 fused_ordering(18) 00:15:17.590 fused_ordering(19) 00:15:17.590 fused_ordering(20) 00:15:17.590 fused_ordering(21) 00:15:17.590 fused_ordering(22) 00:15:17.590 fused_ordering(23) 00:15:17.590 fused_ordering(24) 00:15:17.590 fused_ordering(25) 00:15:17.590 fused_ordering(26) 00:15:17.590 fused_ordering(27) 00:15:17.590 fused_ordering(28) 00:15:17.590 fused_ordering(29) 00:15:17.590 fused_ordering(30) 00:15:17.590 fused_ordering(31) 00:15:17.590 fused_ordering(32) 00:15:17.590 fused_ordering(33) 00:15:17.590 fused_ordering(34) 00:15:17.590 fused_ordering(35) 00:15:17.590 fused_ordering(36) 00:15:17.590 fused_ordering(37) 00:15:17.590 fused_ordering(38) 00:15:17.590 fused_ordering(39) 00:15:17.590 fused_ordering(40) 00:15:17.590 fused_ordering(41) 00:15:17.590 fused_ordering(42) 00:15:17.590 fused_ordering(43) 00:15:17.590 fused_ordering(44) 00:15:17.590 fused_ordering(45) 00:15:17.590 fused_ordering(46) 00:15:17.590 fused_ordering(47) 00:15:17.590 fused_ordering(48) 00:15:17.590 fused_ordering(49) 00:15:17.590 fused_ordering(50) 00:15:17.590 fused_ordering(51) 00:15:17.590 fused_ordering(52) 00:15:17.590 fused_ordering(53) 00:15:17.590 fused_ordering(54) 00:15:17.590 fused_ordering(55) 00:15:17.590 fused_ordering(56) 00:15:17.590 fused_ordering(57) 00:15:17.590 fused_ordering(58) 00:15:17.590 fused_ordering(59) 00:15:17.590 fused_ordering(60) 00:15:17.590 fused_ordering(61) 00:15:17.590 fused_ordering(62) 00:15:17.590 fused_ordering(63) 00:15:17.590 fused_ordering(64) 00:15:17.590 fused_ordering(65) 00:15:17.590 fused_ordering(66) 00:15:17.590 fused_ordering(67) 00:15:17.590 fused_ordering(68) 00:15:17.590 fused_ordering(69) 00:15:17.590 fused_ordering(70) 00:15:17.590 fused_ordering(71) 00:15:17.590 fused_ordering(72) 00:15:17.590 fused_ordering(73) 00:15:17.590 fused_ordering(74) 00:15:17.590 fused_ordering(75) 00:15:17.590 fused_ordering(76) 00:15:17.590 fused_ordering(77) 00:15:17.590 fused_ordering(78) 00:15:17.590 fused_ordering(79) 00:15:17.590 fused_ordering(80) 00:15:17.590 fused_ordering(81) 00:15:17.590 fused_ordering(82) 00:15:17.590 fused_ordering(83) 00:15:17.590 fused_ordering(84) 00:15:17.590 fused_ordering(85) 00:15:17.590 fused_ordering(86) 00:15:17.590 fused_ordering(87) 00:15:17.590 fused_ordering(88) 00:15:17.590 fused_ordering(89) 00:15:17.590 fused_ordering(90) 00:15:17.590 fused_ordering(91) 00:15:17.590 fused_ordering(92) 00:15:17.590 fused_ordering(93) 00:15:17.590 fused_ordering(94) 00:15:17.590 fused_ordering(95) 00:15:17.590 fused_ordering(96) 00:15:17.590 fused_ordering(97) 00:15:17.590 fused_ordering(98) 00:15:17.590 fused_ordering(99) 00:15:17.590 fused_ordering(100) 00:15:17.590 fused_ordering(101) 00:15:17.590 fused_ordering(102) 00:15:17.590 fused_ordering(103) 00:15:17.590 fused_ordering(104) 00:15:17.590 fused_ordering(105) 00:15:17.590 fused_ordering(106) 00:15:17.590 fused_ordering(107) 00:15:17.590 fused_ordering(108) 00:15:17.590 fused_ordering(109) 00:15:17.590 fused_ordering(110) 00:15:17.590 fused_ordering(111) 00:15:17.590 fused_ordering(112) 00:15:17.590 fused_ordering(113) 00:15:17.590 fused_ordering(114) 00:15:17.590 fused_ordering(115) 00:15:17.590 fused_ordering(116) 00:15:17.590 fused_ordering(117) 00:15:17.590 fused_ordering(118) 00:15:17.590 fused_ordering(119) 00:15:17.590 fused_ordering(120) 00:15:17.590 fused_ordering(121) 00:15:17.590 fused_ordering(122) 00:15:17.590 fused_ordering(123) 00:15:17.590 fused_ordering(124) 00:15:17.590 fused_ordering(125) 00:15:17.590 fused_ordering(126) 00:15:17.590 fused_ordering(127) 00:15:17.590 fused_ordering(128) 00:15:17.590 fused_ordering(129) 00:15:17.590 fused_ordering(130) 00:15:17.590 fused_ordering(131) 00:15:17.590 fused_ordering(132) 00:15:17.590 fused_ordering(133) 00:15:17.590 fused_ordering(134) 00:15:17.590 fused_ordering(135) 00:15:17.590 fused_ordering(136) 00:15:17.590 fused_ordering(137) 00:15:17.590 fused_ordering(138) 00:15:17.590 fused_ordering(139) 00:15:17.590 fused_ordering(140) 00:15:17.590 fused_ordering(141) 00:15:17.590 fused_ordering(142) 00:15:17.590 fused_ordering(143) 00:15:17.590 fused_ordering(144) 00:15:17.590 fused_ordering(145) 00:15:17.590 fused_ordering(146) 00:15:17.590 fused_ordering(147) 00:15:17.590 fused_ordering(148) 00:15:17.590 fused_ordering(149) 00:15:17.590 fused_ordering(150) 00:15:17.590 fused_ordering(151) 00:15:17.590 fused_ordering(152) 00:15:17.590 fused_ordering(153) 00:15:17.590 fused_ordering(154) 00:15:17.590 fused_ordering(155) 00:15:17.590 fused_ordering(156) 00:15:17.590 fused_ordering(157) 00:15:17.590 fused_ordering(158) 00:15:17.590 fused_ordering(159) 00:15:17.590 fused_ordering(160) 00:15:17.590 fused_ordering(161) 00:15:17.590 fused_ordering(162) 00:15:17.590 fused_ordering(163) 00:15:17.590 fused_ordering(164) 00:15:17.590 fused_ordering(165) 00:15:17.590 fused_ordering(166) 00:15:17.590 fused_ordering(167) 00:15:17.590 fused_ordering(168) 00:15:17.590 fused_ordering(169) 00:15:17.590 fused_ordering(170) 00:15:17.590 fused_ordering(171) 00:15:17.590 fused_ordering(172) 00:15:17.590 fused_ordering(173) 00:15:17.590 fused_ordering(174) 00:15:17.590 fused_ordering(175) 00:15:17.590 fused_ordering(176) 00:15:17.590 fused_ordering(177) 00:15:17.590 fused_ordering(178) 00:15:17.590 fused_ordering(179) 00:15:17.590 fused_ordering(180) 00:15:17.590 fused_ordering(181) 00:15:17.590 fused_ordering(182) 00:15:17.590 fused_ordering(183) 00:15:17.590 fused_ordering(184) 00:15:17.590 fused_ordering(185) 00:15:17.590 fused_ordering(186) 00:15:17.590 fused_ordering(187) 00:15:17.590 fused_ordering(188) 00:15:17.590 fused_ordering(189) 00:15:17.590 fused_ordering(190) 00:15:17.590 fused_ordering(191) 00:15:17.590 fused_ordering(192) 00:15:17.590 fused_ordering(193) 00:15:17.590 fused_ordering(194) 00:15:17.590 fused_ordering(195) 00:15:17.590 fused_ordering(196) 00:15:17.590 fused_ordering(197) 00:15:17.590 fused_ordering(198) 00:15:17.590 fused_ordering(199) 00:15:17.590 fused_ordering(200) 00:15:17.590 fused_ordering(201) 00:15:17.590 fused_ordering(202) 00:15:17.590 fused_ordering(203) 00:15:17.590 fused_ordering(204) 00:15:17.590 fused_ordering(205) 00:15:17.849 fused_ordering(206) 00:15:17.849 fused_ordering(207) 00:15:17.849 fused_ordering(208) 00:15:17.849 fused_ordering(209) 00:15:17.849 fused_ordering(210) 00:15:17.849 fused_ordering(211) 00:15:17.849 fused_ordering(212) 00:15:17.849 fused_ordering(213) 00:15:17.849 fused_ordering(214) 00:15:17.849 fused_ordering(215) 00:15:17.849 fused_ordering(216) 00:15:17.849 fused_ordering(217) 00:15:17.849 fused_ordering(218) 00:15:17.849 fused_ordering(219) 00:15:17.849 fused_ordering(220) 00:15:17.849 fused_ordering(221) 00:15:17.849 fused_ordering(222) 00:15:17.849 fused_ordering(223) 00:15:17.849 fused_ordering(224) 00:15:17.849 fused_ordering(225) 00:15:17.849 fused_ordering(226) 00:15:17.849 fused_ordering(227) 00:15:17.849 fused_ordering(228) 00:15:17.849 fused_ordering(229) 00:15:17.849 fused_ordering(230) 00:15:17.849 fused_ordering(231) 00:15:17.849 fused_ordering(232) 00:15:17.849 fused_ordering(233) 00:15:17.849 fused_ordering(234) 00:15:17.849 fused_ordering(235) 00:15:17.849 fused_ordering(236) 00:15:17.849 fused_ordering(237) 00:15:17.849 fused_ordering(238) 00:15:17.849 fused_ordering(239) 00:15:17.849 fused_ordering(240) 00:15:17.849 fused_ordering(241) 00:15:17.849 fused_ordering(242) 00:15:17.849 fused_ordering(243) 00:15:17.849 fused_ordering(244) 00:15:17.849 fused_ordering(245) 00:15:17.849 fused_ordering(246) 00:15:17.850 fused_ordering(247) 00:15:17.850 fused_ordering(248) 00:15:17.850 fused_ordering(249) 00:15:17.850 fused_ordering(250) 00:15:17.850 fused_ordering(251) 00:15:17.850 fused_ordering(252) 00:15:17.850 fused_ordering(253) 00:15:17.850 fused_ordering(254) 00:15:17.850 fused_ordering(255) 00:15:17.850 fused_ordering(256) 00:15:17.850 fused_ordering(257) 00:15:17.850 fused_ordering(258) 00:15:17.850 fused_ordering(259) 00:15:17.850 fused_ordering(260) 00:15:17.850 fused_ordering(261) 00:15:17.850 fused_ordering(262) 00:15:17.850 fused_ordering(263) 00:15:17.850 fused_ordering(264) 00:15:17.850 fused_ordering(265) 00:15:17.850 fused_ordering(266) 00:15:17.850 fused_ordering(267) 00:15:17.850 fused_ordering(268) 00:15:17.850 fused_ordering(269) 00:15:17.850 fused_ordering(270) 00:15:17.850 fused_ordering(271) 00:15:17.850 fused_ordering(272) 00:15:17.850 fused_ordering(273) 00:15:17.850 fused_ordering(274) 00:15:17.850 fused_ordering(275) 00:15:17.850 fused_ordering(276) 00:15:17.850 fused_ordering(277) 00:15:17.850 fused_ordering(278) 00:15:17.850 fused_ordering(279) 00:15:17.850 fused_ordering(280) 00:15:17.850 fused_ordering(281) 00:15:17.850 fused_ordering(282) 00:15:17.850 fused_ordering(283) 00:15:17.850 fused_ordering(284) 00:15:17.850 fused_ordering(285) 00:15:17.850 fused_ordering(286) 00:15:17.850 fused_ordering(287) 00:15:17.850 fused_ordering(288) 00:15:17.850 fused_ordering(289) 00:15:17.850 fused_ordering(290) 00:15:17.850 fused_ordering(291) 00:15:17.850 fused_ordering(292) 00:15:17.850 fused_ordering(293) 00:15:17.850 fused_ordering(294) 00:15:17.850 fused_ordering(295) 00:15:17.850 fused_ordering(296) 00:15:17.850 fused_ordering(297) 00:15:17.850 fused_ordering(298) 00:15:17.850 fused_ordering(299) 00:15:17.850 fused_ordering(300) 00:15:17.850 fused_ordering(301) 00:15:17.850 fused_ordering(302) 00:15:17.850 fused_ordering(303) 00:15:17.850 fused_ordering(304) 00:15:17.850 fused_ordering(305) 00:15:17.850 fused_ordering(306) 00:15:17.850 fused_ordering(307) 00:15:17.850 fused_ordering(308) 00:15:17.850 fused_ordering(309) 00:15:17.850 fused_ordering(310) 00:15:17.850 fused_ordering(311) 00:15:17.850 fused_ordering(312) 00:15:17.850 fused_ordering(313) 00:15:17.850 fused_ordering(314) 00:15:17.850 fused_ordering(315) 00:15:17.850 fused_ordering(316) 00:15:17.850 fused_ordering(317) 00:15:17.850 fused_ordering(318) 00:15:17.850 fused_ordering(319) 00:15:17.850 fused_ordering(320) 00:15:17.850 fused_ordering(321) 00:15:17.850 fused_ordering(322) 00:15:17.850 fused_ordering(323) 00:15:17.850 fused_ordering(324) 00:15:17.850 fused_ordering(325) 00:15:17.850 fused_ordering(326) 00:15:17.850 fused_ordering(327) 00:15:17.850 fused_ordering(328) 00:15:17.850 fused_ordering(329) 00:15:17.850 fused_ordering(330) 00:15:17.850 fused_ordering(331) 00:15:17.850 fused_ordering(332) 00:15:17.850 fused_ordering(333) 00:15:17.850 fused_ordering(334) 00:15:17.850 fused_ordering(335) 00:15:17.850 fused_ordering(336) 00:15:17.850 fused_ordering(337) 00:15:17.850 fused_ordering(338) 00:15:17.850 fused_ordering(339) 00:15:17.850 fused_ordering(340) 00:15:17.850 fused_ordering(341) 00:15:17.850 fused_ordering(342) 00:15:17.850 fused_ordering(343) 00:15:17.850 fused_ordering(344) 00:15:17.850 fused_ordering(345) 00:15:17.850 fused_ordering(346) 00:15:17.850 fused_ordering(347) 00:15:17.850 fused_ordering(348) 00:15:17.850 fused_ordering(349) 00:15:17.850 fused_ordering(350) 00:15:17.850 fused_ordering(351) 00:15:17.850 fused_ordering(352) 00:15:17.850 fused_ordering(353) 00:15:17.850 fused_ordering(354) 00:15:17.850 fused_ordering(355) 00:15:17.850 fused_ordering(356) 00:15:17.850 fused_ordering(357) 00:15:17.850 fused_ordering(358) 00:15:17.850 fused_ordering(359) 00:15:17.850 fused_ordering(360) 00:15:17.850 fused_ordering(361) 00:15:17.850 fused_ordering(362) 00:15:17.850 fused_ordering(363) 00:15:17.850 fused_ordering(364) 00:15:17.850 fused_ordering(365) 00:15:17.850 fused_ordering(366) 00:15:17.850 fused_ordering(367) 00:15:17.850 fused_ordering(368) 00:15:17.850 fused_ordering(369) 00:15:17.850 fused_ordering(370) 00:15:17.850 fused_ordering(371) 00:15:17.850 fused_ordering(372) 00:15:17.850 fused_ordering(373) 00:15:17.850 fused_ordering(374) 00:15:17.850 fused_ordering(375) 00:15:17.850 fused_ordering(376) 00:15:17.850 fused_ordering(377) 00:15:17.850 fused_ordering(378) 00:15:17.850 fused_ordering(379) 00:15:17.850 fused_ordering(380) 00:15:17.850 fused_ordering(381) 00:15:17.850 fused_ordering(382) 00:15:17.850 fused_ordering(383) 00:15:17.850 fused_ordering(384) 00:15:17.850 fused_ordering(385) 00:15:17.850 fused_ordering(386) 00:15:17.850 fused_ordering(387) 00:15:17.850 fused_ordering(388) 00:15:17.850 fused_ordering(389) 00:15:17.850 fused_ordering(390) 00:15:17.850 fused_ordering(391) 00:15:17.850 fused_ordering(392) 00:15:17.850 fused_ordering(393) 00:15:17.850 fused_ordering(394) 00:15:17.850 fused_ordering(395) 00:15:17.850 fused_ordering(396) 00:15:17.850 fused_ordering(397) 00:15:17.850 fused_ordering(398) 00:15:17.850 fused_ordering(399) 00:15:17.850 fused_ordering(400) 00:15:17.850 fused_ordering(401) 00:15:17.850 fused_ordering(402) 00:15:17.850 fused_ordering(403) 00:15:17.850 fused_ordering(404) 00:15:17.850 fused_ordering(405) 00:15:17.850 fused_ordering(406) 00:15:17.850 fused_ordering(407) 00:15:17.850 fused_ordering(408) 00:15:17.850 fused_ordering(409) 00:15:17.850 fused_ordering(410) 00:15:18.418 fused_ordering(411) 00:15:18.418 fused_ordering(412) 00:15:18.418 fused_ordering(413) 00:15:18.418 fused_ordering(414) 00:15:18.418 fused_ordering(415) 00:15:18.418 fused_ordering(416) 00:15:18.418 fused_ordering(417) 00:15:18.418 fused_ordering(418) 00:15:18.418 fused_ordering(419) 00:15:18.418 fused_ordering(420) 00:15:18.418 fused_ordering(421) 00:15:18.418 fused_ordering(422) 00:15:18.418 fused_ordering(423) 00:15:18.418 fused_ordering(424) 00:15:18.418 fused_ordering(425) 00:15:18.418 fused_ordering(426) 00:15:18.418 fused_ordering(427) 00:15:18.418 fused_ordering(428) 00:15:18.418 fused_ordering(429) 00:15:18.418 fused_ordering(430) 00:15:18.418 fused_ordering(431) 00:15:18.418 fused_ordering(432) 00:15:18.418 fused_ordering(433) 00:15:18.418 fused_ordering(434) 00:15:18.418 fused_ordering(435) 00:15:18.418 fused_ordering(436) 00:15:18.418 fused_ordering(437) 00:15:18.418 fused_ordering(438) 00:15:18.418 fused_ordering(439) 00:15:18.418 fused_ordering(440) 00:15:18.418 fused_ordering(441) 00:15:18.418 fused_ordering(442) 00:15:18.418 fused_ordering(443) 00:15:18.418 fused_ordering(444) 00:15:18.418 fused_ordering(445) 00:15:18.418 fused_ordering(446) 00:15:18.418 fused_ordering(447) 00:15:18.418 fused_ordering(448) 00:15:18.418 fused_ordering(449) 00:15:18.418 fused_ordering(450) 00:15:18.418 fused_ordering(451) 00:15:18.418 fused_ordering(452) 00:15:18.418 fused_ordering(453) 00:15:18.418 fused_ordering(454) 00:15:18.418 fused_ordering(455) 00:15:18.418 fused_ordering(456) 00:15:18.418 fused_ordering(457) 00:15:18.418 fused_ordering(458) 00:15:18.418 fused_ordering(459) 00:15:18.418 fused_ordering(460) 00:15:18.418 fused_ordering(461) 00:15:18.418 fused_ordering(462) 00:15:18.418 fused_ordering(463) 00:15:18.418 fused_ordering(464) 00:15:18.418 fused_ordering(465) 00:15:18.418 fused_ordering(466) 00:15:18.418 fused_ordering(467) 00:15:18.418 fused_ordering(468) 00:15:18.418 fused_ordering(469) 00:15:18.418 fused_ordering(470) 00:15:18.418 fused_ordering(471) 00:15:18.418 fused_ordering(472) 00:15:18.418 fused_ordering(473) 00:15:18.418 fused_ordering(474) 00:15:18.418 fused_ordering(475) 00:15:18.418 fused_ordering(476) 00:15:18.418 fused_ordering(477) 00:15:18.418 fused_ordering(478) 00:15:18.418 fused_ordering(479) 00:15:18.418 fused_ordering(480) 00:15:18.418 fused_ordering(481) 00:15:18.418 fused_ordering(482) 00:15:18.418 fused_ordering(483) 00:15:18.418 fused_ordering(484) 00:15:18.418 fused_ordering(485) 00:15:18.418 fused_ordering(486) 00:15:18.418 fused_ordering(487) 00:15:18.418 fused_ordering(488) 00:15:18.418 fused_ordering(489) 00:15:18.418 fused_ordering(490) 00:15:18.418 fused_ordering(491) 00:15:18.418 fused_ordering(492) 00:15:18.418 fused_ordering(493) 00:15:18.418 fused_ordering(494) 00:15:18.418 fused_ordering(495) 00:15:18.418 fused_ordering(496) 00:15:18.418 fused_ordering(497) 00:15:18.418 fused_ordering(498) 00:15:18.418 fused_ordering(499) 00:15:18.418 fused_ordering(500) 00:15:18.418 fused_ordering(501) 00:15:18.418 fused_ordering(502) 00:15:18.418 fused_ordering(503) 00:15:18.418 fused_ordering(504) 00:15:18.418 fused_ordering(505) 00:15:18.418 fused_ordering(506) 00:15:18.418 fused_ordering(507) 00:15:18.418 fused_ordering(508) 00:15:18.418 fused_ordering(509) 00:15:18.418 fused_ordering(510) 00:15:18.418 fused_ordering(511) 00:15:18.418 fused_ordering(512) 00:15:18.418 fused_ordering(513) 00:15:18.418 fused_ordering(514) 00:15:18.418 fused_ordering(515) 00:15:18.418 fused_ordering(516) 00:15:18.418 fused_ordering(517) 00:15:18.418 fused_ordering(518) 00:15:18.418 fused_ordering(519) 00:15:18.418 fused_ordering(520) 00:15:18.418 fused_ordering(521) 00:15:18.418 fused_ordering(522) 00:15:18.418 fused_ordering(523) 00:15:18.418 fused_ordering(524) 00:15:18.418 fused_ordering(525) 00:15:18.418 fused_ordering(526) 00:15:18.418 fused_ordering(527) 00:15:18.418 fused_ordering(528) 00:15:18.418 fused_ordering(529) 00:15:18.418 fused_ordering(530) 00:15:18.418 fused_ordering(531) 00:15:18.418 fused_ordering(532) 00:15:18.418 fused_ordering(533) 00:15:18.418 fused_ordering(534) 00:15:18.418 fused_ordering(535) 00:15:18.418 fused_ordering(536) 00:15:18.418 fused_ordering(537) 00:15:18.418 fused_ordering(538) 00:15:18.418 fused_ordering(539) 00:15:18.418 fused_ordering(540) 00:15:18.418 fused_ordering(541) 00:15:18.418 fused_ordering(542) 00:15:18.418 fused_ordering(543) 00:15:18.418 fused_ordering(544) 00:15:18.418 fused_ordering(545) 00:15:18.418 fused_ordering(546) 00:15:18.418 fused_ordering(547) 00:15:18.418 fused_ordering(548) 00:15:18.418 fused_ordering(549) 00:15:18.418 fused_ordering(550) 00:15:18.418 fused_ordering(551) 00:15:18.418 fused_ordering(552) 00:15:18.418 fused_ordering(553) 00:15:18.418 fused_ordering(554) 00:15:18.418 fused_ordering(555) 00:15:18.418 fused_ordering(556) 00:15:18.418 fused_ordering(557) 00:15:18.418 fused_ordering(558) 00:15:18.418 fused_ordering(559) 00:15:18.418 fused_ordering(560) 00:15:18.418 fused_ordering(561) 00:15:18.418 fused_ordering(562) 00:15:18.418 fused_ordering(563) 00:15:18.418 fused_ordering(564) 00:15:18.418 fused_ordering(565) 00:15:18.418 fused_ordering(566) 00:15:18.418 fused_ordering(567) 00:15:18.418 fused_ordering(568) 00:15:18.418 fused_ordering(569) 00:15:18.418 fused_ordering(570) 00:15:18.418 fused_ordering(571) 00:15:18.418 fused_ordering(572) 00:15:18.418 fused_ordering(573) 00:15:18.418 fused_ordering(574) 00:15:18.418 fused_ordering(575) 00:15:18.418 fused_ordering(576) 00:15:18.418 fused_ordering(577) 00:15:18.418 fused_ordering(578) 00:15:18.418 fused_ordering(579) 00:15:18.418 fused_ordering(580) 00:15:18.418 fused_ordering(581) 00:15:18.418 fused_ordering(582) 00:15:18.418 fused_ordering(583) 00:15:18.418 fused_ordering(584) 00:15:18.418 fused_ordering(585) 00:15:18.418 fused_ordering(586) 00:15:18.418 fused_ordering(587) 00:15:18.418 fused_ordering(588) 00:15:18.418 fused_ordering(589) 00:15:18.418 fused_ordering(590) 00:15:18.418 fused_ordering(591) 00:15:18.418 fused_ordering(592) 00:15:18.418 fused_ordering(593) 00:15:18.418 fused_ordering(594) 00:15:18.418 fused_ordering(595) 00:15:18.419 fused_ordering(596) 00:15:18.419 fused_ordering(597) 00:15:18.419 fused_ordering(598) 00:15:18.419 fused_ordering(599) 00:15:18.419 fused_ordering(600) 00:15:18.419 fused_ordering(601) 00:15:18.419 fused_ordering(602) 00:15:18.419 fused_ordering(603) 00:15:18.419 fused_ordering(604) 00:15:18.419 fused_ordering(605) 00:15:18.419 fused_ordering(606) 00:15:18.419 fused_ordering(607) 00:15:18.419 fused_ordering(608) 00:15:18.419 fused_ordering(609) 00:15:18.419 fused_ordering(610) 00:15:18.419 fused_ordering(611) 00:15:18.419 fused_ordering(612) 00:15:18.419 fused_ordering(613) 00:15:18.419 fused_ordering(614) 00:15:18.419 fused_ordering(615) 00:15:18.985 fused_ordering(616) 00:15:18.985 fused_ordering(617) 00:15:18.985 fused_ordering(618) 00:15:18.985 fused_ordering(619) 00:15:18.985 fused_ordering(620) 00:15:18.985 fused_ordering(621) 00:15:18.985 fused_ordering(622) 00:15:18.985 fused_ordering(623) 00:15:18.985 fused_ordering(624) 00:15:18.985 fused_ordering(625) 00:15:18.985 fused_ordering(626) 00:15:18.985 fused_ordering(627) 00:15:18.985 fused_ordering(628) 00:15:18.985 fused_ordering(629) 00:15:18.985 fused_ordering(630) 00:15:18.985 fused_ordering(631) 00:15:18.985 fused_ordering(632) 00:15:18.985 fused_ordering(633) 00:15:18.985 fused_ordering(634) 00:15:18.985 fused_ordering(635) 00:15:18.985 fused_ordering(636) 00:15:18.985 fused_ordering(637) 00:15:18.985 fused_ordering(638) 00:15:18.985 fused_ordering(639) 00:15:18.985 fused_ordering(640) 00:15:18.985 fused_ordering(641) 00:15:18.985 fused_ordering(642) 00:15:18.985 fused_ordering(643) 00:15:18.985 fused_ordering(644) 00:15:18.985 fused_ordering(645) 00:15:18.985 fused_ordering(646) 00:15:18.985 fused_ordering(647) 00:15:18.985 fused_ordering(648) 00:15:18.985 fused_ordering(649) 00:15:18.985 fused_ordering(650) 00:15:18.985 fused_ordering(651) 00:15:18.985 fused_ordering(652) 00:15:18.985 fused_ordering(653) 00:15:18.985 fused_ordering(654) 00:15:18.985 fused_ordering(655) 00:15:18.985 fused_ordering(656) 00:15:18.985 fused_ordering(657) 00:15:18.985 fused_ordering(658) 00:15:18.985 fused_ordering(659) 00:15:18.985 fused_ordering(660) 00:15:18.985 fused_ordering(661) 00:15:18.985 fused_ordering(662) 00:15:18.985 fused_ordering(663) 00:15:18.985 fused_ordering(664) 00:15:18.985 fused_ordering(665) 00:15:18.985 fused_ordering(666) 00:15:18.985 fused_ordering(667) 00:15:18.985 fused_ordering(668) 00:15:18.985 fused_ordering(669) 00:15:18.985 fused_ordering(670) 00:15:18.985 fused_ordering(671) 00:15:18.985 fused_ordering(672) 00:15:18.985 fused_ordering(673) 00:15:18.985 fused_ordering(674) 00:15:18.985 fused_ordering(675) 00:15:18.985 fused_ordering(676) 00:15:18.985 fused_ordering(677) 00:15:18.985 fused_ordering(678) 00:15:18.985 fused_ordering(679) 00:15:18.985 fused_ordering(680) 00:15:18.985 fused_ordering(681) 00:15:18.985 fused_ordering(682) 00:15:18.985 fused_ordering(683) 00:15:18.985 fused_ordering(684) 00:15:18.985 fused_ordering(685) 00:15:18.985 fused_ordering(686) 00:15:18.985 fused_ordering(687) 00:15:18.985 fused_ordering(688) 00:15:18.985 fused_ordering(689) 00:15:18.985 fused_ordering(690) 00:15:18.985 fused_ordering(691) 00:15:18.985 fused_ordering(692) 00:15:18.985 fused_ordering(693) 00:15:18.985 fused_ordering(694) 00:15:18.985 fused_ordering(695) 00:15:18.985 fused_ordering(696) 00:15:18.985 fused_ordering(697) 00:15:18.985 fused_ordering(698) 00:15:18.985 fused_ordering(699) 00:15:18.985 fused_ordering(700) 00:15:18.985 fused_ordering(701) 00:15:18.985 fused_ordering(702) 00:15:18.985 fused_ordering(703) 00:15:18.985 fused_ordering(704) 00:15:18.985 fused_ordering(705) 00:15:18.985 fused_ordering(706) 00:15:18.985 fused_ordering(707) 00:15:18.985 fused_ordering(708) 00:15:18.985 fused_ordering(709) 00:15:18.985 fused_ordering(710) 00:15:18.985 fused_ordering(711) 00:15:18.985 fused_ordering(712) 00:15:18.985 fused_ordering(713) 00:15:18.985 fused_ordering(714) 00:15:18.985 fused_ordering(715) 00:15:18.985 fused_ordering(716) 00:15:18.985 fused_ordering(717) 00:15:18.985 fused_ordering(718) 00:15:18.985 fused_ordering(719) 00:15:18.985 fused_ordering(720) 00:15:18.985 fused_ordering(721) 00:15:18.985 fused_ordering(722) 00:15:18.985 fused_ordering(723) 00:15:18.985 fused_ordering(724) 00:15:18.985 fused_ordering(725) 00:15:18.985 fused_ordering(726) 00:15:18.985 fused_ordering(727) 00:15:18.985 fused_ordering(728) 00:15:18.985 fused_ordering(729) 00:15:18.985 fused_ordering(730) 00:15:18.985 fused_ordering(731) 00:15:18.985 fused_ordering(732) 00:15:18.985 fused_ordering(733) 00:15:18.985 fused_ordering(734) 00:15:18.985 fused_ordering(735) 00:15:18.985 fused_ordering(736) 00:15:18.985 fused_ordering(737) 00:15:18.985 fused_ordering(738) 00:15:18.985 fused_ordering(739) 00:15:18.985 fused_ordering(740) 00:15:18.985 fused_ordering(741) 00:15:18.985 fused_ordering(742) 00:15:18.985 fused_ordering(743) 00:15:18.985 fused_ordering(744) 00:15:18.986 fused_ordering(745) 00:15:18.986 fused_ordering(746) 00:15:18.986 fused_ordering(747) 00:15:18.986 fused_ordering(748) 00:15:18.986 fused_ordering(749) 00:15:18.986 fused_ordering(750) 00:15:18.986 fused_ordering(751) 00:15:18.986 fused_ordering(752) 00:15:18.986 fused_ordering(753) 00:15:18.986 fused_ordering(754) 00:15:18.986 fused_ordering(755) 00:15:18.986 fused_ordering(756) 00:15:18.986 fused_ordering(757) 00:15:18.986 fused_ordering(758) 00:15:18.986 fused_ordering(759) 00:15:18.986 fused_ordering(760) 00:15:18.986 fused_ordering(761) 00:15:18.986 fused_ordering(762) 00:15:18.986 fused_ordering(763) 00:15:18.986 fused_ordering(764) 00:15:18.986 fused_ordering(765) 00:15:18.986 fused_ordering(766) 00:15:18.986 fused_ordering(767) 00:15:18.986 fused_ordering(768) 00:15:18.986 fused_ordering(769) 00:15:18.986 fused_ordering(770) 00:15:18.986 fused_ordering(771) 00:15:18.986 fused_ordering(772) 00:15:18.986 fused_ordering(773) 00:15:18.986 fused_ordering(774) 00:15:18.986 fused_ordering(775) 00:15:18.986 fused_ordering(776) 00:15:18.986 fused_ordering(777) 00:15:18.986 fused_ordering(778) 00:15:18.986 fused_ordering(779) 00:15:18.986 fused_ordering(780) 00:15:18.986 fused_ordering(781) 00:15:18.986 fused_ordering(782) 00:15:18.986 fused_ordering(783) 00:15:18.986 fused_ordering(784) 00:15:18.986 fused_ordering(785) 00:15:18.986 fused_ordering(786) 00:15:18.986 fused_ordering(787) 00:15:18.986 fused_ordering(788) 00:15:18.986 fused_ordering(789) 00:15:18.986 fused_ordering(790) 00:15:18.986 fused_ordering(791) 00:15:18.986 fused_ordering(792) 00:15:18.986 fused_ordering(793) 00:15:18.986 fused_ordering(794) 00:15:18.986 fused_ordering(795) 00:15:18.986 fused_ordering(796) 00:15:18.986 fused_ordering(797) 00:15:18.986 fused_ordering(798) 00:15:18.986 fused_ordering(799) 00:15:18.986 fused_ordering(800) 00:15:18.986 fused_ordering(801) 00:15:18.986 fused_ordering(802) 00:15:18.986 fused_ordering(803) 00:15:18.986 fused_ordering(804) 00:15:18.986 fused_ordering(805) 00:15:18.986 fused_ordering(806) 00:15:18.986 fused_ordering(807) 00:15:18.986 fused_ordering(808) 00:15:18.986 fused_ordering(809) 00:15:18.986 fused_ordering(810) 00:15:18.986 fused_ordering(811) 00:15:18.986 fused_ordering(812) 00:15:18.986 fused_ordering(813) 00:15:18.986 fused_ordering(814) 00:15:18.986 fused_ordering(815) 00:15:18.986 fused_ordering(816) 00:15:18.986 fused_ordering(817) 00:15:18.986 fused_ordering(818) 00:15:18.986 fused_ordering(819) 00:15:18.986 fused_ordering(820) 00:15:19.553 fused_ordering(821) 00:15:19.553 fused_ordering(822) 00:15:19.553 fused_ordering(823) 00:15:19.553 fused_ordering(824) 00:15:19.553 fused_ordering(825) 00:15:19.553 fused_ordering(826) 00:15:19.553 fused_ordering(827) 00:15:19.553 fused_ordering(828) 00:15:19.553 fused_ordering(829) 00:15:19.553 fused_ordering(830) 00:15:19.553 fused_ordering(831) 00:15:19.553 fused_ordering(832) 00:15:19.553 fused_ordering(833) 00:15:19.553 fused_ordering(834) 00:15:19.553 fused_ordering(835) 00:15:19.553 fused_ordering(836) 00:15:19.553 fused_ordering(837) 00:15:19.553 fused_ordering(838) 00:15:19.553 fused_ordering(839) 00:15:19.553 fused_ordering(840) 00:15:19.553 fused_ordering(841) 00:15:19.553 fused_ordering(842) 00:15:19.553 fused_ordering(843) 00:15:19.553 fused_ordering(844) 00:15:19.553 fused_ordering(845) 00:15:19.553 fused_ordering(846) 00:15:19.553 fused_ordering(847) 00:15:19.553 fused_ordering(848) 00:15:19.553 fused_ordering(849) 00:15:19.553 fused_ordering(850) 00:15:19.554 fused_ordering(851) 00:15:19.554 fused_ordering(852) 00:15:19.554 fused_ordering(853) 00:15:19.554 fused_ordering(854) 00:15:19.554 fused_ordering(855) 00:15:19.554 fused_ordering(856) 00:15:19.554 fused_ordering(857) 00:15:19.554 fused_ordering(858) 00:15:19.554 fused_ordering(859) 00:15:19.554 fused_ordering(860) 00:15:19.554 fused_ordering(861) 00:15:19.554 fused_ordering(862) 00:15:19.554 fused_ordering(863) 00:15:19.554 fused_ordering(864) 00:15:19.554 fused_ordering(865) 00:15:19.554 fused_ordering(866) 00:15:19.554 fused_ordering(867) 00:15:19.554 fused_ordering(868) 00:15:19.554 fused_ordering(869) 00:15:19.554 fused_ordering(870) 00:15:19.554 fused_ordering(871) 00:15:19.554 fused_ordering(872) 00:15:19.554 fused_ordering(873) 00:15:19.554 fused_ordering(874) 00:15:19.554 fused_ordering(875) 00:15:19.554 fused_ordering(876) 00:15:19.554 fused_ordering(877) 00:15:19.554 fused_ordering(878) 00:15:19.554 fused_ordering(879) 00:15:19.554 fused_ordering(880) 00:15:19.554 fused_ordering(881) 00:15:19.554 fused_ordering(882) 00:15:19.554 fused_ordering(883) 00:15:19.554 fused_ordering(884) 00:15:19.554 fused_ordering(885) 00:15:19.554 fused_ordering(886) 00:15:19.554 fused_ordering(887) 00:15:19.554 fused_ordering(888) 00:15:19.554 fused_ordering(889) 00:15:19.554 fused_ordering(890) 00:15:19.554 fused_ordering(891) 00:15:19.554 fused_ordering(892) 00:15:19.554 fused_ordering(893) 00:15:19.554 fused_ordering(894) 00:15:19.554 fused_ordering(895) 00:15:19.554 fused_ordering(896) 00:15:19.554 fused_ordering(897) 00:15:19.554 fused_ordering(898) 00:15:19.554 fused_ordering(899) 00:15:19.554 fused_ordering(900) 00:15:19.554 fused_ordering(901) 00:15:19.554 fused_ordering(902) 00:15:19.554 fused_ordering(903) 00:15:19.554 fused_ordering(904) 00:15:19.554 fused_ordering(905) 00:15:19.554 fused_ordering(906) 00:15:19.554 fused_ordering(907) 00:15:19.554 fused_ordering(908) 00:15:19.554 fused_ordering(909) 00:15:19.554 fused_ordering(910) 00:15:19.554 fused_ordering(911) 00:15:19.554 fused_ordering(912) 00:15:19.554 fused_ordering(913) 00:15:19.554 fused_ordering(914) 00:15:19.554 fused_ordering(915) 00:15:19.554 fused_ordering(916) 00:15:19.554 fused_ordering(917) 00:15:19.554 fused_ordering(918) 00:15:19.554 fused_ordering(919) 00:15:19.554 fused_ordering(920) 00:15:19.554 fused_ordering(921) 00:15:19.554 fused_ordering(922) 00:15:19.554 fused_ordering(923) 00:15:19.554 fused_ordering(924) 00:15:19.554 fused_ordering(925) 00:15:19.554 fused_ordering(926) 00:15:19.554 fused_ordering(927) 00:15:19.554 fused_ordering(928) 00:15:19.554 fused_ordering(929) 00:15:19.554 fused_ordering(930) 00:15:19.554 fused_ordering(931) 00:15:19.554 fused_ordering(932) 00:15:19.554 fused_ordering(933) 00:15:19.554 fused_ordering(934) 00:15:19.554 fused_ordering(935) 00:15:19.554 fused_ordering(936) 00:15:19.554 fused_ordering(937) 00:15:19.554 fused_ordering(938) 00:15:19.554 fused_ordering(939) 00:15:19.554 fused_ordering(940) 00:15:19.554 fused_ordering(941) 00:15:19.554 fused_ordering(942) 00:15:19.554 fused_ordering(943) 00:15:19.554 fused_ordering(944) 00:15:19.554 fused_ordering(945) 00:15:19.554 fused_ordering(946) 00:15:19.554 fused_ordering(947) 00:15:19.554 fused_ordering(948) 00:15:19.554 fused_ordering(949) 00:15:19.554 fused_ordering(950) 00:15:19.554 fused_ordering(951) 00:15:19.554 fused_ordering(952) 00:15:19.554 fused_ordering(953) 00:15:19.554 fused_ordering(954) 00:15:19.554 fused_ordering(955) 00:15:19.554 fused_ordering(956) 00:15:19.554 fused_ordering(957) 00:15:19.554 fused_ordering(958) 00:15:19.554 fused_ordering(959) 00:15:19.554 fused_ordering(960) 00:15:19.554 fused_ordering(961) 00:15:19.554 fused_ordering(962) 00:15:19.554 fused_ordering(963) 00:15:19.554 fused_ordering(964) 00:15:19.554 fused_ordering(965) 00:15:19.554 fused_ordering(966) 00:15:19.554 fused_ordering(967) 00:15:19.554 fused_ordering(968) 00:15:19.554 fused_ordering(969) 00:15:19.554 fused_ordering(970) 00:15:19.554 fused_ordering(971) 00:15:19.554 fused_ordering(972) 00:15:19.554 fused_ordering(973) 00:15:19.554 fused_ordering(974) 00:15:19.554 fused_ordering(975) 00:15:19.554 fused_ordering(976) 00:15:19.554 fused_ordering(977) 00:15:19.554 fused_ordering(978) 00:15:19.554 fused_ordering(979) 00:15:19.554 fused_ordering(980) 00:15:19.554 fused_ordering(981) 00:15:19.554 fused_ordering(982) 00:15:19.554 fused_ordering(983) 00:15:19.554 fused_ordering(984) 00:15:19.554 fused_ordering(985) 00:15:19.554 fused_ordering(986) 00:15:19.554 fused_ordering(987) 00:15:19.554 fused_ordering(988) 00:15:19.554 fused_ordering(989) 00:15:19.554 fused_ordering(990) 00:15:19.554 fused_ordering(991) 00:15:19.554 fused_ordering(992) 00:15:19.554 fused_ordering(993) 00:15:19.554 fused_ordering(994) 00:15:19.554 fused_ordering(995) 00:15:19.554 fused_ordering(996) 00:15:19.554 fused_ordering(997) 00:15:19.554 fused_ordering(998) 00:15:19.554 fused_ordering(999) 00:15:19.554 fused_ordering(1000) 00:15:19.554 fused_ordering(1001) 00:15:19.554 fused_ordering(1002) 00:15:19.554 fused_ordering(1003) 00:15:19.554 fused_ordering(1004) 00:15:19.554 fused_ordering(1005) 00:15:19.554 fused_ordering(1006) 00:15:19.554 fused_ordering(1007) 00:15:19.554 fused_ordering(1008) 00:15:19.554 fused_ordering(1009) 00:15:19.554 fused_ordering(1010) 00:15:19.554 fused_ordering(1011) 00:15:19.554 fused_ordering(1012) 00:15:19.554 fused_ordering(1013) 00:15:19.554 fused_ordering(1014) 00:15:19.554 fused_ordering(1015) 00:15:19.554 fused_ordering(1016) 00:15:19.554 fused_ordering(1017) 00:15:19.554 fused_ordering(1018) 00:15:19.554 fused_ordering(1019) 00:15:19.554 fused_ordering(1020) 00:15:19.554 fused_ordering(1021) 00:15:19.554 fused_ordering(1022) 00:15:19.554 fused_ordering(1023) 00:15:19.554 23:07:22 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:15:19.554 23:07:22 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:15:19.554 23:07:23 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:19.554 23:07:23 -- nvmf/common.sh@116 -- # sync 00:15:19.554 23:07:23 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:19.554 23:07:23 -- nvmf/common.sh@119 -- # set +e 00:15:19.554 23:07:23 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:19.554 23:07:23 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:19.554 rmmod nvme_tcp 00:15:19.554 rmmod nvme_fabrics 00:15:19.554 rmmod nvme_keyring 00:15:19.554 23:07:23 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:19.554 23:07:23 -- nvmf/common.sh@123 -- # set -e 00:15:19.554 23:07:23 -- nvmf/common.sh@124 -- # return 0 00:15:19.554 23:07:23 -- nvmf/common.sh@477 -- # '[' -n 2416211 ']' 00:15:19.554 23:07:23 -- nvmf/common.sh@478 -- # killprocess 2416211 00:15:19.554 23:07:23 -- common/autotest_common.sh@936 -- # '[' -z 2416211 ']' 00:15:19.554 23:07:23 -- common/autotest_common.sh@940 -- # kill -0 2416211 00:15:19.554 23:07:23 -- common/autotest_common.sh@941 -- # uname 00:15:19.554 23:07:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:19.554 23:07:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2416211 00:15:19.554 23:07:23 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:19.554 23:07:23 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:19.554 23:07:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2416211' 00:15:19.554 killing process with pid 2416211 00:15:19.554 23:07:23 -- common/autotest_common.sh@955 -- # kill 2416211 00:15:19.554 23:07:23 -- common/autotest_common.sh@960 -- # wait 2416211 00:15:19.888 23:07:23 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:19.889 23:07:23 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:19.889 23:07:23 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:19.889 23:07:23 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:19.889 23:07:23 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:19.889 23:07:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:19.889 23:07:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:19.889 23:07:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:21.822 23:07:25 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:21.822 00:15:21.822 real 0m8.383s 00:15:21.822 user 0m6.191s 00:15:21.822 sys 0m3.180s 00:15:21.822 23:07:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:21.822 23:07:25 -- common/autotest_common.sh@10 -- # set +x 00:15:21.822 ************************************ 00:15:21.822 END TEST nvmf_fused_ordering 00:15:21.822 ************************************ 00:15:21.822 23:07:25 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:15:21.822 23:07:25 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:21.822 23:07:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:21.822 23:07:25 -- common/autotest_common.sh@10 -- # set +x 00:15:21.822 ************************************ 00:15:21.822 START TEST nvmf_delete_subsystem 00:15:21.822 ************************************ 00:15:21.822 23:07:25 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:15:22.081 * Looking for test storage... 00:15:22.081 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:22.081 23:07:25 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:22.081 23:07:25 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:22.081 23:07:25 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:22.081 23:07:25 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:22.081 23:07:25 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:22.081 23:07:25 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:22.081 23:07:25 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:22.081 23:07:25 -- scripts/common.sh@335 -- # IFS=.-: 00:15:22.081 23:07:25 -- scripts/common.sh@335 -- # read -ra ver1 00:15:22.081 23:07:25 -- scripts/common.sh@336 -- # IFS=.-: 00:15:22.081 23:07:25 -- scripts/common.sh@336 -- # read -ra ver2 00:15:22.081 23:07:25 -- scripts/common.sh@337 -- # local 'op=<' 00:15:22.081 23:07:25 -- scripts/common.sh@339 -- # ver1_l=2 00:15:22.081 23:07:25 -- scripts/common.sh@340 -- # ver2_l=1 00:15:22.081 23:07:25 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:22.081 23:07:25 -- scripts/common.sh@343 -- # case "$op" in 00:15:22.081 23:07:25 -- scripts/common.sh@344 -- # : 1 00:15:22.081 23:07:25 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:22.081 23:07:25 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:22.081 23:07:25 -- scripts/common.sh@364 -- # decimal 1 00:15:22.081 23:07:25 -- scripts/common.sh@352 -- # local d=1 00:15:22.081 23:07:25 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:22.081 23:07:25 -- scripts/common.sh@354 -- # echo 1 00:15:22.081 23:07:25 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:22.081 23:07:25 -- scripts/common.sh@365 -- # decimal 2 00:15:22.081 23:07:25 -- scripts/common.sh@352 -- # local d=2 00:15:22.081 23:07:25 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:22.081 23:07:25 -- scripts/common.sh@354 -- # echo 2 00:15:22.081 23:07:25 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:22.081 23:07:25 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:22.081 23:07:25 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:22.081 23:07:25 -- scripts/common.sh@367 -- # return 0 00:15:22.081 23:07:25 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:22.081 23:07:25 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:22.081 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:22.081 --rc genhtml_branch_coverage=1 00:15:22.081 --rc genhtml_function_coverage=1 00:15:22.081 --rc genhtml_legend=1 00:15:22.081 --rc geninfo_all_blocks=1 00:15:22.081 --rc geninfo_unexecuted_blocks=1 00:15:22.081 00:15:22.081 ' 00:15:22.081 23:07:25 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:22.081 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:22.081 --rc genhtml_branch_coverage=1 00:15:22.081 --rc genhtml_function_coverage=1 00:15:22.081 --rc genhtml_legend=1 00:15:22.081 --rc geninfo_all_blocks=1 00:15:22.081 --rc geninfo_unexecuted_blocks=1 00:15:22.081 00:15:22.081 ' 00:15:22.081 23:07:25 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:22.081 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:22.081 --rc genhtml_branch_coverage=1 00:15:22.081 --rc genhtml_function_coverage=1 00:15:22.081 --rc genhtml_legend=1 00:15:22.081 --rc geninfo_all_blocks=1 00:15:22.081 --rc geninfo_unexecuted_blocks=1 00:15:22.081 00:15:22.081 ' 00:15:22.081 23:07:25 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:22.081 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:22.081 --rc genhtml_branch_coverage=1 00:15:22.081 --rc genhtml_function_coverage=1 00:15:22.081 --rc genhtml_legend=1 00:15:22.081 --rc geninfo_all_blocks=1 00:15:22.081 --rc geninfo_unexecuted_blocks=1 00:15:22.081 00:15:22.081 ' 00:15:22.081 23:07:25 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:22.081 23:07:25 -- nvmf/common.sh@7 -- # uname -s 00:15:22.081 23:07:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:22.081 23:07:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:22.081 23:07:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:22.081 23:07:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:22.081 23:07:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:22.081 23:07:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:22.081 23:07:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:22.081 23:07:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:22.081 23:07:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:22.081 23:07:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:22.081 23:07:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:22.081 23:07:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:22.081 23:07:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:22.081 23:07:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:22.081 23:07:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:22.081 23:07:25 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:22.081 23:07:25 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:22.081 23:07:25 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:22.081 23:07:25 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:22.081 23:07:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:22.081 23:07:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:22.081 23:07:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:22.081 23:07:25 -- paths/export.sh@5 -- # export PATH 00:15:22.081 23:07:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:22.081 23:07:25 -- nvmf/common.sh@46 -- # : 0 00:15:22.081 23:07:25 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:22.081 23:07:25 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:22.081 23:07:25 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:22.081 23:07:25 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:22.081 23:07:25 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:22.081 23:07:25 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:22.081 23:07:25 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:22.081 23:07:25 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:22.081 23:07:25 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:15:22.081 23:07:25 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:22.081 23:07:25 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:22.081 23:07:25 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:22.081 23:07:25 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:22.081 23:07:25 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:22.081 23:07:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:22.081 23:07:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:22.081 23:07:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:22.081 23:07:25 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:22.081 23:07:25 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:22.081 23:07:25 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:22.081 23:07:25 -- common/autotest_common.sh@10 -- # set +x 00:15:24.613 23:07:27 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:24.614 23:07:27 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:24.614 23:07:27 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:24.614 23:07:27 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:24.614 23:07:27 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:24.614 23:07:27 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:24.614 23:07:27 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:24.614 23:07:27 -- nvmf/common.sh@294 -- # net_devs=() 00:15:24.614 23:07:27 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:24.614 23:07:27 -- nvmf/common.sh@295 -- # e810=() 00:15:24.614 23:07:27 -- nvmf/common.sh@295 -- # local -ga e810 00:15:24.614 23:07:27 -- nvmf/common.sh@296 -- # x722=() 00:15:24.614 23:07:27 -- nvmf/common.sh@296 -- # local -ga x722 00:15:24.614 23:07:27 -- nvmf/common.sh@297 -- # mlx=() 00:15:24.614 23:07:27 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:24.614 23:07:27 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:24.614 23:07:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:24.614 23:07:27 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:24.614 23:07:27 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:24.614 23:07:27 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:24.614 23:07:27 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:24.614 23:07:27 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:24.614 23:07:27 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:24.614 23:07:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:24.614 23:07:27 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:24.614 23:07:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:24.614 23:07:27 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:24.614 23:07:27 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:24.614 23:07:27 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:24.614 23:07:27 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:24.614 23:07:27 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:24.614 23:07:27 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:24.614 23:07:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:24.614 23:07:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:24.614 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:24.614 23:07:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:24.614 23:07:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:24.614 23:07:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:24.614 23:07:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:24.614 23:07:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:24.614 23:07:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:24.614 23:07:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:24.614 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:24.614 23:07:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:24.614 23:07:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:24.614 23:07:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:24.614 23:07:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:24.614 23:07:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:24.614 23:07:27 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:24.614 23:07:27 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:24.614 23:07:27 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:24.614 23:07:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:24.614 23:07:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:24.614 23:07:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:24.614 23:07:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:24.614 23:07:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:24.614 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:24.614 23:07:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:24.614 23:07:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:24.614 23:07:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:24.614 23:07:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:24.614 23:07:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:24.614 23:07:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:24.614 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:24.614 23:07:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:24.614 23:07:27 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:24.614 23:07:27 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:24.614 23:07:27 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:24.614 23:07:27 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:24.614 23:07:27 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:24.614 23:07:27 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:24.614 23:07:27 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:24.614 23:07:27 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:24.614 23:07:27 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:24.614 23:07:27 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:24.614 23:07:27 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:24.614 23:07:27 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:24.614 23:07:27 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:24.614 23:07:27 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:24.614 23:07:27 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:24.614 23:07:27 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:24.614 23:07:27 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:24.614 23:07:27 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:24.614 23:07:27 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:24.614 23:07:27 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:24.614 23:07:27 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:24.614 23:07:27 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:24.614 23:07:27 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:24.614 23:07:27 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:24.614 23:07:27 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:24.614 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:24.614 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.307 ms 00:15:24.614 00:15:24.614 --- 10.0.0.2 ping statistics --- 00:15:24.614 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:24.614 rtt min/avg/max/mdev = 0.307/0.307/0.307/0.000 ms 00:15:24.614 23:07:27 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:24.614 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:24.614 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.081 ms 00:15:24.614 00:15:24.614 --- 10.0.0.1 ping statistics --- 00:15:24.614 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:24.614 rtt min/avg/max/mdev = 0.081/0.081/0.081/0.000 ms 00:15:24.614 23:07:27 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:24.614 23:07:27 -- nvmf/common.sh@410 -- # return 0 00:15:24.614 23:07:27 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:24.614 23:07:27 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:24.614 23:07:27 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:24.614 23:07:27 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:24.614 23:07:27 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:24.614 23:07:27 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:24.614 23:07:27 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:24.614 23:07:27 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:15:24.614 23:07:27 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:24.614 23:07:27 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:24.614 23:07:27 -- common/autotest_common.sh@10 -- # set +x 00:15:24.614 23:07:27 -- nvmf/common.sh@469 -- # nvmfpid=2418725 00:15:24.614 23:07:27 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:15:24.614 23:07:27 -- nvmf/common.sh@470 -- # waitforlisten 2418725 00:15:24.615 23:07:27 -- common/autotest_common.sh@829 -- # '[' -z 2418725 ']' 00:15:24.615 23:07:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:24.615 23:07:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:24.615 23:07:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:24.615 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:24.615 23:07:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:24.615 23:07:27 -- common/autotest_common.sh@10 -- # set +x 00:15:24.615 [2024-11-28 23:07:27.861417] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:24.615 [2024-11-28 23:07:27.861516] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:24.615 EAL: No free 2048 kB hugepages reported on node 1 00:15:24.615 [2024-11-28 23:07:27.928285] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:15:24.615 [2024-11-28 23:07:28.015633] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:24.615 [2024-11-28 23:07:28.015791] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:24.615 [2024-11-28 23:07:28.015824] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:24.615 [2024-11-28 23:07:28.015838] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:24.615 [2024-11-28 23:07:28.015908] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:24.615 [2024-11-28 23:07:28.015909] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:25.549 23:07:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:25.549 23:07:28 -- common/autotest_common.sh@862 -- # return 0 00:15:25.549 23:07:28 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:25.549 23:07:28 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:25.549 23:07:28 -- common/autotest_common.sh@10 -- # set +x 00:15:25.549 23:07:28 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:25.549 23:07:28 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:25.549 23:07:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:25.550 23:07:28 -- common/autotest_common.sh@10 -- # set +x 00:15:25.550 [2024-11-28 23:07:28.894340] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:25.550 23:07:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:25.550 23:07:28 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:25.550 23:07:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:25.550 23:07:28 -- common/autotest_common.sh@10 -- # set +x 00:15:25.550 23:07:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:25.550 23:07:28 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:25.550 23:07:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:25.550 23:07:28 -- common/autotest_common.sh@10 -- # set +x 00:15:25.550 [2024-11-28 23:07:28.910621] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:25.550 23:07:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:25.550 23:07:28 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:15:25.550 23:07:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:25.550 23:07:28 -- common/autotest_common.sh@10 -- # set +x 00:15:25.550 NULL1 00:15:25.550 23:07:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:25.550 23:07:28 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:15:25.550 23:07:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:25.550 23:07:28 -- common/autotest_common.sh@10 -- # set +x 00:15:25.550 Delay0 00:15:25.550 23:07:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:25.550 23:07:28 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:25.550 23:07:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:25.550 23:07:28 -- common/autotest_common.sh@10 -- # set +x 00:15:25.550 23:07:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:25.550 23:07:28 -- target/delete_subsystem.sh@28 -- # perf_pid=2418882 00:15:25.550 23:07:28 -- target/delete_subsystem.sh@30 -- # sleep 2 00:15:25.550 23:07:28 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:15:25.550 EAL: No free 2048 kB hugepages reported on node 1 00:15:25.550 [2024-11-28 23:07:28.985195] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:15:27.446 23:07:30 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:27.446 23:07:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:27.446 23:07:30 -- common/autotest_common.sh@10 -- # set +x 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 starting I/O failed: -6 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 starting I/O failed: -6 00:15:27.704 Write completed with error (sct=0, sc=8) 00:15:27.704 Write completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 starting I/O failed: -6 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Write completed with error (sct=0, sc=8) 00:15:27.704 Write completed with error (sct=0, sc=8) 00:15:27.704 starting I/O failed: -6 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 starting I/O failed: -6 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Write completed with error (sct=0, sc=8) 00:15:27.704 starting I/O failed: -6 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 starting I/O failed: -6 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Write completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 starting I/O failed: -6 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Write completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 starting I/O failed: -6 00:15:27.704 Write completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Write completed with error (sct=0, sc=8) 00:15:27.704 Write completed with error (sct=0, sc=8) 00:15:27.704 starting I/O failed: -6 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Write completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 starting I/O failed: -6 00:15:27.704 Write completed with error (sct=0, sc=8) 00:15:27.704 Write completed with error (sct=0, sc=8) 00:15:27.704 [2024-11-28 23:07:31.105401] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe10690 is same with the state(5) to be set 00:15:27.704 Write completed with error (sct=0, sc=8) 00:15:27.704 starting I/O failed: -6 00:15:27.704 Write completed with error (sct=0, sc=8) 00:15:27.704 Write completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 starting I/O failed: -6 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 starting I/O failed: -6 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Write completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 starting I/O failed: -6 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 starting I/O failed: -6 00:15:27.704 Write completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Write completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 starting I/O failed: -6 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 starting I/O failed: -6 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Write completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 starting I/O failed: -6 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 starting I/O failed: -6 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 starting I/O failed: -6 00:15:27.704 Write completed with error (sct=0, sc=8) 00:15:27.704 Write completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Write completed with error (sct=0, sc=8) 00:15:27.704 starting I/O failed: -6 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Write completed with error (sct=0, sc=8) 00:15:27.704 [2024-11-28 23:07:31.106598] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7efcec000c00 is same with the state(5) to be set 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Write completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Write completed with error (sct=0, sc=8) 00:15:27.704 Write completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Write completed with error (sct=0, sc=8) 00:15:27.704 Write completed with error (sct=0, sc=8) 00:15:27.704 Write completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Write completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Write completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Write completed with error (sct=0, sc=8) 00:15:27.704 Write completed with error (sct=0, sc=8) 00:15:27.704 Write completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Write completed with error (sct=0, sc=8) 00:15:27.704 Read completed with error (sct=0, sc=8) 00:15:27.704 Write completed with error (sct=0, sc=8) 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:27.705 Write completed with error (sct=0, sc=8) 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:27.705 Write completed with error (sct=0, sc=8) 00:15:27.705 Write completed with error (sct=0, sc=8) 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:27.705 Write completed with error (sct=0, sc=8) 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:27.705 Write completed with error (sct=0, sc=8) 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:27.705 Write completed with error (sct=0, sc=8) 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:27.705 Write completed with error (sct=0, sc=8) 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:27.705 Write completed with error (sct=0, sc=8) 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:27.705 Write completed with error (sct=0, sc=8) 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:27.705 Write completed with error (sct=0, sc=8) 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:27.705 Write completed with error (sct=0, sc=8) 00:15:27.705 Write completed with error (sct=0, sc=8) 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:27.705 Write completed with error (sct=0, sc=8) 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:27.705 Write completed with error (sct=0, sc=8) 00:15:27.705 Write completed with error (sct=0, sc=8) 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:27.705 Write completed with error (sct=0, sc=8) 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:27.705 Write completed with error (sct=0, sc=8) 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:27.705 Write completed with error (sct=0, sc=8) 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:27.705 Write completed with error (sct=0, sc=8) 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:27.705 Write completed with error (sct=0, sc=8) 00:15:27.705 Write completed with error (sct=0, sc=8) 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:27.705 [2024-11-28 23:07:31.107175] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe11c90 is same with the state(5) to be set 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:27.705 Read completed with error (sct=0, sc=8) 00:15:28.636 [2024-11-28 23:07:32.084803] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe11a40 is same with the state(5) to be set 00:15:28.636 Write completed with error (sct=0, sc=8) 00:15:28.636 Read completed with error (sct=0, sc=8) 00:15:28.636 Write completed with error (sct=0, sc=8) 00:15:28.636 Write completed with error (sct=0, sc=8) 00:15:28.636 Write completed with error (sct=0, sc=8) 00:15:28.636 Write completed with error (sct=0, sc=8) 00:15:28.636 Read completed with error (sct=0, sc=8) 00:15:28.636 Read completed with error (sct=0, sc=8) 00:15:28.636 Write completed with error (sct=0, sc=8) 00:15:28.636 Write completed with error (sct=0, sc=8) 00:15:28.636 Read completed with error (sct=0, sc=8) 00:15:28.636 Read completed with error (sct=0, sc=8) 00:15:28.636 Write completed with error (sct=0, sc=8) 00:15:28.636 Write completed with error (sct=0, sc=8) 00:15:28.636 Read completed with error (sct=0, sc=8) 00:15:28.636 Read completed with error (sct=0, sc=8) 00:15:28.636 Write completed with error (sct=0, sc=8) 00:15:28.636 Write completed with error (sct=0, sc=8) 00:15:28.636 Read completed with error (sct=0, sc=8) 00:15:28.636 Read completed with error (sct=0, sc=8) 00:15:28.636 Read completed with error (sct=0, sc=8) 00:15:28.636 [2024-11-28 23:07:32.106200] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe11e10 is same with the state(5) to be set 00:15:28.636 Read completed with error (sct=0, sc=8) 00:15:28.636 Read completed with error (sct=0, sc=8) 00:15:28.636 Read completed with error (sct=0, sc=8) 00:15:28.636 Read completed with error (sct=0, sc=8) 00:15:28.636 Read completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Write completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Write completed with error (sct=0, sc=8) 00:15:28.637 Write completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Write completed with error (sct=0, sc=8) 00:15:28.637 Write completed with error (sct=0, sc=8) 00:15:28.637 Write completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Write completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Write completed with error (sct=0, sc=8) 00:15:28.637 Write completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Write completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 [2024-11-28 23:07:32.108321] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7efcec00bf20 is same with the state(5) to be set 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Write completed with error (sct=0, sc=8) 00:15:28.637 Write completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Write completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Write completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 [2024-11-28 23:07:32.108885] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7efcec00c480 is same with the state(5) to be set 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Write completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Write completed with error (sct=0, sc=8) 00:15:28.637 Write completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Write completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Write completed with error (sct=0, sc=8) 00:15:28.637 Write completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Write completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Write completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Write completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 Read completed with error (sct=0, sc=8) 00:15:28.637 [2024-11-28 23:07:32.109424] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe10810 is same with the state(5) to be set 00:15:28.637 [2024-11-28 23:07:32.110414] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe11a40 (9): Bad file descriptor 00:15:28.637 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:15:28.637 23:07:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:28.637 23:07:32 -- target/delete_subsystem.sh@34 -- # delay=0 00:15:28.637 23:07:32 -- target/delete_subsystem.sh@35 -- # kill -0 2418882 00:15:28.637 23:07:32 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:15:28.637 Initializing NVMe Controllers 00:15:28.637 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:15:28.637 Controller IO queue size 128, less than required. 00:15:28.637 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:15:28.637 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:15:28.637 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:15:28.637 Initialization complete. Launching workers. 00:15:28.637 ======================================================== 00:15:28.637 Latency(us) 00:15:28.637 Device Information : IOPS MiB/s Average min max 00:15:28.637 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 164.91 0.08 930068.77 1781.45 2004012.95 00:15:28.637 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 164.91 0.08 963337.42 632.23 2003273.78 00:15:28.637 ======================================================== 00:15:28.637 Total : 329.81 0.16 946703.09 632.23 2004012.95 00:15:28.637 00:15:29.200 23:07:32 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:15:29.200 23:07:32 -- target/delete_subsystem.sh@35 -- # kill -0 2418882 00:15:29.200 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (2418882) - No such process 00:15:29.200 23:07:32 -- target/delete_subsystem.sh@45 -- # NOT wait 2418882 00:15:29.200 23:07:32 -- common/autotest_common.sh@650 -- # local es=0 00:15:29.200 23:07:32 -- common/autotest_common.sh@652 -- # valid_exec_arg wait 2418882 00:15:29.200 23:07:32 -- common/autotest_common.sh@638 -- # local arg=wait 00:15:29.200 23:07:32 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:29.200 23:07:32 -- common/autotest_common.sh@642 -- # type -t wait 00:15:29.200 23:07:32 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:29.200 23:07:32 -- common/autotest_common.sh@653 -- # wait 2418882 00:15:29.200 23:07:32 -- common/autotest_common.sh@653 -- # es=1 00:15:29.200 23:07:32 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:29.200 23:07:32 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:29.200 23:07:32 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:29.200 23:07:32 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:29.200 23:07:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:29.200 23:07:32 -- common/autotest_common.sh@10 -- # set +x 00:15:29.200 23:07:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:29.200 23:07:32 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:29.200 23:07:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:29.200 23:07:32 -- common/autotest_common.sh@10 -- # set +x 00:15:29.200 [2024-11-28 23:07:32.630871] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:29.200 23:07:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:29.200 23:07:32 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:29.200 23:07:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:29.200 23:07:32 -- common/autotest_common.sh@10 -- # set +x 00:15:29.200 23:07:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:29.200 23:07:32 -- target/delete_subsystem.sh@54 -- # perf_pid=2419296 00:15:29.200 23:07:32 -- target/delete_subsystem.sh@56 -- # delay=0 00:15:29.200 23:07:32 -- target/delete_subsystem.sh@57 -- # kill -0 2419296 00:15:29.200 23:07:32 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:29.200 23:07:32 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:15:29.200 EAL: No free 2048 kB hugepages reported on node 1 00:15:29.200 [2024-11-28 23:07:32.687996] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:15:29.764 23:07:33 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:29.764 23:07:33 -- target/delete_subsystem.sh@57 -- # kill -0 2419296 00:15:29.764 23:07:33 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:30.329 23:07:33 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:30.329 23:07:33 -- target/delete_subsystem.sh@57 -- # kill -0 2419296 00:15:30.329 23:07:33 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:30.586 23:07:34 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:30.586 23:07:34 -- target/delete_subsystem.sh@57 -- # kill -0 2419296 00:15:30.586 23:07:34 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:31.151 23:07:34 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:31.151 23:07:34 -- target/delete_subsystem.sh@57 -- # kill -0 2419296 00:15:31.151 23:07:34 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:31.715 23:07:35 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:31.715 23:07:35 -- target/delete_subsystem.sh@57 -- # kill -0 2419296 00:15:31.715 23:07:35 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:32.279 23:07:35 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:32.279 23:07:35 -- target/delete_subsystem.sh@57 -- # kill -0 2419296 00:15:32.280 23:07:35 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:32.538 Initializing NVMe Controllers 00:15:32.538 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:15:32.538 Controller IO queue size 128, less than required. 00:15:32.538 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:15:32.538 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:15:32.538 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:15:32.538 Initialization complete. Launching workers. 00:15:32.538 ======================================================== 00:15:32.538 Latency(us) 00:15:32.538 Device Information : IOPS MiB/s Average min max 00:15:32.538 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1004604.92 1000186.74 1041631.81 00:15:32.538 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1004096.68 1000173.85 1042490.36 00:15:32.538 ======================================================== 00:15:32.538 Total : 256.00 0.12 1004350.80 1000173.85 1042490.36 00:15:32.538 00:15:32.796 23:07:36 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:32.796 23:07:36 -- target/delete_subsystem.sh@57 -- # kill -0 2419296 00:15:32.796 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (2419296) - No such process 00:15:32.796 23:07:36 -- target/delete_subsystem.sh@67 -- # wait 2419296 00:15:32.796 23:07:36 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:15:32.796 23:07:36 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:15:32.796 23:07:36 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:32.796 23:07:36 -- nvmf/common.sh@116 -- # sync 00:15:32.796 23:07:36 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:32.796 23:07:36 -- nvmf/common.sh@119 -- # set +e 00:15:32.796 23:07:36 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:32.796 23:07:36 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:32.796 rmmod nvme_tcp 00:15:32.796 rmmod nvme_fabrics 00:15:32.796 rmmod nvme_keyring 00:15:32.796 23:07:36 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:32.796 23:07:36 -- nvmf/common.sh@123 -- # set -e 00:15:32.796 23:07:36 -- nvmf/common.sh@124 -- # return 0 00:15:32.796 23:07:36 -- nvmf/common.sh@477 -- # '[' -n 2418725 ']' 00:15:32.796 23:07:36 -- nvmf/common.sh@478 -- # killprocess 2418725 00:15:32.796 23:07:36 -- common/autotest_common.sh@936 -- # '[' -z 2418725 ']' 00:15:32.796 23:07:36 -- common/autotest_common.sh@940 -- # kill -0 2418725 00:15:32.796 23:07:36 -- common/autotest_common.sh@941 -- # uname 00:15:32.796 23:07:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:32.796 23:07:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2418725 00:15:32.796 23:07:36 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:32.796 23:07:36 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:32.796 23:07:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2418725' 00:15:32.796 killing process with pid 2418725 00:15:32.796 23:07:36 -- common/autotest_common.sh@955 -- # kill 2418725 00:15:32.796 23:07:36 -- common/autotest_common.sh@960 -- # wait 2418725 00:15:33.055 23:07:36 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:33.055 23:07:36 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:33.055 23:07:36 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:33.055 23:07:36 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:33.055 23:07:36 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:33.055 23:07:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:33.055 23:07:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:33.055 23:07:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:34.957 23:07:38 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:34.957 00:15:34.957 real 0m13.156s 00:15:34.957 user 0m29.715s 00:15:34.957 sys 0m3.040s 00:15:34.957 23:07:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:34.957 23:07:38 -- common/autotest_common.sh@10 -- # set +x 00:15:34.957 ************************************ 00:15:34.957 END TEST nvmf_delete_subsystem 00:15:34.957 ************************************ 00:15:35.216 23:07:38 -- nvmf/nvmf.sh@36 -- # [[ 1 -eq 1 ]] 00:15:35.216 23:07:38 -- nvmf/nvmf.sh@37 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:15:35.216 23:07:38 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:35.216 23:07:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:35.216 23:07:38 -- common/autotest_common.sh@10 -- # set +x 00:15:35.216 ************************************ 00:15:35.216 START TEST nvmf_nvme_cli 00:15:35.216 ************************************ 00:15:35.216 23:07:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:15:35.216 * Looking for test storage... 00:15:35.216 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:35.216 23:07:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:35.216 23:07:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:35.216 23:07:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:35.216 23:07:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:35.216 23:07:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:35.216 23:07:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:35.216 23:07:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:35.216 23:07:38 -- scripts/common.sh@335 -- # IFS=.-: 00:15:35.216 23:07:38 -- scripts/common.sh@335 -- # read -ra ver1 00:15:35.216 23:07:38 -- scripts/common.sh@336 -- # IFS=.-: 00:15:35.216 23:07:38 -- scripts/common.sh@336 -- # read -ra ver2 00:15:35.216 23:07:38 -- scripts/common.sh@337 -- # local 'op=<' 00:15:35.216 23:07:38 -- scripts/common.sh@339 -- # ver1_l=2 00:15:35.216 23:07:38 -- scripts/common.sh@340 -- # ver2_l=1 00:15:35.216 23:07:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:35.216 23:07:38 -- scripts/common.sh@343 -- # case "$op" in 00:15:35.216 23:07:38 -- scripts/common.sh@344 -- # : 1 00:15:35.216 23:07:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:35.216 23:07:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:35.216 23:07:38 -- scripts/common.sh@364 -- # decimal 1 00:15:35.216 23:07:38 -- scripts/common.sh@352 -- # local d=1 00:15:35.216 23:07:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:35.216 23:07:38 -- scripts/common.sh@354 -- # echo 1 00:15:35.216 23:07:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:35.216 23:07:38 -- scripts/common.sh@365 -- # decimal 2 00:15:35.216 23:07:38 -- scripts/common.sh@352 -- # local d=2 00:15:35.216 23:07:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:35.216 23:07:38 -- scripts/common.sh@354 -- # echo 2 00:15:35.216 23:07:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:35.216 23:07:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:35.216 23:07:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:35.216 23:07:38 -- scripts/common.sh@367 -- # return 0 00:15:35.216 23:07:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:35.216 23:07:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:35.216 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:35.216 --rc genhtml_branch_coverage=1 00:15:35.216 --rc genhtml_function_coverage=1 00:15:35.216 --rc genhtml_legend=1 00:15:35.216 --rc geninfo_all_blocks=1 00:15:35.216 --rc geninfo_unexecuted_blocks=1 00:15:35.216 00:15:35.216 ' 00:15:35.216 23:07:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:35.216 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:35.216 --rc genhtml_branch_coverage=1 00:15:35.216 --rc genhtml_function_coverage=1 00:15:35.216 --rc genhtml_legend=1 00:15:35.216 --rc geninfo_all_blocks=1 00:15:35.216 --rc geninfo_unexecuted_blocks=1 00:15:35.216 00:15:35.216 ' 00:15:35.216 23:07:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:35.216 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:35.216 --rc genhtml_branch_coverage=1 00:15:35.216 --rc genhtml_function_coverage=1 00:15:35.216 --rc genhtml_legend=1 00:15:35.216 --rc geninfo_all_blocks=1 00:15:35.216 --rc geninfo_unexecuted_blocks=1 00:15:35.216 00:15:35.216 ' 00:15:35.216 23:07:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:35.216 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:35.216 --rc genhtml_branch_coverage=1 00:15:35.216 --rc genhtml_function_coverage=1 00:15:35.216 --rc genhtml_legend=1 00:15:35.216 --rc geninfo_all_blocks=1 00:15:35.216 --rc geninfo_unexecuted_blocks=1 00:15:35.216 00:15:35.216 ' 00:15:35.216 23:07:38 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:35.216 23:07:38 -- nvmf/common.sh@7 -- # uname -s 00:15:35.216 23:07:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:35.216 23:07:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:35.216 23:07:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:35.216 23:07:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:35.216 23:07:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:35.216 23:07:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:35.216 23:07:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:35.216 23:07:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:35.216 23:07:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:35.216 23:07:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:35.216 23:07:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:35.216 23:07:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:35.216 23:07:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:35.216 23:07:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:35.216 23:07:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:35.216 23:07:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:35.216 23:07:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:35.216 23:07:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:35.216 23:07:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:35.216 23:07:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:35.216 23:07:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:35.216 23:07:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:35.216 23:07:38 -- paths/export.sh@5 -- # export PATH 00:15:35.216 23:07:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:35.216 23:07:38 -- nvmf/common.sh@46 -- # : 0 00:15:35.216 23:07:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:35.216 23:07:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:35.216 23:07:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:35.216 23:07:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:35.216 23:07:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:35.216 23:07:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:35.216 23:07:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:35.216 23:07:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:35.216 23:07:38 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:35.216 23:07:38 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:35.216 23:07:38 -- target/nvme_cli.sh@14 -- # devs=() 00:15:35.216 23:07:38 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:15:35.216 23:07:38 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:35.216 23:07:38 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:35.217 23:07:38 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:35.217 23:07:38 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:35.217 23:07:38 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:35.217 23:07:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:35.217 23:07:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:35.217 23:07:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:35.217 23:07:38 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:35.217 23:07:38 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:35.217 23:07:38 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:35.217 23:07:38 -- common/autotest_common.sh@10 -- # set +x 00:15:37.746 23:07:40 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:37.746 23:07:40 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:37.746 23:07:40 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:37.746 23:07:40 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:37.746 23:07:40 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:37.746 23:07:40 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:37.746 23:07:40 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:37.746 23:07:40 -- nvmf/common.sh@294 -- # net_devs=() 00:15:37.746 23:07:40 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:37.746 23:07:40 -- nvmf/common.sh@295 -- # e810=() 00:15:37.746 23:07:40 -- nvmf/common.sh@295 -- # local -ga e810 00:15:37.746 23:07:40 -- nvmf/common.sh@296 -- # x722=() 00:15:37.746 23:07:40 -- nvmf/common.sh@296 -- # local -ga x722 00:15:37.746 23:07:40 -- nvmf/common.sh@297 -- # mlx=() 00:15:37.746 23:07:40 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:37.746 23:07:40 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:37.746 23:07:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:37.746 23:07:40 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:37.746 23:07:40 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:37.746 23:07:40 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:37.746 23:07:40 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:37.746 23:07:40 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:37.746 23:07:40 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:37.746 23:07:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:37.746 23:07:40 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:37.746 23:07:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:37.746 23:07:40 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:37.746 23:07:40 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:37.746 23:07:40 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:37.746 23:07:40 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:37.746 23:07:40 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:37.746 23:07:40 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:37.746 23:07:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:37.746 23:07:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:37.746 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:37.746 23:07:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:37.746 23:07:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:37.746 23:07:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:37.746 23:07:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:37.746 23:07:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:37.746 23:07:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:37.746 23:07:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:37.746 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:37.746 23:07:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:37.746 23:07:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:37.746 23:07:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:37.746 23:07:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:37.746 23:07:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:37.746 23:07:40 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:37.746 23:07:40 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:37.746 23:07:40 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:37.746 23:07:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:37.746 23:07:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:37.746 23:07:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:37.746 23:07:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:37.746 23:07:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:37.746 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:37.746 23:07:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:37.746 23:07:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:37.746 23:07:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:37.746 23:07:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:37.746 23:07:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:37.746 23:07:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:37.746 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:37.746 23:07:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:37.746 23:07:40 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:37.746 23:07:40 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:37.746 23:07:40 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:37.746 23:07:40 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:37.746 23:07:40 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:37.746 23:07:40 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:37.746 23:07:40 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:37.746 23:07:40 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:37.746 23:07:40 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:37.746 23:07:40 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:37.746 23:07:40 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:37.746 23:07:40 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:37.746 23:07:40 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:37.746 23:07:40 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:37.746 23:07:40 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:37.746 23:07:40 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:37.746 23:07:40 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:37.746 23:07:40 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:37.746 23:07:40 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:37.746 23:07:40 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:37.746 23:07:40 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:37.746 23:07:40 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:37.746 23:07:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:37.746 23:07:40 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:37.747 23:07:40 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:37.747 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:37.747 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.297 ms 00:15:37.747 00:15:37.747 --- 10.0.0.2 ping statistics --- 00:15:37.747 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:37.747 rtt min/avg/max/mdev = 0.297/0.297/0.297/0.000 ms 00:15:37.747 23:07:40 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:37.747 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:37.747 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.146 ms 00:15:37.747 00:15:37.747 --- 10.0.0.1 ping statistics --- 00:15:37.747 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:37.747 rtt min/avg/max/mdev = 0.146/0.146/0.146/0.000 ms 00:15:37.747 23:07:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:37.747 23:07:40 -- nvmf/common.sh@410 -- # return 0 00:15:37.747 23:07:40 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:37.747 23:07:40 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:37.747 23:07:40 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:37.747 23:07:40 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:37.747 23:07:40 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:37.747 23:07:40 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:37.747 23:07:40 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:37.747 23:07:40 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:15:37.747 23:07:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:37.747 23:07:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:37.747 23:07:40 -- common/autotest_common.sh@10 -- # set +x 00:15:37.747 23:07:40 -- nvmf/common.sh@469 -- # nvmfpid=2421667 00:15:37.747 23:07:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:15:37.747 23:07:40 -- nvmf/common.sh@470 -- # waitforlisten 2421667 00:15:37.747 23:07:40 -- common/autotest_common.sh@829 -- # '[' -z 2421667 ']' 00:15:37.747 23:07:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:37.747 23:07:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:37.747 23:07:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:37.747 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:37.747 23:07:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:37.747 23:07:40 -- common/autotest_common.sh@10 -- # set +x 00:15:37.747 [2024-11-28 23:07:41.016575] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:37.747 [2024-11-28 23:07:41.016645] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:37.747 EAL: No free 2048 kB hugepages reported on node 1 00:15:37.747 [2024-11-28 23:07:41.080423] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:37.747 [2024-11-28 23:07:41.168535] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:37.747 [2024-11-28 23:07:41.168702] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:37.747 [2024-11-28 23:07:41.168721] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:37.747 [2024-11-28 23:07:41.168734] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:37.747 [2024-11-28 23:07:41.168799] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:37.747 [2024-11-28 23:07:41.168862] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:37.747 [2024-11-28 23:07:41.168887] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:37.747 [2024-11-28 23:07:41.168889] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:38.681 23:07:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:38.681 23:07:42 -- common/autotest_common.sh@862 -- # return 0 00:15:38.681 23:07:42 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:38.681 23:07:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:38.681 23:07:42 -- common/autotest_common.sh@10 -- # set +x 00:15:38.681 23:07:42 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:38.681 23:07:42 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:38.681 23:07:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:38.681 23:07:42 -- common/autotest_common.sh@10 -- # set +x 00:15:38.681 [2024-11-28 23:07:42.049190] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:38.681 23:07:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:38.681 23:07:42 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:38.681 23:07:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:38.681 23:07:42 -- common/autotest_common.sh@10 -- # set +x 00:15:38.681 Malloc0 00:15:38.681 23:07:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:38.681 23:07:42 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:15:38.681 23:07:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:38.681 23:07:42 -- common/autotest_common.sh@10 -- # set +x 00:15:38.681 Malloc1 00:15:38.681 23:07:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:38.681 23:07:42 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:15:38.681 23:07:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:38.682 23:07:42 -- common/autotest_common.sh@10 -- # set +x 00:15:38.682 23:07:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:38.682 23:07:42 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:38.682 23:07:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:38.682 23:07:42 -- common/autotest_common.sh@10 -- # set +x 00:15:38.682 23:07:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:38.682 23:07:42 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:15:38.682 23:07:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:38.682 23:07:42 -- common/autotest_common.sh@10 -- # set +x 00:15:38.682 23:07:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:38.682 23:07:42 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:38.682 23:07:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:38.682 23:07:42 -- common/autotest_common.sh@10 -- # set +x 00:15:38.682 [2024-11-28 23:07:42.135977] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:38.682 23:07:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:38.682 23:07:42 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:38.682 23:07:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:38.682 23:07:42 -- common/autotest_common.sh@10 -- # set +x 00:15:38.682 23:07:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:38.682 23:07:42 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:15:38.940 00:15:38.940 Discovery Log Number of Records 2, Generation counter 2 00:15:38.940 =====Discovery Log Entry 0====== 00:15:38.940 trtype: tcp 00:15:38.940 adrfam: ipv4 00:15:38.940 subtype: current discovery subsystem 00:15:38.940 treq: not required 00:15:38.940 portid: 0 00:15:38.940 trsvcid: 4420 00:15:38.940 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:15:38.940 traddr: 10.0.0.2 00:15:38.940 eflags: explicit discovery connections, duplicate discovery information 00:15:38.940 sectype: none 00:15:38.940 =====Discovery Log Entry 1====== 00:15:38.940 trtype: tcp 00:15:38.940 adrfam: ipv4 00:15:38.940 subtype: nvme subsystem 00:15:38.940 treq: not required 00:15:38.940 portid: 0 00:15:38.940 trsvcid: 4420 00:15:38.940 subnqn: nqn.2016-06.io.spdk:cnode1 00:15:38.940 traddr: 10.0.0.2 00:15:38.940 eflags: none 00:15:38.940 sectype: none 00:15:38.940 23:07:42 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:15:38.940 23:07:42 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:15:38.940 23:07:42 -- nvmf/common.sh@510 -- # local dev _ 00:15:38.940 23:07:42 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:38.940 23:07:42 -- nvmf/common.sh@509 -- # nvme list 00:15:38.940 23:07:42 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:38.940 23:07:42 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:38.940 23:07:42 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:38.940 23:07:42 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:38.940 23:07:42 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:15:38.940 23:07:42 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:15:39.507 23:07:43 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:15:39.507 23:07:43 -- common/autotest_common.sh@1187 -- # local i=0 00:15:39.507 23:07:43 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:15:39.507 23:07:43 -- common/autotest_common.sh@1189 -- # [[ -n 2 ]] 00:15:39.507 23:07:43 -- common/autotest_common.sh@1190 -- # nvme_device_counter=2 00:15:39.507 23:07:43 -- common/autotest_common.sh@1194 -- # sleep 2 00:15:42.036 23:07:45 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:15:42.036 23:07:45 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:15:42.036 23:07:45 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:15:42.036 23:07:45 -- common/autotest_common.sh@1196 -- # nvme_devices=2 00:15:42.036 23:07:45 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:15:42.036 23:07:45 -- common/autotest_common.sh@1197 -- # return 0 00:15:42.036 23:07:45 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:15:42.036 23:07:45 -- nvmf/common.sh@510 -- # local dev _ 00:15:42.036 23:07:45 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:42.036 23:07:45 -- nvmf/common.sh@509 -- # nvme list 00:15:42.036 23:07:45 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:42.036 23:07:45 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:42.036 23:07:45 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:42.036 23:07:45 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:42.036 23:07:45 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:15:42.036 23:07:45 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:15:42.036 23:07:45 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:42.036 23:07:45 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:15:42.036 23:07:45 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:15:42.036 23:07:45 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:42.036 23:07:45 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n1 00:15:42.036 /dev/nvme0n2 ]] 00:15:42.036 23:07:45 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:15:42.036 23:07:45 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:15:42.036 23:07:45 -- nvmf/common.sh@510 -- # local dev _ 00:15:42.036 23:07:45 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:42.036 23:07:45 -- nvmf/common.sh@509 -- # nvme list 00:15:42.036 23:07:45 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:42.036 23:07:45 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:42.036 23:07:45 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:42.036 23:07:45 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:42.036 23:07:45 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:15:42.036 23:07:45 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:15:42.036 23:07:45 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:42.036 23:07:45 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:15:42.036 23:07:45 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:15:42.036 23:07:45 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:42.036 23:07:45 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:15:42.036 23:07:45 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:15:42.036 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:15:42.036 23:07:45 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:15:42.036 23:07:45 -- common/autotest_common.sh@1208 -- # local i=0 00:15:42.036 23:07:45 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:15:42.036 23:07:45 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:42.036 23:07:45 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:15:42.036 23:07:45 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:42.036 23:07:45 -- common/autotest_common.sh@1220 -- # return 0 00:15:42.036 23:07:45 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:15:42.036 23:07:45 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:42.036 23:07:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:42.036 23:07:45 -- common/autotest_common.sh@10 -- # set +x 00:15:42.036 23:07:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:42.036 23:07:45 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:15:42.036 23:07:45 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:15:42.036 23:07:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:42.036 23:07:45 -- nvmf/common.sh@116 -- # sync 00:15:42.036 23:07:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:42.036 23:07:45 -- nvmf/common.sh@119 -- # set +e 00:15:42.036 23:07:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:42.036 23:07:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:42.036 rmmod nvme_tcp 00:15:42.036 rmmod nvme_fabrics 00:15:42.036 rmmod nvme_keyring 00:15:42.036 23:07:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:42.036 23:07:45 -- nvmf/common.sh@123 -- # set -e 00:15:42.036 23:07:45 -- nvmf/common.sh@124 -- # return 0 00:15:42.036 23:07:45 -- nvmf/common.sh@477 -- # '[' -n 2421667 ']' 00:15:42.036 23:07:45 -- nvmf/common.sh@478 -- # killprocess 2421667 00:15:42.036 23:07:45 -- common/autotest_common.sh@936 -- # '[' -z 2421667 ']' 00:15:42.036 23:07:45 -- common/autotest_common.sh@940 -- # kill -0 2421667 00:15:42.036 23:07:45 -- common/autotest_common.sh@941 -- # uname 00:15:42.036 23:07:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:42.036 23:07:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2421667 00:15:42.036 23:07:45 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:42.036 23:07:45 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:42.036 23:07:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2421667' 00:15:42.036 killing process with pid 2421667 00:15:42.037 23:07:45 -- common/autotest_common.sh@955 -- # kill 2421667 00:15:42.037 23:07:45 -- common/autotest_common.sh@960 -- # wait 2421667 00:15:42.037 23:07:45 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:42.037 23:07:45 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:42.037 23:07:45 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:42.037 23:07:45 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:42.037 23:07:45 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:42.037 23:07:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:42.037 23:07:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:42.037 23:07:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:44.569 23:07:47 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:44.569 00:15:44.569 real 0m8.981s 00:15:44.569 user 0m18.109s 00:15:44.569 sys 0m2.311s 00:15:44.569 23:07:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:44.569 23:07:47 -- common/autotest_common.sh@10 -- # set +x 00:15:44.569 ************************************ 00:15:44.569 END TEST nvmf_nvme_cli 00:15:44.569 ************************************ 00:15:44.569 23:07:47 -- nvmf/nvmf.sh@39 -- # [[ 1 -eq 1 ]] 00:15:44.569 23:07:47 -- nvmf/nvmf.sh@40 -- # run_test nvmf_vfio_user /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_vfio_user.sh --transport=tcp 00:15:44.569 23:07:47 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:44.569 23:07:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:44.569 23:07:47 -- common/autotest_common.sh@10 -- # set +x 00:15:44.569 ************************************ 00:15:44.569 START TEST nvmf_vfio_user 00:15:44.569 ************************************ 00:15:44.569 23:07:47 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_vfio_user.sh --transport=tcp 00:15:44.569 * Looking for test storage... 00:15:44.569 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:44.569 23:07:47 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:44.569 23:07:47 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:44.569 23:07:47 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:44.569 23:07:47 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:44.569 23:07:47 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:44.569 23:07:47 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:44.569 23:07:47 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:44.569 23:07:47 -- scripts/common.sh@335 -- # IFS=.-: 00:15:44.569 23:07:47 -- scripts/common.sh@335 -- # read -ra ver1 00:15:44.569 23:07:47 -- scripts/common.sh@336 -- # IFS=.-: 00:15:44.569 23:07:47 -- scripts/common.sh@336 -- # read -ra ver2 00:15:44.569 23:07:47 -- scripts/common.sh@337 -- # local 'op=<' 00:15:44.569 23:07:47 -- scripts/common.sh@339 -- # ver1_l=2 00:15:44.569 23:07:47 -- scripts/common.sh@340 -- # ver2_l=1 00:15:44.569 23:07:47 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:44.569 23:07:47 -- scripts/common.sh@343 -- # case "$op" in 00:15:44.569 23:07:47 -- scripts/common.sh@344 -- # : 1 00:15:44.569 23:07:47 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:44.569 23:07:47 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:44.569 23:07:47 -- scripts/common.sh@364 -- # decimal 1 00:15:44.569 23:07:47 -- scripts/common.sh@352 -- # local d=1 00:15:44.569 23:07:47 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:44.569 23:07:47 -- scripts/common.sh@354 -- # echo 1 00:15:44.569 23:07:47 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:44.569 23:07:47 -- scripts/common.sh@365 -- # decimal 2 00:15:44.569 23:07:47 -- scripts/common.sh@352 -- # local d=2 00:15:44.569 23:07:47 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:44.569 23:07:47 -- scripts/common.sh@354 -- # echo 2 00:15:44.569 23:07:47 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:44.569 23:07:47 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:44.569 23:07:47 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:44.569 23:07:47 -- scripts/common.sh@367 -- # return 0 00:15:44.569 23:07:47 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:44.569 23:07:47 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:44.569 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:44.569 --rc genhtml_branch_coverage=1 00:15:44.569 --rc genhtml_function_coverage=1 00:15:44.569 --rc genhtml_legend=1 00:15:44.569 --rc geninfo_all_blocks=1 00:15:44.569 --rc geninfo_unexecuted_blocks=1 00:15:44.570 00:15:44.570 ' 00:15:44.570 23:07:47 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:44.570 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:44.570 --rc genhtml_branch_coverage=1 00:15:44.570 --rc genhtml_function_coverage=1 00:15:44.570 --rc genhtml_legend=1 00:15:44.570 --rc geninfo_all_blocks=1 00:15:44.570 --rc geninfo_unexecuted_blocks=1 00:15:44.570 00:15:44.570 ' 00:15:44.570 23:07:47 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:44.570 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:44.570 --rc genhtml_branch_coverage=1 00:15:44.570 --rc genhtml_function_coverage=1 00:15:44.570 --rc genhtml_legend=1 00:15:44.570 --rc geninfo_all_blocks=1 00:15:44.570 --rc geninfo_unexecuted_blocks=1 00:15:44.570 00:15:44.570 ' 00:15:44.570 23:07:47 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:44.570 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:44.570 --rc genhtml_branch_coverage=1 00:15:44.570 --rc genhtml_function_coverage=1 00:15:44.570 --rc genhtml_legend=1 00:15:44.570 --rc geninfo_all_blocks=1 00:15:44.570 --rc geninfo_unexecuted_blocks=1 00:15:44.570 00:15:44.570 ' 00:15:44.570 23:07:47 -- target/nvmf_vfio_user.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:44.570 23:07:47 -- nvmf/common.sh@7 -- # uname -s 00:15:44.570 23:07:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:44.570 23:07:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:44.570 23:07:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:44.570 23:07:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:44.570 23:07:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:44.570 23:07:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:44.570 23:07:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:44.570 23:07:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:44.570 23:07:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:44.570 23:07:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:44.570 23:07:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:44.570 23:07:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:44.570 23:07:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:44.570 23:07:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:44.570 23:07:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:44.570 23:07:47 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:44.570 23:07:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:44.570 23:07:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:44.570 23:07:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:44.570 23:07:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:44.570 23:07:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:44.570 23:07:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:44.570 23:07:47 -- paths/export.sh@5 -- # export PATH 00:15:44.570 23:07:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:44.570 23:07:47 -- nvmf/common.sh@46 -- # : 0 00:15:44.570 23:07:47 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:44.570 23:07:47 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:44.570 23:07:47 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:44.570 23:07:47 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:44.570 23:07:47 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:44.570 23:07:47 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:44.570 23:07:47 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:44.570 23:07:47 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:44.570 23:07:47 -- target/nvmf_vfio_user.sh@12 -- # MALLOC_BDEV_SIZE=64 00:15:44.570 23:07:47 -- target/nvmf_vfio_user.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:15:44.570 23:07:47 -- target/nvmf_vfio_user.sh@14 -- # NUM_DEVICES=2 00:15:44.570 23:07:47 -- target/nvmf_vfio_user.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:44.570 23:07:47 -- target/nvmf_vfio_user.sh@18 -- # export TEST_TRANSPORT=VFIOUSER 00:15:44.570 23:07:47 -- target/nvmf_vfio_user.sh@18 -- # TEST_TRANSPORT=VFIOUSER 00:15:44.570 23:07:47 -- target/nvmf_vfio_user.sh@47 -- # rm -rf /var/run/vfio-user 00:15:44.570 23:07:47 -- target/nvmf_vfio_user.sh@103 -- # setup_nvmf_vfio_user '' '' 00:15:44.570 23:07:47 -- target/nvmf_vfio_user.sh@51 -- # local nvmf_app_args= 00:15:44.570 23:07:47 -- target/nvmf_vfio_user.sh@52 -- # local transport_args= 00:15:44.570 23:07:47 -- target/nvmf_vfio_user.sh@55 -- # nvmfpid=2422616 00:15:44.570 23:07:47 -- target/nvmf_vfio_user.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m '[0,1,2,3]' 00:15:44.570 23:07:47 -- target/nvmf_vfio_user.sh@57 -- # echo 'Process pid: 2422616' 00:15:44.570 Process pid: 2422616 00:15:44.570 23:07:47 -- target/nvmf_vfio_user.sh@59 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:15:44.570 23:07:47 -- target/nvmf_vfio_user.sh@60 -- # waitforlisten 2422616 00:15:44.570 23:07:47 -- common/autotest_common.sh@829 -- # '[' -z 2422616 ']' 00:15:44.570 23:07:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:44.570 23:07:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:44.570 23:07:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:44.570 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:44.570 23:07:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:44.570 23:07:47 -- common/autotest_common.sh@10 -- # set +x 00:15:44.570 [2024-11-28 23:07:47.792400] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:44.570 [2024-11-28 23:07:47.792505] [ DPDK EAL parameters: nvmf -l 0,1,2,3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:44.570 EAL: No free 2048 kB hugepages reported on node 1 00:15:44.570 [2024-11-28 23:07:47.851031] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:44.570 [2024-11-28 23:07:47.936026] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:44.570 [2024-11-28 23:07:47.936179] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:44.570 [2024-11-28 23:07:47.936196] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:44.570 [2024-11-28 23:07:47.936208] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:44.570 [2024-11-28 23:07:47.936300] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:44.571 [2024-11-28 23:07:47.936367] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:44.571 [2024-11-28 23:07:47.936432] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:44.571 [2024-11-28 23:07:47.936435] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:45.502 23:07:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:45.502 23:07:48 -- common/autotest_common.sh@862 -- # return 0 00:15:45.502 23:07:48 -- target/nvmf_vfio_user.sh@62 -- # sleep 1 00:15:46.435 23:07:49 -- target/nvmf_vfio_user.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t VFIOUSER 00:15:46.692 23:07:50 -- target/nvmf_vfio_user.sh@66 -- # mkdir -p /var/run/vfio-user 00:15:46.692 23:07:50 -- target/nvmf_vfio_user.sh@68 -- # seq 1 2 00:15:46.692 23:07:50 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:46.692 23:07:50 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user1/1 00:15:46.692 23:07:50 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:15:46.950 Malloc1 00:15:46.950 23:07:50 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode1 -a -s SPDK1 00:15:47.208 23:07:50 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc1 00:15:47.466 23:07:50 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode1 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user1/1 -s 0 00:15:47.723 23:07:51 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:47.723 23:07:51 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user2/2 00:15:47.723 23:07:51 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:15:47.981 Malloc2 00:15:47.981 23:07:51 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode2 -a -s SPDK2 00:15:48.238 23:07:51 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc2 00:15:48.495 23:07:51 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode2 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user2/2 -s 0 00:15:48.754 23:07:52 -- target/nvmf_vfio_user.sh@104 -- # run_nvmf_vfio_user 00:15:48.754 23:07:52 -- target/nvmf_vfio_user.sh@80 -- # seq 1 2 00:15:48.754 23:07:52 -- target/nvmf_vfio_user.sh@80 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:48.754 23:07:52 -- target/nvmf_vfio_user.sh@81 -- # test_traddr=/var/run/vfio-user/domain/vfio-user1/1 00:15:48.754 23:07:52 -- target/nvmf_vfio_user.sh@82 -- # test_subnqn=nqn.2019-07.io.spdk:cnode1 00:15:48.754 23:07:52 -- target/nvmf_vfio_user.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -g -L nvme -L nvme_vfio -L vfio_pci 00:15:48.754 [2024-11-28 23:07:52.252696] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:48.754 [2024-11-28 23:07:52.252730] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --single-file-segments --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2423191 ] 00:15:48.754 EAL: No free 2048 kB hugepages reported on node 1 00:15:48.754 [2024-11-28 23:07:52.286626] nvme_vfio_user.c: 259:nvme_vfio_ctrlr_scan: *DEBUG*: Scan controller : /var/run/vfio-user/domain/vfio-user1/1 00:15:48.754 [2024-11-28 23:07:52.295522] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 0, Size 0x2000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:48.754 [2024-11-28 23:07:52.295551] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0x1000, Offset 0x1000, Map addr 0x7fc4f431a000 00:15:48.754 [2024-11-28 23:07:52.296517] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 1, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:48.754 [2024-11-28 23:07:52.297513] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 2, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:48.755 [2024-11-28 23:07:52.298514] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 3, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:48.755 [2024-11-28 23:07:52.299522] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 4, Size 0x2000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:48.755 [2024-11-28 23:07:52.300530] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 5, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:48.755 [2024-11-28 23:07:52.301537] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 6, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:48.755 [2024-11-28 23:07:52.302546] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 7, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:48.755 [2024-11-28 23:07:52.303557] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 8, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:48.755 [2024-11-28 23:07:52.304562] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 9, Size 0xc000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:48.755 [2024-11-28 23:07:52.304583] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0xb000, Offset 0x1000, Map addr 0x7fc4f3012000 00:15:48.755 [2024-11-28 23:07:52.305717] vfio_user_pci.c: 65:vfio_add_mr: *DEBUG*: Add memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:48.755 [2024-11-28 23:07:52.322075] vfio_user_pci.c: 386:spdk_vfio_user_setup: *DEBUG*: Device vfio-user0, Path /var/run/vfio-user/domain/vfio-user1/1/cntrl Setup Successfully 00:15:48.755 [2024-11-28 23:07:52.322109] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to connect adminq (no timeout) 00:15:48.755 [2024-11-28 23:07:52.326702] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x0, value 0x201e0100ff 00:15:48.755 [2024-11-28 23:07:52.326769] nvme_pcie_common.c: 132:nvme_pcie_qpair_construct: *INFO*: max_completions_cap = 64 num_trackers = 192 00:15:48.755 [2024-11-28 23:07:52.326949] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for connect adminq (no timeout) 00:15:48.755 [2024-11-28 23:07:52.326982] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read vs (no timeout) 00:15:48.755 [2024-11-28 23:07:52.326992] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read vs wait for vs (no timeout) 00:15:48.755 [2024-11-28 23:07:52.327714] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x8, value 0x10300 00:15:48.755 [2024-11-28 23:07:52.327734] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read cap (no timeout) 00:15:48.755 [2024-11-28 23:07:52.327769] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read cap wait for cap (no timeout) 00:15:48.755 [2024-11-28 23:07:52.328712] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x0, value 0x201e0100ff 00:15:48.755 [2024-11-28 23:07:52.328729] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to check en (no timeout) 00:15:48.755 [2024-11-28 23:07:52.328743] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to check en wait for cc (timeout 15000 ms) 00:15:48.755 [2024-11-28 23:07:52.329716] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x0 00:15:48.755 [2024-11-28 23:07:52.329733] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:15:48.755 [2024-11-28 23:07:52.330720] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x0 00:15:48.755 [2024-11-28 23:07:52.330738] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CC.EN = 0 && CSTS.RDY = 0 00:15:48.755 [2024-11-28 23:07:52.330747] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to controller is disabled (timeout 15000 ms) 00:15:48.755 [2024-11-28 23:07:52.330758] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:15:48.755 [2024-11-28 23:07:52.330867] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Setting CC.EN = 1 00:15:48.755 [2024-11-28 23:07:52.330875] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:15:48.755 [2024-11-28 23:07:52.330882] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x28, value 0x2000003c0000 00:15:48.755 [2024-11-28 23:07:52.331728] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x30, value 0x2000003be000 00:15:48.755 [2024-11-28 23:07:52.332727] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x24, value 0xff00ff 00:15:48.755 [2024-11-28 23:07:52.333748] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x460001 00:15:48.755 [2024-11-28 23:07:52.334772] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:15:48.755 [2024-11-28 23:07:52.335749] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x1 00:15:48.755 [2024-11-28 23:07:52.335781] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:15:48.755 [2024-11-28 23:07:52.335790] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to reset admin queue (timeout 30000 ms) 00:15:48.755 [2024-11-28 23:07:52.335813] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify controller (no timeout) 00:15:48.755 [2024-11-28 23:07:52.335826] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify controller (timeout 30000 ms) 00:15:48.755 [2024-11-28 23:07:52.335846] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:48.755 [2024-11-28 23:07:52.335855] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:48.755 [2024-11-28 23:07:52.335872] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000001 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:48.755 [2024-11-28 23:07:52.335924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0001 p:1 m:0 dnr:0 00:15:48.755 [2024-11-28 23:07:52.335939] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] transport max_xfer_size 131072 00:15:48.755 [2024-11-28 23:07:52.335947] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] MDTS max_xfer_size 131072 00:15:48.755 [2024-11-28 23:07:52.335954] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CNTLID 0x0001 00:15:48.755 [2024-11-28 23:07:52.335961] nvme_ctrlr.c:1990:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Identify CNTLID 0x0001 != Connect CNTLID 0x0000 00:15:48.755 [2024-11-28 23:07:52.335969] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] transport max_sges 1 00:15:48.755 [2024-11-28 23:07:52.335976] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] fuses compare and write: 1 00:15:48.755 [2024-11-28 23:07:52.335983] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to configure AER (timeout 30000 ms) 00:15:48.755 [2024-11-28 23:07:52.335999] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for configure aer (timeout 30000 ms) 00:15:48.755 [2024-11-28 23:07:52.336014] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:191 cdw10:0000000b PRP1 0x0 PRP2 0x0 00:15:48.755 [2024-11-28 23:07:52.336026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0002 p:1 m:0 dnr:0 00:15:48.755 [2024-11-28 23:07:52.336055] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:190 nsid:0 cdw10:00000000 cdw11:00000000 00:15:48.755 [2024-11-28 23:07:52.336068] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:189 nsid:0 cdw10:00000000 cdw11:00000000 00:15:48.755 [2024-11-28 23:07:52.336079] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:188 nsid:0 cdw10:00000000 cdw11:00000000 00:15:48.755 [2024-11-28 23:07:52.336090] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:187 nsid:0 cdw10:00000000 cdw11:00000000 00:15:48.755 [2024-11-28 23:07:52.336098] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set keep alive timeout (timeout 30000 ms) 00:15:48.755 [2024-11-28 23:07:52.336112] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:15:48.755 [2024-11-28 23:07:52.336126] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:191 cdw10:0000000f PRP1 0x0 PRP2 0x0 00:15:48.755 [2024-11-28 23:07:52.336137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0007 p:1 m:0 dnr:0 00:15:48.755 [2024-11-28 23:07:52.336146] nvme_ctrlr.c:2878:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Controller adjusted keep alive timeout to 0 ms 00:15:48.755 [2024-11-28 23:07:52.336154] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify controller iocs specific (timeout 30000 ms) 00:15:48.755 [2024-11-28 23:07:52.336164] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set number of queues (timeout 30000 ms) 00:15:48.755 [2024-11-28 23:07:52.336176] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for set number of queues (timeout 30000 ms) 00:15:48.755 [2024-11-28 23:07:52.336189] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:48.755 [2024-11-28 23:07:52.336205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:0008 p:1 m:0 dnr:0 00:15:48.755 [2024-11-28 23:07:52.336267] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify active ns (timeout 30000 ms) 00:15:48.755 [2024-11-28 23:07:52.336281] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify active ns (timeout 30000 ms) 00:15:48.755 [2024-11-28 23:07:52.336293] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f9000 len:4096 00:15:48.755 [2024-11-28 23:07:52.336300] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f9000 00:15:48.755 [2024-11-28 23:07:52.336310] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000002 cdw11:00000000 PRP1 0x2000002f9000 PRP2 0x0 00:15:48.755 [2024-11-28 23:07:52.336323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0009 p:1 m:0 dnr:0 00:15:48.755 [2024-11-28 23:07:52.336344] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Namespace 1 was added 00:15:48.755 [2024-11-28 23:07:52.336363] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify ns (timeout 30000 ms) 00:15:48.755 [2024-11-28 23:07:52.336391] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify ns (timeout 30000 ms) 00:15:48.755 [2024-11-28 23:07:52.336416] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:48.755 [2024-11-28 23:07:52.336424] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:48.756 [2024-11-28 23:07:52.336434] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000000 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:48.756 [2024-11-28 23:07:52.336461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000a p:1 m:0 dnr:0 00:15:48.756 [2024-11-28 23:07:52.336481] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:15:48.756 [2024-11-28 23:07:52.336507] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:15:48.756 [2024-11-28 23:07:52.336520] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:48.756 [2024-11-28 23:07:52.336528] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:48.756 [2024-11-28 23:07:52.336537] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:48.756 [2024-11-28 23:07:52.336553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000b p:1 m:0 dnr:0 00:15:48.756 [2024-11-28 23:07:52.336567] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify ns iocs specific (timeout 30000 ms) 00:15:48.756 [2024-11-28 23:07:52.336577] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set supported log pages (timeout 30000 ms) 00:15:48.756 [2024-11-28 23:07:52.336591] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set supported features (timeout 30000 ms) 00:15:48.756 [2024-11-28 23:07:52.336601] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set doorbell buffer config (timeout 30000 ms) 00:15:48.756 [2024-11-28 23:07:52.336610] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set host ID (timeout 30000 ms) 00:15:48.756 [2024-11-28 23:07:52.336618] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] NVMe-oF transport - not sending Set Features - Host ID 00:15:48.756 [2024-11-28 23:07:52.336629] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to transport ready (timeout 30000 ms) 00:15:48.756 [2024-11-28 23:07:52.336638] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to ready (no timeout) 00:15:48.756 [2024-11-28 23:07:52.336663] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:191 cdw10:00000001 PRP1 0x0 PRP2 0x0 00:15:48.756 [2024-11-28 23:07:52.336695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000c p:1 m:0 dnr:0 00:15:48.756 [2024-11-28 23:07:52.336713] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:191 cdw10:00000002 PRP1 0x0 PRP2 0x0 00:15:48.756 [2024-11-28 23:07:52.336727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000d p:1 m:0 dnr:0 00:15:48.756 [2024-11-28 23:07:52.336752] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:191 cdw10:00000004 PRP1 0x0 PRP2 0x0 00:15:48.756 [2024-11-28 23:07:52.336766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000e p:1 m:0 dnr:0 00:15:48.756 [2024-11-28 23:07:52.336780] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:48.756 [2024-11-28 23:07:52.336794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:000f p:1 m:0 dnr:0 00:15:48.756 [2024-11-28 23:07:52.336810] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f6000 len:8192 00:15:48.756 [2024-11-28 23:07:52.336818] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f6000 00:15:48.756 [2024-11-28 23:07:52.336824] nvme_pcie_common.c:1235:nvme_pcie_prp_list_append: *DEBUG*: prp[0] = 0x2000002f7000 00:15:48.756 [2024-11-28 23:07:52.336830] nvme_pcie_common.c:1251:nvme_pcie_prp_list_append: *DEBUG*: prp2 = 0x2000002f7000 00:15:48.756 [2024-11-28 23:07:52.336839] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:191 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 PRP1 0x2000002f6000 PRP2 0x2000002f7000 00:15:48.756 [2024-11-28 23:07:52.336849] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fc000 len:512 00:15:48.756 [2024-11-28 23:07:52.336857] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fc000 00:15:48.756 [2024-11-28 23:07:52.336865] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:186 nsid:ffffffff cdw10:007f0002 cdw11:00000000 PRP1 0x2000002fc000 PRP2 0x0 00:15:48.756 [2024-11-28 23:07:52.336875] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:512 00:15:48.756 [2024-11-28 23:07:52.336882] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:48.756 [2024-11-28 23:07:52.336890] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:185 nsid:ffffffff cdw10:007f0003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:48.756 [2024-11-28 23:07:52.336901] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f4000 len:4096 00:15:48.756 [2024-11-28 23:07:52.336909] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f4000 00:15:48.756 [2024-11-28 23:07:52.336917] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:184 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 PRP1 0x2000002f4000 PRP2 0x0 00:15:48.756 [2024-11-28 23:07:52.336928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0010 p:1 m:0 dnr:0 00:15:48.756 [2024-11-28 23:07:52.336947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:186 cdw0:0 sqhd:0011 p:1 m:0 dnr:0 00:15:48.756 [2024-11-28 23:07:52.336962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:185 cdw0:0 sqhd:0012 p:1 m:0 dnr:0 00:15:48.756 [2024-11-28 23:07:52.336973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0013 p:1 m:0 dnr:0 00:15:48.756 ===================================================== 00:15:48.756 NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:48.756 ===================================================== 00:15:48.756 Controller Capabilities/Features 00:15:48.756 ================================ 00:15:48.756 Vendor ID: 4e58 00:15:48.756 Subsystem Vendor ID: 4e58 00:15:48.756 Serial Number: SPDK1 00:15:48.756 Model Number: SPDK bdev Controller 00:15:48.756 Firmware Version: 24.01.1 00:15:48.756 Recommended Arb Burst: 6 00:15:48.756 IEEE OUI Identifier: 8d 6b 50 00:15:48.756 Multi-path I/O 00:15:48.756 May have multiple subsystem ports: Yes 00:15:48.756 May have multiple controllers: Yes 00:15:48.756 Associated with SR-IOV VF: No 00:15:48.756 Max Data Transfer Size: 131072 00:15:48.756 Max Number of Namespaces: 32 00:15:48.756 Max Number of I/O Queues: 127 00:15:48.756 NVMe Specification Version (VS): 1.3 00:15:48.756 NVMe Specification Version (Identify): 1.3 00:15:48.756 Maximum Queue Entries: 256 00:15:48.756 Contiguous Queues Required: Yes 00:15:48.756 Arbitration Mechanisms Supported 00:15:48.756 Weighted Round Robin: Not Supported 00:15:48.756 Vendor Specific: Not Supported 00:15:48.756 Reset Timeout: 15000 ms 00:15:48.756 Doorbell Stride: 4 bytes 00:15:48.756 NVM Subsystem Reset: Not Supported 00:15:48.756 Command Sets Supported 00:15:48.756 NVM Command Set: Supported 00:15:48.756 Boot Partition: Not Supported 00:15:48.756 Memory Page Size Minimum: 4096 bytes 00:15:48.756 Memory Page Size Maximum: 4096 bytes 00:15:48.756 Persistent Memory Region: Not Supported 00:15:48.756 Optional Asynchronous Events Supported 00:15:48.756 Namespace Attribute Notices: Supported 00:15:48.756 Firmware Activation Notices: Not Supported 00:15:48.756 ANA Change Notices: Not Supported 00:15:48.756 PLE Aggregate Log Change Notices: Not Supported 00:15:48.756 LBA Status Info Alert Notices: Not Supported 00:15:48.756 EGE Aggregate Log Change Notices: Not Supported 00:15:48.756 Normal NVM Subsystem Shutdown event: Not Supported 00:15:48.756 Zone Descriptor Change Notices: Not Supported 00:15:48.756 Discovery Log Change Notices: Not Supported 00:15:48.756 Controller Attributes 00:15:48.756 128-bit Host Identifier: Supported 00:15:48.756 Non-Operational Permissive Mode: Not Supported 00:15:48.756 NVM Sets: Not Supported 00:15:48.756 Read Recovery Levels: Not Supported 00:15:48.756 Endurance Groups: Not Supported 00:15:48.756 Predictable Latency Mode: Not Supported 00:15:48.756 Traffic Based Keep ALive: Not Supported 00:15:48.756 Namespace Granularity: Not Supported 00:15:48.756 SQ Associations: Not Supported 00:15:48.756 UUID List: Not Supported 00:15:48.756 Multi-Domain Subsystem: Not Supported 00:15:48.756 Fixed Capacity Management: Not Supported 00:15:48.756 Variable Capacity Management: Not Supported 00:15:48.756 Delete Endurance Group: Not Supported 00:15:48.756 Delete NVM Set: Not Supported 00:15:48.756 Extended LBA Formats Supported: Not Supported 00:15:48.756 Flexible Data Placement Supported: Not Supported 00:15:48.756 00:15:48.756 Controller Memory Buffer Support 00:15:48.756 ================================ 00:15:48.756 Supported: No 00:15:48.756 00:15:48.756 Persistent Memory Region Support 00:15:48.756 ================================ 00:15:48.756 Supported: No 00:15:48.756 00:15:48.756 Admin Command Set Attributes 00:15:48.756 ============================ 00:15:48.756 Security Send/Receive: Not Supported 00:15:48.756 Format NVM: Not Supported 00:15:48.756 Firmware Activate/Download: Not Supported 00:15:48.756 Namespace Management: Not Supported 00:15:48.756 Device Self-Test: Not Supported 00:15:48.756 Directives: Not Supported 00:15:48.756 NVMe-MI: Not Supported 00:15:48.756 Virtualization Management: Not Supported 00:15:48.756 Doorbell Buffer Config: Not Supported 00:15:48.756 Get LBA Status Capability: Not Supported 00:15:48.756 Command & Feature Lockdown Capability: Not Supported 00:15:48.756 Abort Command Limit: 4 00:15:48.756 Async Event Request Limit: 4 00:15:48.756 Number of Firmware Slots: N/A 00:15:48.756 Firmware Slot 1 Read-Only: N/A 00:15:48.756 Firmware Activation Without Reset: N/A 00:15:48.756 Multiple Update Detection Support: N/A 00:15:48.756 Firmware Update Granularity: No Information Provided 00:15:48.756 Per-Namespace SMART Log: No 00:15:48.756 Asymmetric Namespace Access Log Page: Not Supported 00:15:48.757 Subsystem NQN: nqn.2019-07.io.spdk:cnode1 00:15:48.757 Command Effects Log Page: Supported 00:15:48.757 Get Log Page Extended Data: Supported 00:15:48.757 Telemetry Log Pages: Not Supported 00:15:48.757 Persistent Event Log Pages: Not Supported 00:15:48.757 Supported Log Pages Log Page: May Support 00:15:48.757 Commands Supported & Effects Log Page: Not Supported 00:15:48.757 Feature Identifiers & Effects Log Page:May Support 00:15:48.757 NVMe-MI Commands & Effects Log Page: May Support 00:15:48.757 Data Area 4 for Telemetry Log: Not Supported 00:15:48.757 Error Log Page Entries Supported: 128 00:15:48.757 Keep Alive: Supported 00:15:48.757 Keep Alive Granularity: 10000 ms 00:15:48.757 00:15:48.757 NVM Command Set Attributes 00:15:48.757 ========================== 00:15:48.757 Submission Queue Entry Size 00:15:48.757 Max: 64 00:15:48.757 Min: 64 00:15:48.757 Completion Queue Entry Size 00:15:48.757 Max: 16 00:15:48.757 Min: 16 00:15:48.757 Number of Namespaces: 32 00:15:48.757 Compare Command: Supported 00:15:48.757 Write Uncorrectable Command: Not Supported 00:15:48.757 Dataset Management Command: Supported 00:15:48.757 Write Zeroes Command: Supported 00:15:48.757 Set Features Save Field: Not Supported 00:15:48.757 Reservations: Not Supported 00:15:48.757 Timestamp: Not Supported 00:15:48.757 Copy: Supported 00:15:48.757 Volatile Write Cache: Present 00:15:48.757 Atomic Write Unit (Normal): 1 00:15:48.757 Atomic Write Unit (PFail): 1 00:15:48.757 Atomic Compare & Write Unit: 1 00:15:48.757 Fused Compare & Write: Supported 00:15:48.757 Scatter-Gather List 00:15:48.757 SGL Command Set: Supported (Dword aligned) 00:15:48.757 SGL Keyed: Not Supported 00:15:48.757 SGL Bit Bucket Descriptor: Not Supported 00:15:48.757 SGL Metadata Pointer: Not Supported 00:15:48.757 Oversized SGL: Not Supported 00:15:48.757 SGL Metadata Address: Not Supported 00:15:48.757 SGL Offset: Not Supported 00:15:48.757 Transport SGL Data Block: Not Supported 00:15:48.757 Replay Protected Memory Block: Not Supported 00:15:48.757 00:15:48.757 Firmware Slot Information 00:15:48.757 ========================= 00:15:48.757 Active slot: 1 00:15:48.757 Slot 1 Firmware Revision: 24.01.1 00:15:48.757 00:15:48.757 00:15:48.757 Commands Supported and Effects 00:15:48.757 ============================== 00:15:48.757 Admin Commands 00:15:48.757 -------------- 00:15:48.757 Get Log Page (02h): Supported 00:15:48.757 Identify (06h): Supported 00:15:48.757 Abort (08h): Supported 00:15:48.757 Set Features (09h): Supported 00:15:48.757 Get Features (0Ah): Supported 00:15:48.757 Asynchronous Event Request (0Ch): Supported 00:15:48.757 Keep Alive (18h): Supported 00:15:48.757 I/O Commands 00:15:48.757 ------------ 00:15:48.757 Flush (00h): Supported LBA-Change 00:15:48.757 Write (01h): Supported LBA-Change 00:15:48.757 Read (02h): Supported 00:15:48.757 Compare (05h): Supported 00:15:48.757 Write Zeroes (08h): Supported LBA-Change 00:15:48.757 Dataset Management (09h): Supported LBA-Change 00:15:48.757 Copy (19h): Supported LBA-Change 00:15:48.757 Unknown (79h): Supported LBA-Change 00:15:48.757 Unknown (7Ah): Supported 00:15:48.757 00:15:48.757 Error Log 00:15:48.757 ========= 00:15:48.757 00:15:48.757 Arbitration 00:15:48.757 =========== 00:15:48.757 Arbitration Burst: 1 00:15:48.757 00:15:48.757 Power Management 00:15:48.757 ================ 00:15:48.757 Number of Power States: 1 00:15:48.757 Current Power State: Power State #0 00:15:48.757 Power State #0: 00:15:48.757 Max Power: 0.00 W 00:15:48.757 Non-Operational State: Operational 00:15:48.757 Entry Latency: Not Reported 00:15:48.757 Exit Latency: Not Reported 00:15:48.757 Relative Read Throughput: 0 00:15:48.757 Relative Read Latency: 0 00:15:48.757 Relative Write Throughput: 0 00:15:48.757 Relative Write Latency: 0 00:15:48.757 Idle Power: Not Reported 00:15:48.757 Active Power: Not Reported 00:15:48.757 Non-Operational Permissive Mode: Not Supported 00:15:48.757 00:15:48.757 Health Information 00:15:48.757 ================== 00:15:48.757 Critical Warnings: 00:15:48.757 Available Spare Space: OK 00:15:48.757 Temperature: OK 00:15:48.757 Device Reliability: OK 00:15:48.757 Read Only: No 00:15:48.757 Volatile Memory Backup: OK 00:15:48.757 Current Temperature: 0 Kelvin[2024-11-28 23:07:52.337102] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:184 cdw10:00000005 PRP1 0x0 PRP2 0x0 00:15:48.757 [2024-11-28 23:07:52.337118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0014 p:1 m:0 dnr:0 00:15:48.757 [2024-11-28 23:07:52.337154] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Prepare to destruct SSD 00:15:48.757 [2024-11-28 23:07:52.337170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:190 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:48.757 [2024-11-28 23:07:52.337181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:189 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:48.757 [2024-11-28 23:07:52.337190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:188 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:48.757 [2024-11-28 23:07:52.337200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:187 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:48.757 [2024-11-28 23:07:52.341404] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x460001 00:15:48.757 [2024-11-28 23:07:52.341425] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x464001 00:15:48.757 [2024-11-28 23:07:52.341818] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] RTD3E = 0 us 00:15:48.757 [2024-11-28 23:07:52.341831] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] shutdown timeout = 10000 ms 00:15:48.757 [2024-11-28 23:07:52.342788] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x9 00:15:48.757 [2024-11-28 23:07:52.342810] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] shutdown complete in 0 milliseconds 00:15:48.757 [2024-11-28 23:07:52.342861] vfio_user_pci.c: 399:spdk_vfio_user_release: *DEBUG*: Release file /var/run/vfio-user/domain/vfio-user1/1/cntrl 00:15:48.757 [2024-11-28 23:07:52.344836] vfio_user_pci.c: 96:vfio_remove_mr: *DEBUG*: Remove memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:49.015 (-273 Celsius) 00:15:49.015 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:15:49.015 Available Spare: 0% 00:15:49.015 Available Spare Threshold: 0% 00:15:49.015 Life Percentage Used: 0% 00:15:49.015 Data Units Read: 0 00:15:49.015 Data Units Written: 0 00:15:49.015 Host Read Commands: 0 00:15:49.015 Host Write Commands: 0 00:15:49.015 Controller Busy Time: 0 minutes 00:15:49.015 Power Cycles: 0 00:15:49.015 Power On Hours: 0 hours 00:15:49.015 Unsafe Shutdowns: 0 00:15:49.015 Unrecoverable Media Errors: 0 00:15:49.015 Lifetime Error Log Entries: 0 00:15:49.015 Warning Temperature Time: 0 minutes 00:15:49.015 Critical Temperature Time: 0 minutes 00:15:49.015 00:15:49.015 Number of Queues 00:15:49.015 ================ 00:15:49.015 Number of I/O Submission Queues: 127 00:15:49.015 Number of I/O Completion Queues: 127 00:15:49.015 00:15:49.015 Active Namespaces 00:15:49.015 ================= 00:15:49.015 Namespace ID:1 00:15:49.015 Error Recovery Timeout: Unlimited 00:15:49.015 Command Set Identifier: NVM (00h) 00:15:49.015 Deallocate: Supported 00:15:49.015 Deallocated/Unwritten Error: Not Supported 00:15:49.015 Deallocated Read Value: Unknown 00:15:49.015 Deallocate in Write Zeroes: Not Supported 00:15:49.015 Deallocated Guard Field: 0xFFFF 00:15:49.015 Flush: Supported 00:15:49.015 Reservation: Supported 00:15:49.015 Namespace Sharing Capabilities: Multiple Controllers 00:15:49.015 Size (in LBAs): 131072 (0GiB) 00:15:49.015 Capacity (in LBAs): 131072 (0GiB) 00:15:49.015 Utilization (in LBAs): 131072 (0GiB) 00:15:49.015 NGUID: 3C0605388DD54603B78A7814161E4282 00:15:49.015 UUID: 3c060538-8dd5-4603-b78a-7814161e4282 00:15:49.015 Thin Provisioning: Not Supported 00:15:49.015 Per-NS Atomic Units: Yes 00:15:49.015 Atomic Boundary Size (Normal): 0 00:15:49.015 Atomic Boundary Size (PFail): 0 00:15:49.015 Atomic Boundary Offset: 0 00:15:49.015 Maximum Single Source Range Length: 65535 00:15:49.015 Maximum Copy Length: 65535 00:15:49.015 Maximum Source Range Count: 1 00:15:49.015 NGUID/EUI64 Never Reused: No 00:15:49.015 Namespace Write Protected: No 00:15:49.015 Number of LBA Formats: 1 00:15:49.015 Current LBA Format: LBA Format #00 00:15:49.015 LBA Format #00: Data Size: 512 Metadata Size: 0 00:15:49.015 00:15:49.015 23:07:52 -- target/nvmf_vfio_user.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -s 256 -g -q 128 -o 4096 -w read -t 5 -c 0x2 00:15:49.015 EAL: No free 2048 kB hugepages reported on node 1 00:15:54.279 Initializing NVMe Controllers 00:15:54.279 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:54.279 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 with lcore 1 00:15:54.279 Initialization complete. Launching workers. 00:15:54.279 ======================================================== 00:15:54.279 Latency(us) 00:15:54.279 Device Information : IOPS MiB/s Average min max 00:15:54.279 VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 from core 1: 35989.99 140.59 3557.34 1177.72 8910.87 00:15:54.279 ======================================================== 00:15:54.279 Total : 35989.99 140.59 3557.34 1177.72 8910.87 00:15:54.279 00:15:54.279 23:07:57 -- target/nvmf_vfio_user.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -s 256 -g -q 128 -o 4096 -w write -t 5 -c 0x2 00:15:54.279 EAL: No free 2048 kB hugepages reported on node 1 00:15:59.540 Initializing NVMe Controllers 00:15:59.540 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:59.540 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 with lcore 1 00:15:59.540 Initialization complete. Launching workers. 00:15:59.540 ======================================================== 00:15:59.540 Latency(us) 00:15:59.540 Device Information : IOPS MiB/s Average min max 00:15:59.540 VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 from core 1: 16046.12 62.68 7976.27 5951.50 9990.68 00:15:59.540 ======================================================== 00:15:59.540 Total : 16046.12 62.68 7976.27 5951.50 9990.68 00:15:59.540 00:15:59.540 23:08:02 -- target/nvmf_vfio_user.sh@86 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -g -q 32 -o 4096 -w randrw -M 50 -t 5 -c 0xE 00:15:59.540 EAL: No free 2048 kB hugepages reported on node 1 00:16:04.878 Initializing NVMe Controllers 00:16:04.878 Attaching to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:16:04.878 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:16:04.878 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 1 00:16:04.878 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 2 00:16:04.878 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 3 00:16:04.878 Initialization complete. Launching workers. 00:16:04.878 Starting thread on core 2 00:16:04.878 Starting thread on core 3 00:16:04.878 Starting thread on core 1 00:16:04.878 23:08:08 -- target/nvmf_vfio_user.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -t 3 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -d 256 -g 00:16:04.878 EAL: No free 2048 kB hugepages reported on node 1 00:16:09.060 Initializing NVMe Controllers 00:16:09.060 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:16:09.060 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:16:09.060 Associating SPDK bdev Controller (SPDK1 ) with lcore 0 00:16:09.060 Associating SPDK bdev Controller (SPDK1 ) with lcore 1 00:16:09.060 Associating SPDK bdev Controller (SPDK1 ) with lcore 2 00:16:09.060 Associating SPDK bdev Controller (SPDK1 ) with lcore 3 00:16:09.060 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration run with configuration: 00:16:09.060 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -q 64 -s 131072 -w randrw -M 50 -l 0 -t 3 -c 0xf -m 0 -a 0 -b 0 -n 100000 -i -1 00:16:09.060 Initialization complete. Launching workers. 00:16:09.060 Starting thread on core 1 with urgent priority queue 00:16:09.060 Starting thread on core 2 with urgent priority queue 00:16:09.060 Starting thread on core 3 with urgent priority queue 00:16:09.060 Starting thread on core 0 with urgent priority queue 00:16:09.060 SPDK bdev Controller (SPDK1 ) core 0: 3360.67 IO/s 29.76 secs/100000 ios 00:16:09.060 SPDK bdev Controller (SPDK1 ) core 1: 3199.00 IO/s 31.26 secs/100000 ios 00:16:09.060 SPDK bdev Controller (SPDK1 ) core 2: 2827.33 IO/s 35.37 secs/100000 ios 00:16:09.060 SPDK bdev Controller (SPDK1 ) core 3: 3159.67 IO/s 31.65 secs/100000 ios 00:16:09.060 ======================================================== 00:16:09.060 00:16:09.060 23:08:11 -- target/nvmf_vfio_user.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/hello_world -d 256 -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' 00:16:09.060 EAL: No free 2048 kB hugepages reported on node 1 00:16:09.060 Initializing NVMe Controllers 00:16:09.060 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:16:09.060 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:16:09.060 Namespace ID: 1 size: 0GB 00:16:09.060 Initialization complete. 00:16:09.060 INFO: using host memory buffer for IO 00:16:09.060 Hello world! 00:16:09.060 23:08:12 -- target/nvmf_vfio_user.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/overhead/overhead -o 4096 -t 1 -H -g -d 256 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' 00:16:09.060 EAL: No free 2048 kB hugepages reported on node 1 00:16:09.992 Initializing NVMe Controllers 00:16:09.992 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:16:09.992 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:16:09.992 Initialization complete. Launching workers. 00:16:09.992 submit (in ns) avg, min, max = 7335.9, 3464.4, 5013413.3 00:16:09.992 complete (in ns) avg, min, max = 26826.8, 2041.1, 7989573.3 00:16:09.992 00:16:09.992 Submit histogram 00:16:09.992 ================ 00:16:09.992 Range in us Cumulative Count 00:16:09.992 3.461 - 3.484: 0.4041% ( 55) 00:16:09.992 3.484 - 3.508: 1.6676% ( 172) 00:16:09.992 3.508 - 3.532: 5.4805% ( 519) 00:16:09.992 3.532 - 3.556: 11.1740% ( 775) 00:16:09.992 3.556 - 3.579: 22.4434% ( 1534) 00:16:09.992 3.579 - 3.603: 32.8240% ( 1413) 00:16:09.992 3.603 - 3.627: 41.8014% ( 1222) 00:16:09.992 3.627 - 3.650: 48.1928% ( 870) 00:16:09.992 3.650 - 3.674: 53.7173% ( 752) 00:16:09.992 3.674 - 3.698: 57.8313% ( 560) 00:16:09.992 3.698 - 3.721: 61.6588% ( 521) 00:16:09.992 3.721 - 3.745: 64.8472% ( 434) 00:16:09.992 3.745 - 3.769: 67.6976% ( 388) 00:16:09.992 3.769 - 3.793: 71.5398% ( 523) 00:16:09.992 3.793 - 3.816: 75.9330% ( 598) 00:16:09.992 3.816 - 3.840: 80.6200% ( 638) 00:16:09.992 3.840 - 3.864: 84.1904% ( 486) 00:16:09.992 3.864 - 3.887: 86.7396% ( 347) 00:16:09.992 3.887 - 3.911: 88.4808% ( 237) 00:16:09.992 3.911 - 3.935: 90.2292% ( 238) 00:16:09.992 3.935 - 3.959: 91.5516% ( 180) 00:16:09.992 3.959 - 3.982: 92.6462% ( 149) 00:16:09.992 3.982 - 4.006: 93.5718% ( 126) 00:16:09.992 4.006 - 4.030: 94.3873% ( 111) 00:16:09.992 4.030 - 4.053: 95.2101% ( 112) 00:16:09.992 4.053 - 4.077: 95.8713% ( 90) 00:16:09.992 4.077 - 4.101: 96.1872% ( 43) 00:16:09.992 4.101 - 4.124: 96.4884% ( 41) 00:16:09.992 4.124 - 4.148: 96.7235% ( 32) 00:16:09.992 4.148 - 4.172: 96.8410% ( 16) 00:16:09.992 4.172 - 4.196: 96.9953% ( 21) 00:16:09.993 4.196 - 4.219: 97.0761% ( 11) 00:16:09.993 4.219 - 4.243: 97.1643% ( 12) 00:16:09.993 4.243 - 4.267: 97.2892% ( 17) 00:16:09.993 4.267 - 4.290: 97.3332% ( 6) 00:16:09.993 4.290 - 4.314: 97.4140% ( 11) 00:16:09.993 4.314 - 4.338: 97.4728% ( 8) 00:16:09.993 4.338 - 4.361: 97.5096% ( 5) 00:16:09.993 4.361 - 4.385: 97.5169% ( 1) 00:16:09.993 4.385 - 4.409: 97.5610% ( 6) 00:16:09.993 4.409 - 4.433: 97.5977% ( 5) 00:16:09.993 4.433 - 4.456: 97.6124% ( 2) 00:16:09.993 4.456 - 4.480: 97.6638% ( 7) 00:16:09.993 4.480 - 4.504: 97.7153% ( 7) 00:16:09.993 4.504 - 4.527: 97.7887% ( 10) 00:16:09.993 4.527 - 4.551: 97.8181% ( 4) 00:16:09.993 4.551 - 4.575: 97.8548% ( 5) 00:16:09.993 4.575 - 4.599: 97.8769% ( 3) 00:16:09.993 4.599 - 4.622: 97.9136% ( 5) 00:16:09.993 4.622 - 4.646: 97.9650% ( 7) 00:16:09.993 4.646 - 4.670: 97.9944% ( 4) 00:16:09.993 4.670 - 4.693: 98.0311% ( 5) 00:16:09.993 4.693 - 4.717: 98.0679% ( 5) 00:16:09.993 4.717 - 4.741: 98.1120% ( 6) 00:16:09.993 4.741 - 4.764: 98.1487% ( 5) 00:16:09.993 4.764 - 4.788: 98.1560% ( 1) 00:16:09.993 4.788 - 4.812: 98.1781% ( 3) 00:16:09.993 4.812 - 4.836: 98.2075% ( 4) 00:16:09.993 4.836 - 4.859: 98.2222% ( 2) 00:16:09.993 4.859 - 4.883: 98.2809% ( 8) 00:16:09.993 4.883 - 4.907: 98.2956% ( 2) 00:16:09.993 4.907 - 4.930: 98.3030% ( 1) 00:16:09.993 4.930 - 4.954: 98.3177% ( 2) 00:16:09.993 4.954 - 4.978: 98.3324% ( 2) 00:16:09.993 4.978 - 5.001: 98.3397% ( 1) 00:16:09.993 5.001 - 5.025: 98.3470% ( 1) 00:16:09.993 5.025 - 5.049: 98.3544% ( 1) 00:16:09.993 5.073 - 5.096: 98.3617% ( 1) 00:16:09.993 5.120 - 5.144: 98.3764% ( 2) 00:16:09.993 5.191 - 5.215: 98.3838% ( 1) 00:16:09.993 5.239 - 5.262: 98.3985% ( 2) 00:16:09.993 5.262 - 5.286: 98.4058% ( 1) 00:16:09.993 5.333 - 5.357: 98.4132% ( 1) 00:16:09.993 5.713 - 5.736: 98.4205% ( 1) 00:16:09.993 6.305 - 6.353: 98.4352% ( 2) 00:16:09.993 6.495 - 6.542: 98.4426% ( 1) 00:16:09.993 6.590 - 6.637: 98.4499% ( 1) 00:16:09.993 6.637 - 6.684: 98.4572% ( 1) 00:16:09.993 6.684 - 6.732: 98.4719% ( 2) 00:16:09.993 6.779 - 6.827: 98.4793% ( 1) 00:16:09.993 6.827 - 6.874: 98.4866% ( 1) 00:16:09.993 6.921 - 6.969: 98.4940% ( 1) 00:16:09.993 6.969 - 7.016: 98.5087% ( 2) 00:16:09.993 7.016 - 7.064: 98.5160% ( 1) 00:16:09.993 7.111 - 7.159: 98.5234% ( 1) 00:16:09.993 7.206 - 7.253: 98.5307% ( 1) 00:16:09.993 7.301 - 7.348: 98.5381% ( 1) 00:16:09.993 7.396 - 7.443: 98.5601% ( 3) 00:16:09.993 7.443 - 7.490: 98.5748% ( 2) 00:16:09.993 7.490 - 7.538: 98.5821% ( 1) 00:16:09.993 7.538 - 7.585: 98.5968% ( 2) 00:16:09.993 7.633 - 7.680: 98.6042% ( 1) 00:16:09.993 7.680 - 7.727: 98.6189% ( 2) 00:16:09.993 7.775 - 7.822: 98.6336% ( 2) 00:16:09.993 7.822 - 7.870: 98.6483% ( 2) 00:16:09.993 7.917 - 7.964: 98.6556% ( 1) 00:16:09.993 7.964 - 8.012: 98.6629% ( 1) 00:16:09.993 8.012 - 8.059: 98.6776% ( 2) 00:16:09.993 8.059 - 8.107: 98.6850% ( 1) 00:16:09.993 8.154 - 8.201: 98.6997% ( 2) 00:16:09.993 8.201 - 8.249: 98.7070% ( 1) 00:16:09.993 8.344 - 8.391: 98.7144% ( 1) 00:16:09.993 8.391 - 8.439: 98.7217% ( 1) 00:16:09.993 8.439 - 8.486: 98.7291% ( 1) 00:16:09.993 8.486 - 8.533: 98.7438% ( 2) 00:16:09.993 8.533 - 8.581: 98.7511% ( 1) 00:16:09.993 8.581 - 8.628: 98.7584% ( 1) 00:16:09.993 8.676 - 8.723: 98.7658% ( 1) 00:16:09.993 8.770 - 8.818: 98.7731% ( 1) 00:16:09.993 9.102 - 9.150: 98.7805% ( 1) 00:16:09.993 9.150 - 9.197: 98.7878% ( 1) 00:16:09.993 9.244 - 9.292: 98.8099% ( 3) 00:16:09.993 9.719 - 9.766: 98.8172% ( 1) 00:16:09.993 9.766 - 9.813: 98.8246% ( 1) 00:16:09.993 10.050 - 10.098: 98.8319% ( 1) 00:16:09.993 10.098 - 10.145: 98.8393% ( 1) 00:16:09.993 10.145 - 10.193: 98.8466% ( 1) 00:16:09.993 10.477 - 10.524: 98.8540% ( 1) 00:16:09.993 10.572 - 10.619: 98.8613% ( 1) 00:16:09.993 10.667 - 10.714: 98.8686% ( 1) 00:16:09.993 10.999 - 11.046: 98.8760% ( 1) 00:16:09.993 11.236 - 11.283: 98.8833% ( 1) 00:16:09.993 11.378 - 11.425: 98.8907% ( 1) 00:16:09.993 11.425 - 11.473: 98.8980% ( 1) 00:16:09.993 11.520 - 11.567: 98.9054% ( 1) 00:16:09.993 11.567 - 11.615: 98.9201% ( 2) 00:16:09.993 11.710 - 11.757: 98.9274% ( 1) 00:16:09.993 12.136 - 12.231: 98.9348% ( 1) 00:16:09.993 12.231 - 12.326: 98.9421% ( 1) 00:16:09.993 12.421 - 12.516: 98.9495% ( 1) 00:16:09.993 13.084 - 13.179: 98.9568% ( 1) 00:16:09.993 13.369 - 13.464: 98.9715% ( 2) 00:16:09.993 13.748 - 13.843: 98.9788% ( 1) 00:16:09.993 14.317 - 14.412: 98.9862% ( 1) 00:16:09.993 14.981 - 15.076: 98.9935% ( 1) 00:16:09.993 17.067 - 17.161: 99.0009% ( 1) 00:16:09.993 17.161 - 17.256: 99.0082% ( 1) 00:16:09.993 17.256 - 17.351: 99.0450% ( 5) 00:16:09.993 17.351 - 17.446: 99.0743% ( 4) 00:16:09.993 17.446 - 17.541: 99.0964% ( 3) 00:16:09.993 17.541 - 17.636: 99.1331% ( 5) 00:16:09.993 17.636 - 17.730: 99.1699% ( 5) 00:16:09.993 17.730 - 17.825: 99.2286% ( 8) 00:16:09.993 17.825 - 17.920: 99.2654% ( 5) 00:16:09.993 17.920 - 18.015: 99.2947% ( 4) 00:16:09.993 18.015 - 18.110: 99.3609% ( 9) 00:16:09.993 18.110 - 18.204: 99.4417% ( 11) 00:16:09.993 18.204 - 18.299: 99.5078% ( 9) 00:16:09.993 18.299 - 18.394: 99.6106% ( 14) 00:16:09.993 18.394 - 18.489: 99.6621% ( 7) 00:16:09.993 18.489 - 18.584: 99.7135% ( 7) 00:16:09.993 18.584 - 18.679: 99.7429% ( 4) 00:16:09.993 18.679 - 18.773: 99.7796% ( 5) 00:16:09.993 18.773 - 18.868: 99.7943% ( 2) 00:16:09.993 18.868 - 18.963: 99.8163% ( 3) 00:16:09.993 18.963 - 19.058: 99.8310% ( 2) 00:16:09.993 19.247 - 19.342: 99.8384% ( 1) 00:16:09.993 19.342 - 19.437: 99.8531% ( 2) 00:16:09.993 19.437 - 19.532: 99.8678% ( 2) 00:16:09.993 19.627 - 19.721: 99.8751% ( 1) 00:16:09.993 19.911 - 20.006: 99.8825% ( 1) 00:16:09.993 20.196 - 20.290: 99.8898% ( 1) 00:16:09.993 20.575 - 20.670: 99.8971% ( 1) 00:16:09.993 22.376 - 22.471: 99.9045% ( 1) 00:16:09.993 23.514 - 23.609: 99.9118% ( 1) 00:16:09.993 2160.261 - 2172.397: 99.9192% ( 1) 00:16:09.993 3980.705 - 4004.978: 99.9853% ( 9) 00:16:09.993 4004.978 - 4029.250: 99.9927% ( 1) 00:16:09.993 5000.154 - 5024.427: 100.0000% ( 1) 00:16:09.993 00:16:09.993 Complete histogram 00:16:09.993 ================== 00:16:09.993 Range in us Cumulative Count 00:16:09.993 2.039 - 2.050: 1.8513% ( 252) 00:16:09.993 2.050 - 2.062: 14.4431% ( 1714) 00:16:09.993 2.062 - 2.074: 17.2568% ( 383) 00:16:09.993 2.074 - 2.086: 32.5669% ( 2084) 00:16:09.993 2.086 - 2.098: 59.4035% ( 3653) 00:16:09.993 2.098 - 2.110: 63.1428% ( 509) 00:16:09.993 2.110 - 2.121: 65.8610% ( 370) 00:16:09.993 2.121 - 2.133: 68.3221% ( 335) 00:16:09.993 2.133 - 2.145: 69.1228% ( 109) 00:16:09.993 2.145 - 2.157: 76.6456% ( 1024) 00:16:09.993 2.157 - 2.169: 82.1481% ( 749) 00:16:09.993 2.169 - 2.181: 83.7496% ( 218) 00:16:09.993 2.181 - 2.193: 85.6891% ( 264) 00:16:09.993 2.193 - 2.204: 86.8425% ( 157) 00:16:09.993 2.204 - 2.216: 87.9371% ( 149) 00:16:09.993 2.216 - 2.228: 91.5148% ( 487) 00:16:09.993 2.228 - 2.240: 94.1375% ( 357) 00:16:09.993 2.240 - 2.252: 94.7767% ( 87) 00:16:09.993 2.252 - 2.264: 95.2028% ( 58) 00:16:09.993 2.264 - 2.276: 95.4011% ( 27) 00:16:09.993 2.276 - 2.287: 95.7831% ( 52) 00:16:09.993 2.287 - 2.299: 95.9962% ( 29) 00:16:09.993 2.299 - 2.311: 96.1284% ( 18) 00:16:09.993 2.311 - 2.323: 96.2607% ( 18) 00:16:09.993 2.323 - 2.335: 96.4957% ( 32) 00:16:09.993 2.335 - 2.347: 96.6867% ( 26) 00:16:09.993 2.347 - 2.359: 96.9512% ( 36) 00:16:09.993 2.359 - 2.370: 97.3847% ( 59) 00:16:09.993 2.370 - 2.382: 97.6418% ( 35) 00:16:09.993 2.382 - 2.394: 97.7961% ( 21) 00:16:09.993 2.394 - 2.406: 97.9577% ( 22) 00:16:09.993 2.406 - 2.418: 98.0311% ( 10) 00:16:09.993 2.418 - 2.430: 98.1487% ( 16) 00:16:09.993 2.430 - 2.441: 98.2589% ( 15) 00:16:09.993 2.441 - 2.453: 98.3470% ( 12) 00:16:09.993 2.453 - 2.465: 98.4572% ( 15) 00:16:09.993 2.465 - 2.477: 98.4866% ( 4) 00:16:09.993 2.477 - 2.489: 98.5013% ( 2) 00:16:09.993 2.489 - 2.501: 98.5234% ( 3) 00:16:09.993 2.501 - 2.513: 98.5381% ( 2) 00:16:09.993 2.513 - 2.524: 98.5454% ( 1) 00:16:09.993 2.524 - 2.536: 98.5527% ( 1) 00:16:09.993 2.536 - 2.548: 98.5601% ( 1) 00:16:09.993 2.572 - 2.584: 98.5674% ( 1) 00:16:09.993 2.596 - 2.607: 98.5748% ( 1) 00:16:09.993 2.667 - 2.679: 98.5821% ( 1) 00:16:09.993 2.999 - 3.010: 98.5895% ( 1) 00:16:09.993 3.153 - 3.176: 98.5968% ( 1) 00:16:09.993 3.224 - 3.247: 98.6115% ( 2) 00:16:09.993 3.271 - 3.295: 98.6262% ( 2) 00:16:09.994 3.295 - 3.319: 98.6483% ( 3) 00:16:09.994 3.342 - 3.366: 98.6629% ( 2) 00:16:09.994 3.366 - 3.390: 98.6776% ( 2) 00:16:09.994 3.390 - 3.413: 98.6850% ( 1) 00:16:09.994 3.413 - 3.437: 98.6997% ( 2) 00:16:09.994 3.437 - 3.461: 98.7144% ( 2) 00:16:09.994 3.461 - 3.484: 98.7217% ( 1) 00:16:09.994 3.484 - 3.508: 98.7291% ( 1) 00:16:09.994 3.532 - 3.556: 98.7364% ( 1) 00:16:09.994 3.556 - 3.579: 98.7511% ( 2) 00:16:09.994 3.579 - 3.603: 98.7658% ( 2) 00:16:09.994 3.603 - 3.627: 98.7731% ( 1) 00:16:09.994 3.674 - 3.698: 98.7805% ( 1) 00:16:09.994 3.745 - 3.769: 98.7878% ( 1) 00:16:09.994 3.793 - 3.816: 98.7952% ( 1) 00:16:09.994 3.864 - 3.887: 98.8025% ( 1) 00:16:09.994 5.618 - 5.641: 98.8099% ( 1) 00:16:09.994 5.665 - 5.689: 98.8246% ( 2) 00:16:09.994 5.689 - 5.713: 98.8393% ( 2) 00:16:09.994 5.831 - 5.855: 98.8466% ( 1) 00:16:09.994 5.879 - 5.902: 98.8540% ( 1) 00:16:09.994 5.973 - 5.997: 98.8613% ( 1) 00:16:09.994 6.258 - 6.305: 98.8686% ( 1) 00:16:09.994 6.732 - 6.779: 98.8760% ( 1) 00:16:09.994 6.827 - 6.874: 98.8833% ( 1) 00:16:09.994 6.969 - 7.016: 98.8907% ( 1) 00:16:09.994 8.154 - 8.201: 98.8980% ( 1) 00:16:09.994 13.938 - 14.033: 98.9054% ( 1) 00:16:09.994 15.455 - 15.550: 98.9127% ( 1) 00:16:09.994 15.644 - 15.739: 98.9274% ( 2) 00:16:09.994 15.739 - 15.834: 98.9495% ( 3) 00:16:09.994 15.834 - 15.929: 98.9862% ( 5) 00:16:09.994 15.929 - 16.024: 99.0009% ( 2) 00:16:09.994 16.024 - 16.119: 99.0303% ( 4) 00:16:09.994 16.119 - 16.213: 99.0670% ( 5) 00:16:09.994 16.213 - 16.308: 99.0964% ( 4) 00:16:09.994 16.308 - 16.403: 99.1258% ( 4) 00:16:09.994 16.403 - 16.498: 99.1478% ( 3) 00:16:09.994 16.498 - 16.593: 99.1772% ( 4) 00:16:09.994 16.593 - 16.687: 99.1845% ( 1) 00:16:09.994 16.687 - 16.782: 99.2139% ( 4) 00:16:09.994 16.782 - 16.877: 99.2947% ( 11) 00:16:09.994 16.877 - 16.972: 99.3241% ( 4) 00:16:09.994 17.067 - 17.161: 99.3315% ( 1) 00:16:09.994 17.161 - 17.256: 99.3388% ( 1) 00:16:09.994 17.256 - 17.351: 99.3462% ( 1) 00:16:09.994 17.351 - 17.446: 99.3535% ( 1) 00:16:09.994 17.636 - 17.730: 99.3609% ( 1) 00:16:09.994 18.204 - 18.299: 99.3682% ( 1) 00:16:09.994 19.153 - 19.247: 99.3756% ( 1) 00:16:09.994 19.816 - 19.911: 99.3829% ( 1) 00:16:09.994 20.101 - 20.196: 99.3902% ( 1) 00:16:09.994 371.674 - 373.191: 99.3976% ( 1) 00:16:09.994 3980.705 - 4004.978: 99.9045% ( 69) 00:16:09.994 4004.978 - 4029.250: 99.9853% ( 11) 00:16:09.994 6990.507 - 7039.052: 99.9927% ( 1) 00:16:09.994 7961.410 - 8009.956: 100.0000% ( 1) 00:16:09.994 00:16:09.994 23:08:13 -- target/nvmf_vfio_user.sh@90 -- # aer_vfio_user /var/run/vfio-user/domain/vfio-user1/1 nqn.2019-07.io.spdk:cnode1 1 00:16:09.994 23:08:13 -- target/nvmf_vfio_user.sh@22 -- # local traddr=/var/run/vfio-user/domain/vfio-user1/1 00:16:09.994 23:08:13 -- target/nvmf_vfio_user.sh@23 -- # local subnqn=nqn.2019-07.io.spdk:cnode1 00:16:09.994 23:08:13 -- target/nvmf_vfio_user.sh@24 -- # local malloc_num=Malloc3 00:16:09.994 23:08:13 -- target/nvmf_vfio_user.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:16:10.252 [2024-11-28 23:08:13.766185] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:16:10.252 [ 00:16:10.252 { 00:16:10.252 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:16:10.252 "subtype": "Discovery", 00:16:10.252 "listen_addresses": [], 00:16:10.252 "allow_any_host": true, 00:16:10.252 "hosts": [] 00:16:10.252 }, 00:16:10.252 { 00:16:10.252 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:16:10.252 "subtype": "NVMe", 00:16:10.252 "listen_addresses": [ 00:16:10.252 { 00:16:10.252 "transport": "VFIOUSER", 00:16:10.252 "trtype": "VFIOUSER", 00:16:10.252 "adrfam": "IPv4", 00:16:10.252 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:16:10.252 "trsvcid": "0" 00:16:10.252 } 00:16:10.252 ], 00:16:10.252 "allow_any_host": true, 00:16:10.252 "hosts": [], 00:16:10.252 "serial_number": "SPDK1", 00:16:10.252 "model_number": "SPDK bdev Controller", 00:16:10.252 "max_namespaces": 32, 00:16:10.252 "min_cntlid": 1, 00:16:10.252 "max_cntlid": 65519, 00:16:10.252 "namespaces": [ 00:16:10.252 { 00:16:10.252 "nsid": 1, 00:16:10.252 "bdev_name": "Malloc1", 00:16:10.252 "name": "Malloc1", 00:16:10.252 "nguid": "3C0605388DD54603B78A7814161E4282", 00:16:10.252 "uuid": "3c060538-8dd5-4603-b78a-7814161e4282" 00:16:10.252 } 00:16:10.252 ] 00:16:10.252 }, 00:16:10.252 { 00:16:10.252 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:16:10.252 "subtype": "NVMe", 00:16:10.252 "listen_addresses": [ 00:16:10.252 { 00:16:10.252 "transport": "VFIOUSER", 00:16:10.252 "trtype": "VFIOUSER", 00:16:10.252 "adrfam": "IPv4", 00:16:10.252 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:16:10.252 "trsvcid": "0" 00:16:10.252 } 00:16:10.252 ], 00:16:10.252 "allow_any_host": true, 00:16:10.252 "hosts": [], 00:16:10.252 "serial_number": "SPDK2", 00:16:10.252 "model_number": "SPDK bdev Controller", 00:16:10.252 "max_namespaces": 32, 00:16:10.252 "min_cntlid": 1, 00:16:10.252 "max_cntlid": 65519, 00:16:10.252 "namespaces": [ 00:16:10.252 { 00:16:10.252 "nsid": 1, 00:16:10.252 "bdev_name": "Malloc2", 00:16:10.252 "name": "Malloc2", 00:16:10.252 "nguid": "2F8C2BF3AD55420CB95FCE40E9FFFCF5", 00:16:10.252 "uuid": "2f8c2bf3-ad55-420c-b95f-ce40e9fffcf5" 00:16:10.252 } 00:16:10.252 ] 00:16:10.252 } 00:16:10.252 ] 00:16:10.252 23:08:13 -- target/nvmf_vfio_user.sh@27 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:16:10.252 23:08:13 -- target/nvmf_vfio_user.sh@34 -- # aerpid=2425801 00:16:10.252 23:08:13 -- target/nvmf_vfio_user.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -n 2 -g -t /tmp/aer_touch_file 00:16:10.252 23:08:13 -- target/nvmf_vfio_user.sh@37 -- # waitforfile /tmp/aer_touch_file 00:16:10.252 23:08:13 -- common/autotest_common.sh@1254 -- # local i=0 00:16:10.252 23:08:13 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:16:10.252 23:08:13 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:16:10.252 23:08:13 -- common/autotest_common.sh@1265 -- # return 0 00:16:10.252 23:08:13 -- target/nvmf_vfio_user.sh@38 -- # rm -f /tmp/aer_touch_file 00:16:10.252 23:08:13 -- target/nvmf_vfio_user.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 --name Malloc3 00:16:10.252 EAL: No free 2048 kB hugepages reported on node 1 00:16:10.510 Malloc3 00:16:10.510 23:08:14 -- target/nvmf_vfio_user.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc3 -n 2 00:16:10.767 23:08:14 -- target/nvmf_vfio_user.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:16:10.767 Asynchronous Event Request test 00:16:10.767 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:16:10.767 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:16:10.767 Registering asynchronous event callbacks... 00:16:10.767 Starting namespace attribute notice tests for all controllers... 00:16:10.767 /var/run/vfio-user/domain/vfio-user1/1: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:16:10.767 aer_cb - Changed Namespace 00:16:10.767 Cleaning up... 00:16:11.025 [ 00:16:11.025 { 00:16:11.025 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:16:11.025 "subtype": "Discovery", 00:16:11.025 "listen_addresses": [], 00:16:11.025 "allow_any_host": true, 00:16:11.025 "hosts": [] 00:16:11.025 }, 00:16:11.025 { 00:16:11.025 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:16:11.025 "subtype": "NVMe", 00:16:11.025 "listen_addresses": [ 00:16:11.025 { 00:16:11.025 "transport": "VFIOUSER", 00:16:11.025 "trtype": "VFIOUSER", 00:16:11.025 "adrfam": "IPv4", 00:16:11.025 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:16:11.025 "trsvcid": "0" 00:16:11.025 } 00:16:11.025 ], 00:16:11.025 "allow_any_host": true, 00:16:11.025 "hosts": [], 00:16:11.025 "serial_number": "SPDK1", 00:16:11.025 "model_number": "SPDK bdev Controller", 00:16:11.025 "max_namespaces": 32, 00:16:11.025 "min_cntlid": 1, 00:16:11.025 "max_cntlid": 65519, 00:16:11.025 "namespaces": [ 00:16:11.025 { 00:16:11.025 "nsid": 1, 00:16:11.025 "bdev_name": "Malloc1", 00:16:11.025 "name": "Malloc1", 00:16:11.025 "nguid": "3C0605388DD54603B78A7814161E4282", 00:16:11.025 "uuid": "3c060538-8dd5-4603-b78a-7814161e4282" 00:16:11.025 }, 00:16:11.025 { 00:16:11.025 "nsid": 2, 00:16:11.025 "bdev_name": "Malloc3", 00:16:11.025 "name": "Malloc3", 00:16:11.025 "nguid": "8F3683120FA84F549E15D51DC09387D2", 00:16:11.025 "uuid": "8f368312-0fa8-4f54-9e15-d51dc09387d2" 00:16:11.025 } 00:16:11.025 ] 00:16:11.025 }, 00:16:11.025 { 00:16:11.025 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:16:11.025 "subtype": "NVMe", 00:16:11.025 "listen_addresses": [ 00:16:11.025 { 00:16:11.025 "transport": "VFIOUSER", 00:16:11.025 "trtype": "VFIOUSER", 00:16:11.025 "adrfam": "IPv4", 00:16:11.025 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:16:11.025 "trsvcid": "0" 00:16:11.025 } 00:16:11.025 ], 00:16:11.025 "allow_any_host": true, 00:16:11.025 "hosts": [], 00:16:11.025 "serial_number": "SPDK2", 00:16:11.025 "model_number": "SPDK bdev Controller", 00:16:11.025 "max_namespaces": 32, 00:16:11.025 "min_cntlid": 1, 00:16:11.025 "max_cntlid": 65519, 00:16:11.025 "namespaces": [ 00:16:11.025 { 00:16:11.025 "nsid": 1, 00:16:11.025 "bdev_name": "Malloc2", 00:16:11.025 "name": "Malloc2", 00:16:11.025 "nguid": "2F8C2BF3AD55420CB95FCE40E9FFFCF5", 00:16:11.025 "uuid": "2f8c2bf3-ad55-420c-b95f-ce40e9fffcf5" 00:16:11.025 } 00:16:11.025 ] 00:16:11.025 } 00:16:11.025 ] 00:16:11.025 23:08:14 -- target/nvmf_vfio_user.sh@44 -- # wait 2425801 00:16:11.025 23:08:14 -- target/nvmf_vfio_user.sh@80 -- # for i in $(seq 1 $NUM_DEVICES) 00:16:11.025 23:08:14 -- target/nvmf_vfio_user.sh@81 -- # test_traddr=/var/run/vfio-user/domain/vfio-user2/2 00:16:11.025 23:08:14 -- target/nvmf_vfio_user.sh@82 -- # test_subnqn=nqn.2019-07.io.spdk:cnode2 00:16:11.025 23:08:14 -- target/nvmf_vfio_user.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -g -L nvme -L nvme_vfio -L vfio_pci 00:16:11.025 [2024-11-28 23:08:14.600038] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:11.025 [2024-11-28 23:08:14.600083] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --single-file-segments --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2425942 ] 00:16:11.025 EAL: No free 2048 kB hugepages reported on node 1 00:16:11.284 [2024-11-28 23:08:14.634654] nvme_vfio_user.c: 259:nvme_vfio_ctrlr_scan: *DEBUG*: Scan controller : /var/run/vfio-user/domain/vfio-user2/2 00:16:11.284 [2024-11-28 23:08:14.643353] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 0, Size 0x2000, Offset 0x0, Flags 0xf, Cap offset 32 00:16:11.284 [2024-11-28 23:08:14.643403] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0x1000, Offset 0x1000, Map addr 0x7f7258055000 00:16:11.284 [2024-11-28 23:08:14.644354] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 1, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:16:11.284 [2024-11-28 23:08:14.645356] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 2, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:16:11.284 [2024-11-28 23:08:14.649402] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 3, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:16:11.284 [2024-11-28 23:08:14.650389] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 4, Size 0x2000, Offset 0x0, Flags 0x3, Cap offset 0 00:16:11.284 [2024-11-28 23:08:14.651409] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 5, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:16:11.284 [2024-11-28 23:08:14.652413] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 6, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:16:11.284 [2024-11-28 23:08:14.653419] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 7, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:16:11.284 [2024-11-28 23:08:14.654427] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 8, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:16:11.284 [2024-11-28 23:08:14.655437] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 9, Size 0xc000, Offset 0x0, Flags 0xf, Cap offset 32 00:16:11.285 [2024-11-28 23:08:14.655460] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0xb000, Offset 0x1000, Map addr 0x7f7256d4d000 00:16:11.285 [2024-11-28 23:08:14.656581] vfio_user_pci.c: 65:vfio_add_mr: *DEBUG*: Add memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:16:11.285 [2024-11-28 23:08:14.669308] vfio_user_pci.c: 386:spdk_vfio_user_setup: *DEBUG*: Device vfio-user0, Path /var/run/vfio-user/domain/vfio-user2/2/cntrl Setup Successfully 00:16:11.285 [2024-11-28 23:08:14.669338] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to connect adminq (no timeout) 00:16:11.285 [2024-11-28 23:08:14.673472] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x0, value 0x201e0100ff 00:16:11.285 [2024-11-28 23:08:14.673524] nvme_pcie_common.c: 132:nvme_pcie_qpair_construct: *INFO*: max_completions_cap = 64 num_trackers = 192 00:16:11.285 [2024-11-28 23:08:14.673609] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for connect adminq (no timeout) 00:16:11.285 [2024-11-28 23:08:14.673634] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read vs (no timeout) 00:16:11.285 [2024-11-28 23:08:14.673645] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read vs wait for vs (no timeout) 00:16:11.285 [2024-11-28 23:08:14.674479] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x8, value 0x10300 00:16:11.285 [2024-11-28 23:08:14.674500] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read cap (no timeout) 00:16:11.285 [2024-11-28 23:08:14.674512] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read cap wait for cap (no timeout) 00:16:11.285 [2024-11-28 23:08:14.675491] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x0, value 0x201e0100ff 00:16:11.285 [2024-11-28 23:08:14.675512] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to check en (no timeout) 00:16:11.285 [2024-11-28 23:08:14.675526] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to check en wait for cc (timeout 15000 ms) 00:16:11.285 [2024-11-28 23:08:14.676494] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x0 00:16:11.285 [2024-11-28 23:08:14.676515] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:16:11.285 [2024-11-28 23:08:14.677502] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x0 00:16:11.285 [2024-11-28 23:08:14.677522] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CC.EN = 0 && CSTS.RDY = 0 00:16:11.285 [2024-11-28 23:08:14.677532] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to controller is disabled (timeout 15000 ms) 00:16:11.285 [2024-11-28 23:08:14.677544] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:16:11.285 [2024-11-28 23:08:14.677653] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Setting CC.EN = 1 00:16:11.285 [2024-11-28 23:08:14.677662] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:16:11.285 [2024-11-28 23:08:14.677670] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x28, value 0x2000003c0000 00:16:11.285 [2024-11-28 23:08:14.678509] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x30, value 0x2000003be000 00:16:11.285 [2024-11-28 23:08:14.679517] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x24, value 0xff00ff 00:16:11.285 [2024-11-28 23:08:14.680523] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x460001 00:16:11.285 [2024-11-28 23:08:14.681559] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:16:11.285 [2024-11-28 23:08:14.682541] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x1 00:16:11.285 [2024-11-28 23:08:14.682560] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:16:11.285 [2024-11-28 23:08:14.682570] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to reset admin queue (timeout 30000 ms) 00:16:11.285 [2024-11-28 23:08:14.682594] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify controller (no timeout) 00:16:11.285 [2024-11-28 23:08:14.682607] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify controller (timeout 30000 ms) 00:16:11.285 [2024-11-28 23:08:14.682624] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:16:11.285 [2024-11-28 23:08:14.682634] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:16:11.285 [2024-11-28 23:08:14.682651] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000001 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:16:11.285 [2024-11-28 23:08:14.691408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0001 p:1 m:0 dnr:0 00:16:11.285 [2024-11-28 23:08:14.691429] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] transport max_xfer_size 131072 00:16:11.285 [2024-11-28 23:08:14.691439] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] MDTS max_xfer_size 131072 00:16:11.285 [2024-11-28 23:08:14.691446] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CNTLID 0x0001 00:16:11.285 [2024-11-28 23:08:14.691454] nvme_ctrlr.c:1990:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Identify CNTLID 0x0001 != Connect CNTLID 0x0000 00:16:11.285 [2024-11-28 23:08:14.691462] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] transport max_sges 1 00:16:11.285 [2024-11-28 23:08:14.691470] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] fuses compare and write: 1 00:16:11.285 [2024-11-28 23:08:14.691478] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to configure AER (timeout 30000 ms) 00:16:11.285 [2024-11-28 23:08:14.691495] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for configure aer (timeout 30000 ms) 00:16:11.285 [2024-11-28 23:08:14.691512] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:191 cdw10:0000000b PRP1 0x0 PRP2 0x0 00:16:11.285 [2024-11-28 23:08:14.699402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0002 p:1 m:0 dnr:0 00:16:11.285 [2024-11-28 23:08:14.699447] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:190 nsid:0 cdw10:00000000 cdw11:00000000 00:16:11.285 [2024-11-28 23:08:14.699463] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:189 nsid:0 cdw10:00000000 cdw11:00000000 00:16:11.285 [2024-11-28 23:08:14.699475] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:188 nsid:0 cdw10:00000000 cdw11:00000000 00:16:11.285 [2024-11-28 23:08:14.699487] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:187 nsid:0 cdw10:00000000 cdw11:00000000 00:16:11.285 [2024-11-28 23:08:14.699496] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set keep alive timeout (timeout 30000 ms) 00:16:11.285 [2024-11-28 23:08:14.699514] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:16:11.285 [2024-11-28 23:08:14.699530] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:191 cdw10:0000000f PRP1 0x0 PRP2 0x0 00:16:11.285 [2024-11-28 23:08:14.707420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0007 p:1 m:0 dnr:0 00:16:11.285 [2024-11-28 23:08:14.707437] nvme_ctrlr.c:2878:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Controller adjusted keep alive timeout to 0 ms 00:16:11.285 [2024-11-28 23:08:14.707447] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify controller iocs specific (timeout 30000 ms) 00:16:11.285 [2024-11-28 23:08:14.707458] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set number of queues (timeout 30000 ms) 00:16:11.285 [2024-11-28 23:08:14.707472] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for set number of queues (timeout 30000 ms) 00:16:11.285 [2024-11-28 23:08:14.707487] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:16:11.285 [2024-11-28 23:08:14.715403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:0008 p:1 m:0 dnr:0 00:16:11.285 [2024-11-28 23:08:14.715473] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify active ns (timeout 30000 ms) 00:16:11.285 [2024-11-28 23:08:14.715488] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify active ns (timeout 30000 ms) 00:16:11.285 [2024-11-28 23:08:14.715501] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f9000 len:4096 00:16:11.285 [2024-11-28 23:08:14.715509] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f9000 00:16:11.285 [2024-11-28 23:08:14.715520] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000002 cdw11:00000000 PRP1 0x2000002f9000 PRP2 0x0 00:16:11.285 [2024-11-28 23:08:14.723404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0009 p:1 m:0 dnr:0 00:16:11.285 [2024-11-28 23:08:14.723430] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Namespace 1 was added 00:16:11.285 [2024-11-28 23:08:14.723446] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify ns (timeout 30000 ms) 00:16:11.285 [2024-11-28 23:08:14.723460] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify ns (timeout 30000 ms) 00:16:11.285 [2024-11-28 23:08:14.723472] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:16:11.285 [2024-11-28 23:08:14.723481] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:16:11.285 [2024-11-28 23:08:14.723491] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000000 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:16:11.285 [2024-11-28 23:08:14.731404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000a p:1 m:0 dnr:0 00:16:11.285 [2024-11-28 23:08:14.731431] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify namespace id descriptors (timeout 30000 ms) 00:16:11.285 [2024-11-28 23:08:14.731447] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:16:11.285 [2024-11-28 23:08:14.731460] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:16:11.285 [2024-11-28 23:08:14.731469] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:16:11.285 [2024-11-28 23:08:14.731482] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:16:11.286 [2024-11-28 23:08:14.739406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000b p:1 m:0 dnr:0 00:16:11.286 [2024-11-28 23:08:14.739427] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify ns iocs specific (timeout 30000 ms) 00:16:11.286 [2024-11-28 23:08:14.739439] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set supported log pages (timeout 30000 ms) 00:16:11.286 [2024-11-28 23:08:14.739453] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set supported features (timeout 30000 ms) 00:16:11.286 [2024-11-28 23:08:14.739465] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set doorbell buffer config (timeout 30000 ms) 00:16:11.286 [2024-11-28 23:08:14.739473] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set host ID (timeout 30000 ms) 00:16:11.286 [2024-11-28 23:08:14.739481] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] NVMe-oF transport - not sending Set Features - Host ID 00:16:11.286 [2024-11-28 23:08:14.739489] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to transport ready (timeout 30000 ms) 00:16:11.286 [2024-11-28 23:08:14.739498] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to ready (no timeout) 00:16:11.286 [2024-11-28 23:08:14.739522] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:191 cdw10:00000001 PRP1 0x0 PRP2 0x0 00:16:11.286 [2024-11-28 23:08:14.747403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000c p:1 m:0 dnr:0 00:16:11.286 [2024-11-28 23:08:14.747429] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:191 cdw10:00000002 PRP1 0x0 PRP2 0x0 00:16:11.286 [2024-11-28 23:08:14.755416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000d p:1 m:0 dnr:0 00:16:11.286 [2024-11-28 23:08:14.755441] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:191 cdw10:00000004 PRP1 0x0 PRP2 0x0 00:16:11.286 [2024-11-28 23:08:14.763420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000e p:1 m:0 dnr:0 00:16:11.286 [2024-11-28 23:08:14.763446] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:16:11.286 [2024-11-28 23:08:14.771405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:000f p:1 m:0 dnr:0 00:16:11.286 [2024-11-28 23:08:14.771431] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f6000 len:8192 00:16:11.286 [2024-11-28 23:08:14.771441] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f6000 00:16:11.286 [2024-11-28 23:08:14.771447] nvme_pcie_common.c:1235:nvme_pcie_prp_list_append: *DEBUG*: prp[0] = 0x2000002f7000 00:16:11.286 [2024-11-28 23:08:14.771453] nvme_pcie_common.c:1251:nvme_pcie_prp_list_append: *DEBUG*: prp2 = 0x2000002f7000 00:16:11.286 [2024-11-28 23:08:14.771463] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:191 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 PRP1 0x2000002f6000 PRP2 0x2000002f7000 00:16:11.286 [2024-11-28 23:08:14.771474] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fc000 len:512 00:16:11.286 [2024-11-28 23:08:14.771482] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fc000 00:16:11.286 [2024-11-28 23:08:14.771492] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:186 nsid:ffffffff cdw10:007f0002 cdw11:00000000 PRP1 0x2000002fc000 PRP2 0x0 00:16:11.286 [2024-11-28 23:08:14.771507] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:512 00:16:11.286 [2024-11-28 23:08:14.771517] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:16:11.286 [2024-11-28 23:08:14.771526] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:185 nsid:ffffffff cdw10:007f0003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:16:11.286 [2024-11-28 23:08:14.771538] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f4000 len:4096 00:16:11.286 [2024-11-28 23:08:14.771546] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f4000 00:16:11.286 [2024-11-28 23:08:14.771555] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:184 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 PRP1 0x2000002f4000 PRP2 0x0 00:16:11.286 [2024-11-28 23:08:14.779405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0010 p:1 m:0 dnr:0 00:16:11.286 [2024-11-28 23:08:14.779436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:186 cdw0:0 sqhd:0011 p:1 m:0 dnr:0 00:16:11.286 [2024-11-28 23:08:14.779453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:185 cdw0:0 sqhd:0012 p:1 m:0 dnr:0 00:16:11.286 [2024-11-28 23:08:14.779466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0013 p:1 m:0 dnr:0 00:16:11.286 ===================================================== 00:16:11.286 NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:11.286 ===================================================== 00:16:11.286 Controller Capabilities/Features 00:16:11.286 ================================ 00:16:11.286 Vendor ID: 4e58 00:16:11.286 Subsystem Vendor ID: 4e58 00:16:11.286 Serial Number: SPDK2 00:16:11.286 Model Number: SPDK bdev Controller 00:16:11.286 Firmware Version: 24.01.1 00:16:11.286 Recommended Arb Burst: 6 00:16:11.286 IEEE OUI Identifier: 8d 6b 50 00:16:11.286 Multi-path I/O 00:16:11.286 May have multiple subsystem ports: Yes 00:16:11.286 May have multiple controllers: Yes 00:16:11.286 Associated with SR-IOV VF: No 00:16:11.286 Max Data Transfer Size: 131072 00:16:11.286 Max Number of Namespaces: 32 00:16:11.286 Max Number of I/O Queues: 127 00:16:11.286 NVMe Specification Version (VS): 1.3 00:16:11.286 NVMe Specification Version (Identify): 1.3 00:16:11.286 Maximum Queue Entries: 256 00:16:11.286 Contiguous Queues Required: Yes 00:16:11.286 Arbitration Mechanisms Supported 00:16:11.286 Weighted Round Robin: Not Supported 00:16:11.286 Vendor Specific: Not Supported 00:16:11.286 Reset Timeout: 15000 ms 00:16:11.286 Doorbell Stride: 4 bytes 00:16:11.286 NVM Subsystem Reset: Not Supported 00:16:11.286 Command Sets Supported 00:16:11.286 NVM Command Set: Supported 00:16:11.286 Boot Partition: Not Supported 00:16:11.286 Memory Page Size Minimum: 4096 bytes 00:16:11.286 Memory Page Size Maximum: 4096 bytes 00:16:11.286 Persistent Memory Region: Not Supported 00:16:11.286 Optional Asynchronous Events Supported 00:16:11.286 Namespace Attribute Notices: Supported 00:16:11.286 Firmware Activation Notices: Not Supported 00:16:11.286 ANA Change Notices: Not Supported 00:16:11.286 PLE Aggregate Log Change Notices: Not Supported 00:16:11.286 LBA Status Info Alert Notices: Not Supported 00:16:11.286 EGE Aggregate Log Change Notices: Not Supported 00:16:11.286 Normal NVM Subsystem Shutdown event: Not Supported 00:16:11.286 Zone Descriptor Change Notices: Not Supported 00:16:11.286 Discovery Log Change Notices: Not Supported 00:16:11.286 Controller Attributes 00:16:11.286 128-bit Host Identifier: Supported 00:16:11.286 Non-Operational Permissive Mode: Not Supported 00:16:11.286 NVM Sets: Not Supported 00:16:11.286 Read Recovery Levels: Not Supported 00:16:11.286 Endurance Groups: Not Supported 00:16:11.286 Predictable Latency Mode: Not Supported 00:16:11.286 Traffic Based Keep ALive: Not Supported 00:16:11.286 Namespace Granularity: Not Supported 00:16:11.286 SQ Associations: Not Supported 00:16:11.286 UUID List: Not Supported 00:16:11.286 Multi-Domain Subsystem: Not Supported 00:16:11.286 Fixed Capacity Management: Not Supported 00:16:11.286 Variable Capacity Management: Not Supported 00:16:11.286 Delete Endurance Group: Not Supported 00:16:11.286 Delete NVM Set: Not Supported 00:16:11.286 Extended LBA Formats Supported: Not Supported 00:16:11.286 Flexible Data Placement Supported: Not Supported 00:16:11.286 00:16:11.286 Controller Memory Buffer Support 00:16:11.286 ================================ 00:16:11.286 Supported: No 00:16:11.286 00:16:11.286 Persistent Memory Region Support 00:16:11.286 ================================ 00:16:11.286 Supported: No 00:16:11.286 00:16:11.286 Admin Command Set Attributes 00:16:11.286 ============================ 00:16:11.286 Security Send/Receive: Not Supported 00:16:11.286 Format NVM: Not Supported 00:16:11.286 Firmware Activate/Download: Not Supported 00:16:11.286 Namespace Management: Not Supported 00:16:11.286 Device Self-Test: Not Supported 00:16:11.286 Directives: Not Supported 00:16:11.286 NVMe-MI: Not Supported 00:16:11.286 Virtualization Management: Not Supported 00:16:11.286 Doorbell Buffer Config: Not Supported 00:16:11.286 Get LBA Status Capability: Not Supported 00:16:11.286 Command & Feature Lockdown Capability: Not Supported 00:16:11.286 Abort Command Limit: 4 00:16:11.286 Async Event Request Limit: 4 00:16:11.286 Number of Firmware Slots: N/A 00:16:11.286 Firmware Slot 1 Read-Only: N/A 00:16:11.286 Firmware Activation Without Reset: N/A 00:16:11.286 Multiple Update Detection Support: N/A 00:16:11.286 Firmware Update Granularity: No Information Provided 00:16:11.286 Per-Namespace SMART Log: No 00:16:11.286 Asymmetric Namespace Access Log Page: Not Supported 00:16:11.286 Subsystem NQN: nqn.2019-07.io.spdk:cnode2 00:16:11.286 Command Effects Log Page: Supported 00:16:11.286 Get Log Page Extended Data: Supported 00:16:11.286 Telemetry Log Pages: Not Supported 00:16:11.286 Persistent Event Log Pages: Not Supported 00:16:11.286 Supported Log Pages Log Page: May Support 00:16:11.286 Commands Supported & Effects Log Page: Not Supported 00:16:11.286 Feature Identifiers & Effects Log Page:May Support 00:16:11.286 NVMe-MI Commands & Effects Log Page: May Support 00:16:11.286 Data Area 4 for Telemetry Log: Not Supported 00:16:11.286 Error Log Page Entries Supported: 128 00:16:11.286 Keep Alive: Supported 00:16:11.286 Keep Alive Granularity: 10000 ms 00:16:11.286 00:16:11.286 NVM Command Set Attributes 00:16:11.286 ========================== 00:16:11.286 Submission Queue Entry Size 00:16:11.286 Max: 64 00:16:11.286 Min: 64 00:16:11.287 Completion Queue Entry Size 00:16:11.287 Max: 16 00:16:11.287 Min: 16 00:16:11.287 Number of Namespaces: 32 00:16:11.287 Compare Command: Supported 00:16:11.287 Write Uncorrectable Command: Not Supported 00:16:11.287 Dataset Management Command: Supported 00:16:11.287 Write Zeroes Command: Supported 00:16:11.287 Set Features Save Field: Not Supported 00:16:11.287 Reservations: Not Supported 00:16:11.287 Timestamp: Not Supported 00:16:11.287 Copy: Supported 00:16:11.287 Volatile Write Cache: Present 00:16:11.287 Atomic Write Unit (Normal): 1 00:16:11.287 Atomic Write Unit (PFail): 1 00:16:11.287 Atomic Compare & Write Unit: 1 00:16:11.287 Fused Compare & Write: Supported 00:16:11.287 Scatter-Gather List 00:16:11.287 SGL Command Set: Supported (Dword aligned) 00:16:11.287 SGL Keyed: Not Supported 00:16:11.287 SGL Bit Bucket Descriptor: Not Supported 00:16:11.287 SGL Metadata Pointer: Not Supported 00:16:11.287 Oversized SGL: Not Supported 00:16:11.287 SGL Metadata Address: Not Supported 00:16:11.287 SGL Offset: Not Supported 00:16:11.287 Transport SGL Data Block: Not Supported 00:16:11.287 Replay Protected Memory Block: Not Supported 00:16:11.287 00:16:11.287 Firmware Slot Information 00:16:11.287 ========================= 00:16:11.287 Active slot: 1 00:16:11.287 Slot 1 Firmware Revision: 24.01.1 00:16:11.287 00:16:11.287 00:16:11.287 Commands Supported and Effects 00:16:11.287 ============================== 00:16:11.287 Admin Commands 00:16:11.287 -------------- 00:16:11.287 Get Log Page (02h): Supported 00:16:11.287 Identify (06h): Supported 00:16:11.287 Abort (08h): Supported 00:16:11.287 Set Features (09h): Supported 00:16:11.287 Get Features (0Ah): Supported 00:16:11.287 Asynchronous Event Request (0Ch): Supported 00:16:11.287 Keep Alive (18h): Supported 00:16:11.287 I/O Commands 00:16:11.287 ------------ 00:16:11.287 Flush (00h): Supported LBA-Change 00:16:11.287 Write (01h): Supported LBA-Change 00:16:11.287 Read (02h): Supported 00:16:11.287 Compare (05h): Supported 00:16:11.287 Write Zeroes (08h): Supported LBA-Change 00:16:11.287 Dataset Management (09h): Supported LBA-Change 00:16:11.287 Copy (19h): Supported LBA-Change 00:16:11.287 Unknown (79h): Supported LBA-Change 00:16:11.287 Unknown (7Ah): Supported 00:16:11.287 00:16:11.287 Error Log 00:16:11.287 ========= 00:16:11.287 00:16:11.287 Arbitration 00:16:11.287 =========== 00:16:11.287 Arbitration Burst: 1 00:16:11.287 00:16:11.287 Power Management 00:16:11.287 ================ 00:16:11.287 Number of Power States: 1 00:16:11.287 Current Power State: Power State #0 00:16:11.287 Power State #0: 00:16:11.287 Max Power: 0.00 W 00:16:11.287 Non-Operational State: Operational 00:16:11.287 Entry Latency: Not Reported 00:16:11.287 Exit Latency: Not Reported 00:16:11.287 Relative Read Throughput: 0 00:16:11.287 Relative Read Latency: 0 00:16:11.287 Relative Write Throughput: 0 00:16:11.287 Relative Write Latency: 0 00:16:11.287 Idle Power: Not Reported 00:16:11.287 Active Power: Not Reported 00:16:11.287 Non-Operational Permissive Mode: Not Supported 00:16:11.287 00:16:11.287 Health Information 00:16:11.287 ================== 00:16:11.287 Critical Warnings: 00:16:11.287 Available Spare Space: OK 00:16:11.287 Temperature: OK 00:16:11.287 Device Reliability: OK 00:16:11.287 Read Only: No 00:16:11.287 Volatile Memory Backup: OK 00:16:11.287 Current Temperature: 0 Kelvin[2024-11-28 23:08:14.779594] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:184 cdw10:00000005 PRP1 0x0 PRP2 0x0 00:16:11.287 [2024-11-28 23:08:14.787403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0014 p:1 m:0 dnr:0 00:16:11.287 [2024-11-28 23:08:14.787449] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Prepare to destruct SSD 00:16:11.287 [2024-11-28 23:08:14.787466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:190 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:11.287 [2024-11-28 23:08:14.787477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:189 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:11.287 [2024-11-28 23:08:14.787487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:188 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:11.287 [2024-11-28 23:08:14.787497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:187 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:11.287 [2024-11-28 23:08:14.787574] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x460001 00:16:11.287 [2024-11-28 23:08:14.787595] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x464001 00:16:11.287 [2024-11-28 23:08:14.788623] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] RTD3E = 0 us 00:16:11.287 [2024-11-28 23:08:14.788640] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] shutdown timeout = 10000 ms 00:16:11.287 [2024-11-28 23:08:14.789592] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x9 00:16:11.287 [2024-11-28 23:08:14.789616] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] shutdown complete in 0 milliseconds 00:16:11.287 [2024-11-28 23:08:14.789667] vfio_user_pci.c: 399:spdk_vfio_user_release: *DEBUG*: Release file /var/run/vfio-user/domain/vfio-user2/2/cntrl 00:16:11.287 [2024-11-28 23:08:14.790861] vfio_user_pci.c: 96:vfio_remove_mr: *DEBUG*: Remove memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:16:11.287 (-273 Celsius) 00:16:11.287 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:16:11.287 Available Spare: 0% 00:16:11.287 Available Spare Threshold: 0% 00:16:11.287 Life Percentage Used: 0% 00:16:11.287 Data Units Read: 0 00:16:11.287 Data Units Written: 0 00:16:11.287 Host Read Commands: 0 00:16:11.287 Host Write Commands: 0 00:16:11.287 Controller Busy Time: 0 minutes 00:16:11.287 Power Cycles: 0 00:16:11.287 Power On Hours: 0 hours 00:16:11.287 Unsafe Shutdowns: 0 00:16:11.287 Unrecoverable Media Errors: 0 00:16:11.287 Lifetime Error Log Entries: 0 00:16:11.287 Warning Temperature Time: 0 minutes 00:16:11.287 Critical Temperature Time: 0 minutes 00:16:11.287 00:16:11.287 Number of Queues 00:16:11.287 ================ 00:16:11.287 Number of I/O Submission Queues: 127 00:16:11.287 Number of I/O Completion Queues: 127 00:16:11.287 00:16:11.287 Active Namespaces 00:16:11.287 ================= 00:16:11.287 Namespace ID:1 00:16:11.287 Error Recovery Timeout: Unlimited 00:16:11.287 Command Set Identifier: NVM (00h) 00:16:11.287 Deallocate: Supported 00:16:11.287 Deallocated/Unwritten Error: Not Supported 00:16:11.287 Deallocated Read Value: Unknown 00:16:11.287 Deallocate in Write Zeroes: Not Supported 00:16:11.287 Deallocated Guard Field: 0xFFFF 00:16:11.287 Flush: Supported 00:16:11.287 Reservation: Supported 00:16:11.287 Namespace Sharing Capabilities: Multiple Controllers 00:16:11.287 Size (in LBAs): 131072 (0GiB) 00:16:11.287 Capacity (in LBAs): 131072 (0GiB) 00:16:11.287 Utilization (in LBAs): 131072 (0GiB) 00:16:11.287 NGUID: 2F8C2BF3AD55420CB95FCE40E9FFFCF5 00:16:11.287 UUID: 2f8c2bf3-ad55-420c-b95f-ce40e9fffcf5 00:16:11.287 Thin Provisioning: Not Supported 00:16:11.287 Per-NS Atomic Units: Yes 00:16:11.287 Atomic Boundary Size (Normal): 0 00:16:11.287 Atomic Boundary Size (PFail): 0 00:16:11.287 Atomic Boundary Offset: 0 00:16:11.287 Maximum Single Source Range Length: 65535 00:16:11.287 Maximum Copy Length: 65535 00:16:11.287 Maximum Source Range Count: 1 00:16:11.287 NGUID/EUI64 Never Reused: No 00:16:11.287 Namespace Write Protected: No 00:16:11.287 Number of LBA Formats: 1 00:16:11.287 Current LBA Format: LBA Format #00 00:16:11.287 LBA Format #00: Data Size: 512 Metadata Size: 0 00:16:11.287 00:16:11.287 23:08:14 -- target/nvmf_vfio_user.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -s 256 -g -q 128 -o 4096 -w read -t 5 -c 0x2 00:16:11.287 EAL: No free 2048 kB hugepages reported on node 1 00:16:17.843 Initializing NVMe Controllers 00:16:17.843 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:17.843 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 with lcore 1 00:16:17.843 Initialization complete. Launching workers. 00:16:17.843 ======================================================== 00:16:17.843 Latency(us) 00:16:17.843 Device Information : IOPS MiB/s Average min max 00:16:17.843 VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 from core 1: 36858.46 143.98 3472.12 1164.11 7669.94 00:16:17.843 ======================================================== 00:16:17.843 Total : 36858.46 143.98 3472.12 1164.11 7669.94 00:16:17.843 00:16:17.843 23:08:20 -- target/nvmf_vfio_user.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -s 256 -g -q 128 -o 4096 -w write -t 5 -c 0x2 00:16:17.843 EAL: No free 2048 kB hugepages reported on node 1 00:16:22.021 Initializing NVMe Controllers 00:16:22.021 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:22.021 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 with lcore 1 00:16:22.021 Initialization complete. Launching workers. 00:16:22.021 ======================================================== 00:16:22.021 Latency(us) 00:16:22.021 Device Information : IOPS MiB/s Average min max 00:16:22.021 VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 from core 1: 33495.15 130.84 3822.92 1202.94 7401.06 00:16:22.021 ======================================================== 00:16:22.021 Total : 33495.15 130.84 3822.92 1202.94 7401.06 00:16:22.021 00:16:22.021 23:08:25 -- target/nvmf_vfio_user.sh@86 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -g -q 32 -o 4096 -w randrw -M 50 -t 5 -c 0xE 00:16:22.022 EAL: No free 2048 kB hugepages reported on node 1 00:16:27.285 Initializing NVMe Controllers 00:16:27.285 Attaching to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:27.285 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:27.285 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 1 00:16:27.285 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 2 00:16:27.285 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 3 00:16:27.285 Initialization complete. Launching workers. 00:16:27.285 Starting thread on core 2 00:16:27.285 Starting thread on core 3 00:16:27.285 Starting thread on core 1 00:16:27.285 23:08:30 -- target/nvmf_vfio_user.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -t 3 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -d 256 -g 00:16:27.285 EAL: No free 2048 kB hugepages reported on node 1 00:16:30.565 Initializing NVMe Controllers 00:16:30.565 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:30.565 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:30.565 Associating SPDK bdev Controller (SPDK2 ) with lcore 0 00:16:30.565 Associating SPDK bdev Controller (SPDK2 ) with lcore 1 00:16:30.565 Associating SPDK bdev Controller (SPDK2 ) with lcore 2 00:16:30.565 Associating SPDK bdev Controller (SPDK2 ) with lcore 3 00:16:30.565 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration run with configuration: 00:16:30.565 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -q 64 -s 131072 -w randrw -M 50 -l 0 -t 3 -c 0xf -m 0 -a 0 -b 0 -n 100000 -i -1 00:16:30.565 Initialization complete. Launching workers. 00:16:30.565 Starting thread on core 1 with urgent priority queue 00:16:30.565 Starting thread on core 2 with urgent priority queue 00:16:30.565 Starting thread on core 3 with urgent priority queue 00:16:30.565 Starting thread on core 0 with urgent priority queue 00:16:30.565 SPDK bdev Controller (SPDK2 ) core 0: 5500.67 IO/s 18.18 secs/100000 ios 00:16:30.565 SPDK bdev Controller (SPDK2 ) core 1: 5329.33 IO/s 18.76 secs/100000 ios 00:16:30.566 SPDK bdev Controller (SPDK2 ) core 2: 5451.33 IO/s 18.34 secs/100000 ios 00:16:30.566 SPDK bdev Controller (SPDK2 ) core 3: 5633.00 IO/s 17.75 secs/100000 ios 00:16:30.566 ======================================================== 00:16:30.566 00:16:30.566 23:08:34 -- target/nvmf_vfio_user.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/hello_world -d 256 -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' 00:16:30.823 EAL: No free 2048 kB hugepages reported on node 1 00:16:31.081 Initializing NVMe Controllers 00:16:31.081 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:31.081 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:31.081 Namespace ID: 1 size: 0GB 00:16:31.081 Initialization complete. 00:16:31.081 INFO: using host memory buffer for IO 00:16:31.081 Hello world! 00:16:31.081 23:08:34 -- target/nvmf_vfio_user.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/overhead/overhead -o 4096 -t 1 -H -g -d 256 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' 00:16:31.081 EAL: No free 2048 kB hugepages reported on node 1 00:16:32.455 Initializing NVMe Controllers 00:16:32.455 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:32.455 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:32.455 Initialization complete. Launching workers. 00:16:32.455 submit (in ns) avg, min, max = 5575.3, 3446.7, 4017653.3 00:16:32.455 complete (in ns) avg, min, max = 28190.0, 2032.2, 4998248.9 00:16:32.455 00:16:32.455 Submit histogram 00:16:32.455 ================ 00:16:32.455 Range in us Cumulative Count 00:16:32.455 3.437 - 3.461: 0.0803% ( 11) 00:16:32.455 3.461 - 3.484: 0.5253% ( 61) 00:16:32.455 3.484 - 3.508: 1.9845% ( 200) 00:16:32.455 3.508 - 3.532: 5.1218% ( 430) 00:16:32.455 3.532 - 3.556: 10.9879% ( 804) 00:16:32.455 3.556 - 3.579: 20.2028% ( 1263) 00:16:32.455 3.579 - 3.603: 30.4027% ( 1398) 00:16:32.455 3.603 - 3.627: 39.0559% ( 1186) 00:16:32.455 3.627 - 3.650: 47.1399% ( 1108) 00:16:32.455 3.650 - 3.674: 53.3489% ( 851) 00:16:32.455 3.674 - 3.698: 59.2004% ( 802) 00:16:32.455 3.698 - 3.721: 64.2930% ( 698) 00:16:32.455 3.721 - 3.745: 68.2183% ( 538) 00:16:32.455 3.745 - 3.769: 71.6693% ( 473) 00:16:32.455 3.769 - 3.793: 74.9234% ( 446) 00:16:32.455 3.793 - 3.816: 78.2650% ( 458) 00:16:32.455 3.816 - 3.840: 82.1100% ( 527) 00:16:32.455 3.840 - 3.864: 84.9628% ( 391) 00:16:32.455 3.864 - 3.887: 87.0932% ( 292) 00:16:32.455 3.887 - 3.911: 89.1580% ( 283) 00:16:32.455 3.911 - 3.935: 91.1134% ( 268) 00:16:32.455 3.935 - 3.959: 92.6091% ( 205) 00:16:32.455 3.959 - 3.982: 93.9370% ( 182) 00:16:32.455 3.982 - 4.006: 94.9511% ( 139) 00:16:32.455 4.006 - 4.030: 95.5786% ( 86) 00:16:32.455 4.030 - 4.053: 96.1987% ( 85) 00:16:32.455 4.053 - 4.077: 96.6146% ( 57) 00:16:32.455 4.077 - 4.101: 96.9138% ( 41) 00:16:32.455 4.101 - 4.124: 97.0816% ( 23) 00:16:32.455 4.124 - 4.148: 97.2056% ( 17) 00:16:32.455 4.148 - 4.172: 97.3077% ( 14) 00:16:32.455 4.172 - 4.196: 97.4537% ( 20) 00:16:32.455 4.196 - 4.219: 97.5631% ( 15) 00:16:32.455 4.219 - 4.243: 97.6434% ( 11) 00:16:32.455 4.243 - 4.267: 97.7017% ( 8) 00:16:32.455 4.267 - 4.290: 97.7820% ( 11) 00:16:32.455 4.290 - 4.314: 97.8550% ( 10) 00:16:32.455 4.314 - 4.338: 97.9060% ( 7) 00:16:32.455 4.338 - 4.361: 97.9571% ( 7) 00:16:32.455 4.361 - 4.385: 97.9644% ( 1) 00:16:32.455 4.385 - 4.409: 97.9790% ( 2) 00:16:32.455 4.409 - 4.433: 97.9863% ( 1) 00:16:32.455 4.433 - 4.456: 97.9936% ( 1) 00:16:32.455 4.456 - 4.480: 98.0082% ( 2) 00:16:32.455 4.504 - 4.527: 98.0155% ( 1) 00:16:32.455 4.527 - 4.551: 98.0301% ( 2) 00:16:32.455 4.551 - 4.575: 98.0592% ( 4) 00:16:32.455 4.575 - 4.599: 98.0665% ( 1) 00:16:32.455 4.599 - 4.622: 98.0738% ( 1) 00:16:32.455 4.622 - 4.646: 98.1030% ( 4) 00:16:32.455 4.646 - 4.670: 98.1176% ( 2) 00:16:32.455 4.670 - 4.693: 98.1687% ( 7) 00:16:32.455 4.693 - 4.717: 98.1979% ( 4) 00:16:32.455 4.717 - 4.741: 98.2416% ( 6) 00:16:32.455 4.741 - 4.764: 98.2781% ( 5) 00:16:32.455 4.764 - 4.788: 98.3219% ( 6) 00:16:32.455 4.788 - 4.812: 98.3803% ( 8) 00:16:32.455 4.812 - 4.836: 98.4095% ( 4) 00:16:32.455 4.836 - 4.859: 98.4605% ( 7) 00:16:32.455 4.859 - 4.883: 98.4970% ( 5) 00:16:32.455 4.883 - 4.907: 98.5335% ( 5) 00:16:32.455 4.907 - 4.930: 98.5408% ( 1) 00:16:32.455 4.930 - 4.954: 98.5627% ( 3) 00:16:32.455 4.954 - 4.978: 98.5919% ( 4) 00:16:32.455 4.978 - 5.001: 98.6137% ( 3) 00:16:32.455 5.001 - 5.025: 98.6210% ( 1) 00:16:32.455 5.049 - 5.073: 98.6575% ( 5) 00:16:32.455 5.073 - 5.096: 98.6867% ( 4) 00:16:32.455 5.096 - 5.120: 98.7086% ( 3) 00:16:32.455 5.120 - 5.144: 98.7232% ( 2) 00:16:32.455 5.144 - 5.167: 98.7305% ( 1) 00:16:32.455 5.167 - 5.191: 98.7378% ( 1) 00:16:32.455 5.191 - 5.215: 98.7597% ( 3) 00:16:32.455 5.215 - 5.239: 98.7743% ( 2) 00:16:32.455 5.239 - 5.262: 98.7816% ( 1) 00:16:32.455 5.262 - 5.286: 98.7889% ( 1) 00:16:32.455 5.310 - 5.333: 98.7961% ( 1) 00:16:32.455 5.333 - 5.357: 98.8034% ( 1) 00:16:32.455 5.357 - 5.381: 98.8107% ( 1) 00:16:32.455 5.547 - 5.570: 98.8180% ( 1) 00:16:32.455 5.618 - 5.641: 98.8253% ( 1) 00:16:32.455 5.665 - 5.689: 98.8326% ( 1) 00:16:32.455 5.973 - 5.997: 98.8399% ( 1) 00:16:32.455 6.021 - 6.044: 98.8472% ( 1) 00:16:32.455 6.163 - 6.210: 98.8545% ( 1) 00:16:32.455 6.400 - 6.447: 98.8691% ( 2) 00:16:32.455 6.590 - 6.637: 98.8764% ( 1) 00:16:32.455 6.637 - 6.684: 98.8837% ( 1) 00:16:32.455 6.732 - 6.779: 98.8910% ( 1) 00:16:32.455 6.874 - 6.921: 98.9056% ( 2) 00:16:32.455 7.016 - 7.064: 98.9129% ( 1) 00:16:32.455 7.064 - 7.111: 98.9202% ( 1) 00:16:32.455 7.111 - 7.159: 98.9421% ( 3) 00:16:32.456 7.206 - 7.253: 98.9494% ( 1) 00:16:32.456 7.253 - 7.301: 98.9567% ( 1) 00:16:32.456 7.348 - 7.396: 98.9640% ( 1) 00:16:32.456 7.396 - 7.443: 98.9713% ( 1) 00:16:32.456 7.443 - 7.490: 98.9858% ( 2) 00:16:32.456 7.490 - 7.538: 98.9931% ( 1) 00:16:32.456 7.585 - 7.633: 99.0004% ( 1) 00:16:32.456 7.680 - 7.727: 99.0077% ( 1) 00:16:32.456 7.727 - 7.775: 99.0296% ( 3) 00:16:32.456 7.775 - 7.822: 99.0369% ( 1) 00:16:32.456 7.822 - 7.870: 99.0515% ( 2) 00:16:32.456 7.917 - 7.964: 99.0734% ( 3) 00:16:32.456 7.964 - 8.012: 99.0807% ( 1) 00:16:32.456 8.012 - 8.059: 99.0880% ( 1) 00:16:32.456 8.059 - 8.107: 99.0953% ( 1) 00:16:32.456 8.154 - 8.201: 99.1026% ( 1) 00:16:32.456 8.439 - 8.486: 99.1099% ( 1) 00:16:32.456 8.676 - 8.723: 99.1172% ( 1) 00:16:32.456 8.818 - 8.865: 99.1245% ( 1) 00:16:32.456 8.913 - 8.960: 99.1391% ( 2) 00:16:32.456 9.055 - 9.102: 99.1537% ( 2) 00:16:32.456 9.102 - 9.150: 99.1610% ( 1) 00:16:32.456 9.624 - 9.671: 99.1755% ( 2) 00:16:32.456 9.719 - 9.766: 99.1828% ( 1) 00:16:32.456 9.956 - 10.003: 99.1901% ( 1) 00:16:32.456 10.145 - 10.193: 99.1974% ( 1) 00:16:32.456 10.477 - 10.524: 99.2047% ( 1) 00:16:32.456 10.714 - 10.761: 99.2120% ( 1) 00:16:32.456 10.904 - 10.951: 99.2339% ( 3) 00:16:32.456 11.046 - 11.093: 99.2485% ( 2) 00:16:32.456 11.141 - 11.188: 99.2558% ( 1) 00:16:32.456 11.188 - 11.236: 99.2631% ( 1) 00:16:32.456 11.283 - 11.330: 99.2704% ( 1) 00:16:32.456 11.567 - 11.615: 99.2777% ( 1) 00:16:32.456 11.757 - 11.804: 99.2850% ( 1) 00:16:32.456 11.804 - 11.852: 99.2923% ( 1) 00:16:32.456 12.041 - 12.089: 99.2996% ( 1) 00:16:32.456 12.421 - 12.516: 99.3069% ( 1) 00:16:32.456 12.705 - 12.800: 99.3142% ( 1) 00:16:32.456 12.800 - 12.895: 99.3215% ( 1) 00:16:32.456 13.369 - 13.464: 99.3288% ( 1) 00:16:32.456 13.464 - 13.559: 99.3361% ( 1) 00:16:32.456 13.748 - 13.843: 99.3434% ( 1) 00:16:32.456 14.033 - 14.127: 99.3506% ( 1) 00:16:32.456 14.222 - 14.317: 99.3652% ( 2) 00:16:32.456 14.412 - 14.507: 99.3798% ( 2) 00:16:32.456 14.601 - 14.696: 99.3871% ( 1) 00:16:32.456 17.161 - 17.256: 99.4017% ( 2) 00:16:32.456 17.351 - 17.446: 99.4309% ( 4) 00:16:32.456 17.446 - 17.541: 99.4455% ( 2) 00:16:32.456 17.541 - 17.636: 99.4747% ( 4) 00:16:32.456 17.636 - 17.730: 99.4966% ( 3) 00:16:32.456 17.730 - 17.825: 99.5112% ( 2) 00:16:32.456 17.825 - 17.920: 99.5403% ( 4) 00:16:32.456 17.920 - 18.015: 99.5841% ( 6) 00:16:32.456 18.015 - 18.110: 99.6133% ( 4) 00:16:32.456 18.110 - 18.204: 99.6644% ( 7) 00:16:32.456 18.204 - 18.299: 99.7155% ( 7) 00:16:32.456 18.299 - 18.394: 99.7519% ( 5) 00:16:32.456 18.394 - 18.489: 99.7811% ( 4) 00:16:32.456 18.489 - 18.584: 99.7957% ( 2) 00:16:32.456 18.584 - 18.679: 99.8249% ( 4) 00:16:32.456 18.868 - 18.963: 99.8468% ( 3) 00:16:32.456 19.058 - 19.153: 99.8614% ( 2) 00:16:32.456 19.153 - 19.247: 99.8979% ( 5) 00:16:32.456 19.247 - 19.342: 99.9124% ( 2) 00:16:32.456 19.532 - 19.627: 99.9197% ( 1) 00:16:32.456 19.627 - 19.721: 99.9270% ( 1) 00:16:32.456 19.816 - 19.911: 99.9343% ( 1) 00:16:32.456 20.101 - 20.196: 99.9416% ( 1) 00:16:32.456 22.471 - 22.566: 99.9489% ( 1) 00:16:32.456 24.178 - 24.273: 99.9562% ( 1) 00:16:32.456 3980.705 - 4004.978: 99.9708% ( 2) 00:16:32.456 4004.978 - 4029.250: 100.0000% ( 4) 00:16:32.456 00:16:32.456 Complete histogram 00:16:32.456 ================== 00:16:32.456 Range in us Cumulative Count 00:16:32.456 2.027 - 2.039: 0.6566% ( 90) 00:16:32.456 2.039 - 2.050: 13.9501% ( 1822) 00:16:32.456 2.050 - 2.062: 17.9410% ( 547) 00:16:32.456 2.062 - 2.074: 26.1345% ( 1123) 00:16:32.456 2.074 - 2.086: 55.1875% ( 3982) 00:16:32.456 2.086 - 2.098: 59.9445% ( 652) 00:16:32.456 2.098 - 2.110: 62.9068% ( 406) 00:16:32.456 2.110 - 2.121: 67.7441% ( 663) 00:16:32.456 2.121 - 2.133: 68.4153% ( 92) 00:16:32.456 2.133 - 2.145: 77.1779% ( 1201) 00:16:32.456 2.145 - 2.157: 88.5598% ( 1560) 00:16:32.456 2.157 - 2.169: 90.0919% ( 210) 00:16:32.456 2.169 - 2.181: 91.4855% ( 191) 00:16:32.456 2.181 - 2.193: 92.3829% ( 123) 00:16:32.456 2.193 - 2.204: 92.9958% ( 84) 00:16:32.456 2.204 - 2.216: 94.4185% ( 195) 00:16:32.456 2.216 - 2.228: 95.6297% ( 166) 00:16:32.456 2.228 - 2.240: 95.8704% ( 33) 00:16:32.456 2.240 - 2.252: 96.0163% ( 20) 00:16:32.456 2.252 - 2.264: 96.1185% ( 14) 00:16:32.456 2.264 - 2.276: 96.2060% ( 12) 00:16:32.456 2.276 - 2.287: 96.3301% ( 17) 00:16:32.456 2.287 - 2.299: 96.3957% ( 9) 00:16:32.456 2.299 - 2.311: 96.4687% ( 10) 00:16:32.456 2.311 - 2.323: 96.6511% ( 25) 00:16:32.456 2.323 - 2.335: 96.9138% ( 36) 00:16:32.456 2.335 - 2.347: 97.1545% ( 33) 00:16:32.456 2.347 - 2.359: 97.5631% ( 56) 00:16:32.456 2.359 - 2.370: 97.9717% ( 56) 00:16:32.456 2.370 - 2.382: 98.1249% ( 21) 00:16:32.456 2.382 - 2.394: 98.2343% ( 15) 00:16:32.456 2.394 - 2.406: 98.3000% ( 9) 00:16:32.456 2.406 - 2.418: 98.3438% ( 6) 00:16:32.456 2.418 - 2.430: 98.3584% ( 2) 00:16:32.456 2.430 - 2.441: 98.4168% ( 8) 00:16:32.456 2.441 - 2.453: 98.4313% ( 2) 00:16:32.456 2.453 - 2.465: 98.4459% ( 2) 00:16:32.456 2.465 - 2.477: 98.4532% ( 1) 00:16:32.456 2.477 - 2.489: 98.4678% ( 2) 00:16:32.456 2.489 - 2.501: 98.4751% ( 1) 00:16:32.456 2.607 - 2.619: 98.4824% ( 1) 00:16:32.456 2.619 - 2.631: 98.4897% ( 1) 00:16:32.456 2.655 - 2.667: 98.5043% ( 2) 00:16:32.456 2.667 - 2.679: 98.5189% ( 2) 00:16:32.456 2.797 - 2.809: 98.5262% ( 1) 00:16:32.456 2.844 - 2.856: 98.5335% ( 1) 00:16:32.456 3.081 - 3.105: 98.5408% ( 1) 00:16:32.456 3.247 - 3.271: 98.5481% ( 1) 00:16:32.456 3.319 - 3.342: 98.5627% ( 2) 00:16:32.456 3.342 - 3.366: 98.5700% ( 1) 00:16:32.456 3.366 - 3.390: 98.5773% ( 1) 00:16:32.456 3.390 - 3.413: 98.5846% ( 1) 00:16:32.456 3.437 - 3.461: 98.5992% ( 2) 00:16:32.456 3.484 - 3.508: 98.6064% ( 1) 00:16:32.456 3.508 - 3.532: 98.6210% ( 2) 00:16:32.457 3.532 - 3.556: 98.6283% ( 1) 00:16:32.457 3.603 - 3.627: 98.6356% ( 1) 00:16:32.457 3.627 - 3.650: 98.6429% ( 1) 00:16:32.457 3.793 - 3.816: 98.6502% ( 1) 00:16:32.457 3.816 - 3.840: 98.6575% ( 1) 00:16:32.457 3.840 - 3.864: 98.6648% ( 1) 00:16:32.457 3.864 - 3.887: 98.6721% ( 1) 00:16:32.457 3.887 - 3.911: 98.6794% ( 1) 00:16:32.457 4.006 - 4.030: 98.6867% ( 1) 00:16:32.457 4.859 - 4.883: 98.6940% ( 1) 00:16:32.457 5.096 - 5.120: 98.7013% ( 1) 00:16:32.457 5.310 - 5.333: 98.7086% ( 1) 00:16:32.457 5.428 - 5.452: 98.7159% ( 1) 00:16:32.457 5.476 - 5.499: 98.7232% ( 1) 00:16:32.457 5.570 - 5.594: 98.7378% ( 2) 00:16:32.457 5.641 - 5.665: 98.7524% ( 2) 00:16:32.457 5.784 - 5.807: 98.7597% ( 1) 00:16:32.457 5.831 - 5.855: 98.7670% ( 1) 00:16:32.457 5.926 - 5.950: 98.7743% ( 1) 00:16:32.457 6.068 - 6.116: 98.7889% ( 2) 00:16:32.457 6.163 - 6.210: 98.7961% ( 1) 00:16:32.457 6.258 - 6.305: 98.8034% ( 1) 00:16:32.457 6.353 - 6.400: 98.8180% ( 2) 00:16:32.457 7.301 - 7.348: 98.8253% ( 1) 00:16:32.457 7.443 - 7.490: 98.8326% ( 1) 00:16:32.457 11.804 - 11.852: 98.8399% ( 1) 00:16:32.457 15.550 - 15.644: 98.8472% ( 1) 00:16:32.457 15.644 - 15.739: 98.8837% ( 5) 00:16:32.457 15.739 - 15.834: 98.8983% ( 2) 00:16:32.457 15.834 - 15.929: 98.9202% ( 3) 00:16:32.457 15.929 - 16.024: 98.9567% ( 5) 00:16:32.457 16.024 - 16.119: 98.9931% ( 5) 00:16:32.457 16.119 - 16.213: 99.0369% ( 6) 00:16:32.457 16.213 - 16.308: 99.0734% ( 5) 00:16:32.457 16.308 - 16.403: 99.1026% ( 4) 00:16:32.457 16.403 - 16.498: 99.1391% ( 5) 00:16:32.457 16.498 - 16.593: 99.1682% ( 4) 00:16:32.457 16.593 - 16.687: 99.1828% ( 2) 00:16:32.457 16.687 - 16.782: 99.2047% ( 3) 00:16:32.457 16.782 - 16.877: 99.2120% ( 1) 00:16:32.457 16.877 - 16.972: 99.2193% ( 1) 00:16:32.457 16.972 - 17.067: 99.2266% ( 1) 00:16:32.457 17.067 - 17.161: 99.2339% ( 1) 00:16:32.457 17.161 - 17.256: 99.2558% ( 3) 00:16:32.457 17.256 - 17.351: 99.2631% ( 1) 00:16:32.457 17.351 - 17.446: 99.2777% ( 2) 00:16:32.457 17.446 - 17.541: 99.2850% ( 1) 00:16:32.457 17.541 - 17.636: 99.2923% ( 1) 00:16:32.457 17.730 - 17.825: 99.2996% ( 1) 00:16:32.457 17.825 - 17.920: 99.3069% ( 1) 00:16:32.457 18.015 - 18.110: 99.3215% ( 2) 00:16:32.457 18.110 - 18.204: 99.3361% ( 2) 00:16:32.457 18.489 - 18.584: 99.3434% ( 1) 00:16:32.457 32.616 - 32.806: 99.3506% ( 1) 00:16:32.457 3009.801 - 3021.938: 99.3579% ( 1) 00:16:32.457 3980.705 - 4004.978: 99.7884% ( 59) 00:16:32.457 4004.978 - 4029.250: 99.9854% ( 27) 00:16:32.457 4223.431 - 4247.704: 99.9927% ( 1) 00:16:32.457 4975.881 - 5000.154: 100.0000% ( 1) 00:16:32.457 00:16:32.457 23:08:35 -- target/nvmf_vfio_user.sh@90 -- # aer_vfio_user /var/run/vfio-user/domain/vfio-user2/2 nqn.2019-07.io.spdk:cnode2 2 00:16:32.457 23:08:35 -- target/nvmf_vfio_user.sh@22 -- # local traddr=/var/run/vfio-user/domain/vfio-user2/2 00:16:32.457 23:08:35 -- target/nvmf_vfio_user.sh@23 -- # local subnqn=nqn.2019-07.io.spdk:cnode2 00:16:32.457 23:08:35 -- target/nvmf_vfio_user.sh@24 -- # local malloc_num=Malloc4 00:16:32.457 23:08:35 -- target/nvmf_vfio_user.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:16:32.715 [ 00:16:32.715 { 00:16:32.715 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:16:32.715 "subtype": "Discovery", 00:16:32.715 "listen_addresses": [], 00:16:32.715 "allow_any_host": true, 00:16:32.715 "hosts": [] 00:16:32.715 }, 00:16:32.715 { 00:16:32.715 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:16:32.715 "subtype": "NVMe", 00:16:32.715 "listen_addresses": [ 00:16:32.715 { 00:16:32.715 "transport": "VFIOUSER", 00:16:32.715 "trtype": "VFIOUSER", 00:16:32.715 "adrfam": "IPv4", 00:16:32.715 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:16:32.715 "trsvcid": "0" 00:16:32.715 } 00:16:32.715 ], 00:16:32.715 "allow_any_host": true, 00:16:32.715 "hosts": [], 00:16:32.715 "serial_number": "SPDK1", 00:16:32.715 "model_number": "SPDK bdev Controller", 00:16:32.715 "max_namespaces": 32, 00:16:32.715 "min_cntlid": 1, 00:16:32.715 "max_cntlid": 65519, 00:16:32.715 "namespaces": [ 00:16:32.715 { 00:16:32.715 "nsid": 1, 00:16:32.715 "bdev_name": "Malloc1", 00:16:32.715 "name": "Malloc1", 00:16:32.715 "nguid": "3C0605388DD54603B78A7814161E4282", 00:16:32.715 "uuid": "3c060538-8dd5-4603-b78a-7814161e4282" 00:16:32.715 }, 00:16:32.715 { 00:16:32.715 "nsid": 2, 00:16:32.715 "bdev_name": "Malloc3", 00:16:32.715 "name": "Malloc3", 00:16:32.715 "nguid": "8F3683120FA84F549E15D51DC09387D2", 00:16:32.715 "uuid": "8f368312-0fa8-4f54-9e15-d51dc09387d2" 00:16:32.715 } 00:16:32.715 ] 00:16:32.715 }, 00:16:32.715 { 00:16:32.715 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:16:32.715 "subtype": "NVMe", 00:16:32.715 "listen_addresses": [ 00:16:32.715 { 00:16:32.715 "transport": "VFIOUSER", 00:16:32.715 "trtype": "VFIOUSER", 00:16:32.715 "adrfam": "IPv4", 00:16:32.715 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:16:32.715 "trsvcid": "0" 00:16:32.715 } 00:16:32.715 ], 00:16:32.715 "allow_any_host": true, 00:16:32.715 "hosts": [], 00:16:32.715 "serial_number": "SPDK2", 00:16:32.715 "model_number": "SPDK bdev Controller", 00:16:32.715 "max_namespaces": 32, 00:16:32.715 "min_cntlid": 1, 00:16:32.715 "max_cntlid": 65519, 00:16:32.715 "namespaces": [ 00:16:32.715 { 00:16:32.715 "nsid": 1, 00:16:32.715 "bdev_name": "Malloc2", 00:16:32.715 "name": "Malloc2", 00:16:32.715 "nguid": "2F8C2BF3AD55420CB95FCE40E9FFFCF5", 00:16:32.715 "uuid": "2f8c2bf3-ad55-420c-b95f-ce40e9fffcf5" 00:16:32.715 } 00:16:32.715 ] 00:16:32.715 } 00:16:32.715 ] 00:16:32.715 23:08:36 -- target/nvmf_vfio_user.sh@27 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:16:32.715 23:08:36 -- target/nvmf_vfio_user.sh@34 -- # aerpid=2428538 00:16:32.715 23:08:36 -- target/nvmf_vfio_user.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -n 2 -g -t /tmp/aer_touch_file 00:16:32.715 23:08:36 -- target/nvmf_vfio_user.sh@37 -- # waitforfile /tmp/aer_touch_file 00:16:32.715 23:08:36 -- common/autotest_common.sh@1254 -- # local i=0 00:16:32.715 23:08:36 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:16:32.715 23:08:36 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:16:32.715 23:08:36 -- common/autotest_common.sh@1265 -- # return 0 00:16:32.715 23:08:36 -- target/nvmf_vfio_user.sh@38 -- # rm -f /tmp/aer_touch_file 00:16:32.715 23:08:36 -- target/nvmf_vfio_user.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 --name Malloc4 00:16:32.715 EAL: No free 2048 kB hugepages reported on node 1 00:16:32.974 Malloc4 00:16:32.974 23:08:36 -- target/nvmf_vfio_user.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc4 -n 2 00:16:33.232 23:08:36 -- target/nvmf_vfio_user.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:16:33.232 Asynchronous Event Request test 00:16:33.232 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:33.232 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:33.232 Registering asynchronous event callbacks... 00:16:33.232 Starting namespace attribute notice tests for all controllers... 00:16:33.232 /var/run/vfio-user/domain/vfio-user2/2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:16:33.232 aer_cb - Changed Namespace 00:16:33.232 Cleaning up... 00:16:33.490 [ 00:16:33.490 { 00:16:33.490 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:16:33.490 "subtype": "Discovery", 00:16:33.490 "listen_addresses": [], 00:16:33.490 "allow_any_host": true, 00:16:33.490 "hosts": [] 00:16:33.490 }, 00:16:33.490 { 00:16:33.490 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:16:33.490 "subtype": "NVMe", 00:16:33.490 "listen_addresses": [ 00:16:33.490 { 00:16:33.491 "transport": "VFIOUSER", 00:16:33.491 "trtype": "VFIOUSER", 00:16:33.491 "adrfam": "IPv4", 00:16:33.491 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:16:33.491 "trsvcid": "0" 00:16:33.491 } 00:16:33.491 ], 00:16:33.491 "allow_any_host": true, 00:16:33.491 "hosts": [], 00:16:33.491 "serial_number": "SPDK1", 00:16:33.491 "model_number": "SPDK bdev Controller", 00:16:33.491 "max_namespaces": 32, 00:16:33.491 "min_cntlid": 1, 00:16:33.491 "max_cntlid": 65519, 00:16:33.491 "namespaces": [ 00:16:33.491 { 00:16:33.491 "nsid": 1, 00:16:33.491 "bdev_name": "Malloc1", 00:16:33.491 "name": "Malloc1", 00:16:33.491 "nguid": "3C0605388DD54603B78A7814161E4282", 00:16:33.491 "uuid": "3c060538-8dd5-4603-b78a-7814161e4282" 00:16:33.491 }, 00:16:33.491 { 00:16:33.491 "nsid": 2, 00:16:33.491 "bdev_name": "Malloc3", 00:16:33.491 "name": "Malloc3", 00:16:33.491 "nguid": "8F3683120FA84F549E15D51DC09387D2", 00:16:33.491 "uuid": "8f368312-0fa8-4f54-9e15-d51dc09387d2" 00:16:33.491 } 00:16:33.491 ] 00:16:33.491 }, 00:16:33.491 { 00:16:33.491 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:16:33.491 "subtype": "NVMe", 00:16:33.491 "listen_addresses": [ 00:16:33.491 { 00:16:33.491 "transport": "VFIOUSER", 00:16:33.491 "trtype": "VFIOUSER", 00:16:33.491 "adrfam": "IPv4", 00:16:33.491 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:16:33.491 "trsvcid": "0" 00:16:33.491 } 00:16:33.491 ], 00:16:33.491 "allow_any_host": true, 00:16:33.491 "hosts": [], 00:16:33.491 "serial_number": "SPDK2", 00:16:33.491 "model_number": "SPDK bdev Controller", 00:16:33.491 "max_namespaces": 32, 00:16:33.491 "min_cntlid": 1, 00:16:33.491 "max_cntlid": 65519, 00:16:33.491 "namespaces": [ 00:16:33.491 { 00:16:33.491 "nsid": 1, 00:16:33.491 "bdev_name": "Malloc2", 00:16:33.491 "name": "Malloc2", 00:16:33.491 "nguid": "2F8C2BF3AD55420CB95FCE40E9FFFCF5", 00:16:33.491 "uuid": "2f8c2bf3-ad55-420c-b95f-ce40e9fffcf5" 00:16:33.491 }, 00:16:33.491 { 00:16:33.491 "nsid": 2, 00:16:33.491 "bdev_name": "Malloc4", 00:16:33.491 "name": "Malloc4", 00:16:33.491 "nguid": "09C1F4158CFC4E59AA91B38330400633", 00:16:33.491 "uuid": "09c1f415-8cfc-4e59-aa91-b38330400633" 00:16:33.491 } 00:16:33.491 ] 00:16:33.491 } 00:16:33.491 ] 00:16:33.491 23:08:36 -- target/nvmf_vfio_user.sh@44 -- # wait 2428538 00:16:33.491 23:08:36 -- target/nvmf_vfio_user.sh@105 -- # stop_nvmf_vfio_user 00:16:33.491 23:08:36 -- target/nvmf_vfio_user.sh@95 -- # killprocess 2422616 00:16:33.491 23:08:36 -- common/autotest_common.sh@936 -- # '[' -z 2422616 ']' 00:16:33.491 23:08:36 -- common/autotest_common.sh@940 -- # kill -0 2422616 00:16:33.491 23:08:36 -- common/autotest_common.sh@941 -- # uname 00:16:33.491 23:08:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:33.491 23:08:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2422616 00:16:33.491 23:08:36 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:33.491 23:08:36 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:33.491 23:08:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2422616' 00:16:33.491 killing process with pid 2422616 00:16:33.491 23:08:36 -- common/autotest_common.sh@955 -- # kill 2422616 00:16:33.491 [2024-11-28 23:08:36.945929] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:16:33.491 23:08:36 -- common/autotest_common.sh@960 -- # wait 2422616 00:16:33.748 23:08:37 -- target/nvmf_vfio_user.sh@97 -- # rm -rf /var/run/vfio-user 00:16:33.748 23:08:37 -- target/nvmf_vfio_user.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:16:33.748 23:08:37 -- target/nvmf_vfio_user.sh@108 -- # setup_nvmf_vfio_user --interrupt-mode '-M -I' 00:16:33.748 23:08:37 -- target/nvmf_vfio_user.sh@51 -- # local nvmf_app_args=--interrupt-mode 00:16:33.748 23:08:37 -- target/nvmf_vfio_user.sh@52 -- # local 'transport_args=-M -I' 00:16:33.748 23:08:37 -- target/nvmf_vfio_user.sh@55 -- # nvmfpid=2428685 00:16:33.748 23:08:37 -- target/nvmf_vfio_user.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m '[0,1,2,3]' --interrupt-mode 00:16:33.748 23:08:37 -- target/nvmf_vfio_user.sh@57 -- # echo 'Process pid: 2428685' 00:16:33.748 Process pid: 2428685 00:16:33.748 23:08:37 -- target/nvmf_vfio_user.sh@59 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:16:33.748 23:08:37 -- target/nvmf_vfio_user.sh@60 -- # waitforlisten 2428685 00:16:33.748 23:08:37 -- common/autotest_common.sh@829 -- # '[' -z 2428685 ']' 00:16:33.748 23:08:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:33.748 23:08:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:33.748 23:08:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:33.748 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:33.748 23:08:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:33.748 23:08:37 -- common/autotest_common.sh@10 -- # set +x 00:16:33.748 [2024-11-28 23:08:37.322988] thread.c:2929:spdk_interrupt_mode_enable: *NOTICE*: Set SPDK running in interrupt mode. 00:16:33.748 [2024-11-28 23:08:37.324060] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:33.749 [2024-11-28 23:08:37.324121] [ DPDK EAL parameters: nvmf -l 0,1,2,3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:33.749 EAL: No free 2048 kB hugepages reported on node 1 00:16:34.008 [2024-11-28 23:08:37.383447] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:34.008 [2024-11-28 23:08:37.466911] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:34.008 [2024-11-28 23:08:37.467064] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:34.008 [2024-11-28 23:08:37.467082] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:34.008 [2024-11-28 23:08:37.467094] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:34.008 [2024-11-28 23:08:37.467149] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:34.008 [2024-11-28 23:08:37.467208] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:34.008 [2024-11-28 23:08:37.467274] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:34.008 [2024-11-28 23:08:37.467276] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:34.008 [2024-11-28 23:08:37.554623] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_0) to intr mode from intr mode. 00:16:34.008 [2024-11-28 23:08:37.554889] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_1) to intr mode from intr mode. 00:16:34.008 [2024-11-28 23:08:37.555138] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_2) to intr mode from intr mode. 00:16:34.008 [2024-11-28 23:08:37.555813] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (app_thread) to intr mode from intr mode. 00:16:34.008 [2024-11-28 23:08:37.555921] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_3) to intr mode from intr mode. 00:16:34.939 23:08:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:34.939 23:08:38 -- common/autotest_common.sh@862 -- # return 0 00:16:34.940 23:08:38 -- target/nvmf_vfio_user.sh@62 -- # sleep 1 00:16:35.870 23:08:39 -- target/nvmf_vfio_user.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t VFIOUSER -M -I 00:16:36.127 23:08:39 -- target/nvmf_vfio_user.sh@66 -- # mkdir -p /var/run/vfio-user 00:16:36.127 23:08:39 -- target/nvmf_vfio_user.sh@68 -- # seq 1 2 00:16:36.127 23:08:39 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:16:36.127 23:08:39 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user1/1 00:16:36.127 23:08:39 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:16:36.385 Malloc1 00:16:36.385 23:08:39 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode1 -a -s SPDK1 00:16:36.641 23:08:40 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc1 00:16:36.898 23:08:40 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode1 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user1/1 -s 0 00:16:37.154 23:08:40 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:16:37.154 23:08:40 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user2/2 00:16:37.154 23:08:40 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:16:37.410 Malloc2 00:16:37.410 23:08:41 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode2 -a -s SPDK2 00:16:37.970 23:08:41 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc2 00:16:38.225 23:08:41 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode2 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user2/2 -s 0 00:16:38.483 23:08:41 -- target/nvmf_vfio_user.sh@109 -- # stop_nvmf_vfio_user 00:16:38.483 23:08:41 -- target/nvmf_vfio_user.sh@95 -- # killprocess 2428685 00:16:38.483 23:08:41 -- common/autotest_common.sh@936 -- # '[' -z 2428685 ']' 00:16:38.483 23:08:41 -- common/autotest_common.sh@940 -- # kill -0 2428685 00:16:38.483 23:08:41 -- common/autotest_common.sh@941 -- # uname 00:16:38.483 23:08:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:38.483 23:08:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2428685 00:16:38.483 23:08:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:38.483 23:08:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:38.483 23:08:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2428685' 00:16:38.483 killing process with pid 2428685 00:16:38.483 23:08:41 -- common/autotest_common.sh@955 -- # kill 2428685 00:16:38.483 23:08:41 -- common/autotest_common.sh@960 -- # wait 2428685 00:16:38.741 23:08:42 -- target/nvmf_vfio_user.sh@97 -- # rm -rf /var/run/vfio-user 00:16:38.741 23:08:42 -- target/nvmf_vfio_user.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:16:38.741 00:16:38.741 real 0m54.599s 00:16:38.741 user 3m36.090s 00:16:38.741 sys 0m4.625s 00:16:38.741 23:08:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:38.741 23:08:42 -- common/autotest_common.sh@10 -- # set +x 00:16:38.741 ************************************ 00:16:38.741 END TEST nvmf_vfio_user 00:16:38.741 ************************************ 00:16:38.741 23:08:42 -- nvmf/nvmf.sh@41 -- # run_test nvmf_vfio_user_nvme_compliance /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/compliance.sh --transport=tcp 00:16:38.741 23:08:42 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:38.741 23:08:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:38.741 23:08:42 -- common/autotest_common.sh@10 -- # set +x 00:16:38.741 ************************************ 00:16:38.741 START TEST nvmf_vfio_user_nvme_compliance 00:16:38.741 ************************************ 00:16:38.741 23:08:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/compliance.sh --transport=tcp 00:16:38.741 * Looking for test storage... 00:16:38.741 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance 00:16:38.741 23:08:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:38.741 23:08:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:38.741 23:08:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:38.741 23:08:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:38.741 23:08:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:38.741 23:08:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:38.741 23:08:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:38.741 23:08:42 -- scripts/common.sh@335 -- # IFS=.-: 00:16:38.741 23:08:42 -- scripts/common.sh@335 -- # read -ra ver1 00:16:38.741 23:08:42 -- scripts/common.sh@336 -- # IFS=.-: 00:16:38.741 23:08:42 -- scripts/common.sh@336 -- # read -ra ver2 00:16:38.741 23:08:42 -- scripts/common.sh@337 -- # local 'op=<' 00:16:38.741 23:08:42 -- scripts/common.sh@339 -- # ver1_l=2 00:16:38.741 23:08:42 -- scripts/common.sh@340 -- # ver2_l=1 00:16:38.741 23:08:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:38.741 23:08:42 -- scripts/common.sh@343 -- # case "$op" in 00:16:38.741 23:08:42 -- scripts/common.sh@344 -- # : 1 00:16:39.000 23:08:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:39.000 23:08:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:39.000 23:08:42 -- scripts/common.sh@364 -- # decimal 1 00:16:39.000 23:08:42 -- scripts/common.sh@352 -- # local d=1 00:16:39.000 23:08:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:39.000 23:08:42 -- scripts/common.sh@354 -- # echo 1 00:16:39.000 23:08:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:39.000 23:08:42 -- scripts/common.sh@365 -- # decimal 2 00:16:39.000 23:08:42 -- scripts/common.sh@352 -- # local d=2 00:16:39.000 23:08:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:39.000 23:08:42 -- scripts/common.sh@354 -- # echo 2 00:16:39.000 23:08:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:39.000 23:08:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:39.000 23:08:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:39.000 23:08:42 -- scripts/common.sh@367 -- # return 0 00:16:39.000 23:08:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:39.000 23:08:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:39.000 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:39.000 --rc genhtml_branch_coverage=1 00:16:39.000 --rc genhtml_function_coverage=1 00:16:39.000 --rc genhtml_legend=1 00:16:39.000 --rc geninfo_all_blocks=1 00:16:39.000 --rc geninfo_unexecuted_blocks=1 00:16:39.000 00:16:39.000 ' 00:16:39.000 23:08:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:39.000 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:39.000 --rc genhtml_branch_coverage=1 00:16:39.000 --rc genhtml_function_coverage=1 00:16:39.000 --rc genhtml_legend=1 00:16:39.000 --rc geninfo_all_blocks=1 00:16:39.000 --rc geninfo_unexecuted_blocks=1 00:16:39.000 00:16:39.000 ' 00:16:39.000 23:08:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:39.000 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:39.000 --rc genhtml_branch_coverage=1 00:16:39.000 --rc genhtml_function_coverage=1 00:16:39.000 --rc genhtml_legend=1 00:16:39.000 --rc geninfo_all_blocks=1 00:16:39.000 --rc geninfo_unexecuted_blocks=1 00:16:39.000 00:16:39.000 ' 00:16:39.000 23:08:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:39.000 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:39.000 --rc genhtml_branch_coverage=1 00:16:39.000 --rc genhtml_function_coverage=1 00:16:39.000 --rc genhtml_legend=1 00:16:39.000 --rc geninfo_all_blocks=1 00:16:39.000 --rc geninfo_unexecuted_blocks=1 00:16:39.000 00:16:39.000 ' 00:16:39.000 23:08:42 -- compliance/compliance.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:39.000 23:08:42 -- nvmf/common.sh@7 -- # uname -s 00:16:39.000 23:08:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:39.000 23:08:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:39.000 23:08:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:39.000 23:08:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:39.000 23:08:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:39.000 23:08:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:39.000 23:08:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:39.000 23:08:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:39.000 23:08:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:39.000 23:08:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:39.000 23:08:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:39.000 23:08:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:39.000 23:08:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:39.000 23:08:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:39.000 23:08:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:39.000 23:08:42 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:39.000 23:08:42 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:39.000 23:08:42 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:39.000 23:08:42 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:39.000 23:08:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:39.000 23:08:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:39.000 23:08:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:39.000 23:08:42 -- paths/export.sh@5 -- # export PATH 00:16:39.000 23:08:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:39.000 23:08:42 -- nvmf/common.sh@46 -- # : 0 00:16:39.000 23:08:42 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:39.000 23:08:42 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:39.000 23:08:42 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:39.000 23:08:42 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:39.000 23:08:42 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:39.000 23:08:42 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:39.000 23:08:42 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:39.000 23:08:42 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:39.000 23:08:42 -- compliance/compliance.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:39.000 23:08:42 -- compliance/compliance.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:39.000 23:08:42 -- compliance/compliance.sh@14 -- # export TEST_TRANSPORT=VFIOUSER 00:16:39.000 23:08:42 -- compliance/compliance.sh@14 -- # TEST_TRANSPORT=VFIOUSER 00:16:39.000 23:08:42 -- compliance/compliance.sh@16 -- # rm -rf /var/run/vfio-user 00:16:39.000 23:08:42 -- compliance/compliance.sh@20 -- # nvmfpid=2429316 00:16:39.000 23:08:42 -- compliance/compliance.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:16:39.000 23:08:42 -- compliance/compliance.sh@21 -- # echo 'Process pid: 2429316' 00:16:39.000 Process pid: 2429316 00:16:39.000 23:08:42 -- compliance/compliance.sh@23 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:16:39.000 23:08:42 -- compliance/compliance.sh@24 -- # waitforlisten 2429316 00:16:39.000 23:08:42 -- common/autotest_common.sh@829 -- # '[' -z 2429316 ']' 00:16:39.000 23:08:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:39.000 23:08:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:39.000 23:08:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:39.000 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:39.000 23:08:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:39.001 23:08:42 -- common/autotest_common.sh@10 -- # set +x 00:16:39.001 [2024-11-28 23:08:42.421544] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:39.001 [2024-11-28 23:08:42.421632] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:39.001 EAL: No free 2048 kB hugepages reported on node 1 00:16:39.001 [2024-11-28 23:08:42.484730] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:16:39.001 [2024-11-28 23:08:42.576537] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:39.001 [2024-11-28 23:08:42.576688] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:39.001 [2024-11-28 23:08:42.576719] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:39.001 [2024-11-28 23:08:42.576733] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:39.001 [2024-11-28 23:08:42.576819] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:39.001 [2024-11-28 23:08:42.576898] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:39.001 [2024-11-28 23:08:42.576900] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:39.934 23:08:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:39.934 23:08:43 -- common/autotest_common.sh@862 -- # return 0 00:16:39.934 23:08:43 -- compliance/compliance.sh@26 -- # sleep 1 00:16:40.867 23:08:44 -- compliance/compliance.sh@28 -- # nqn=nqn.2021-09.io.spdk:cnode0 00:16:40.867 23:08:44 -- compliance/compliance.sh@29 -- # traddr=/var/run/vfio-user 00:16:40.867 23:08:44 -- compliance/compliance.sh@31 -- # rpc_cmd nvmf_create_transport -t VFIOUSER 00:16:40.867 23:08:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:40.867 23:08:44 -- common/autotest_common.sh@10 -- # set +x 00:16:40.867 23:08:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:40.867 23:08:44 -- compliance/compliance.sh@33 -- # mkdir -p /var/run/vfio-user 00:16:40.867 23:08:44 -- compliance/compliance.sh@35 -- # rpc_cmd bdev_malloc_create 64 512 -b malloc0 00:16:40.867 23:08:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:40.867 23:08:44 -- common/autotest_common.sh@10 -- # set +x 00:16:40.867 malloc0 00:16:40.867 23:08:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:40.867 23:08:44 -- compliance/compliance.sh@36 -- # rpc_cmd nvmf_create_subsystem nqn.2021-09.io.spdk:cnode0 -a -s spdk -m 32 00:16:40.867 23:08:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:40.867 23:08:44 -- common/autotest_common.sh@10 -- # set +x 00:16:40.867 23:08:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:40.867 23:08:44 -- compliance/compliance.sh@37 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2021-09.io.spdk:cnode0 malloc0 00:16:40.867 23:08:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:40.867 23:08:44 -- common/autotest_common.sh@10 -- # set +x 00:16:40.867 23:08:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:40.867 23:08:44 -- compliance/compliance.sh@38 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2021-09.io.spdk:cnode0 -t VFIOUSER -a /var/run/vfio-user -s 0 00:16:40.867 23:08:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:40.867 23:08:44 -- common/autotest_common.sh@10 -- # set +x 00:16:40.867 23:08:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:40.867 23:08:44 -- compliance/compliance.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/nvme_compliance -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user subnqn:nqn.2021-09.io.spdk:cnode0' 00:16:41.126 EAL: No free 2048 kB hugepages reported on node 1 00:16:41.126 00:16:41.126 00:16:41.126 CUnit - A unit testing framework for C - Version 2.1-3 00:16:41.126 http://cunit.sourceforge.net/ 00:16:41.126 00:16:41.126 00:16:41.126 Suite: nvme_compliance 00:16:41.126 Test: admin_identify_ctrlr_verify_dptr ...[2024-11-28 23:08:44.616368] vfio_user.c: 789:nvme_cmd_map_prps: *ERROR*: no PRP2, 3072 remaining 00:16:41.126 [2024-11-28 23:08:44.616451] vfio_user.c:5484:map_admin_cmd_req: *ERROR*: /var/run/vfio-user: map Admin Opc 6 failed 00:16:41.126 [2024-11-28 23:08:44.616478] vfio_user.c:5576:handle_cmd_req: *ERROR*: /var/run/vfio-user: process NVMe command opc 0x6 failed 00:16:41.126 passed 00:16:41.384 Test: admin_identify_ctrlr_verify_fused ...passed 00:16:41.384 Test: admin_identify_ns ...[2024-11-28 23:08:44.858433] ctrlr.c:2598:_nvmf_subsystem_get_ns_safe: *ERROR*: Identify Namespace for invalid NSID 0 00:16:41.384 [2024-11-28 23:08:44.866413] ctrlr.c:2598:_nvmf_subsystem_get_ns_safe: *ERROR*: Identify Namespace for invalid NSID 4294967295 00:16:41.384 passed 00:16:41.641 Test: admin_get_features_mandatory_features ...passed 00:16:41.641 Test: admin_get_features_optional_features ...passed 00:16:41.898 Test: admin_set_features_number_of_queues ...passed 00:16:41.899 Test: admin_get_log_page_mandatory_logs ...passed 00:16:41.899 Test: admin_get_log_page_with_lpo ...[2024-11-28 23:08:45.491409] ctrlr.c:2546:nvmf_ctrlr_get_log_page: *ERROR*: Get log page: offset (516) > len (512) 00:16:42.156 passed 00:16:42.156 Test: fabric_property_get ...passed 00:16:42.156 Test: admin_delete_io_sq_use_admin_qid ...[2024-11-28 23:08:45.673236] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:0 does not exist 00:16:42.156 passed 00:16:42.414 Test: admin_delete_io_sq_delete_sq_twice ...[2024-11-28 23:08:45.846434] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:42.414 [2024-11-28 23:08:45.862405] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:42.414 passed 00:16:42.414 Test: admin_delete_io_cq_use_admin_qid ...[2024-11-28 23:08:45.952525] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O cqid:0 does not exist 00:16:42.414 passed 00:16:42.672 Test: admin_delete_io_cq_delete_cq_first ...[2024-11-28 23:08:46.116409] vfio_user.c:2310:handle_del_io_q: *ERROR*: /var/run/vfio-user: the associated SQ must be deleted first 00:16:42.672 [2024-11-28 23:08:46.140402] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:42.672 passed 00:16:42.672 Test: admin_create_io_cq_verify_iv_pc ...[2024-11-28 23:08:46.232501] vfio_user.c:2150:handle_create_io_cq: *ERROR*: /var/run/vfio-user: IV is too big 00:16:42.672 [2024-11-28 23:08:46.232560] vfio_user.c:2144:handle_create_io_cq: *ERROR*: /var/run/vfio-user: non-PC CQ not supported 00:16:42.672 passed 00:16:42.929 Test: admin_create_io_sq_verify_qsize_cqid ...[2024-11-28 23:08:46.411421] vfio_user.c:2231:handle_create_io_q: *ERROR*: /var/run/vfio-user: invalid I/O queue size 1 00:16:42.929 [2024-11-28 23:08:46.419424] vfio_user.c:2231:handle_create_io_q: *ERROR*: /var/run/vfio-user: invalid I/O queue size 257 00:16:42.929 [2024-11-28 23:08:46.427432] vfio_user.c:2031:handle_create_io_sq: *ERROR*: /var/run/vfio-user: invalid cqid:0 00:16:42.929 [2024-11-28 23:08:46.435422] vfio_user.c:2031:handle_create_io_sq: *ERROR*: /var/run/vfio-user: invalid cqid:128 00:16:42.929 passed 00:16:43.186 Test: admin_create_io_sq_verify_pc ...[2024-11-28 23:08:46.568416] vfio_user.c:2044:handle_create_io_sq: *ERROR*: /var/run/vfio-user: non-PC SQ not supported 00:16:43.186 passed 00:16:44.652 Test: admin_create_io_qp_max_qps ...[2024-11-28 23:08:47.770424] nvme_ctrlr.c:5318:spdk_nvme_ctrlr_alloc_qid: *ERROR*: [/var/run/vfio-user] No free I/O queue IDs 00:16:44.652 passed 00:16:44.931 Test: admin_create_io_sq_shared_cq ...[2024-11-28 23:08:48.370403] vfio_user.c:2310:handle_del_io_q: *ERROR*: /var/run/vfio-user: the associated SQ must be deleted first 00:16:44.931 passed 00:16:44.931 00:16:44.931 Run Summary: Type Total Ran Passed Failed Inactive 00:16:44.931 suites 1 1 n/a 0 0 00:16:44.931 tests 18 18 18 0 0 00:16:44.931 asserts 360 360 360 0 n/a 00:16:44.931 00:16:44.931 Elapsed time = 1.572 seconds 00:16:44.931 23:08:48 -- compliance/compliance.sh@42 -- # killprocess 2429316 00:16:44.931 23:08:48 -- common/autotest_common.sh@936 -- # '[' -z 2429316 ']' 00:16:44.931 23:08:48 -- common/autotest_common.sh@940 -- # kill -0 2429316 00:16:44.931 23:08:48 -- common/autotest_common.sh@941 -- # uname 00:16:44.931 23:08:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:44.931 23:08:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2429316 00:16:44.931 23:08:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:44.931 23:08:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:44.931 23:08:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2429316' 00:16:44.931 killing process with pid 2429316 00:16:44.931 23:08:48 -- common/autotest_common.sh@955 -- # kill 2429316 00:16:44.931 23:08:48 -- common/autotest_common.sh@960 -- # wait 2429316 00:16:45.190 23:08:48 -- compliance/compliance.sh@44 -- # rm -rf /var/run/vfio-user 00:16:45.190 23:08:48 -- compliance/compliance.sh@46 -- # trap - SIGINT SIGTERM EXIT 00:16:45.190 00:16:45.190 real 0m6.539s 00:16:45.190 user 0m18.521s 00:16:45.190 sys 0m0.637s 00:16:45.190 23:08:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:45.190 23:08:48 -- common/autotest_common.sh@10 -- # set +x 00:16:45.190 ************************************ 00:16:45.190 END TEST nvmf_vfio_user_nvme_compliance 00:16:45.190 ************************************ 00:16:45.190 23:08:48 -- nvmf/nvmf.sh@42 -- # run_test nvmf_vfio_user_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/vfio_user_fuzz.sh --transport=tcp 00:16:45.190 23:08:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:45.190 23:08:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:45.190 23:08:48 -- common/autotest_common.sh@10 -- # set +x 00:16:45.190 ************************************ 00:16:45.190 START TEST nvmf_vfio_user_fuzz 00:16:45.190 ************************************ 00:16:45.190 23:08:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/vfio_user_fuzz.sh --transport=tcp 00:16:45.448 * Looking for test storage... 00:16:45.448 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:45.448 23:08:48 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:45.448 23:08:48 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:45.448 23:08:48 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:45.448 23:08:48 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:45.448 23:08:48 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:45.448 23:08:48 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:45.448 23:08:48 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:45.449 23:08:48 -- scripts/common.sh@335 -- # IFS=.-: 00:16:45.449 23:08:48 -- scripts/common.sh@335 -- # read -ra ver1 00:16:45.449 23:08:48 -- scripts/common.sh@336 -- # IFS=.-: 00:16:45.449 23:08:48 -- scripts/common.sh@336 -- # read -ra ver2 00:16:45.449 23:08:48 -- scripts/common.sh@337 -- # local 'op=<' 00:16:45.449 23:08:48 -- scripts/common.sh@339 -- # ver1_l=2 00:16:45.449 23:08:48 -- scripts/common.sh@340 -- # ver2_l=1 00:16:45.449 23:08:48 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:45.449 23:08:48 -- scripts/common.sh@343 -- # case "$op" in 00:16:45.449 23:08:48 -- scripts/common.sh@344 -- # : 1 00:16:45.449 23:08:48 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:45.449 23:08:48 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:45.449 23:08:48 -- scripts/common.sh@364 -- # decimal 1 00:16:45.449 23:08:48 -- scripts/common.sh@352 -- # local d=1 00:16:45.449 23:08:48 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:45.449 23:08:48 -- scripts/common.sh@354 -- # echo 1 00:16:45.449 23:08:48 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:45.449 23:08:48 -- scripts/common.sh@365 -- # decimal 2 00:16:45.449 23:08:48 -- scripts/common.sh@352 -- # local d=2 00:16:45.449 23:08:48 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:45.449 23:08:48 -- scripts/common.sh@354 -- # echo 2 00:16:45.449 23:08:48 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:45.449 23:08:48 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:45.449 23:08:48 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:45.449 23:08:48 -- scripts/common.sh@367 -- # return 0 00:16:45.449 23:08:48 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:45.449 23:08:48 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:45.449 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:45.449 --rc genhtml_branch_coverage=1 00:16:45.449 --rc genhtml_function_coverage=1 00:16:45.449 --rc genhtml_legend=1 00:16:45.449 --rc geninfo_all_blocks=1 00:16:45.449 --rc geninfo_unexecuted_blocks=1 00:16:45.449 00:16:45.449 ' 00:16:45.449 23:08:48 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:45.449 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:45.449 --rc genhtml_branch_coverage=1 00:16:45.449 --rc genhtml_function_coverage=1 00:16:45.449 --rc genhtml_legend=1 00:16:45.449 --rc geninfo_all_blocks=1 00:16:45.449 --rc geninfo_unexecuted_blocks=1 00:16:45.449 00:16:45.449 ' 00:16:45.449 23:08:48 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:45.449 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:45.449 --rc genhtml_branch_coverage=1 00:16:45.449 --rc genhtml_function_coverage=1 00:16:45.449 --rc genhtml_legend=1 00:16:45.449 --rc geninfo_all_blocks=1 00:16:45.449 --rc geninfo_unexecuted_blocks=1 00:16:45.449 00:16:45.449 ' 00:16:45.449 23:08:48 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:45.449 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:45.449 --rc genhtml_branch_coverage=1 00:16:45.449 --rc genhtml_function_coverage=1 00:16:45.449 --rc genhtml_legend=1 00:16:45.449 --rc geninfo_all_blocks=1 00:16:45.449 --rc geninfo_unexecuted_blocks=1 00:16:45.449 00:16:45.449 ' 00:16:45.449 23:08:48 -- target/vfio_user_fuzz.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:45.449 23:08:48 -- nvmf/common.sh@7 -- # uname -s 00:16:45.449 23:08:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:45.449 23:08:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:45.449 23:08:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:45.449 23:08:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:45.449 23:08:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:45.449 23:08:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:45.449 23:08:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:45.449 23:08:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:45.449 23:08:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:45.449 23:08:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:45.449 23:08:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:45.449 23:08:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:45.449 23:08:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:45.449 23:08:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:45.449 23:08:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:45.449 23:08:48 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:45.449 23:08:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:45.449 23:08:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:45.449 23:08:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:45.449 23:08:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:45.449 23:08:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:45.449 23:08:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:45.449 23:08:48 -- paths/export.sh@5 -- # export PATH 00:16:45.449 23:08:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:45.449 23:08:48 -- nvmf/common.sh@46 -- # : 0 00:16:45.449 23:08:48 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:45.449 23:08:48 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:45.449 23:08:48 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:45.449 23:08:48 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:45.449 23:08:48 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:45.449 23:08:48 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:45.449 23:08:48 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:45.449 23:08:48 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:45.449 23:08:48 -- target/vfio_user_fuzz.sh@12 -- # MALLOC_BDEV_SIZE=64 00:16:45.449 23:08:48 -- target/vfio_user_fuzz.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:16:45.449 23:08:48 -- target/vfio_user_fuzz.sh@15 -- # nqn=nqn.2021-09.io.spdk:cnode0 00:16:45.449 23:08:48 -- target/vfio_user_fuzz.sh@16 -- # traddr=/var/run/vfio-user 00:16:45.449 23:08:48 -- target/vfio_user_fuzz.sh@18 -- # export TEST_TRANSPORT=VFIOUSER 00:16:45.449 23:08:48 -- target/vfio_user_fuzz.sh@18 -- # TEST_TRANSPORT=VFIOUSER 00:16:45.449 23:08:48 -- target/vfio_user_fuzz.sh@20 -- # rm -rf /var/run/vfio-user 00:16:45.449 23:08:48 -- target/vfio_user_fuzz.sh@24 -- # nvmfpid=2430204 00:16:45.449 23:08:48 -- target/vfio_user_fuzz.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:16:45.449 23:08:48 -- target/vfio_user_fuzz.sh@25 -- # echo 'Process pid: 2430204' 00:16:45.449 Process pid: 2430204 00:16:45.449 23:08:48 -- target/vfio_user_fuzz.sh@27 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:16:45.449 23:08:48 -- target/vfio_user_fuzz.sh@28 -- # waitforlisten 2430204 00:16:45.449 23:08:48 -- common/autotest_common.sh@829 -- # '[' -z 2430204 ']' 00:16:45.449 23:08:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:45.449 23:08:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:45.449 23:08:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:45.449 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:45.449 23:08:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:45.449 23:08:48 -- common/autotest_common.sh@10 -- # set +x 00:16:46.383 23:08:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:46.383 23:08:49 -- common/autotest_common.sh@862 -- # return 0 00:16:46.383 23:08:49 -- target/vfio_user_fuzz.sh@30 -- # sleep 1 00:16:47.756 23:08:50 -- target/vfio_user_fuzz.sh@32 -- # rpc_cmd nvmf_create_transport -t VFIOUSER 00:16:47.756 23:08:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:47.756 23:08:50 -- common/autotest_common.sh@10 -- # set +x 00:16:47.756 23:08:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:47.756 23:08:50 -- target/vfio_user_fuzz.sh@34 -- # mkdir -p /var/run/vfio-user 00:16:47.756 23:08:50 -- target/vfio_user_fuzz.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b malloc0 00:16:47.756 23:08:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:47.756 23:08:50 -- common/autotest_common.sh@10 -- # set +x 00:16:47.756 malloc0 00:16:47.756 23:08:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:47.756 23:08:50 -- target/vfio_user_fuzz.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2021-09.io.spdk:cnode0 -a -s spdk 00:16:47.756 23:08:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:47.756 23:08:50 -- common/autotest_common.sh@10 -- # set +x 00:16:47.756 23:08:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:47.756 23:08:50 -- target/vfio_user_fuzz.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2021-09.io.spdk:cnode0 malloc0 00:16:47.756 23:08:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:47.756 23:08:50 -- common/autotest_common.sh@10 -- # set +x 00:16:47.756 23:08:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:47.756 23:08:51 -- target/vfio_user_fuzz.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2021-09.io.spdk:cnode0 -t VFIOUSER -a /var/run/vfio-user -s 0 00:16:47.756 23:08:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:47.756 23:08:51 -- common/autotest_common.sh@10 -- # set +x 00:16:47.756 23:08:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:47.756 23:08:51 -- target/vfio_user_fuzz.sh@41 -- # trid='trtype:VFIOUSER subnqn:nqn.2021-09.io.spdk:cnode0 traddr:/var/run/vfio-user' 00:16:47.756 23:08:51 -- target/vfio_user_fuzz.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/vfio_user_fuzz -t 30 -S 123456 -F 'trtype:VFIOUSER subnqn:nqn.2021-09.io.spdk:cnode0 traddr:/var/run/vfio-user' -N -a 00:17:19.830 Fuzzing completed. Shutting down the fuzz application 00:17:19.830 00:17:19.830 Dumping successful admin opcodes: 00:17:19.830 8, 9, 10, 24, 00:17:19.830 Dumping successful io opcodes: 00:17:19.830 0, 00:17:19.830 NS: 0x200003a1ef00 I/O qp, Total commands completed: 645818, total successful commands: 2506, random_seed: 2926357696 00:17:19.830 NS: 0x200003a1ef00 admin qp, Total commands completed: 161048, total successful commands: 1299, random_seed: 1965363712 00:17:19.830 23:09:21 -- target/vfio_user_fuzz.sh@44 -- # rpc_cmd nvmf_delete_subsystem nqn.2021-09.io.spdk:cnode0 00:17:19.830 23:09:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:19.830 23:09:21 -- common/autotest_common.sh@10 -- # set +x 00:17:19.830 23:09:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:19.830 23:09:21 -- target/vfio_user_fuzz.sh@46 -- # killprocess 2430204 00:17:19.830 23:09:21 -- common/autotest_common.sh@936 -- # '[' -z 2430204 ']' 00:17:19.830 23:09:21 -- common/autotest_common.sh@940 -- # kill -0 2430204 00:17:19.830 23:09:21 -- common/autotest_common.sh@941 -- # uname 00:17:19.830 23:09:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:19.830 23:09:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2430204 00:17:19.830 23:09:21 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:19.830 23:09:21 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:19.830 23:09:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2430204' 00:17:19.830 killing process with pid 2430204 00:17:19.830 23:09:21 -- common/autotest_common.sh@955 -- # kill 2430204 00:17:19.830 23:09:21 -- common/autotest_common.sh@960 -- # wait 2430204 00:17:19.831 23:09:21 -- target/vfio_user_fuzz.sh@48 -- # rm -rf /var/run/vfio-user /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/vfio_user_fuzz_log.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/vfio_user_fuzz_tgt_output.txt 00:17:19.831 23:09:21 -- target/vfio_user_fuzz.sh@50 -- # trap - SIGINT SIGTERM EXIT 00:17:19.831 00:17:19.831 real 0m33.173s 00:17:19.831 user 0m36.514s 00:17:19.831 sys 0m23.154s 00:17:19.831 23:09:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:19.831 23:09:21 -- common/autotest_common.sh@10 -- # set +x 00:17:19.831 ************************************ 00:17:19.831 END TEST nvmf_vfio_user_fuzz 00:17:19.831 ************************************ 00:17:19.831 23:09:21 -- nvmf/nvmf.sh@46 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:17:19.831 23:09:21 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:19.831 23:09:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:19.831 23:09:21 -- common/autotest_common.sh@10 -- # set +x 00:17:19.831 ************************************ 00:17:19.831 START TEST nvmf_host_management 00:17:19.831 ************************************ 00:17:19.831 23:09:21 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:17:19.831 * Looking for test storage... 00:17:19.831 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:19.831 23:09:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:19.831 23:09:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:19.831 23:09:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:19.831 23:09:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:19.831 23:09:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:19.831 23:09:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:19.831 23:09:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:19.831 23:09:22 -- scripts/common.sh@335 -- # IFS=.-: 00:17:19.831 23:09:22 -- scripts/common.sh@335 -- # read -ra ver1 00:17:19.831 23:09:22 -- scripts/common.sh@336 -- # IFS=.-: 00:17:19.831 23:09:22 -- scripts/common.sh@336 -- # read -ra ver2 00:17:19.831 23:09:22 -- scripts/common.sh@337 -- # local 'op=<' 00:17:19.831 23:09:22 -- scripts/common.sh@339 -- # ver1_l=2 00:17:19.831 23:09:22 -- scripts/common.sh@340 -- # ver2_l=1 00:17:19.831 23:09:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:19.831 23:09:22 -- scripts/common.sh@343 -- # case "$op" in 00:17:19.831 23:09:22 -- scripts/common.sh@344 -- # : 1 00:17:19.831 23:09:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:19.831 23:09:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:19.831 23:09:22 -- scripts/common.sh@364 -- # decimal 1 00:17:19.831 23:09:22 -- scripts/common.sh@352 -- # local d=1 00:17:19.831 23:09:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:19.831 23:09:22 -- scripts/common.sh@354 -- # echo 1 00:17:19.831 23:09:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:19.831 23:09:22 -- scripts/common.sh@365 -- # decimal 2 00:17:19.831 23:09:22 -- scripts/common.sh@352 -- # local d=2 00:17:19.831 23:09:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:19.831 23:09:22 -- scripts/common.sh@354 -- # echo 2 00:17:19.831 23:09:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:19.831 23:09:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:19.831 23:09:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:19.831 23:09:22 -- scripts/common.sh@367 -- # return 0 00:17:19.831 23:09:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:19.831 23:09:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:19.831 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:19.831 --rc genhtml_branch_coverage=1 00:17:19.831 --rc genhtml_function_coverage=1 00:17:19.831 --rc genhtml_legend=1 00:17:19.831 --rc geninfo_all_blocks=1 00:17:19.831 --rc geninfo_unexecuted_blocks=1 00:17:19.831 00:17:19.831 ' 00:17:19.831 23:09:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:19.831 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:19.831 --rc genhtml_branch_coverage=1 00:17:19.831 --rc genhtml_function_coverage=1 00:17:19.831 --rc genhtml_legend=1 00:17:19.831 --rc geninfo_all_blocks=1 00:17:19.831 --rc geninfo_unexecuted_blocks=1 00:17:19.831 00:17:19.831 ' 00:17:19.831 23:09:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:19.831 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:19.831 --rc genhtml_branch_coverage=1 00:17:19.831 --rc genhtml_function_coverage=1 00:17:19.831 --rc genhtml_legend=1 00:17:19.831 --rc geninfo_all_blocks=1 00:17:19.831 --rc geninfo_unexecuted_blocks=1 00:17:19.831 00:17:19.831 ' 00:17:19.831 23:09:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:19.831 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:19.831 --rc genhtml_branch_coverage=1 00:17:19.831 --rc genhtml_function_coverage=1 00:17:19.831 --rc genhtml_legend=1 00:17:19.831 --rc geninfo_all_blocks=1 00:17:19.831 --rc geninfo_unexecuted_blocks=1 00:17:19.831 00:17:19.831 ' 00:17:19.831 23:09:22 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:19.831 23:09:22 -- nvmf/common.sh@7 -- # uname -s 00:17:19.831 23:09:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:19.831 23:09:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:19.831 23:09:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:19.831 23:09:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:19.831 23:09:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:19.831 23:09:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:19.831 23:09:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:19.831 23:09:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:19.831 23:09:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:19.831 23:09:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:19.831 23:09:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:19.831 23:09:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:19.831 23:09:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:19.831 23:09:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:19.831 23:09:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:19.831 23:09:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:19.831 23:09:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:19.831 23:09:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:19.831 23:09:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:19.831 23:09:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:19.831 23:09:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:19.831 23:09:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:19.831 23:09:22 -- paths/export.sh@5 -- # export PATH 00:17:19.831 23:09:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:19.831 23:09:22 -- nvmf/common.sh@46 -- # : 0 00:17:19.831 23:09:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:19.831 23:09:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:19.831 23:09:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:19.831 23:09:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:19.831 23:09:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:19.831 23:09:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:19.831 23:09:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:19.831 23:09:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:19.831 23:09:22 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:19.831 23:09:22 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:19.831 23:09:22 -- target/host_management.sh@104 -- # nvmftestinit 00:17:19.831 23:09:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:19.831 23:09:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:19.831 23:09:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:19.831 23:09:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:19.831 23:09:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:19.831 23:09:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:19.831 23:09:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:19.831 23:09:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:19.831 23:09:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:19.831 23:09:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:19.831 23:09:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:19.831 23:09:22 -- common/autotest_common.sh@10 -- # set +x 00:17:20.766 23:09:24 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:20.766 23:09:24 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:20.766 23:09:24 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:20.766 23:09:24 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:20.766 23:09:24 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:20.766 23:09:24 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:20.766 23:09:24 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:20.766 23:09:24 -- nvmf/common.sh@294 -- # net_devs=() 00:17:20.766 23:09:24 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:20.766 23:09:24 -- nvmf/common.sh@295 -- # e810=() 00:17:20.766 23:09:24 -- nvmf/common.sh@295 -- # local -ga e810 00:17:20.766 23:09:24 -- nvmf/common.sh@296 -- # x722=() 00:17:20.766 23:09:24 -- nvmf/common.sh@296 -- # local -ga x722 00:17:20.767 23:09:24 -- nvmf/common.sh@297 -- # mlx=() 00:17:20.767 23:09:24 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:20.767 23:09:24 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:20.767 23:09:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:20.767 23:09:24 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:20.767 23:09:24 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:20.767 23:09:24 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:20.767 23:09:24 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:20.767 23:09:24 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:20.767 23:09:24 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:20.767 23:09:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:20.767 23:09:24 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:20.767 23:09:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:20.767 23:09:24 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:20.767 23:09:24 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:20.767 23:09:24 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:20.767 23:09:24 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:20.767 23:09:24 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:20.767 23:09:24 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:20.767 23:09:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:20.767 23:09:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:20.767 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:20.767 23:09:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:20.767 23:09:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:20.767 23:09:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:20.767 23:09:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:20.767 23:09:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:20.767 23:09:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:20.767 23:09:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:20.767 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:20.767 23:09:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:20.767 23:09:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:20.767 23:09:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:20.767 23:09:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:20.767 23:09:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:20.767 23:09:24 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:20.767 23:09:24 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:20.767 23:09:24 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:20.767 23:09:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:20.767 23:09:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:20.767 23:09:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:20.767 23:09:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:20.767 23:09:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:20.767 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:20.767 23:09:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:20.767 23:09:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:20.767 23:09:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:20.767 23:09:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:20.767 23:09:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:20.767 23:09:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:20.767 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:20.767 23:09:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:20.767 23:09:24 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:20.767 23:09:24 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:20.767 23:09:24 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:20.767 23:09:24 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:20.767 23:09:24 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:20.767 23:09:24 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:20.767 23:09:24 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:20.767 23:09:24 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:20.767 23:09:24 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:20.767 23:09:24 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:20.767 23:09:24 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:20.767 23:09:24 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:20.767 23:09:24 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:20.767 23:09:24 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:20.767 23:09:24 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:20.767 23:09:24 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:20.767 23:09:24 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:20.767 23:09:24 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:20.767 23:09:24 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:20.767 23:09:24 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:20.767 23:09:24 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:20.767 23:09:24 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:20.767 23:09:24 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:20.767 23:09:24 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:20.767 23:09:24 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:20.767 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:20.767 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.228 ms 00:17:20.767 00:17:20.767 --- 10.0.0.2 ping statistics --- 00:17:20.767 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:20.767 rtt min/avg/max/mdev = 0.228/0.228/0.228/0.000 ms 00:17:20.767 23:09:24 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:20.767 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:20.767 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.151 ms 00:17:20.767 00:17:20.767 --- 10.0.0.1 ping statistics --- 00:17:20.767 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:20.767 rtt min/avg/max/mdev = 0.151/0.151/0.151/0.000 ms 00:17:20.767 23:09:24 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:20.767 23:09:24 -- nvmf/common.sh@410 -- # return 0 00:17:20.767 23:09:24 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:20.767 23:09:24 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:20.767 23:09:24 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:20.767 23:09:24 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:20.767 23:09:24 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:20.767 23:09:24 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:20.767 23:09:24 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:20.767 23:09:24 -- target/host_management.sh@106 -- # run_test nvmf_host_management nvmf_host_management 00:17:20.767 23:09:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:17:20.767 23:09:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:20.767 23:09:24 -- common/autotest_common.sh@10 -- # set +x 00:17:20.767 ************************************ 00:17:20.767 START TEST nvmf_host_management 00:17:20.767 ************************************ 00:17:20.767 23:09:24 -- common/autotest_common.sh@1114 -- # nvmf_host_management 00:17:20.767 23:09:24 -- target/host_management.sh@69 -- # starttarget 00:17:20.767 23:09:24 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:17:20.767 23:09:24 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:20.767 23:09:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:20.767 23:09:24 -- common/autotest_common.sh@10 -- # set +x 00:17:20.767 23:09:24 -- nvmf/common.sh@469 -- # nvmfpid=2436405 00:17:20.767 23:09:24 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:17:20.767 23:09:24 -- nvmf/common.sh@470 -- # waitforlisten 2436405 00:17:20.767 23:09:24 -- common/autotest_common.sh@829 -- # '[' -z 2436405 ']' 00:17:20.767 23:09:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:20.767 23:09:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:20.767 23:09:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:20.767 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:20.767 23:09:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:20.767 23:09:24 -- common/autotest_common.sh@10 -- # set +x 00:17:20.767 [2024-11-28 23:09:24.221832] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:20.767 [2024-11-28 23:09:24.221913] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:20.767 EAL: No free 2048 kB hugepages reported on node 1 00:17:20.767 [2024-11-28 23:09:24.291338] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:21.026 [2024-11-28 23:09:24.385879] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:21.026 [2024-11-28 23:09:24.386033] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:21.026 [2024-11-28 23:09:24.386053] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:21.026 [2024-11-28 23:09:24.386072] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:21.026 [2024-11-28 23:09:24.386133] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:21.026 [2024-11-28 23:09:24.386177] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:21.026 [2024-11-28 23:09:24.386242] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:21.026 [2024-11-28 23:09:24.386244] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:21.591 23:09:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:21.591 23:09:25 -- common/autotest_common.sh@862 -- # return 0 00:17:21.591 23:09:25 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:21.591 23:09:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:21.591 23:09:25 -- common/autotest_common.sh@10 -- # set +x 00:17:21.849 23:09:25 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:21.849 23:09:25 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:21.849 23:09:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:21.849 23:09:25 -- common/autotest_common.sh@10 -- # set +x 00:17:21.849 [2024-11-28 23:09:25.215000] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:21.849 23:09:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:21.849 23:09:25 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:17:21.849 23:09:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:21.849 23:09:25 -- common/autotest_common.sh@10 -- # set +x 00:17:21.849 23:09:25 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:17:21.849 23:09:25 -- target/host_management.sh@23 -- # cat 00:17:21.849 23:09:25 -- target/host_management.sh@30 -- # rpc_cmd 00:17:21.849 23:09:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:21.849 23:09:25 -- common/autotest_common.sh@10 -- # set +x 00:17:21.849 Malloc0 00:17:21.849 [2024-11-28 23:09:25.280346] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:21.849 23:09:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:21.849 23:09:25 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:17:21.849 23:09:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:21.849 23:09:25 -- common/autotest_common.sh@10 -- # set +x 00:17:21.849 23:09:25 -- target/host_management.sh@73 -- # perfpid=2436586 00:17:21.849 23:09:25 -- target/host_management.sh@74 -- # waitforlisten 2436586 /var/tmp/bdevperf.sock 00:17:21.849 23:09:25 -- common/autotest_common.sh@829 -- # '[' -z 2436586 ']' 00:17:21.849 23:09:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:21.849 23:09:25 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:17:21.849 23:09:25 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:17:21.849 23:09:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:21.849 23:09:25 -- nvmf/common.sh@520 -- # config=() 00:17:21.849 23:09:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:21.849 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:21.849 23:09:25 -- nvmf/common.sh@520 -- # local subsystem config 00:17:21.849 23:09:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:21.849 23:09:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:21.849 23:09:25 -- common/autotest_common.sh@10 -- # set +x 00:17:21.849 23:09:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:21.849 { 00:17:21.849 "params": { 00:17:21.849 "name": "Nvme$subsystem", 00:17:21.849 "trtype": "$TEST_TRANSPORT", 00:17:21.849 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:21.849 "adrfam": "ipv4", 00:17:21.849 "trsvcid": "$NVMF_PORT", 00:17:21.849 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:21.849 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:21.849 "hdgst": ${hdgst:-false}, 00:17:21.849 "ddgst": ${ddgst:-false} 00:17:21.849 }, 00:17:21.849 "method": "bdev_nvme_attach_controller" 00:17:21.849 } 00:17:21.849 EOF 00:17:21.849 )") 00:17:21.849 23:09:25 -- nvmf/common.sh@542 -- # cat 00:17:21.849 23:09:25 -- nvmf/common.sh@544 -- # jq . 00:17:21.849 23:09:25 -- nvmf/common.sh@545 -- # IFS=, 00:17:21.849 23:09:25 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:21.849 "params": { 00:17:21.849 "name": "Nvme0", 00:17:21.849 "trtype": "tcp", 00:17:21.849 "traddr": "10.0.0.2", 00:17:21.849 "adrfam": "ipv4", 00:17:21.849 "trsvcid": "4420", 00:17:21.849 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:21.849 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:17:21.849 "hdgst": false, 00:17:21.849 "ddgst": false 00:17:21.849 }, 00:17:21.849 "method": "bdev_nvme_attach_controller" 00:17:21.849 }' 00:17:21.849 [2024-11-28 23:09:25.358595] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:21.849 [2024-11-28 23:09:25.358684] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2436586 ] 00:17:21.849 EAL: No free 2048 kB hugepages reported on node 1 00:17:21.849 [2024-11-28 23:09:25.419660] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:22.106 [2024-11-28 23:09:25.506558] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:22.365 Running I/O for 10 seconds... 00:17:22.934 23:09:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:22.934 23:09:26 -- common/autotest_common.sh@862 -- # return 0 00:17:22.934 23:09:26 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:17:22.934 23:09:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:22.934 23:09:26 -- common/autotest_common.sh@10 -- # set +x 00:17:22.934 23:09:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:22.934 23:09:26 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:22.934 23:09:26 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:17:22.934 23:09:26 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:17:22.934 23:09:26 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:17:22.934 23:09:26 -- target/host_management.sh@52 -- # local ret=1 00:17:22.934 23:09:26 -- target/host_management.sh@53 -- # local i 00:17:22.934 23:09:26 -- target/host_management.sh@54 -- # (( i = 10 )) 00:17:22.934 23:09:26 -- target/host_management.sh@54 -- # (( i != 0 )) 00:17:22.934 23:09:26 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:17:22.934 23:09:26 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:17:22.934 23:09:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:22.934 23:09:26 -- common/autotest_common.sh@10 -- # set +x 00:17:22.934 23:09:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:22.934 23:09:26 -- target/host_management.sh@55 -- # read_io_count=1885 00:17:22.934 23:09:26 -- target/host_management.sh@58 -- # '[' 1885 -ge 100 ']' 00:17:22.934 23:09:26 -- target/host_management.sh@59 -- # ret=0 00:17:22.934 23:09:26 -- target/host_management.sh@60 -- # break 00:17:22.934 23:09:26 -- target/host_management.sh@64 -- # return 0 00:17:22.934 23:09:26 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:17:22.934 23:09:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:22.934 23:09:26 -- common/autotest_common.sh@10 -- # set +x 00:17:22.934 [2024-11-28 23:09:26.384492] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.934 [2024-11-28 23:09:26.384611] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.934 [2024-11-28 23:09:26.384628] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.934 [2024-11-28 23:09:26.384642] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.934 [2024-11-28 23:09:26.384654] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.934 [2024-11-28 23:09:26.384666] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.934 [2024-11-28 23:09:26.384679] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.934 [2024-11-28 23:09:26.384691] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.934 [2024-11-28 23:09:26.384703] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.934 [2024-11-28 23:09:26.384728] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.934 [2024-11-28 23:09:26.384741] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.934 [2024-11-28 23:09:26.384760] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.934 [2024-11-28 23:09:26.384772] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.934 [2024-11-28 23:09:26.384784] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.934 [2024-11-28 23:09:26.384796] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.934 [2024-11-28 23:09:26.384807] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.934 [2024-11-28 23:09:26.384825] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.934 [2024-11-28 23:09:26.384837] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.934 [2024-11-28 23:09:26.384848] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.934 [2024-11-28 23:09:26.384860] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.934 [2024-11-28 23:09:26.384872] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.934 [2024-11-28 23:09:26.384883] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.934 [2024-11-28 23:09:26.384895] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.934 [2024-11-28 23:09:26.384907] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.934 [2024-11-28 23:09:26.384919] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.934 [2024-11-28 23:09:26.384931] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.934 [2024-11-28 23:09:26.384942] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.934 [2024-11-28 23:09:26.384954] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.934 [2024-11-28 23:09:26.384966] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.934 [2024-11-28 23:09:26.384977] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.934 [2024-11-28 23:09:26.384989] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.934 [2024-11-28 23:09:26.385001] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.934 [2024-11-28 23:09:26.385012] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.934 [2024-11-28 23:09:26.385024] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.934 [2024-11-28 23:09:26.385036] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.934 [2024-11-28 23:09:26.385048] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.934 [2024-11-28 23:09:26.385064] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.934 [2024-11-28 23:09:26.385077] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.934 [2024-11-28 23:09:26.385088] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.934 [2024-11-28 23:09:26.385100] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.934 [2024-11-28 23:09:26.385112] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.934 [2024-11-28 23:09:26.385124] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.934 [2024-11-28 23:09:26.385136] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.934 [2024-11-28 23:09:26.385147] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.935 [2024-11-28 23:09:26.385159] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.935 [2024-11-28 23:09:26.385170] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.935 [2024-11-28 23:09:26.385182] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.935 [2024-11-28 23:09:26.385194] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.935 [2024-11-28 23:09:26.385206] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf2cf40 is same with the state(5) to be set 00:17:22.935 [2024-11-28 23:09:26.385746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:123392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.935 [2024-11-28 23:09:26.385789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.935 [2024-11-28 23:09:26.385816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:123776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.935 [2024-11-28 23:09:26.385832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.935 [2024-11-28 23:09:26.385849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:124032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.935 [2024-11-28 23:09:26.385863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.935 [2024-11-28 23:09:26.385878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:130048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.935 [2024-11-28 23:09:26.385892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.935 [2024-11-28 23:09:26.385906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:130176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.935 [2024-11-28 23:09:26.385920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.935 [2024-11-28 23:09:26.385936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:130304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.935 [2024-11-28 23:09:26.385950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.935 [2024-11-28 23:09:26.385964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:130432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.935 [2024-11-28 23:09:26.385984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.935 [2024-11-28 23:09:26.386000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:130560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.935 [2024-11-28 23:09:26.386015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.935 [2024-11-28 23:09:26.386030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:130688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.935 [2024-11-28 23:09:26.386044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.935 [2024-11-28 23:09:26.386059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:130816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.935 [2024-11-28 23:09:26.386073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.935 [2024-11-28 23:09:26.386088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:124288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.935 [2024-11-28 23:09:26.386102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.935 [2024-11-28 23:09:26.386117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:124416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.935 [2024-11-28 23:09:26.386130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.935 [2024-11-28 23:09:26.386145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:124672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.935 [2024-11-28 23:09:26.386159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.935 [2024-11-28 23:09:26.386174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:125312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.935 [2024-11-28 23:09:26.386188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.935 [2024-11-28 23:09:26.386203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:130944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.935 [2024-11-28 23:09:26.386217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.935 [2024-11-28 23:09:26.386232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:0 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.935 [2024-11-28 23:09:26.386245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.935 [2024-11-28 23:09:26.386260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.935 [2024-11-28 23:09:26.386274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.935 [2024-11-28 23:09:26.386288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.935 [2024-11-28 23:09:26.386302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.935 [2024-11-28 23:09:26.386316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.935 [2024-11-28 23:09:26.386329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.935 [2024-11-28 23:09:26.386348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.935 [2024-11-28 23:09:26.386362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.935 [2024-11-28 23:09:26.386383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.935 [2024-11-28 23:09:26.386408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.935 [2024-11-28 23:09:26.386426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.935 [2024-11-28 23:09:26.386440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.935 [2024-11-28 23:09:26.386456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:125568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.935 [2024-11-28 23:09:26.386470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.935 [2024-11-28 23:09:26.386485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.935 [2024-11-28 23:09:26.386499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.935 [2024-11-28 23:09:26.386514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:1024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.935 [2024-11-28 23:09:26.386528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.935 [2024-11-28 23:09:26.386543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:1152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.935 [2024-11-28 23:09:26.386557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.935 [2024-11-28 23:09:26.386573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:1280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.935 [2024-11-28 23:09:26.386587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.935 [2024-11-28 23:09:26.386602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:1408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.935 [2024-11-28 23:09:26.386616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.935 [2024-11-28 23:09:26.386632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:1536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.935 [2024-11-28 23:09:26.386646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.936 [2024-11-28 23:09:26.386661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:1664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.936 [2024-11-28 23:09:26.386675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.936 [2024-11-28 23:09:26.386694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:125696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.936 [2024-11-28 23:09:26.386710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.936 [2024-11-28 23:09:26.386725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:125952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.936 [2024-11-28 23:09:26.386743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.936 [2024-11-28 23:09:26.386759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:126208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.936 [2024-11-28 23:09:26.386774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.936 [2024-11-28 23:09:26.386790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:126592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.936 [2024-11-28 23:09:26.386804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.936 [2024-11-28 23:09:26.386819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:1792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.936 [2024-11-28 23:09:26.386833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.936 [2024-11-28 23:09:26.386848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:1920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.936 [2024-11-28 23:09:26.386862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.936 [2024-11-28 23:09:26.386877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:2048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.936 [2024-11-28 23:09:26.386892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.936 [2024-11-28 23:09:26.386907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:126976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.936 [2024-11-28 23:09:26.386921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.936 [2024-11-28 23:09:26.386936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:2176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.936 [2024-11-28 23:09:26.386950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.936 [2024-11-28 23:09:26.386966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:2304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.936 [2024-11-28 23:09:26.386980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.936 [2024-11-28 23:09:26.386995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:2432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.936 [2024-11-28 23:09:26.387009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.936 [2024-11-28 23:09:26.387024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:2560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.936 [2024-11-28 23:09:26.387039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.936 [2024-11-28 23:09:26.387054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:127232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.936 [2024-11-28 23:09:26.387068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.936 [2024-11-28 23:09:26.387083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:127360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.936 [2024-11-28 23:09:26.387097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.936 [2024-11-28 23:09:26.387117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:127488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.936 [2024-11-28 23:09:26.387131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.936 [2024-11-28 23:09:26.387147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:127616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.936 [2024-11-28 23:09:26.387162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.936 [2024-11-28 23:09:26.387177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:2688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.936 [2024-11-28 23:09:26.387191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.936 [2024-11-28 23:09:26.387206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:2816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.936 [2024-11-28 23:09:26.387220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.936 [2024-11-28 23:09:26.387235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:2944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.936 [2024-11-28 23:09:26.387249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.936 [2024-11-28 23:09:26.387265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:3072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.936 [2024-11-28 23:09:26.387280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.936 [2024-11-28 23:09:26.387294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:3200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.936 [2024-11-28 23:09:26.387308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.936 [2024-11-28 23:09:26.387323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:3328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.936 [2024-11-28 23:09:26.387337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.936 [2024-11-28 23:09:26.387352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:3456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.936 [2024-11-28 23:09:26.387367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.936 [2024-11-28 23:09:26.387390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:3584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.936 [2024-11-28 23:09:26.387416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.936 [2024-11-28 23:09:26.387433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:3712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.936 [2024-11-28 23:09:26.387448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.936 [2024-11-28 23:09:26.387463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:3840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.936 [2024-11-28 23:09:26.387477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.936 [2024-11-28 23:09:26.387492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:3968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.936 [2024-11-28 23:09:26.387510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.936 [2024-11-28 23:09:26.387526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:128000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.936 [2024-11-28 23:09:26.387541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.936 [2024-11-28 23:09:26.387556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:128128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.936 [2024-11-28 23:09:26.387570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.936 [2024-11-28 23:09:26.387585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:128512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.937 [2024-11-28 23:09:26.387599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.937 [2024-11-28 23:09:26.387614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:128896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.937 [2024-11-28 23:09:26.387629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.937 [2024-11-28 23:09:26.387644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:129024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.937 [2024-11-28 23:09:26.387658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.937 [2024-11-28 23:09:26.387673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:129408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.937 [2024-11-28 23:09:26.387687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.937 [2024-11-28 23:09:26.387703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:129664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.937 [2024-11-28 23:09:26.387717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.937 [2024-11-28 23:09:26.387811] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1989f30 was disconnected and freed. reset controller. 00:17:22.937 [2024-11-28 23:09:26.387900] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:17:22.937 [2024-11-28 23:09:26.387923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.937 [2024-11-28 23:09:26.387939] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:17:22.937 [2024-11-28 23:09:26.387952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.937 [2024-11-28 23:09:26.387965] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:17:22.937 [2024-11-28 23:09:26.387977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.937 [2024-11-28 23:09:26.387994] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:17:22.937 [2024-11-28 23:09:26.388007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.937 [2024-11-28 23:09:26.388020] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x198c870 is same with the state(5) to be set 00:17:22.937 23:09:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:22.937 23:09:26 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:17:22.937 23:09:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:22.937 23:09:26 -- common/autotest_common.sh@10 -- # set +x 00:17:22.937 [2024-11-28 23:09:26.389138] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:17:22.937 task offset: 123392 on job bdev=Nvme0n1 fails 00:17:22.937 00:17:22.937 Latency(us) 00:17:22.937 [2024-11-28T22:09:26.543Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:22.937 [2024-11-28T22:09:26.543Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:22.937 [2024-11-28T22:09:26.543Z] Job: Nvme0n1 ended in about 0.54 seconds with error 00:17:22.937 Verification LBA range: start 0x0 length 0x400 00:17:22.937 Nvme0n1 : 0.54 3726.52 232.91 118.30 0.00 16379.41 2657.85 22136.60 00:17:22.937 [2024-11-28T22:09:26.543Z] =================================================================================================================== 00:17:22.937 [2024-11-28T22:09:26.543Z] Total : 3726.52 232.91 118.30 0.00 16379.41 2657.85 22136.60 00:17:22.937 [2024-11-28 23:09:26.390998] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:17:22.937 [2024-11-28 23:09:26.391026] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x198c870 (9): Bad file descriptor 00:17:22.937 [2024-11-28 23:09:26.396028] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:22.937 23:09:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:22.937 23:09:26 -- target/host_management.sh@87 -- # sleep 1 00:17:23.870 23:09:27 -- target/host_management.sh@91 -- # kill -9 2436586 00:17:23.870 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (2436586) - No such process 00:17:23.870 23:09:27 -- target/host_management.sh@91 -- # true 00:17:23.870 23:09:27 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:17:23.870 23:09:27 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:17:23.870 23:09:27 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:17:23.870 23:09:27 -- nvmf/common.sh@520 -- # config=() 00:17:23.870 23:09:27 -- nvmf/common.sh@520 -- # local subsystem config 00:17:23.870 23:09:27 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:23.870 23:09:27 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:23.870 { 00:17:23.870 "params": { 00:17:23.870 "name": "Nvme$subsystem", 00:17:23.870 "trtype": "$TEST_TRANSPORT", 00:17:23.870 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:23.870 "adrfam": "ipv4", 00:17:23.870 "trsvcid": "$NVMF_PORT", 00:17:23.870 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:23.870 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:23.870 "hdgst": ${hdgst:-false}, 00:17:23.870 "ddgst": ${ddgst:-false} 00:17:23.870 }, 00:17:23.870 "method": "bdev_nvme_attach_controller" 00:17:23.870 } 00:17:23.870 EOF 00:17:23.870 )") 00:17:23.870 23:09:27 -- nvmf/common.sh@542 -- # cat 00:17:23.870 23:09:27 -- nvmf/common.sh@544 -- # jq . 00:17:23.870 23:09:27 -- nvmf/common.sh@545 -- # IFS=, 00:17:23.870 23:09:27 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:23.870 "params": { 00:17:23.870 "name": "Nvme0", 00:17:23.870 "trtype": "tcp", 00:17:23.870 "traddr": "10.0.0.2", 00:17:23.870 "adrfam": "ipv4", 00:17:23.870 "trsvcid": "4420", 00:17:23.870 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:23.870 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:17:23.870 "hdgst": false, 00:17:23.870 "ddgst": false 00:17:23.870 }, 00:17:23.870 "method": "bdev_nvme_attach_controller" 00:17:23.870 }' 00:17:23.870 [2024-11-28 23:09:27.443277] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:23.870 [2024-11-28 23:09:27.443354] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2436869 ] 00:17:23.870 EAL: No free 2048 kB hugepages reported on node 1 00:17:24.129 [2024-11-28 23:09:27.504989] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:24.129 [2024-11-28 23:09:27.589471] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:24.387 Running I/O for 1 seconds... 00:17:25.324 00:17:25.324 Latency(us) 00:17:25.324 [2024-11-28T22:09:28.930Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:25.324 [2024-11-28T22:09:28.930Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:25.324 Verification LBA range: start 0x0 length 0x400 00:17:25.324 Nvme0n1 : 1.01 3583.65 223.98 0.00 0.00 17563.46 1565.58 24466.77 00:17:25.324 [2024-11-28T22:09:28.930Z] =================================================================================================================== 00:17:25.324 [2024-11-28T22:09:28.930Z] Total : 3583.65 223.98 0.00 0.00 17563.46 1565.58 24466.77 00:17:25.582 23:09:29 -- target/host_management.sh@101 -- # stoptarget 00:17:25.582 23:09:29 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:17:25.582 23:09:29 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:17:25.582 23:09:29 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:17:25.582 23:09:29 -- target/host_management.sh@40 -- # nvmftestfini 00:17:25.582 23:09:29 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:25.582 23:09:29 -- nvmf/common.sh@116 -- # sync 00:17:25.582 23:09:29 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:25.582 23:09:29 -- nvmf/common.sh@119 -- # set +e 00:17:25.582 23:09:29 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:25.582 23:09:29 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:25.582 rmmod nvme_tcp 00:17:25.582 rmmod nvme_fabrics 00:17:25.582 rmmod nvme_keyring 00:17:25.582 23:09:29 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:25.582 23:09:29 -- nvmf/common.sh@123 -- # set -e 00:17:25.582 23:09:29 -- nvmf/common.sh@124 -- # return 0 00:17:25.582 23:09:29 -- nvmf/common.sh@477 -- # '[' -n 2436405 ']' 00:17:25.582 23:09:29 -- nvmf/common.sh@478 -- # killprocess 2436405 00:17:25.582 23:09:29 -- common/autotest_common.sh@936 -- # '[' -z 2436405 ']' 00:17:25.582 23:09:29 -- common/autotest_common.sh@940 -- # kill -0 2436405 00:17:25.582 23:09:29 -- common/autotest_common.sh@941 -- # uname 00:17:25.582 23:09:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:25.582 23:09:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2436405 00:17:25.582 23:09:29 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:25.582 23:09:29 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:25.582 23:09:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2436405' 00:17:25.582 killing process with pid 2436405 00:17:25.582 23:09:29 -- common/autotest_common.sh@955 -- # kill 2436405 00:17:25.582 23:09:29 -- common/autotest_common.sh@960 -- # wait 2436405 00:17:25.841 [2024-11-28 23:09:29.363274] app.c: 605:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:17:25.841 23:09:29 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:25.841 23:09:29 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:25.841 23:09:29 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:25.841 23:09:29 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:25.841 23:09:29 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:25.841 23:09:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:25.841 23:09:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:25.841 23:09:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:28.375 23:09:31 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:28.375 00:17:28.375 real 0m7.261s 00:17:28.375 user 0m22.371s 00:17:28.375 sys 0m1.387s 00:17:28.375 23:09:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:28.375 23:09:31 -- common/autotest_common.sh@10 -- # set +x 00:17:28.375 ************************************ 00:17:28.375 END TEST nvmf_host_management 00:17:28.375 ************************************ 00:17:28.375 23:09:31 -- target/host_management.sh@108 -- # trap - SIGINT SIGTERM EXIT 00:17:28.375 00:17:28.375 real 0m9.476s 00:17:28.376 user 0m23.192s 00:17:28.376 sys 0m2.809s 00:17:28.376 23:09:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:28.376 23:09:31 -- common/autotest_common.sh@10 -- # set +x 00:17:28.376 ************************************ 00:17:28.376 END TEST nvmf_host_management 00:17:28.376 ************************************ 00:17:28.376 23:09:31 -- nvmf/nvmf.sh@47 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:17:28.376 23:09:31 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:28.376 23:09:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:28.376 23:09:31 -- common/autotest_common.sh@10 -- # set +x 00:17:28.376 ************************************ 00:17:28.376 START TEST nvmf_lvol 00:17:28.376 ************************************ 00:17:28.376 23:09:31 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:17:28.376 * Looking for test storage... 00:17:28.376 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:28.376 23:09:31 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:28.376 23:09:31 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:28.376 23:09:31 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:28.376 23:09:31 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:28.376 23:09:31 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:28.376 23:09:31 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:28.376 23:09:31 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:28.376 23:09:31 -- scripts/common.sh@335 -- # IFS=.-: 00:17:28.376 23:09:31 -- scripts/common.sh@335 -- # read -ra ver1 00:17:28.376 23:09:31 -- scripts/common.sh@336 -- # IFS=.-: 00:17:28.376 23:09:31 -- scripts/common.sh@336 -- # read -ra ver2 00:17:28.376 23:09:31 -- scripts/common.sh@337 -- # local 'op=<' 00:17:28.376 23:09:31 -- scripts/common.sh@339 -- # ver1_l=2 00:17:28.376 23:09:31 -- scripts/common.sh@340 -- # ver2_l=1 00:17:28.376 23:09:31 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:28.376 23:09:31 -- scripts/common.sh@343 -- # case "$op" in 00:17:28.376 23:09:31 -- scripts/common.sh@344 -- # : 1 00:17:28.376 23:09:31 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:28.376 23:09:31 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:28.376 23:09:31 -- scripts/common.sh@364 -- # decimal 1 00:17:28.376 23:09:31 -- scripts/common.sh@352 -- # local d=1 00:17:28.376 23:09:31 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:28.376 23:09:31 -- scripts/common.sh@354 -- # echo 1 00:17:28.376 23:09:31 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:28.376 23:09:31 -- scripts/common.sh@365 -- # decimal 2 00:17:28.376 23:09:31 -- scripts/common.sh@352 -- # local d=2 00:17:28.376 23:09:31 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:28.376 23:09:31 -- scripts/common.sh@354 -- # echo 2 00:17:28.376 23:09:31 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:28.376 23:09:31 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:28.376 23:09:31 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:28.376 23:09:31 -- scripts/common.sh@367 -- # return 0 00:17:28.376 23:09:31 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:28.376 23:09:31 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:28.376 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:28.376 --rc genhtml_branch_coverage=1 00:17:28.376 --rc genhtml_function_coverage=1 00:17:28.376 --rc genhtml_legend=1 00:17:28.376 --rc geninfo_all_blocks=1 00:17:28.376 --rc geninfo_unexecuted_blocks=1 00:17:28.376 00:17:28.376 ' 00:17:28.376 23:09:31 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:28.376 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:28.376 --rc genhtml_branch_coverage=1 00:17:28.376 --rc genhtml_function_coverage=1 00:17:28.376 --rc genhtml_legend=1 00:17:28.376 --rc geninfo_all_blocks=1 00:17:28.376 --rc geninfo_unexecuted_blocks=1 00:17:28.376 00:17:28.376 ' 00:17:28.376 23:09:31 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:28.376 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:28.376 --rc genhtml_branch_coverage=1 00:17:28.376 --rc genhtml_function_coverage=1 00:17:28.376 --rc genhtml_legend=1 00:17:28.376 --rc geninfo_all_blocks=1 00:17:28.376 --rc geninfo_unexecuted_blocks=1 00:17:28.376 00:17:28.376 ' 00:17:28.376 23:09:31 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:28.376 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:28.376 --rc genhtml_branch_coverage=1 00:17:28.376 --rc genhtml_function_coverage=1 00:17:28.376 --rc genhtml_legend=1 00:17:28.376 --rc geninfo_all_blocks=1 00:17:28.376 --rc geninfo_unexecuted_blocks=1 00:17:28.376 00:17:28.376 ' 00:17:28.376 23:09:31 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:28.376 23:09:31 -- nvmf/common.sh@7 -- # uname -s 00:17:28.376 23:09:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:28.376 23:09:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:28.376 23:09:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:28.376 23:09:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:28.376 23:09:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:28.376 23:09:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:28.376 23:09:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:28.376 23:09:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:28.376 23:09:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:28.376 23:09:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:28.376 23:09:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:28.376 23:09:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:28.376 23:09:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:28.376 23:09:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:28.376 23:09:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:28.376 23:09:31 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:28.376 23:09:31 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:28.376 23:09:31 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:28.376 23:09:31 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:28.376 23:09:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:28.376 23:09:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:28.376 23:09:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:28.376 23:09:31 -- paths/export.sh@5 -- # export PATH 00:17:28.376 23:09:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:28.376 23:09:31 -- nvmf/common.sh@46 -- # : 0 00:17:28.376 23:09:31 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:28.376 23:09:31 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:28.376 23:09:31 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:28.376 23:09:31 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:28.376 23:09:31 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:28.376 23:09:31 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:28.376 23:09:31 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:28.376 23:09:31 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:28.376 23:09:31 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:28.376 23:09:31 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:28.376 23:09:31 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:17:28.376 23:09:31 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:17:28.376 23:09:31 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:28.376 23:09:31 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:17:28.376 23:09:31 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:28.376 23:09:31 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:28.376 23:09:31 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:28.376 23:09:31 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:28.376 23:09:31 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:28.376 23:09:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:28.376 23:09:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:28.376 23:09:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:28.376 23:09:31 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:28.376 23:09:31 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:28.376 23:09:31 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:28.376 23:09:31 -- common/autotest_common.sh@10 -- # set +x 00:17:30.273 23:09:33 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:30.273 23:09:33 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:30.273 23:09:33 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:30.273 23:09:33 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:30.273 23:09:33 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:30.273 23:09:33 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:30.273 23:09:33 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:30.273 23:09:33 -- nvmf/common.sh@294 -- # net_devs=() 00:17:30.273 23:09:33 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:30.273 23:09:33 -- nvmf/common.sh@295 -- # e810=() 00:17:30.273 23:09:33 -- nvmf/common.sh@295 -- # local -ga e810 00:17:30.273 23:09:33 -- nvmf/common.sh@296 -- # x722=() 00:17:30.273 23:09:33 -- nvmf/common.sh@296 -- # local -ga x722 00:17:30.273 23:09:33 -- nvmf/common.sh@297 -- # mlx=() 00:17:30.273 23:09:33 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:30.273 23:09:33 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:30.273 23:09:33 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:30.273 23:09:33 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:30.273 23:09:33 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:30.273 23:09:33 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:30.273 23:09:33 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:30.273 23:09:33 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:30.273 23:09:33 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:30.273 23:09:33 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:30.273 23:09:33 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:30.273 23:09:33 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:30.273 23:09:33 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:30.273 23:09:33 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:30.273 23:09:33 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:30.273 23:09:33 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:30.273 23:09:33 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:30.273 23:09:33 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:30.273 23:09:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:30.273 23:09:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:30.273 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:30.273 23:09:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:30.273 23:09:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:30.273 23:09:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:30.273 23:09:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:30.273 23:09:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:30.273 23:09:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:30.273 23:09:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:30.273 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:30.273 23:09:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:30.273 23:09:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:30.273 23:09:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:30.273 23:09:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:30.273 23:09:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:30.273 23:09:33 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:30.273 23:09:33 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:30.273 23:09:33 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:30.273 23:09:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:30.273 23:09:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:30.273 23:09:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:30.273 23:09:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:30.273 23:09:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:30.273 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:30.273 23:09:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:30.273 23:09:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:30.273 23:09:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:30.273 23:09:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:30.273 23:09:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:30.273 23:09:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:30.273 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:30.273 23:09:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:30.273 23:09:33 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:30.273 23:09:33 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:30.273 23:09:33 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:30.273 23:09:33 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:30.273 23:09:33 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:30.273 23:09:33 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:30.273 23:09:33 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:30.273 23:09:33 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:30.273 23:09:33 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:30.273 23:09:33 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:30.273 23:09:33 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:30.273 23:09:33 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:30.273 23:09:33 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:30.273 23:09:33 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:30.273 23:09:33 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:30.273 23:09:33 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:30.273 23:09:33 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:30.273 23:09:33 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:30.273 23:09:33 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:30.274 23:09:33 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:30.274 23:09:33 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:30.274 23:09:33 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:30.274 23:09:33 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:30.274 23:09:33 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:30.274 23:09:33 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:30.274 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:30.274 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.311 ms 00:17:30.274 00:17:30.274 --- 10.0.0.2 ping statistics --- 00:17:30.274 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:30.274 rtt min/avg/max/mdev = 0.311/0.311/0.311/0.000 ms 00:17:30.274 23:09:33 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:30.274 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:30.274 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.144 ms 00:17:30.274 00:17:30.274 --- 10.0.0.1 ping statistics --- 00:17:30.274 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:30.274 rtt min/avg/max/mdev = 0.144/0.144/0.144/0.000 ms 00:17:30.274 23:09:33 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:30.274 23:09:33 -- nvmf/common.sh@410 -- # return 0 00:17:30.274 23:09:33 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:30.274 23:09:33 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:30.274 23:09:33 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:30.274 23:09:33 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:30.274 23:09:33 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:30.274 23:09:33 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:30.274 23:09:33 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:30.274 23:09:33 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:17:30.274 23:09:33 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:30.274 23:09:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:30.274 23:09:33 -- common/autotest_common.sh@10 -- # set +x 00:17:30.274 23:09:33 -- nvmf/common.sh@469 -- # nvmfpid=2439108 00:17:30.274 23:09:33 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:17:30.274 23:09:33 -- nvmf/common.sh@470 -- # waitforlisten 2439108 00:17:30.274 23:09:33 -- common/autotest_common.sh@829 -- # '[' -z 2439108 ']' 00:17:30.274 23:09:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:30.274 23:09:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:30.274 23:09:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:30.274 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:30.274 23:09:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:30.274 23:09:33 -- common/autotest_common.sh@10 -- # set +x 00:17:30.274 [2024-11-28 23:09:33.854141] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:30.274 [2024-11-28 23:09:33.854209] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:30.532 EAL: No free 2048 kB hugepages reported on node 1 00:17:30.532 [2024-11-28 23:09:33.919713] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:17:30.532 [2024-11-28 23:09:34.007242] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:30.532 [2024-11-28 23:09:34.007425] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:30.532 [2024-11-28 23:09:34.007459] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:30.532 [2024-11-28 23:09:34.007472] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:30.532 [2024-11-28 23:09:34.007544] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:30.532 [2024-11-28 23:09:34.007575] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:30.532 [2024-11-28 23:09:34.007577] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:31.466 23:09:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:31.466 23:09:34 -- common/autotest_common.sh@862 -- # return 0 00:17:31.466 23:09:34 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:31.466 23:09:34 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:31.466 23:09:34 -- common/autotest_common.sh@10 -- # set +x 00:17:31.466 23:09:34 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:31.466 23:09:34 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:17:31.723 [2024-11-28 23:09:35.128559] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:31.723 23:09:35 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:31.980 23:09:35 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:17:31.980 23:09:35 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:32.237 23:09:35 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:17:32.237 23:09:35 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:17:32.494 23:09:35 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:17:32.752 23:09:36 -- target/nvmf_lvol.sh@29 -- # lvs=4a768583-15f7-44bb-a5af-90be6b1bc160 00:17:32.752 23:09:36 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 4a768583-15f7-44bb-a5af-90be6b1bc160 lvol 20 00:17:33.010 23:09:36 -- target/nvmf_lvol.sh@32 -- # lvol=308e6db3-98de-44b8-95f5-ad7c26f35169 00:17:33.010 23:09:36 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:33.267 23:09:36 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 308e6db3-98de-44b8-95f5-ad7c26f35169 00:17:33.525 23:09:37 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:17:33.783 [2024-11-28 23:09:37.239628] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:33.783 23:09:37 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:17:34.040 23:09:37 -- target/nvmf_lvol.sh@42 -- # perf_pid=2439556 00:17:34.040 23:09:37 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:17:34.040 23:09:37 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:17:34.040 EAL: No free 2048 kB hugepages reported on node 1 00:17:34.976 23:09:38 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot 308e6db3-98de-44b8-95f5-ad7c26f35169 MY_SNAPSHOT 00:17:35.234 23:09:38 -- target/nvmf_lvol.sh@47 -- # snapshot=f51c6f40-7ba0-407b-bb77-edd55739d6aa 00:17:35.234 23:09:38 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize 308e6db3-98de-44b8-95f5-ad7c26f35169 30 00:17:35.492 23:09:39 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone f51c6f40-7ba0-407b-bb77-edd55739d6aa MY_CLONE 00:17:36.058 23:09:39 -- target/nvmf_lvol.sh@49 -- # clone=1984f881-6b54-4505-9c9c-940890253f00 00:17:36.058 23:09:39 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate 1984f881-6b54-4505-9c9c-940890253f00 00:17:36.625 23:09:40 -- target/nvmf_lvol.sh@53 -- # wait 2439556 00:17:44.732 Initializing NVMe Controllers 00:17:44.732 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:17:44.732 Controller IO queue size 128, less than required. 00:17:44.732 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:17:44.732 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:17:44.732 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:17:44.732 Initialization complete. Launching workers. 00:17:44.732 ======================================================== 00:17:44.732 Latency(us) 00:17:44.732 Device Information : IOPS MiB/s Average min max 00:17:44.732 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 10924.20 42.67 11720.02 1996.70 77085.90 00:17:44.732 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 10763.10 42.04 11894.82 1919.92 79710.48 00:17:44.732 ======================================================== 00:17:44.732 Total : 21687.30 84.72 11806.77 1919.92 79710.48 00:17:44.732 00:17:44.732 23:09:47 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:17:44.732 23:09:48 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 308e6db3-98de-44b8-95f5-ad7c26f35169 00:17:44.990 23:09:48 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 4a768583-15f7-44bb-a5af-90be6b1bc160 00:17:45.247 23:09:48 -- target/nvmf_lvol.sh@60 -- # rm -f 00:17:45.247 23:09:48 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:17:45.247 23:09:48 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:17:45.247 23:09:48 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:45.247 23:09:48 -- nvmf/common.sh@116 -- # sync 00:17:45.247 23:09:48 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:45.247 23:09:48 -- nvmf/common.sh@119 -- # set +e 00:17:45.247 23:09:48 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:45.247 23:09:48 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:45.247 rmmod nvme_tcp 00:17:45.247 rmmod nvme_fabrics 00:17:45.247 rmmod nvme_keyring 00:17:45.247 23:09:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:45.247 23:09:48 -- nvmf/common.sh@123 -- # set -e 00:17:45.247 23:09:48 -- nvmf/common.sh@124 -- # return 0 00:17:45.247 23:09:48 -- nvmf/common.sh@477 -- # '[' -n 2439108 ']' 00:17:45.247 23:09:48 -- nvmf/common.sh@478 -- # killprocess 2439108 00:17:45.247 23:09:48 -- common/autotest_common.sh@936 -- # '[' -z 2439108 ']' 00:17:45.247 23:09:48 -- common/autotest_common.sh@940 -- # kill -0 2439108 00:17:45.247 23:09:48 -- common/autotest_common.sh@941 -- # uname 00:17:45.247 23:09:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:45.247 23:09:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2439108 00:17:45.247 23:09:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:45.247 23:09:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:45.247 23:09:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2439108' 00:17:45.247 killing process with pid 2439108 00:17:45.247 23:09:48 -- common/autotest_common.sh@955 -- # kill 2439108 00:17:45.247 23:09:48 -- common/autotest_common.sh@960 -- # wait 2439108 00:17:45.505 23:09:49 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:45.505 23:09:49 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:45.505 23:09:49 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:45.505 23:09:49 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:45.505 23:09:49 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:45.505 23:09:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:45.505 23:09:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:45.505 23:09:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:48.034 23:09:51 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:48.034 00:17:48.034 real 0m19.608s 00:17:48.034 user 1m6.288s 00:17:48.034 sys 0m5.697s 00:17:48.034 23:09:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:48.034 23:09:51 -- common/autotest_common.sh@10 -- # set +x 00:17:48.034 ************************************ 00:17:48.034 END TEST nvmf_lvol 00:17:48.034 ************************************ 00:17:48.034 23:09:51 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:17:48.034 23:09:51 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:48.034 23:09:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:48.034 23:09:51 -- common/autotest_common.sh@10 -- # set +x 00:17:48.034 ************************************ 00:17:48.034 START TEST nvmf_lvs_grow 00:17:48.034 ************************************ 00:17:48.034 23:09:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:17:48.034 * Looking for test storage... 00:17:48.034 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:48.034 23:09:51 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:48.034 23:09:51 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:48.034 23:09:51 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:48.034 23:09:51 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:48.034 23:09:51 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:48.034 23:09:51 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:48.034 23:09:51 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:48.034 23:09:51 -- scripts/common.sh@335 -- # IFS=.-: 00:17:48.034 23:09:51 -- scripts/common.sh@335 -- # read -ra ver1 00:17:48.034 23:09:51 -- scripts/common.sh@336 -- # IFS=.-: 00:17:48.034 23:09:51 -- scripts/common.sh@336 -- # read -ra ver2 00:17:48.034 23:09:51 -- scripts/common.sh@337 -- # local 'op=<' 00:17:48.034 23:09:51 -- scripts/common.sh@339 -- # ver1_l=2 00:17:48.034 23:09:51 -- scripts/common.sh@340 -- # ver2_l=1 00:17:48.034 23:09:51 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:48.034 23:09:51 -- scripts/common.sh@343 -- # case "$op" in 00:17:48.034 23:09:51 -- scripts/common.sh@344 -- # : 1 00:17:48.034 23:09:51 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:48.034 23:09:51 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:48.034 23:09:51 -- scripts/common.sh@364 -- # decimal 1 00:17:48.034 23:09:51 -- scripts/common.sh@352 -- # local d=1 00:17:48.034 23:09:51 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:48.034 23:09:51 -- scripts/common.sh@354 -- # echo 1 00:17:48.034 23:09:51 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:48.034 23:09:51 -- scripts/common.sh@365 -- # decimal 2 00:17:48.034 23:09:51 -- scripts/common.sh@352 -- # local d=2 00:17:48.034 23:09:51 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:48.034 23:09:51 -- scripts/common.sh@354 -- # echo 2 00:17:48.034 23:09:51 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:48.034 23:09:51 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:48.034 23:09:51 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:48.034 23:09:51 -- scripts/common.sh@367 -- # return 0 00:17:48.034 23:09:51 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:48.034 23:09:51 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:48.034 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:48.034 --rc genhtml_branch_coverage=1 00:17:48.034 --rc genhtml_function_coverage=1 00:17:48.034 --rc genhtml_legend=1 00:17:48.034 --rc geninfo_all_blocks=1 00:17:48.034 --rc geninfo_unexecuted_blocks=1 00:17:48.034 00:17:48.034 ' 00:17:48.034 23:09:51 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:48.034 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:48.034 --rc genhtml_branch_coverage=1 00:17:48.034 --rc genhtml_function_coverage=1 00:17:48.034 --rc genhtml_legend=1 00:17:48.034 --rc geninfo_all_blocks=1 00:17:48.034 --rc geninfo_unexecuted_blocks=1 00:17:48.034 00:17:48.034 ' 00:17:48.034 23:09:51 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:48.034 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:48.034 --rc genhtml_branch_coverage=1 00:17:48.034 --rc genhtml_function_coverage=1 00:17:48.034 --rc genhtml_legend=1 00:17:48.034 --rc geninfo_all_blocks=1 00:17:48.034 --rc geninfo_unexecuted_blocks=1 00:17:48.034 00:17:48.034 ' 00:17:48.034 23:09:51 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:48.034 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:48.034 --rc genhtml_branch_coverage=1 00:17:48.034 --rc genhtml_function_coverage=1 00:17:48.034 --rc genhtml_legend=1 00:17:48.034 --rc geninfo_all_blocks=1 00:17:48.034 --rc geninfo_unexecuted_blocks=1 00:17:48.034 00:17:48.034 ' 00:17:48.034 23:09:51 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:48.034 23:09:51 -- nvmf/common.sh@7 -- # uname -s 00:17:48.034 23:09:51 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:48.034 23:09:51 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:48.034 23:09:51 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:48.034 23:09:51 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:48.034 23:09:51 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:48.034 23:09:51 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:48.034 23:09:51 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:48.034 23:09:51 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:48.034 23:09:51 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:48.034 23:09:51 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:48.034 23:09:51 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:48.034 23:09:51 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:48.034 23:09:51 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:48.034 23:09:51 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:48.034 23:09:51 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:48.034 23:09:51 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:48.034 23:09:51 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:48.034 23:09:51 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:48.034 23:09:51 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:48.034 23:09:51 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:48.034 23:09:51 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:48.034 23:09:51 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:48.034 23:09:51 -- paths/export.sh@5 -- # export PATH 00:17:48.034 23:09:51 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:48.034 23:09:51 -- nvmf/common.sh@46 -- # : 0 00:17:48.034 23:09:51 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:48.034 23:09:51 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:48.034 23:09:51 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:48.034 23:09:51 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:48.034 23:09:51 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:48.034 23:09:51 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:48.034 23:09:51 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:48.034 23:09:51 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:48.034 23:09:51 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:48.034 23:09:51 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:48.034 23:09:51 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:17:48.034 23:09:51 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:48.034 23:09:51 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:48.034 23:09:51 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:48.034 23:09:51 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:48.034 23:09:51 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:48.034 23:09:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:48.034 23:09:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:48.034 23:09:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:48.034 23:09:51 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:48.034 23:09:51 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:48.034 23:09:51 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:48.034 23:09:51 -- common/autotest_common.sh@10 -- # set +x 00:17:49.994 23:09:53 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:49.994 23:09:53 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:49.994 23:09:53 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:49.994 23:09:53 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:49.994 23:09:53 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:49.994 23:09:53 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:49.994 23:09:53 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:49.994 23:09:53 -- nvmf/common.sh@294 -- # net_devs=() 00:17:49.994 23:09:53 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:49.994 23:09:53 -- nvmf/common.sh@295 -- # e810=() 00:17:49.994 23:09:53 -- nvmf/common.sh@295 -- # local -ga e810 00:17:49.994 23:09:53 -- nvmf/common.sh@296 -- # x722=() 00:17:49.994 23:09:53 -- nvmf/common.sh@296 -- # local -ga x722 00:17:49.994 23:09:53 -- nvmf/common.sh@297 -- # mlx=() 00:17:49.994 23:09:53 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:49.994 23:09:53 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:49.994 23:09:53 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:49.994 23:09:53 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:49.994 23:09:53 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:49.994 23:09:53 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:49.994 23:09:53 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:49.994 23:09:53 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:49.994 23:09:53 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:49.994 23:09:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:49.994 23:09:53 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:49.994 23:09:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:49.994 23:09:53 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:49.994 23:09:53 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:49.994 23:09:53 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:49.994 23:09:53 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:49.994 23:09:53 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:49.994 23:09:53 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:49.994 23:09:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:49.994 23:09:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:49.994 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:49.994 23:09:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:49.994 23:09:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:49.994 23:09:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:49.994 23:09:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:49.994 23:09:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:49.994 23:09:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:49.994 23:09:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:49.994 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:49.994 23:09:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:49.994 23:09:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:49.994 23:09:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:49.994 23:09:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:49.994 23:09:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:49.994 23:09:53 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:49.994 23:09:53 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:49.994 23:09:53 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:49.994 23:09:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:49.994 23:09:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:49.994 23:09:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:49.994 23:09:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:49.994 23:09:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:49.994 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:49.994 23:09:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:49.994 23:09:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:49.994 23:09:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:49.994 23:09:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:49.994 23:09:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:49.994 23:09:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:49.994 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:49.994 23:09:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:49.994 23:09:53 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:49.994 23:09:53 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:49.994 23:09:53 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:49.994 23:09:53 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:49.994 23:09:53 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:49.994 23:09:53 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:49.994 23:09:53 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:49.994 23:09:53 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:49.994 23:09:53 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:49.994 23:09:53 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:49.994 23:09:53 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:49.994 23:09:53 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:49.994 23:09:53 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:49.994 23:09:53 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:49.994 23:09:53 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:49.994 23:09:53 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:49.995 23:09:53 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:49.995 23:09:53 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:49.995 23:09:53 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:49.995 23:09:53 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:49.995 23:09:53 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:49.995 23:09:53 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:49.995 23:09:53 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:49.995 23:09:53 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:49.995 23:09:53 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:49.995 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:49.995 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.297 ms 00:17:49.995 00:17:49.995 --- 10.0.0.2 ping statistics --- 00:17:49.995 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:49.995 rtt min/avg/max/mdev = 0.297/0.297/0.297/0.000 ms 00:17:49.995 23:09:53 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:49.995 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:49.995 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.112 ms 00:17:49.995 00:17:49.995 --- 10.0.0.1 ping statistics --- 00:17:49.995 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:49.995 rtt min/avg/max/mdev = 0.112/0.112/0.112/0.000 ms 00:17:49.995 23:09:53 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:49.995 23:09:53 -- nvmf/common.sh@410 -- # return 0 00:17:49.995 23:09:53 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:49.995 23:09:53 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:49.995 23:09:53 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:49.995 23:09:53 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:49.995 23:09:53 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:49.995 23:09:53 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:49.995 23:09:53 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:49.995 23:09:53 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:17:49.995 23:09:53 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:49.995 23:09:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:49.995 23:09:53 -- common/autotest_common.sh@10 -- # set +x 00:17:49.995 23:09:53 -- nvmf/common.sh@469 -- # nvmfpid=2442872 00:17:49.995 23:09:53 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:17:49.995 23:09:53 -- nvmf/common.sh@470 -- # waitforlisten 2442872 00:17:49.995 23:09:53 -- common/autotest_common.sh@829 -- # '[' -z 2442872 ']' 00:17:49.995 23:09:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:49.995 23:09:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:49.995 23:09:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:49.995 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:49.995 23:09:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:49.995 23:09:53 -- common/autotest_common.sh@10 -- # set +x 00:17:49.995 [2024-11-28 23:09:53.498795] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:49.995 [2024-11-28 23:09:53.498886] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:49.995 EAL: No free 2048 kB hugepages reported on node 1 00:17:49.995 [2024-11-28 23:09:53.565458] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:50.253 [2024-11-28 23:09:53.654213] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:50.253 [2024-11-28 23:09:53.654363] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:50.253 [2024-11-28 23:09:53.654405] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:50.253 [2024-11-28 23:09:53.654421] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:50.253 [2024-11-28 23:09:53.654460] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:51.187 23:09:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:51.187 23:09:54 -- common/autotest_common.sh@862 -- # return 0 00:17:51.187 23:09:54 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:51.187 23:09:54 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:51.187 23:09:54 -- common/autotest_common.sh@10 -- # set +x 00:17:51.187 23:09:54 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:51.187 23:09:54 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:17:51.187 [2024-11-28 23:09:54.728199] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:51.187 23:09:54 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:17:51.187 23:09:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:17:51.187 23:09:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:51.187 23:09:54 -- common/autotest_common.sh@10 -- # set +x 00:17:51.187 ************************************ 00:17:51.187 START TEST lvs_grow_clean 00:17:51.187 ************************************ 00:17:51.187 23:09:54 -- common/autotest_common.sh@1114 -- # lvs_grow 00:17:51.187 23:09:54 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:17:51.187 23:09:54 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:17:51.187 23:09:54 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:17:51.187 23:09:54 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:17:51.187 23:09:54 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:17:51.187 23:09:54 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:17:51.187 23:09:54 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:51.187 23:09:54 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:51.187 23:09:54 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:51.753 23:09:55 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:17:51.753 23:09:55 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:17:51.753 23:09:55 -- target/nvmf_lvs_grow.sh@28 -- # lvs=79d82336-1f60-4a38-9d57-1102a35004db 00:17:51.753 23:09:55 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 79d82336-1f60-4a38-9d57-1102a35004db 00:17:51.753 23:09:55 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:17:52.011 23:09:55 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:17:52.011 23:09:55 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:17:52.011 23:09:55 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 79d82336-1f60-4a38-9d57-1102a35004db lvol 150 00:17:52.269 23:09:55 -- target/nvmf_lvs_grow.sh@33 -- # lvol=4fca910b-9aad-4db9-8201-4994c64b07e9 00:17:52.269 23:09:55 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:52.269 23:09:55 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:17:52.527 [2024-11-28 23:09:56.071648] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:17:52.527 [2024-11-28 23:09:56.071753] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:17:52.527 true 00:17:52.527 23:09:56 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 79d82336-1f60-4a38-9d57-1102a35004db 00:17:52.528 23:09:56 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:17:52.786 23:09:56 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:17:52.786 23:09:56 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:53.044 23:09:56 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 4fca910b-9aad-4db9-8201-4994c64b07e9 00:17:53.303 23:09:56 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:17:53.561 [2024-11-28 23:09:57.078763] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:53.561 23:09:57 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:17:53.819 23:09:57 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=2443450 00:17:53.819 23:09:57 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:17:53.819 23:09:57 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:53.819 23:09:57 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 2443450 /var/tmp/bdevperf.sock 00:17:53.819 23:09:57 -- common/autotest_common.sh@829 -- # '[' -z 2443450 ']' 00:17:53.819 23:09:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:53.820 23:09:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:53.820 23:09:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:53.820 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:53.820 23:09:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:53.820 23:09:57 -- common/autotest_common.sh@10 -- # set +x 00:17:53.820 [2024-11-28 23:09:57.384823] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:53.820 [2024-11-28 23:09:57.384907] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2443450 ] 00:17:53.820 EAL: No free 2048 kB hugepages reported on node 1 00:17:54.078 [2024-11-28 23:09:57.448265] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:54.078 [2024-11-28 23:09:57.536638] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:55.010 23:09:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:55.010 23:09:58 -- common/autotest_common.sh@862 -- # return 0 00:17:55.010 23:09:58 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:17:55.577 Nvme0n1 00:17:55.577 23:09:58 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:17:55.577 [ 00:17:55.577 { 00:17:55.577 "name": "Nvme0n1", 00:17:55.577 "aliases": [ 00:17:55.577 "4fca910b-9aad-4db9-8201-4994c64b07e9" 00:17:55.577 ], 00:17:55.577 "product_name": "NVMe disk", 00:17:55.577 "block_size": 4096, 00:17:55.577 "num_blocks": 38912, 00:17:55.577 "uuid": "4fca910b-9aad-4db9-8201-4994c64b07e9", 00:17:55.577 "assigned_rate_limits": { 00:17:55.577 "rw_ios_per_sec": 0, 00:17:55.578 "rw_mbytes_per_sec": 0, 00:17:55.578 "r_mbytes_per_sec": 0, 00:17:55.578 "w_mbytes_per_sec": 0 00:17:55.578 }, 00:17:55.578 "claimed": false, 00:17:55.578 "zoned": false, 00:17:55.578 "supported_io_types": { 00:17:55.578 "read": true, 00:17:55.578 "write": true, 00:17:55.578 "unmap": true, 00:17:55.578 "write_zeroes": true, 00:17:55.578 "flush": true, 00:17:55.578 "reset": true, 00:17:55.578 "compare": true, 00:17:55.578 "compare_and_write": true, 00:17:55.578 "abort": true, 00:17:55.578 "nvme_admin": true, 00:17:55.578 "nvme_io": true 00:17:55.578 }, 00:17:55.578 "driver_specific": { 00:17:55.578 "nvme": [ 00:17:55.578 { 00:17:55.578 "trid": { 00:17:55.578 "trtype": "TCP", 00:17:55.578 "adrfam": "IPv4", 00:17:55.578 "traddr": "10.0.0.2", 00:17:55.578 "trsvcid": "4420", 00:17:55.578 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:17:55.578 }, 00:17:55.578 "ctrlr_data": { 00:17:55.578 "cntlid": 1, 00:17:55.578 "vendor_id": "0x8086", 00:17:55.578 "model_number": "SPDK bdev Controller", 00:17:55.578 "serial_number": "SPDK0", 00:17:55.578 "firmware_revision": "24.01.1", 00:17:55.578 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:55.578 "oacs": { 00:17:55.578 "security": 0, 00:17:55.578 "format": 0, 00:17:55.578 "firmware": 0, 00:17:55.578 "ns_manage": 0 00:17:55.578 }, 00:17:55.578 "multi_ctrlr": true, 00:17:55.578 "ana_reporting": false 00:17:55.578 }, 00:17:55.578 "vs": { 00:17:55.578 "nvme_version": "1.3" 00:17:55.578 }, 00:17:55.578 "ns_data": { 00:17:55.578 "id": 1, 00:17:55.578 "can_share": true 00:17:55.578 } 00:17:55.578 } 00:17:55.578 ], 00:17:55.578 "mp_policy": "active_passive" 00:17:55.578 } 00:17:55.578 } 00:17:55.578 ] 00:17:55.578 23:09:59 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=2443604 00:17:55.578 23:09:59 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:17:55.578 23:09:59 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:55.836 Running I/O for 10 seconds... 00:17:56.770 Latency(us) 00:17:56.770 [2024-11-28T22:10:00.376Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:56.770 [2024-11-28T22:10:00.376Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:56.770 Nvme0n1 : 1.00 14452.00 56.45 0.00 0.00 0.00 0.00 0.00 00:17:56.770 [2024-11-28T22:10:00.376Z] =================================================================================================================== 00:17:56.770 [2024-11-28T22:10:00.376Z] Total : 14452.00 56.45 0.00 0.00 0.00 0.00 0.00 00:17:56.770 00:17:57.703 23:10:01 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 79d82336-1f60-4a38-9d57-1102a35004db 00:17:57.703 [2024-11-28T22:10:01.309Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:57.703 Nvme0n1 : 2.00 14624.50 57.13 0.00 0.00 0.00 0.00 0.00 00:17:57.703 [2024-11-28T22:10:01.309Z] =================================================================================================================== 00:17:57.703 [2024-11-28T22:10:01.309Z] Total : 14624.50 57.13 0.00 0.00 0.00 0.00 0.00 00:17:57.703 00:17:57.961 true 00:17:57.961 23:10:01 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 79d82336-1f60-4a38-9d57-1102a35004db 00:17:57.961 23:10:01 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:17:58.219 23:10:01 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:17:58.219 23:10:01 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:17:58.219 23:10:01 -- target/nvmf_lvs_grow.sh@65 -- # wait 2443604 00:17:58.785 [2024-11-28T22:10:02.391Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:58.785 Nvme0n1 : 3.00 14942.67 58.37 0.00 0.00 0.00 0.00 0.00 00:17:58.785 [2024-11-28T22:10:02.391Z] =================================================================================================================== 00:17:58.785 [2024-11-28T22:10:02.391Z] Total : 14942.67 58.37 0.00 0.00 0.00 0.00 0.00 00:17:58.785 00:17:59.721 [2024-11-28T22:10:03.327Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:59.721 Nvme0n1 : 4.00 14986.25 58.54 0.00 0.00 0.00 0.00 0.00 00:17:59.721 [2024-11-28T22:10:03.327Z] =================================================================================================================== 00:17:59.721 [2024-11-28T22:10:03.327Z] Total : 14986.25 58.54 0.00 0.00 0.00 0.00 0.00 00:17:59.721 00:18:01.095 [2024-11-28T22:10:04.701Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:01.095 Nvme0n1 : 5.00 15022.80 58.68 0.00 0.00 0.00 0.00 0.00 00:18:01.095 [2024-11-28T22:10:04.701Z] =================================================================================================================== 00:18:01.095 [2024-11-28T22:10:04.701Z] Total : 15022.80 58.68 0.00 0.00 0.00 0.00 0.00 00:18:01.095 00:18:02.028 [2024-11-28T22:10:05.634Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:02.028 Nvme0n1 : 6.00 15070.33 58.87 0.00 0.00 0.00 0.00 0.00 00:18:02.028 [2024-11-28T22:10:05.634Z] =================================================================================================================== 00:18:02.028 [2024-11-28T22:10:05.634Z] Total : 15070.33 58.87 0.00 0.00 0.00 0.00 0.00 00:18:02.028 00:18:02.960 [2024-11-28T22:10:06.566Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:02.960 Nvme0n1 : 7.00 15103.86 59.00 0.00 0.00 0.00 0.00 0.00 00:18:02.960 [2024-11-28T22:10:06.566Z] =================================================================================================================== 00:18:02.960 [2024-11-28T22:10:06.566Z] Total : 15103.86 59.00 0.00 0.00 0.00 0.00 0.00 00:18:02.960 00:18:03.894 [2024-11-28T22:10:07.500Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:03.894 Nvme0n1 : 8.00 15144.88 59.16 0.00 0.00 0.00 0.00 0.00 00:18:03.894 [2024-11-28T22:10:07.500Z] =================================================================================================================== 00:18:03.894 [2024-11-28T22:10:07.500Z] Total : 15144.88 59.16 0.00 0.00 0.00 0.00 0.00 00:18:03.894 00:18:04.828 [2024-11-28T22:10:08.434Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:04.828 Nvme0n1 : 9.00 15164.78 59.24 0.00 0.00 0.00 0.00 0.00 00:18:04.829 [2024-11-28T22:10:08.435Z] =================================================================================================================== 00:18:04.829 [2024-11-28T22:10:08.435Z] Total : 15164.78 59.24 0.00 0.00 0.00 0.00 0.00 00:18:04.829 00:18:05.763 [2024-11-28T22:10:09.369Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:05.763 Nvme0n1 : 10.00 15193.70 59.35 0.00 0.00 0.00 0.00 0.00 00:18:05.763 [2024-11-28T22:10:09.369Z] =================================================================================================================== 00:18:05.763 [2024-11-28T22:10:09.369Z] Total : 15193.70 59.35 0.00 0.00 0.00 0.00 0.00 00:18:05.763 00:18:05.763 00:18:05.763 Latency(us) 00:18:05.763 [2024-11-28T22:10:09.369Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:05.763 [2024-11-28T22:10:09.369Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:05.763 Nvme0n1 : 10.01 15194.32 59.35 0.00 0.00 8418.18 3446.71 19320.98 00:18:05.763 [2024-11-28T22:10:09.369Z] =================================================================================================================== 00:18:05.763 [2024-11-28T22:10:09.369Z] Total : 15194.32 59.35 0.00 0.00 8418.18 3446.71 19320.98 00:18:05.763 0 00:18:05.763 23:10:09 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 2443450 00:18:05.763 23:10:09 -- common/autotest_common.sh@936 -- # '[' -z 2443450 ']' 00:18:05.763 23:10:09 -- common/autotest_common.sh@940 -- # kill -0 2443450 00:18:05.763 23:10:09 -- common/autotest_common.sh@941 -- # uname 00:18:05.763 23:10:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:05.763 23:10:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2443450 00:18:06.021 23:10:09 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:06.021 23:10:09 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:06.021 23:10:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2443450' 00:18:06.021 killing process with pid 2443450 00:18:06.021 23:10:09 -- common/autotest_common.sh@955 -- # kill 2443450 00:18:06.021 Received shutdown signal, test time was about 10.000000 seconds 00:18:06.021 00:18:06.021 Latency(us) 00:18:06.021 [2024-11-28T22:10:09.627Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:06.021 [2024-11-28T22:10:09.627Z] =================================================================================================================== 00:18:06.021 [2024-11-28T22:10:09.627Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:06.021 23:10:09 -- common/autotest_common.sh@960 -- # wait 2443450 00:18:06.021 23:10:09 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:18:06.279 23:10:09 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 79d82336-1f60-4a38-9d57-1102a35004db 00:18:06.279 23:10:09 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:18:06.538 23:10:10 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:18:06.538 23:10:10 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:18:06.538 23:10:10 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:18:06.796 [2024-11-28 23:10:10.354342] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:18:06.796 23:10:10 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 79d82336-1f60-4a38-9d57-1102a35004db 00:18:06.796 23:10:10 -- common/autotest_common.sh@650 -- # local es=0 00:18:06.796 23:10:10 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 79d82336-1f60-4a38-9d57-1102a35004db 00:18:06.796 23:10:10 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:06.796 23:10:10 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:06.796 23:10:10 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:06.796 23:10:10 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:06.796 23:10:10 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:06.796 23:10:10 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:06.796 23:10:10 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:06.796 23:10:10 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:18:06.796 23:10:10 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 79d82336-1f60-4a38-9d57-1102a35004db 00:18:07.054 request: 00:18:07.054 { 00:18:07.054 "uuid": "79d82336-1f60-4a38-9d57-1102a35004db", 00:18:07.054 "method": "bdev_lvol_get_lvstores", 00:18:07.054 "req_id": 1 00:18:07.054 } 00:18:07.054 Got JSON-RPC error response 00:18:07.054 response: 00:18:07.054 { 00:18:07.054 "code": -19, 00:18:07.054 "message": "No such device" 00:18:07.054 } 00:18:07.054 23:10:10 -- common/autotest_common.sh@653 -- # es=1 00:18:07.054 23:10:10 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:07.054 23:10:10 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:07.054 23:10:10 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:07.054 23:10:10 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:18:07.312 aio_bdev 00:18:07.570 23:10:10 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 4fca910b-9aad-4db9-8201-4994c64b07e9 00:18:07.570 23:10:10 -- common/autotest_common.sh@897 -- # local bdev_name=4fca910b-9aad-4db9-8201-4994c64b07e9 00:18:07.570 23:10:10 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:18:07.570 23:10:10 -- common/autotest_common.sh@899 -- # local i 00:18:07.570 23:10:10 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:18:07.570 23:10:10 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:18:07.570 23:10:10 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:18:07.828 23:10:11 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 4fca910b-9aad-4db9-8201-4994c64b07e9 -t 2000 00:18:08.085 [ 00:18:08.085 { 00:18:08.085 "name": "4fca910b-9aad-4db9-8201-4994c64b07e9", 00:18:08.085 "aliases": [ 00:18:08.085 "lvs/lvol" 00:18:08.085 ], 00:18:08.085 "product_name": "Logical Volume", 00:18:08.085 "block_size": 4096, 00:18:08.085 "num_blocks": 38912, 00:18:08.085 "uuid": "4fca910b-9aad-4db9-8201-4994c64b07e9", 00:18:08.085 "assigned_rate_limits": { 00:18:08.085 "rw_ios_per_sec": 0, 00:18:08.085 "rw_mbytes_per_sec": 0, 00:18:08.085 "r_mbytes_per_sec": 0, 00:18:08.085 "w_mbytes_per_sec": 0 00:18:08.085 }, 00:18:08.085 "claimed": false, 00:18:08.085 "zoned": false, 00:18:08.085 "supported_io_types": { 00:18:08.085 "read": true, 00:18:08.085 "write": true, 00:18:08.085 "unmap": true, 00:18:08.085 "write_zeroes": true, 00:18:08.085 "flush": false, 00:18:08.085 "reset": true, 00:18:08.085 "compare": false, 00:18:08.085 "compare_and_write": false, 00:18:08.085 "abort": false, 00:18:08.085 "nvme_admin": false, 00:18:08.085 "nvme_io": false 00:18:08.085 }, 00:18:08.085 "driver_specific": { 00:18:08.085 "lvol": { 00:18:08.085 "lvol_store_uuid": "79d82336-1f60-4a38-9d57-1102a35004db", 00:18:08.085 "base_bdev": "aio_bdev", 00:18:08.085 "thin_provision": false, 00:18:08.085 "snapshot": false, 00:18:08.085 "clone": false, 00:18:08.085 "esnap_clone": false 00:18:08.085 } 00:18:08.085 } 00:18:08.085 } 00:18:08.085 ] 00:18:08.085 23:10:11 -- common/autotest_common.sh@905 -- # return 0 00:18:08.085 23:10:11 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 79d82336-1f60-4a38-9d57-1102a35004db 00:18:08.086 23:10:11 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:18:08.343 23:10:11 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:18:08.343 23:10:11 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 79d82336-1f60-4a38-9d57-1102a35004db 00:18:08.343 23:10:11 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:18:08.601 23:10:12 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:18:08.601 23:10:12 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 4fca910b-9aad-4db9-8201-4994c64b07e9 00:18:08.859 23:10:12 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 79d82336-1f60-4a38-9d57-1102a35004db 00:18:09.118 23:10:12 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:18:09.377 23:10:12 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:09.377 00:18:09.377 real 0m18.111s 00:18:09.377 user 0m17.945s 00:18:09.377 sys 0m1.831s 00:18:09.377 23:10:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:09.377 23:10:12 -- common/autotest_common.sh@10 -- # set +x 00:18:09.377 ************************************ 00:18:09.377 END TEST lvs_grow_clean 00:18:09.377 ************************************ 00:18:09.377 23:10:12 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:18:09.377 23:10:12 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:09.377 23:10:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:09.377 23:10:12 -- common/autotest_common.sh@10 -- # set +x 00:18:09.377 ************************************ 00:18:09.377 START TEST lvs_grow_dirty 00:18:09.377 ************************************ 00:18:09.377 23:10:12 -- common/autotest_common.sh@1114 -- # lvs_grow dirty 00:18:09.377 23:10:12 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:18:09.377 23:10:12 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:18:09.377 23:10:12 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:18:09.377 23:10:12 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:18:09.377 23:10:12 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:18:09.377 23:10:12 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:18:09.377 23:10:12 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:09.377 23:10:12 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:09.377 23:10:12 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:18:09.636 23:10:13 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:18:09.636 23:10:13 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:18:09.894 23:10:13 -- target/nvmf_lvs_grow.sh@28 -- # lvs=ff38efff-74c8-440a-94ad-fb5c076933ce 00:18:09.894 23:10:13 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ff38efff-74c8-440a-94ad-fb5c076933ce 00:18:09.894 23:10:13 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:18:10.152 23:10:13 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:18:10.152 23:10:13 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:18:10.152 23:10:13 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u ff38efff-74c8-440a-94ad-fb5c076933ce lvol 150 00:18:10.410 23:10:13 -- target/nvmf_lvs_grow.sh@33 -- # lvol=c8e6ff73-5206-4c01-90f9-022697913309 00:18:10.410 23:10:13 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:10.410 23:10:13 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:18:10.668 [2024-11-28 23:10:14.206816] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:18:10.668 [2024-11-28 23:10:14.206917] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:18:10.668 true 00:18:10.668 23:10:14 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ff38efff-74c8-440a-94ad-fb5c076933ce 00:18:10.668 23:10:14 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:18:10.927 23:10:14 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:18:10.927 23:10:14 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:18:11.185 23:10:14 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 c8e6ff73-5206-4c01-90f9-022697913309 00:18:11.444 23:10:14 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:18:11.704 23:10:15 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:18:11.962 23:10:15 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=2445690 00:18:11.962 23:10:15 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:18:11.962 23:10:15 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:11.962 23:10:15 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 2445690 /var/tmp/bdevperf.sock 00:18:11.962 23:10:15 -- common/autotest_common.sh@829 -- # '[' -z 2445690 ']' 00:18:11.962 23:10:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:11.962 23:10:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:11.962 23:10:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:11.962 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:11.962 23:10:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:11.962 23:10:15 -- common/autotest_common.sh@10 -- # set +x 00:18:11.962 [2024-11-28 23:10:15.536408] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:11.962 [2024-11-28 23:10:15.536499] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2445690 ] 00:18:11.962 EAL: No free 2048 kB hugepages reported on node 1 00:18:12.221 [2024-11-28 23:10:15.599278] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:12.221 [2024-11-28 23:10:15.687848] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:13.154 23:10:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:13.154 23:10:16 -- common/autotest_common.sh@862 -- # return 0 00:18:13.154 23:10:16 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:18:13.412 Nvme0n1 00:18:13.412 23:10:16 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:18:13.670 [ 00:18:13.670 { 00:18:13.670 "name": "Nvme0n1", 00:18:13.670 "aliases": [ 00:18:13.670 "c8e6ff73-5206-4c01-90f9-022697913309" 00:18:13.670 ], 00:18:13.670 "product_name": "NVMe disk", 00:18:13.670 "block_size": 4096, 00:18:13.670 "num_blocks": 38912, 00:18:13.670 "uuid": "c8e6ff73-5206-4c01-90f9-022697913309", 00:18:13.670 "assigned_rate_limits": { 00:18:13.670 "rw_ios_per_sec": 0, 00:18:13.670 "rw_mbytes_per_sec": 0, 00:18:13.670 "r_mbytes_per_sec": 0, 00:18:13.670 "w_mbytes_per_sec": 0 00:18:13.670 }, 00:18:13.670 "claimed": false, 00:18:13.670 "zoned": false, 00:18:13.670 "supported_io_types": { 00:18:13.670 "read": true, 00:18:13.670 "write": true, 00:18:13.670 "unmap": true, 00:18:13.670 "write_zeroes": true, 00:18:13.670 "flush": true, 00:18:13.670 "reset": true, 00:18:13.670 "compare": true, 00:18:13.670 "compare_and_write": true, 00:18:13.670 "abort": true, 00:18:13.670 "nvme_admin": true, 00:18:13.670 "nvme_io": true 00:18:13.670 }, 00:18:13.670 "driver_specific": { 00:18:13.670 "nvme": [ 00:18:13.670 { 00:18:13.670 "trid": { 00:18:13.670 "trtype": "TCP", 00:18:13.670 "adrfam": "IPv4", 00:18:13.670 "traddr": "10.0.0.2", 00:18:13.670 "trsvcid": "4420", 00:18:13.670 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:18:13.670 }, 00:18:13.670 "ctrlr_data": { 00:18:13.670 "cntlid": 1, 00:18:13.670 "vendor_id": "0x8086", 00:18:13.670 "model_number": "SPDK bdev Controller", 00:18:13.670 "serial_number": "SPDK0", 00:18:13.670 "firmware_revision": "24.01.1", 00:18:13.670 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:18:13.670 "oacs": { 00:18:13.670 "security": 0, 00:18:13.670 "format": 0, 00:18:13.670 "firmware": 0, 00:18:13.671 "ns_manage": 0 00:18:13.671 }, 00:18:13.671 "multi_ctrlr": true, 00:18:13.671 "ana_reporting": false 00:18:13.671 }, 00:18:13.671 "vs": { 00:18:13.671 "nvme_version": "1.3" 00:18:13.671 }, 00:18:13.671 "ns_data": { 00:18:13.671 "id": 1, 00:18:13.671 "can_share": true 00:18:13.671 } 00:18:13.671 } 00:18:13.671 ], 00:18:13.671 "mp_policy": "active_passive" 00:18:13.671 } 00:18:13.671 } 00:18:13.671 ] 00:18:13.671 23:10:17 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=2445838 00:18:13.671 23:10:17 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:13.671 23:10:17 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:18:13.671 Running I/O for 10 seconds... 00:18:15.047 Latency(us) 00:18:15.047 [2024-11-28T22:10:18.653Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:15.047 [2024-11-28T22:10:18.653Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:15.047 Nvme0n1 : 1.00 14239.00 55.62 0.00 0.00 0.00 0.00 0.00 00:18:15.047 [2024-11-28T22:10:18.653Z] =================================================================================================================== 00:18:15.047 [2024-11-28T22:10:18.653Z] Total : 14239.00 55.62 0.00 0.00 0.00 0.00 0.00 00:18:15.047 00:18:15.614 23:10:19 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u ff38efff-74c8-440a-94ad-fb5c076933ce 00:18:15.872 [2024-11-28T22:10:19.478Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:15.872 Nvme0n1 : 2.00 14422.00 56.34 0.00 0.00 0.00 0.00 0.00 00:18:15.872 [2024-11-28T22:10:19.478Z] =================================================================================================================== 00:18:15.872 [2024-11-28T22:10:19.479Z] Total : 14422.00 56.34 0.00 0.00 0.00 0.00 0.00 00:18:15.873 00:18:15.873 true 00:18:16.131 23:10:19 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ff38efff-74c8-440a-94ad-fb5c076933ce 00:18:16.131 23:10:19 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:18:16.389 23:10:19 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:18:16.389 23:10:19 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:18:16.389 23:10:19 -- target/nvmf_lvs_grow.sh@65 -- # wait 2445838 00:18:16.955 [2024-11-28T22:10:20.561Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:16.955 Nvme0n1 : 3.00 14504.00 56.66 0.00 0.00 0.00 0.00 0.00 00:18:16.955 [2024-11-28T22:10:20.561Z] =================================================================================================================== 00:18:16.955 [2024-11-28T22:10:20.561Z] Total : 14504.00 56.66 0.00 0.00 0.00 0.00 0.00 00:18:16.955 00:18:17.889 [2024-11-28T22:10:21.495Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:17.889 Nvme0n1 : 4.00 14609.00 57.07 0.00 0.00 0.00 0.00 0.00 00:18:17.889 [2024-11-28T22:10:21.495Z] =================================================================================================================== 00:18:17.889 [2024-11-28T22:10:21.495Z] Total : 14609.00 57.07 0.00 0.00 0.00 0.00 0.00 00:18:17.889 00:18:18.824 [2024-11-28T22:10:22.430Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:18.824 Nvme0n1 : 5.00 14767.60 57.69 0.00 0.00 0.00 0.00 0.00 00:18:18.824 [2024-11-28T22:10:22.430Z] =================================================================================================================== 00:18:18.824 [2024-11-28T22:10:22.430Z] Total : 14767.60 57.69 0.00 0.00 0.00 0.00 0.00 00:18:18.824 00:18:19.757 [2024-11-28T22:10:23.363Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:19.757 Nvme0n1 : 6.00 14804.00 57.83 0.00 0.00 0.00 0.00 0.00 00:18:19.757 [2024-11-28T22:10:23.363Z] =================================================================================================================== 00:18:19.757 [2024-11-28T22:10:23.363Z] Total : 14804.00 57.83 0.00 0.00 0.00 0.00 0.00 00:18:19.757 00:18:20.764 [2024-11-28T22:10:24.370Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:20.764 Nvme0n1 : 7.00 14839.29 57.97 0.00 0.00 0.00 0.00 0.00 00:18:20.764 [2024-11-28T22:10:24.370Z] =================================================================================================================== 00:18:20.764 [2024-11-28T22:10:24.370Z] Total : 14839.29 57.97 0.00 0.00 0.00 0.00 0.00 00:18:20.764 00:18:21.697 [2024-11-28T22:10:25.303Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:21.697 Nvme0n1 : 8.00 14868.88 58.08 0.00 0.00 0.00 0.00 0.00 00:18:21.697 [2024-11-28T22:10:25.303Z] =================================================================================================================== 00:18:21.697 [2024-11-28T22:10:25.303Z] Total : 14868.88 58.08 0.00 0.00 0.00 0.00 0.00 00:18:21.697 00:18:23.068 [2024-11-28T22:10:26.674Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:23.069 Nvme0n1 : 9.00 14903.89 58.22 0.00 0.00 0.00 0.00 0.00 00:18:23.069 [2024-11-28T22:10:26.675Z] =================================================================================================================== 00:18:23.069 [2024-11-28T22:10:26.675Z] Total : 14903.89 58.22 0.00 0.00 0.00 0.00 0.00 00:18:23.069 00:18:24.002 00:18:24.002 Latency(us) 00:18:24.002 [2024-11-28T22:10:27.608Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:24.002 [2024-11-28T22:10:27.608Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:24.002 Nvme0n1 : 10.00 14913.32 58.26 0.00 0.00 8578.38 2148.12 17087.91 00:18:24.002 [2024-11-28T22:10:27.608Z] =================================================================================================================== 00:18:24.002 [2024-11-28T22:10:27.608Z] Total : 14913.32 58.26 0.00 0.00 8578.38 2148.12 17087.91 00:18:24.002 0 00:18:24.002 23:10:27 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 2445690 00:18:24.002 23:10:27 -- common/autotest_common.sh@936 -- # '[' -z 2445690 ']' 00:18:24.002 23:10:27 -- common/autotest_common.sh@940 -- # kill -0 2445690 00:18:24.002 23:10:27 -- common/autotest_common.sh@941 -- # uname 00:18:24.002 23:10:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:24.002 23:10:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2445690 00:18:24.002 23:10:27 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:24.002 23:10:27 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:24.002 23:10:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2445690' 00:18:24.002 killing process with pid 2445690 00:18:24.002 23:10:27 -- common/autotest_common.sh@955 -- # kill 2445690 00:18:24.002 Received shutdown signal, test time was about 10.000000 seconds 00:18:24.002 00:18:24.003 Latency(us) 00:18:24.003 [2024-11-28T22:10:27.609Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:24.003 [2024-11-28T22:10:27.609Z] =================================================================================================================== 00:18:24.003 [2024-11-28T22:10:27.609Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:24.003 23:10:27 -- common/autotest_common.sh@960 -- # wait 2445690 00:18:24.003 23:10:27 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:18:24.568 23:10:27 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ff38efff-74c8-440a-94ad-fb5c076933ce 00:18:24.568 23:10:27 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:18:24.568 23:10:28 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:18:24.568 23:10:28 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:18:24.568 23:10:28 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 2442872 00:18:24.568 23:10:28 -- target/nvmf_lvs_grow.sh@74 -- # wait 2442872 00:18:24.568 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 2442872 Killed "${NVMF_APP[@]}" "$@" 00:18:24.568 23:10:28 -- target/nvmf_lvs_grow.sh@74 -- # true 00:18:24.569 23:10:28 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:18:24.569 23:10:28 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:24.569 23:10:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:24.569 23:10:28 -- common/autotest_common.sh@10 -- # set +x 00:18:24.569 23:10:28 -- nvmf/common.sh@469 -- # nvmfpid=2447208 00:18:24.569 23:10:28 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:18:24.569 23:10:28 -- nvmf/common.sh@470 -- # waitforlisten 2447208 00:18:24.569 23:10:28 -- common/autotest_common.sh@829 -- # '[' -z 2447208 ']' 00:18:24.569 23:10:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:24.569 23:10:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:24.569 23:10:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:24.569 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:24.569 23:10:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:24.569 23:10:28 -- common/autotest_common.sh@10 -- # set +x 00:18:24.827 [2024-11-28 23:10:28.207330] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:24.827 [2024-11-28 23:10:28.207437] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:24.827 EAL: No free 2048 kB hugepages reported on node 1 00:18:24.827 [2024-11-28 23:10:28.274607] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:24.827 [2024-11-28 23:10:28.360291] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:24.827 [2024-11-28 23:10:28.360484] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:24.827 [2024-11-28 23:10:28.360504] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:24.827 [2024-11-28 23:10:28.360517] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:24.827 [2024-11-28 23:10:28.360546] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:25.761 23:10:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:25.761 23:10:29 -- common/autotest_common.sh@862 -- # return 0 00:18:25.761 23:10:29 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:25.761 23:10:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:25.761 23:10:29 -- common/autotest_common.sh@10 -- # set +x 00:18:25.761 23:10:29 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:25.761 23:10:29 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:18:26.019 [2024-11-28 23:10:29.430025] blobstore.c:4642:bs_recover: *NOTICE*: Performing recovery on blobstore 00:18:26.019 [2024-11-28 23:10:29.430186] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:18:26.019 [2024-11-28 23:10:29.430243] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:18:26.019 23:10:29 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:18:26.019 23:10:29 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev c8e6ff73-5206-4c01-90f9-022697913309 00:18:26.019 23:10:29 -- common/autotest_common.sh@897 -- # local bdev_name=c8e6ff73-5206-4c01-90f9-022697913309 00:18:26.019 23:10:29 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:18:26.019 23:10:29 -- common/autotest_common.sh@899 -- # local i 00:18:26.019 23:10:29 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:18:26.019 23:10:29 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:18:26.019 23:10:29 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:18:26.277 23:10:29 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b c8e6ff73-5206-4c01-90f9-022697913309 -t 2000 00:18:26.535 [ 00:18:26.535 { 00:18:26.535 "name": "c8e6ff73-5206-4c01-90f9-022697913309", 00:18:26.536 "aliases": [ 00:18:26.536 "lvs/lvol" 00:18:26.536 ], 00:18:26.536 "product_name": "Logical Volume", 00:18:26.536 "block_size": 4096, 00:18:26.536 "num_blocks": 38912, 00:18:26.536 "uuid": "c8e6ff73-5206-4c01-90f9-022697913309", 00:18:26.536 "assigned_rate_limits": { 00:18:26.536 "rw_ios_per_sec": 0, 00:18:26.536 "rw_mbytes_per_sec": 0, 00:18:26.536 "r_mbytes_per_sec": 0, 00:18:26.536 "w_mbytes_per_sec": 0 00:18:26.536 }, 00:18:26.536 "claimed": false, 00:18:26.536 "zoned": false, 00:18:26.536 "supported_io_types": { 00:18:26.536 "read": true, 00:18:26.536 "write": true, 00:18:26.536 "unmap": true, 00:18:26.536 "write_zeroes": true, 00:18:26.536 "flush": false, 00:18:26.536 "reset": true, 00:18:26.536 "compare": false, 00:18:26.536 "compare_and_write": false, 00:18:26.536 "abort": false, 00:18:26.536 "nvme_admin": false, 00:18:26.536 "nvme_io": false 00:18:26.536 }, 00:18:26.536 "driver_specific": { 00:18:26.536 "lvol": { 00:18:26.536 "lvol_store_uuid": "ff38efff-74c8-440a-94ad-fb5c076933ce", 00:18:26.536 "base_bdev": "aio_bdev", 00:18:26.536 "thin_provision": false, 00:18:26.536 "snapshot": false, 00:18:26.536 "clone": false, 00:18:26.536 "esnap_clone": false 00:18:26.536 } 00:18:26.536 } 00:18:26.536 } 00:18:26.536 ] 00:18:26.536 23:10:29 -- common/autotest_common.sh@905 -- # return 0 00:18:26.536 23:10:29 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ff38efff-74c8-440a-94ad-fb5c076933ce 00:18:26.536 23:10:29 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:18:26.793 23:10:30 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:18:26.794 23:10:30 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ff38efff-74c8-440a-94ad-fb5c076933ce 00:18:26.794 23:10:30 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:18:27.051 23:10:30 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:18:27.051 23:10:30 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:18:27.309 [2024-11-28 23:10:30.727084] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:18:27.310 23:10:30 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ff38efff-74c8-440a-94ad-fb5c076933ce 00:18:27.310 23:10:30 -- common/autotest_common.sh@650 -- # local es=0 00:18:27.310 23:10:30 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ff38efff-74c8-440a-94ad-fb5c076933ce 00:18:27.310 23:10:30 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:27.310 23:10:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:27.310 23:10:30 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:27.310 23:10:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:27.310 23:10:30 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:27.310 23:10:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:27.310 23:10:30 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:27.310 23:10:30 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:18:27.310 23:10:30 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ff38efff-74c8-440a-94ad-fb5c076933ce 00:18:27.567 request: 00:18:27.567 { 00:18:27.567 "uuid": "ff38efff-74c8-440a-94ad-fb5c076933ce", 00:18:27.567 "method": "bdev_lvol_get_lvstores", 00:18:27.567 "req_id": 1 00:18:27.567 } 00:18:27.567 Got JSON-RPC error response 00:18:27.567 response: 00:18:27.567 { 00:18:27.567 "code": -19, 00:18:27.567 "message": "No such device" 00:18:27.567 } 00:18:27.567 23:10:31 -- common/autotest_common.sh@653 -- # es=1 00:18:27.567 23:10:31 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:27.567 23:10:31 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:27.567 23:10:31 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:27.567 23:10:31 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:18:27.825 aio_bdev 00:18:27.825 23:10:31 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev c8e6ff73-5206-4c01-90f9-022697913309 00:18:27.825 23:10:31 -- common/autotest_common.sh@897 -- # local bdev_name=c8e6ff73-5206-4c01-90f9-022697913309 00:18:27.825 23:10:31 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:18:27.825 23:10:31 -- common/autotest_common.sh@899 -- # local i 00:18:27.825 23:10:31 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:18:27.825 23:10:31 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:18:27.825 23:10:31 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:18:28.083 23:10:31 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b c8e6ff73-5206-4c01-90f9-022697913309 -t 2000 00:18:28.342 [ 00:18:28.342 { 00:18:28.342 "name": "c8e6ff73-5206-4c01-90f9-022697913309", 00:18:28.342 "aliases": [ 00:18:28.342 "lvs/lvol" 00:18:28.342 ], 00:18:28.342 "product_name": "Logical Volume", 00:18:28.342 "block_size": 4096, 00:18:28.342 "num_blocks": 38912, 00:18:28.342 "uuid": "c8e6ff73-5206-4c01-90f9-022697913309", 00:18:28.342 "assigned_rate_limits": { 00:18:28.342 "rw_ios_per_sec": 0, 00:18:28.342 "rw_mbytes_per_sec": 0, 00:18:28.342 "r_mbytes_per_sec": 0, 00:18:28.342 "w_mbytes_per_sec": 0 00:18:28.342 }, 00:18:28.342 "claimed": false, 00:18:28.342 "zoned": false, 00:18:28.342 "supported_io_types": { 00:18:28.342 "read": true, 00:18:28.342 "write": true, 00:18:28.342 "unmap": true, 00:18:28.342 "write_zeroes": true, 00:18:28.342 "flush": false, 00:18:28.342 "reset": true, 00:18:28.342 "compare": false, 00:18:28.342 "compare_and_write": false, 00:18:28.342 "abort": false, 00:18:28.342 "nvme_admin": false, 00:18:28.342 "nvme_io": false 00:18:28.342 }, 00:18:28.342 "driver_specific": { 00:18:28.342 "lvol": { 00:18:28.342 "lvol_store_uuid": "ff38efff-74c8-440a-94ad-fb5c076933ce", 00:18:28.342 "base_bdev": "aio_bdev", 00:18:28.342 "thin_provision": false, 00:18:28.342 "snapshot": false, 00:18:28.342 "clone": false, 00:18:28.342 "esnap_clone": false 00:18:28.342 } 00:18:28.342 } 00:18:28.342 } 00:18:28.342 ] 00:18:28.342 23:10:31 -- common/autotest_common.sh@905 -- # return 0 00:18:28.342 23:10:31 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ff38efff-74c8-440a-94ad-fb5c076933ce 00:18:28.342 23:10:31 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:18:28.600 23:10:32 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:18:28.600 23:10:32 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ff38efff-74c8-440a-94ad-fb5c076933ce 00:18:28.600 23:10:32 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:18:28.858 23:10:32 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:18:28.858 23:10:32 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete c8e6ff73-5206-4c01-90f9-022697913309 00:18:29.116 23:10:32 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u ff38efff-74c8-440a-94ad-fb5c076933ce 00:18:29.375 23:10:32 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:18:29.633 23:10:33 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:29.633 00:18:29.633 real 0m20.243s 00:18:29.633 user 0m51.015s 00:18:29.633 sys 0m4.719s 00:18:29.633 23:10:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:29.633 23:10:33 -- common/autotest_common.sh@10 -- # set +x 00:18:29.633 ************************************ 00:18:29.633 END TEST lvs_grow_dirty 00:18:29.633 ************************************ 00:18:29.633 23:10:33 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:18:29.633 23:10:33 -- common/autotest_common.sh@806 -- # type=--id 00:18:29.633 23:10:33 -- common/autotest_common.sh@807 -- # id=0 00:18:29.633 23:10:33 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:18:29.633 23:10:33 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:29.633 23:10:33 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:18:29.633 23:10:33 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:18:29.633 23:10:33 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:18:29.633 23:10:33 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:29.633 nvmf_trace.0 00:18:29.633 23:10:33 -- common/autotest_common.sh@821 -- # return 0 00:18:29.633 23:10:33 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:18:29.633 23:10:33 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:29.633 23:10:33 -- nvmf/common.sh@116 -- # sync 00:18:29.633 23:10:33 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:29.633 23:10:33 -- nvmf/common.sh@119 -- # set +e 00:18:29.633 23:10:33 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:29.633 23:10:33 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:29.633 rmmod nvme_tcp 00:18:29.633 rmmod nvme_fabrics 00:18:29.633 rmmod nvme_keyring 00:18:29.892 23:10:33 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:29.892 23:10:33 -- nvmf/common.sh@123 -- # set -e 00:18:29.892 23:10:33 -- nvmf/common.sh@124 -- # return 0 00:18:29.892 23:10:33 -- nvmf/common.sh@477 -- # '[' -n 2447208 ']' 00:18:29.892 23:10:33 -- nvmf/common.sh@478 -- # killprocess 2447208 00:18:29.892 23:10:33 -- common/autotest_common.sh@936 -- # '[' -z 2447208 ']' 00:18:29.892 23:10:33 -- common/autotest_common.sh@940 -- # kill -0 2447208 00:18:29.892 23:10:33 -- common/autotest_common.sh@941 -- # uname 00:18:29.892 23:10:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:29.892 23:10:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2447208 00:18:29.892 23:10:33 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:29.892 23:10:33 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:29.892 23:10:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2447208' 00:18:29.892 killing process with pid 2447208 00:18:29.892 23:10:33 -- common/autotest_common.sh@955 -- # kill 2447208 00:18:29.892 23:10:33 -- common/autotest_common.sh@960 -- # wait 2447208 00:18:30.151 23:10:33 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:30.151 23:10:33 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:30.151 23:10:33 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:30.151 23:10:33 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:30.151 23:10:33 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:30.151 23:10:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:30.151 23:10:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:30.151 23:10:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:32.055 23:10:35 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:32.055 00:18:32.055 real 0m44.436s 00:18:32.055 user 1m15.645s 00:18:32.055 sys 0m8.493s 00:18:32.055 23:10:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:32.055 23:10:35 -- common/autotest_common.sh@10 -- # set +x 00:18:32.055 ************************************ 00:18:32.055 END TEST nvmf_lvs_grow 00:18:32.055 ************************************ 00:18:32.055 23:10:35 -- nvmf/nvmf.sh@49 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:18:32.055 23:10:35 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:32.055 23:10:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:32.055 23:10:35 -- common/autotest_common.sh@10 -- # set +x 00:18:32.055 ************************************ 00:18:32.055 START TEST nvmf_bdev_io_wait 00:18:32.055 ************************************ 00:18:32.055 23:10:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:18:32.055 * Looking for test storage... 00:18:32.055 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:32.055 23:10:35 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:32.055 23:10:35 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:32.055 23:10:35 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:32.313 23:10:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:32.313 23:10:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:32.313 23:10:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:32.313 23:10:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:32.314 23:10:35 -- scripts/common.sh@335 -- # IFS=.-: 00:18:32.314 23:10:35 -- scripts/common.sh@335 -- # read -ra ver1 00:18:32.314 23:10:35 -- scripts/common.sh@336 -- # IFS=.-: 00:18:32.314 23:10:35 -- scripts/common.sh@336 -- # read -ra ver2 00:18:32.314 23:10:35 -- scripts/common.sh@337 -- # local 'op=<' 00:18:32.314 23:10:35 -- scripts/common.sh@339 -- # ver1_l=2 00:18:32.314 23:10:35 -- scripts/common.sh@340 -- # ver2_l=1 00:18:32.314 23:10:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:32.314 23:10:35 -- scripts/common.sh@343 -- # case "$op" in 00:18:32.314 23:10:35 -- scripts/common.sh@344 -- # : 1 00:18:32.314 23:10:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:32.314 23:10:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:32.314 23:10:35 -- scripts/common.sh@364 -- # decimal 1 00:18:32.314 23:10:35 -- scripts/common.sh@352 -- # local d=1 00:18:32.314 23:10:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:32.314 23:10:35 -- scripts/common.sh@354 -- # echo 1 00:18:32.314 23:10:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:32.314 23:10:35 -- scripts/common.sh@365 -- # decimal 2 00:18:32.314 23:10:35 -- scripts/common.sh@352 -- # local d=2 00:18:32.314 23:10:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:32.314 23:10:35 -- scripts/common.sh@354 -- # echo 2 00:18:32.314 23:10:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:32.314 23:10:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:32.314 23:10:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:32.314 23:10:35 -- scripts/common.sh@367 -- # return 0 00:18:32.314 23:10:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:32.314 23:10:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:32.314 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:32.314 --rc genhtml_branch_coverage=1 00:18:32.314 --rc genhtml_function_coverage=1 00:18:32.314 --rc genhtml_legend=1 00:18:32.314 --rc geninfo_all_blocks=1 00:18:32.314 --rc geninfo_unexecuted_blocks=1 00:18:32.314 00:18:32.314 ' 00:18:32.314 23:10:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:32.314 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:32.314 --rc genhtml_branch_coverage=1 00:18:32.314 --rc genhtml_function_coverage=1 00:18:32.314 --rc genhtml_legend=1 00:18:32.314 --rc geninfo_all_blocks=1 00:18:32.314 --rc geninfo_unexecuted_blocks=1 00:18:32.314 00:18:32.314 ' 00:18:32.314 23:10:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:32.314 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:32.314 --rc genhtml_branch_coverage=1 00:18:32.314 --rc genhtml_function_coverage=1 00:18:32.314 --rc genhtml_legend=1 00:18:32.314 --rc geninfo_all_blocks=1 00:18:32.314 --rc geninfo_unexecuted_blocks=1 00:18:32.314 00:18:32.314 ' 00:18:32.314 23:10:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:32.314 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:32.314 --rc genhtml_branch_coverage=1 00:18:32.314 --rc genhtml_function_coverage=1 00:18:32.314 --rc genhtml_legend=1 00:18:32.314 --rc geninfo_all_blocks=1 00:18:32.314 --rc geninfo_unexecuted_blocks=1 00:18:32.314 00:18:32.314 ' 00:18:32.314 23:10:35 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:32.314 23:10:35 -- nvmf/common.sh@7 -- # uname -s 00:18:32.314 23:10:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:32.314 23:10:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:32.314 23:10:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:32.314 23:10:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:32.314 23:10:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:32.314 23:10:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:32.314 23:10:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:32.314 23:10:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:32.314 23:10:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:32.314 23:10:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:32.314 23:10:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:32.314 23:10:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:32.314 23:10:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:32.314 23:10:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:32.314 23:10:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:32.314 23:10:35 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:32.314 23:10:35 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:32.314 23:10:35 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:32.314 23:10:35 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:32.314 23:10:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:32.314 23:10:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:32.314 23:10:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:32.314 23:10:35 -- paths/export.sh@5 -- # export PATH 00:18:32.314 23:10:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:32.314 23:10:35 -- nvmf/common.sh@46 -- # : 0 00:18:32.314 23:10:35 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:32.314 23:10:35 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:32.314 23:10:35 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:32.314 23:10:35 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:32.314 23:10:35 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:32.314 23:10:35 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:32.314 23:10:35 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:32.314 23:10:35 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:32.314 23:10:35 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:32.314 23:10:35 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:32.314 23:10:35 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:18:32.314 23:10:35 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:32.314 23:10:35 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:32.314 23:10:35 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:32.314 23:10:35 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:32.314 23:10:35 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:32.314 23:10:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:32.314 23:10:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:32.314 23:10:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:32.314 23:10:35 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:32.314 23:10:35 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:32.314 23:10:35 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:32.314 23:10:35 -- common/autotest_common.sh@10 -- # set +x 00:18:34.216 23:10:37 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:34.216 23:10:37 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:34.216 23:10:37 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:34.216 23:10:37 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:34.216 23:10:37 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:34.216 23:10:37 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:34.216 23:10:37 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:34.216 23:10:37 -- nvmf/common.sh@294 -- # net_devs=() 00:18:34.216 23:10:37 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:34.216 23:10:37 -- nvmf/common.sh@295 -- # e810=() 00:18:34.216 23:10:37 -- nvmf/common.sh@295 -- # local -ga e810 00:18:34.216 23:10:37 -- nvmf/common.sh@296 -- # x722=() 00:18:34.216 23:10:37 -- nvmf/common.sh@296 -- # local -ga x722 00:18:34.216 23:10:37 -- nvmf/common.sh@297 -- # mlx=() 00:18:34.216 23:10:37 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:34.216 23:10:37 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:34.216 23:10:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:34.216 23:10:37 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:34.216 23:10:37 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:34.216 23:10:37 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:34.216 23:10:37 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:34.216 23:10:37 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:34.217 23:10:37 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:34.217 23:10:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:34.217 23:10:37 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:34.217 23:10:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:34.217 23:10:37 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:34.217 23:10:37 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:34.217 23:10:37 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:34.217 23:10:37 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:34.217 23:10:37 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:34.217 23:10:37 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:34.217 23:10:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:34.217 23:10:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:34.217 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:34.217 23:10:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:34.217 23:10:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:34.217 23:10:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:34.217 23:10:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:34.217 23:10:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:34.217 23:10:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:34.217 23:10:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:34.217 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:34.217 23:10:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:34.217 23:10:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:34.217 23:10:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:34.217 23:10:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:34.217 23:10:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:34.217 23:10:37 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:34.217 23:10:37 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:34.217 23:10:37 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:34.217 23:10:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:34.217 23:10:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:34.217 23:10:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:34.217 23:10:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:34.217 23:10:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:34.217 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:34.217 23:10:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:34.217 23:10:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:34.217 23:10:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:34.217 23:10:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:34.217 23:10:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:34.217 23:10:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:34.217 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:34.217 23:10:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:34.217 23:10:37 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:34.217 23:10:37 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:34.217 23:10:37 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:34.217 23:10:37 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:34.217 23:10:37 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:34.217 23:10:37 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:34.217 23:10:37 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:34.217 23:10:37 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:34.217 23:10:37 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:34.217 23:10:37 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:34.217 23:10:37 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:34.217 23:10:37 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:34.217 23:10:37 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:34.217 23:10:37 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:34.217 23:10:37 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:34.217 23:10:37 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:34.217 23:10:37 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:34.217 23:10:37 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:34.217 23:10:37 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:34.217 23:10:37 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:34.217 23:10:37 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:34.217 23:10:37 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:34.217 23:10:37 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:34.217 23:10:37 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:34.217 23:10:37 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:34.217 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:34.217 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.239 ms 00:18:34.217 00:18:34.217 --- 10.0.0.2 ping statistics --- 00:18:34.217 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:34.217 rtt min/avg/max/mdev = 0.239/0.239/0.239/0.000 ms 00:18:34.217 23:10:37 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:34.217 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:34.217 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.139 ms 00:18:34.217 00:18:34.217 --- 10.0.0.1 ping statistics --- 00:18:34.217 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:34.217 rtt min/avg/max/mdev = 0.139/0.139/0.139/0.000 ms 00:18:34.217 23:10:37 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:34.217 23:10:37 -- nvmf/common.sh@410 -- # return 0 00:18:34.217 23:10:37 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:34.217 23:10:37 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:34.217 23:10:37 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:34.217 23:10:37 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:34.217 23:10:37 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:34.217 23:10:37 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:34.217 23:10:37 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:34.217 23:10:37 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:18:34.217 23:10:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:34.217 23:10:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:34.217 23:10:37 -- common/autotest_common.sh@10 -- # set +x 00:18:34.217 23:10:37 -- nvmf/common.sh@469 -- # nvmfpid=2449767 00:18:34.217 23:10:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:18:34.217 23:10:37 -- nvmf/common.sh@470 -- # waitforlisten 2449767 00:18:34.217 23:10:37 -- common/autotest_common.sh@829 -- # '[' -z 2449767 ']' 00:18:34.217 23:10:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:34.217 23:10:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:34.217 23:10:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:34.217 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:34.217 23:10:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:34.217 23:10:37 -- common/autotest_common.sh@10 -- # set +x 00:18:34.475 [2024-11-28 23:10:37.849372] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:34.476 [2024-11-28 23:10:37.849468] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:34.476 EAL: No free 2048 kB hugepages reported on node 1 00:18:34.476 [2024-11-28 23:10:37.921513] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:34.476 [2024-11-28 23:10:38.017082] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:34.476 [2024-11-28 23:10:38.017240] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:34.476 [2024-11-28 23:10:38.017258] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:34.476 [2024-11-28 23:10:38.017270] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:34.476 [2024-11-28 23:10:38.018419] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:34.476 [2024-11-28 23:10:38.018465] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:34.476 [2024-11-28 23:10:38.018567] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:34.476 [2024-11-28 23:10:38.018570] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:34.476 23:10:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:34.476 23:10:38 -- common/autotest_common.sh@862 -- # return 0 00:18:34.476 23:10:38 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:34.476 23:10:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:34.476 23:10:38 -- common/autotest_common.sh@10 -- # set +x 00:18:34.734 23:10:38 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:34.734 23:10:38 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:18:34.734 23:10:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:34.734 23:10:38 -- common/autotest_common.sh@10 -- # set +x 00:18:34.734 23:10:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:34.734 23:10:38 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:18:34.734 23:10:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:34.734 23:10:38 -- common/autotest_common.sh@10 -- # set +x 00:18:34.734 23:10:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:34.734 23:10:38 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:34.734 23:10:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:34.734 23:10:38 -- common/autotest_common.sh@10 -- # set +x 00:18:34.734 [2024-11-28 23:10:38.174545] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:34.734 23:10:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:34.734 23:10:38 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:34.734 23:10:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:34.734 23:10:38 -- common/autotest_common.sh@10 -- # set +x 00:18:34.734 Malloc0 00:18:34.734 23:10:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:34.734 23:10:38 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:34.734 23:10:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:34.734 23:10:38 -- common/autotest_common.sh@10 -- # set +x 00:18:34.734 23:10:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:34.734 23:10:38 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:34.734 23:10:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:34.734 23:10:38 -- common/autotest_common.sh@10 -- # set +x 00:18:34.734 23:10:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:34.734 23:10:38 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:34.734 23:10:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:34.734 23:10:38 -- common/autotest_common.sh@10 -- # set +x 00:18:34.734 [2024-11-28 23:10:38.237066] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:34.734 23:10:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:34.734 23:10:38 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=2449919 00:18:34.734 23:10:38 -- target/bdev_io_wait.sh@30 -- # READ_PID=2449920 00:18:34.734 23:10:38 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:18:34.734 23:10:38 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:18:34.734 23:10:38 -- nvmf/common.sh@520 -- # config=() 00:18:34.734 23:10:38 -- nvmf/common.sh@520 -- # local subsystem config 00:18:34.734 23:10:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:34.734 23:10:38 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=2449923 00:18:34.734 23:10:38 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:18:34.734 23:10:38 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:18:34.734 23:10:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:34.734 { 00:18:34.734 "params": { 00:18:34.734 "name": "Nvme$subsystem", 00:18:34.734 "trtype": "$TEST_TRANSPORT", 00:18:34.734 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:34.734 "adrfam": "ipv4", 00:18:34.734 "trsvcid": "$NVMF_PORT", 00:18:34.734 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:34.734 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:34.734 "hdgst": ${hdgst:-false}, 00:18:34.734 "ddgst": ${ddgst:-false} 00:18:34.734 }, 00:18:34.734 "method": "bdev_nvme_attach_controller" 00:18:34.734 } 00:18:34.734 EOF 00:18:34.734 )") 00:18:34.734 23:10:38 -- nvmf/common.sh@520 -- # config=() 00:18:34.734 23:10:38 -- nvmf/common.sh@520 -- # local subsystem config 00:18:34.734 23:10:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:34.734 23:10:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:34.734 { 00:18:34.734 "params": { 00:18:34.734 "name": "Nvme$subsystem", 00:18:34.734 "trtype": "$TEST_TRANSPORT", 00:18:34.734 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:34.734 "adrfam": "ipv4", 00:18:34.734 "trsvcid": "$NVMF_PORT", 00:18:34.734 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:34.734 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:34.734 "hdgst": ${hdgst:-false}, 00:18:34.734 "ddgst": ${ddgst:-false} 00:18:34.734 }, 00:18:34.734 "method": "bdev_nvme_attach_controller" 00:18:34.734 } 00:18:34.734 EOF 00:18:34.734 )") 00:18:34.734 23:10:38 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=2449925 00:18:34.734 23:10:38 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:18:34.734 23:10:38 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:18:34.734 23:10:38 -- target/bdev_io_wait.sh@35 -- # sync 00:18:34.734 23:10:38 -- nvmf/common.sh@520 -- # config=() 00:18:34.734 23:10:38 -- nvmf/common.sh@520 -- # local subsystem config 00:18:34.734 23:10:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:34.734 23:10:38 -- nvmf/common.sh@542 -- # cat 00:18:34.734 23:10:38 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:18:34.734 23:10:38 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:18:34.734 23:10:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:34.734 { 00:18:34.734 "params": { 00:18:34.734 "name": "Nvme$subsystem", 00:18:34.734 "trtype": "$TEST_TRANSPORT", 00:18:34.734 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:34.734 "adrfam": "ipv4", 00:18:34.734 "trsvcid": "$NVMF_PORT", 00:18:34.734 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:34.734 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:34.734 "hdgst": ${hdgst:-false}, 00:18:34.734 "ddgst": ${ddgst:-false} 00:18:34.734 }, 00:18:34.734 "method": "bdev_nvme_attach_controller" 00:18:34.734 } 00:18:34.734 EOF 00:18:34.734 )") 00:18:34.734 23:10:38 -- nvmf/common.sh@520 -- # config=() 00:18:34.734 23:10:38 -- nvmf/common.sh@520 -- # local subsystem config 00:18:34.734 23:10:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:34.734 23:10:38 -- nvmf/common.sh@542 -- # cat 00:18:34.734 23:10:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:34.734 { 00:18:34.734 "params": { 00:18:34.734 "name": "Nvme$subsystem", 00:18:34.734 "trtype": "$TEST_TRANSPORT", 00:18:34.734 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:34.734 "adrfam": "ipv4", 00:18:34.734 "trsvcid": "$NVMF_PORT", 00:18:34.734 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:34.735 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:34.735 "hdgst": ${hdgst:-false}, 00:18:34.735 "ddgst": ${ddgst:-false} 00:18:34.735 }, 00:18:34.735 "method": "bdev_nvme_attach_controller" 00:18:34.735 } 00:18:34.735 EOF 00:18:34.735 )") 00:18:34.735 23:10:38 -- nvmf/common.sh@542 -- # cat 00:18:34.735 23:10:38 -- target/bdev_io_wait.sh@37 -- # wait 2449919 00:18:34.735 23:10:38 -- nvmf/common.sh@542 -- # cat 00:18:34.735 23:10:38 -- nvmf/common.sh@544 -- # jq . 00:18:34.735 23:10:38 -- nvmf/common.sh@544 -- # jq . 00:18:34.735 23:10:38 -- nvmf/common.sh@544 -- # jq . 00:18:34.735 23:10:38 -- nvmf/common.sh@544 -- # jq . 00:18:34.735 23:10:38 -- nvmf/common.sh@545 -- # IFS=, 00:18:34.735 23:10:38 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:34.735 "params": { 00:18:34.735 "name": "Nvme1", 00:18:34.735 "trtype": "tcp", 00:18:34.735 "traddr": "10.0.0.2", 00:18:34.735 "adrfam": "ipv4", 00:18:34.735 "trsvcid": "4420", 00:18:34.735 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:34.735 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:34.735 "hdgst": false, 00:18:34.735 "ddgst": false 00:18:34.735 }, 00:18:34.735 "method": "bdev_nvme_attach_controller" 00:18:34.735 }' 00:18:34.735 23:10:38 -- nvmf/common.sh@545 -- # IFS=, 00:18:34.735 23:10:38 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:34.735 "params": { 00:18:34.735 "name": "Nvme1", 00:18:34.735 "trtype": "tcp", 00:18:34.735 "traddr": "10.0.0.2", 00:18:34.735 "adrfam": "ipv4", 00:18:34.735 "trsvcid": "4420", 00:18:34.735 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:34.735 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:34.735 "hdgst": false, 00:18:34.735 "ddgst": false 00:18:34.735 }, 00:18:34.735 "method": "bdev_nvme_attach_controller" 00:18:34.735 }' 00:18:34.735 23:10:38 -- nvmf/common.sh@545 -- # IFS=, 00:18:34.735 23:10:38 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:34.735 "params": { 00:18:34.735 "name": "Nvme1", 00:18:34.735 "trtype": "tcp", 00:18:34.735 "traddr": "10.0.0.2", 00:18:34.735 "adrfam": "ipv4", 00:18:34.735 "trsvcid": "4420", 00:18:34.735 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:34.735 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:34.735 "hdgst": false, 00:18:34.735 "ddgst": false 00:18:34.735 }, 00:18:34.735 "method": "bdev_nvme_attach_controller" 00:18:34.735 }' 00:18:34.735 23:10:38 -- nvmf/common.sh@545 -- # IFS=, 00:18:34.735 23:10:38 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:34.735 "params": { 00:18:34.735 "name": "Nvme1", 00:18:34.735 "trtype": "tcp", 00:18:34.735 "traddr": "10.0.0.2", 00:18:34.735 "adrfam": "ipv4", 00:18:34.735 "trsvcid": "4420", 00:18:34.735 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:34.735 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:34.735 "hdgst": false, 00:18:34.735 "ddgst": false 00:18:34.735 }, 00:18:34.735 "method": "bdev_nvme_attach_controller" 00:18:34.735 }' 00:18:34.735 [2024-11-28 23:10:38.283023] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:34.735 [2024-11-28 23:10:38.283094] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:18:34.735 [2024-11-28 23:10:38.283784] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:34.735 [2024-11-28 23:10:38.283784] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:34.735 [2024-11-28 23:10:38.283784] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:34.735 [2024-11-28 23:10:38.283873] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-28 23:10:38.283873] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-28 23:10:38.283874] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:18:34.735 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:18:34.735 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:18:34.735 EAL: No free 2048 kB hugepages reported on node 1 00:18:34.992 EAL: No free 2048 kB hugepages reported on node 1 00:18:34.993 [2024-11-28 23:10:38.463511] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:34.993 EAL: No free 2048 kB hugepages reported on node 1 00:18:34.993 [2024-11-28 23:10:38.535725] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:18:34.993 [2024-11-28 23:10:38.563213] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:35.250 EAL: No free 2048 kB hugepages reported on node 1 00:18:35.250 [2024-11-28 23:10:38.635895] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:18:35.250 [2024-11-28 23:10:38.662141] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:35.250 [2024-11-28 23:10:38.728448] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:35.250 [2024-11-28 23:10:38.730905] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:18:35.250 [2024-11-28 23:10:38.793744] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:18:35.508 Running I/O for 1 seconds... 00:18:35.508 Running I/O for 1 seconds... 00:18:35.508 Running I/O for 1 seconds... 00:18:35.508 Running I/O for 1 seconds... 00:18:36.465 00:18:36.465 Latency(us) 00:18:36.465 [2024-11-28T22:10:40.071Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:36.465 [2024-11-28T22:10:40.071Z] Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:18:36.466 Nvme1n1 : 1.01 11414.80 44.59 0.00 0.00 11167.71 7330.32 19903.53 00:18:36.466 [2024-11-28T22:10:40.072Z] =================================================================================================================== 00:18:36.466 [2024-11-28T22:10:40.072Z] Total : 11414.80 44.59 0.00 0.00 11167.71 7330.32 19903.53 00:18:36.466 00:18:36.466 Latency(us) 00:18:36.466 [2024-11-28T22:10:40.072Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:36.466 [2024-11-28T22:10:40.072Z] Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:18:36.466 Nvme1n1 : 1.01 9894.96 38.65 0.00 0.00 12887.92 6505.05 22427.88 00:18:36.466 [2024-11-28T22:10:40.072Z] =================================================================================================================== 00:18:36.466 [2024-11-28T22:10:40.072Z] Total : 9894.96 38.65 0.00 0.00 12887.92 6505.05 22427.88 00:18:36.466 00:18:36.466 Latency(us) 00:18:36.466 [2024-11-28T22:10:40.072Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:36.466 [2024-11-28T22:10:40.072Z] Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:18:36.466 Nvme1n1 : 1.01 7709.07 30.11 0.00 0.00 16538.13 6844.87 31068.92 00:18:36.466 [2024-11-28T22:10:40.072Z] =================================================================================================================== 00:18:36.466 [2024-11-28T22:10:40.072Z] Total : 7709.07 30.11 0.00 0.00 16538.13 6844.87 31068.92 00:18:36.466 00:18:36.466 Latency(us) 00:18:36.466 [2024-11-28T22:10:40.072Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:36.466 [2024-11-28T22:10:40.072Z] Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:18:36.466 Nvme1n1 : 1.00 193654.41 756.46 0.00 0.00 658.45 307.96 1037.65 00:18:36.466 [2024-11-28T22:10:40.072Z] =================================================================================================================== 00:18:36.466 [2024-11-28T22:10:40.072Z] Total : 193654.41 756.46 0.00 0.00 658.45 307.96 1037.65 00:18:36.725 23:10:40 -- target/bdev_io_wait.sh@38 -- # wait 2449920 00:18:36.725 23:10:40 -- target/bdev_io_wait.sh@39 -- # wait 2449923 00:18:36.725 23:10:40 -- target/bdev_io_wait.sh@40 -- # wait 2449925 00:18:36.725 23:10:40 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:18:36.725 23:10:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:36.725 23:10:40 -- common/autotest_common.sh@10 -- # set +x 00:18:36.982 23:10:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:36.982 23:10:40 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:18:36.982 23:10:40 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:18:36.982 23:10:40 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:36.982 23:10:40 -- nvmf/common.sh@116 -- # sync 00:18:36.983 23:10:40 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:36.983 23:10:40 -- nvmf/common.sh@119 -- # set +e 00:18:36.983 23:10:40 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:36.983 23:10:40 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:36.983 rmmod nvme_tcp 00:18:36.983 rmmod nvme_fabrics 00:18:36.983 rmmod nvme_keyring 00:18:36.983 23:10:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:36.983 23:10:40 -- nvmf/common.sh@123 -- # set -e 00:18:36.983 23:10:40 -- nvmf/common.sh@124 -- # return 0 00:18:36.983 23:10:40 -- nvmf/common.sh@477 -- # '[' -n 2449767 ']' 00:18:36.983 23:10:40 -- nvmf/common.sh@478 -- # killprocess 2449767 00:18:36.983 23:10:40 -- common/autotest_common.sh@936 -- # '[' -z 2449767 ']' 00:18:36.983 23:10:40 -- common/autotest_common.sh@940 -- # kill -0 2449767 00:18:36.983 23:10:40 -- common/autotest_common.sh@941 -- # uname 00:18:36.983 23:10:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:36.983 23:10:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2449767 00:18:36.983 23:10:40 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:36.983 23:10:40 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:36.983 23:10:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2449767' 00:18:36.983 killing process with pid 2449767 00:18:36.983 23:10:40 -- common/autotest_common.sh@955 -- # kill 2449767 00:18:36.983 23:10:40 -- common/autotest_common.sh@960 -- # wait 2449767 00:18:37.242 23:10:40 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:37.242 23:10:40 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:37.242 23:10:40 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:37.242 23:10:40 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:37.242 23:10:40 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:37.242 23:10:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:37.242 23:10:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:37.242 23:10:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:39.146 23:10:42 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:39.146 00:18:39.146 real 0m7.128s 00:18:39.146 user 0m15.971s 00:18:39.146 sys 0m3.590s 00:18:39.146 23:10:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:39.146 23:10:42 -- common/autotest_common.sh@10 -- # set +x 00:18:39.146 ************************************ 00:18:39.146 END TEST nvmf_bdev_io_wait 00:18:39.146 ************************************ 00:18:39.146 23:10:42 -- nvmf/nvmf.sh@50 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:18:39.146 23:10:42 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:39.146 23:10:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:39.146 23:10:42 -- common/autotest_common.sh@10 -- # set +x 00:18:39.146 ************************************ 00:18:39.146 START TEST nvmf_queue_depth 00:18:39.146 ************************************ 00:18:39.146 23:10:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:18:39.405 * Looking for test storage... 00:18:39.405 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:39.405 23:10:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:39.405 23:10:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:39.405 23:10:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:39.405 23:10:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:39.405 23:10:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:39.405 23:10:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:39.405 23:10:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:39.405 23:10:42 -- scripts/common.sh@335 -- # IFS=.-: 00:18:39.405 23:10:42 -- scripts/common.sh@335 -- # read -ra ver1 00:18:39.405 23:10:42 -- scripts/common.sh@336 -- # IFS=.-: 00:18:39.405 23:10:42 -- scripts/common.sh@336 -- # read -ra ver2 00:18:39.405 23:10:42 -- scripts/common.sh@337 -- # local 'op=<' 00:18:39.405 23:10:42 -- scripts/common.sh@339 -- # ver1_l=2 00:18:39.405 23:10:42 -- scripts/common.sh@340 -- # ver2_l=1 00:18:39.405 23:10:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:39.405 23:10:42 -- scripts/common.sh@343 -- # case "$op" in 00:18:39.405 23:10:42 -- scripts/common.sh@344 -- # : 1 00:18:39.405 23:10:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:39.405 23:10:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:39.405 23:10:42 -- scripts/common.sh@364 -- # decimal 1 00:18:39.405 23:10:42 -- scripts/common.sh@352 -- # local d=1 00:18:39.405 23:10:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:39.405 23:10:42 -- scripts/common.sh@354 -- # echo 1 00:18:39.405 23:10:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:39.405 23:10:42 -- scripts/common.sh@365 -- # decimal 2 00:18:39.405 23:10:42 -- scripts/common.sh@352 -- # local d=2 00:18:39.405 23:10:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:39.405 23:10:42 -- scripts/common.sh@354 -- # echo 2 00:18:39.405 23:10:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:39.405 23:10:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:39.405 23:10:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:39.405 23:10:42 -- scripts/common.sh@367 -- # return 0 00:18:39.405 23:10:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:39.405 23:10:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:39.405 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:39.405 --rc genhtml_branch_coverage=1 00:18:39.405 --rc genhtml_function_coverage=1 00:18:39.405 --rc genhtml_legend=1 00:18:39.405 --rc geninfo_all_blocks=1 00:18:39.405 --rc geninfo_unexecuted_blocks=1 00:18:39.405 00:18:39.405 ' 00:18:39.405 23:10:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:39.405 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:39.405 --rc genhtml_branch_coverage=1 00:18:39.405 --rc genhtml_function_coverage=1 00:18:39.405 --rc genhtml_legend=1 00:18:39.405 --rc geninfo_all_blocks=1 00:18:39.405 --rc geninfo_unexecuted_blocks=1 00:18:39.405 00:18:39.405 ' 00:18:39.405 23:10:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:39.405 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:39.405 --rc genhtml_branch_coverage=1 00:18:39.405 --rc genhtml_function_coverage=1 00:18:39.405 --rc genhtml_legend=1 00:18:39.405 --rc geninfo_all_blocks=1 00:18:39.405 --rc geninfo_unexecuted_blocks=1 00:18:39.405 00:18:39.405 ' 00:18:39.405 23:10:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:39.405 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:39.405 --rc genhtml_branch_coverage=1 00:18:39.405 --rc genhtml_function_coverage=1 00:18:39.405 --rc genhtml_legend=1 00:18:39.405 --rc geninfo_all_blocks=1 00:18:39.405 --rc geninfo_unexecuted_blocks=1 00:18:39.405 00:18:39.405 ' 00:18:39.405 23:10:42 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:39.405 23:10:42 -- nvmf/common.sh@7 -- # uname -s 00:18:39.405 23:10:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:39.405 23:10:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:39.405 23:10:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:39.405 23:10:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:39.405 23:10:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:39.405 23:10:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:39.405 23:10:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:39.405 23:10:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:39.405 23:10:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:39.405 23:10:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:39.405 23:10:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:39.405 23:10:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:39.405 23:10:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:39.405 23:10:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:39.405 23:10:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:39.405 23:10:42 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:39.405 23:10:42 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:39.405 23:10:42 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:39.405 23:10:42 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:39.405 23:10:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:39.405 23:10:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:39.405 23:10:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:39.405 23:10:42 -- paths/export.sh@5 -- # export PATH 00:18:39.405 23:10:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:39.405 23:10:42 -- nvmf/common.sh@46 -- # : 0 00:18:39.405 23:10:42 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:39.405 23:10:42 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:39.405 23:10:42 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:39.406 23:10:42 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:39.406 23:10:42 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:39.406 23:10:42 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:39.406 23:10:42 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:39.406 23:10:42 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:39.406 23:10:42 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:18:39.406 23:10:42 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:18:39.406 23:10:42 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:39.406 23:10:42 -- target/queue_depth.sh@19 -- # nvmftestinit 00:18:39.406 23:10:42 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:39.406 23:10:42 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:39.406 23:10:42 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:39.406 23:10:42 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:39.406 23:10:42 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:39.406 23:10:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:39.406 23:10:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:39.406 23:10:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:39.406 23:10:42 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:39.406 23:10:42 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:39.406 23:10:42 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:39.406 23:10:42 -- common/autotest_common.sh@10 -- # set +x 00:18:41.936 23:10:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:41.936 23:10:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:41.936 23:10:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:41.936 23:10:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:41.936 23:10:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:41.936 23:10:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:41.936 23:10:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:41.936 23:10:45 -- nvmf/common.sh@294 -- # net_devs=() 00:18:41.936 23:10:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:41.936 23:10:45 -- nvmf/common.sh@295 -- # e810=() 00:18:41.936 23:10:45 -- nvmf/common.sh@295 -- # local -ga e810 00:18:41.936 23:10:45 -- nvmf/common.sh@296 -- # x722=() 00:18:41.936 23:10:45 -- nvmf/common.sh@296 -- # local -ga x722 00:18:41.936 23:10:45 -- nvmf/common.sh@297 -- # mlx=() 00:18:41.936 23:10:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:41.936 23:10:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:41.936 23:10:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:41.936 23:10:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:41.936 23:10:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:41.936 23:10:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:41.936 23:10:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:41.936 23:10:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:41.936 23:10:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:41.936 23:10:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:41.936 23:10:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:41.936 23:10:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:41.936 23:10:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:41.936 23:10:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:41.936 23:10:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:41.936 23:10:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:41.936 23:10:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:41.936 23:10:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:41.936 23:10:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:41.936 23:10:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:41.936 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:41.936 23:10:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:41.936 23:10:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:41.936 23:10:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:41.936 23:10:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:41.936 23:10:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:41.936 23:10:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:41.936 23:10:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:41.936 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:41.936 23:10:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:41.936 23:10:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:41.936 23:10:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:41.936 23:10:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:41.936 23:10:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:41.936 23:10:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:41.936 23:10:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:41.936 23:10:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:41.936 23:10:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:41.936 23:10:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:41.936 23:10:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:41.936 23:10:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:41.936 23:10:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:41.936 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:41.936 23:10:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:41.936 23:10:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:41.936 23:10:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:41.936 23:10:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:41.937 23:10:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:41.937 23:10:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:41.937 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:41.937 23:10:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:41.937 23:10:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:41.937 23:10:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:41.937 23:10:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:41.937 23:10:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:41.937 23:10:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:41.937 23:10:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:41.937 23:10:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:41.937 23:10:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:41.937 23:10:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:41.937 23:10:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:41.937 23:10:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:41.937 23:10:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:41.937 23:10:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:41.937 23:10:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:41.937 23:10:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:41.937 23:10:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:41.937 23:10:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:41.937 23:10:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:41.937 23:10:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:41.937 23:10:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:41.937 23:10:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:41.937 23:10:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:41.937 23:10:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:41.937 23:10:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:41.937 23:10:45 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:41.937 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:41.937 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.257 ms 00:18:41.937 00:18:41.937 --- 10.0.0.2 ping statistics --- 00:18:41.937 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:41.937 rtt min/avg/max/mdev = 0.257/0.257/0.257/0.000 ms 00:18:41.937 23:10:45 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:41.937 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:41.937 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.135 ms 00:18:41.937 00:18:41.937 --- 10.0.0.1 ping statistics --- 00:18:41.937 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:41.937 rtt min/avg/max/mdev = 0.135/0.135/0.135/0.000 ms 00:18:41.937 23:10:45 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:41.937 23:10:45 -- nvmf/common.sh@410 -- # return 0 00:18:41.937 23:10:45 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:41.937 23:10:45 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:41.937 23:10:45 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:41.937 23:10:45 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:41.937 23:10:45 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:41.937 23:10:45 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:41.937 23:10:45 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:41.937 23:10:45 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:18:41.937 23:10:45 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:41.937 23:10:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:41.937 23:10:45 -- common/autotest_common.sh@10 -- # set +x 00:18:41.937 23:10:45 -- nvmf/common.sh@469 -- # nvmfpid=2452163 00:18:41.937 23:10:45 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:41.937 23:10:45 -- nvmf/common.sh@470 -- # waitforlisten 2452163 00:18:41.937 23:10:45 -- common/autotest_common.sh@829 -- # '[' -z 2452163 ']' 00:18:41.937 23:10:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:41.937 23:10:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:41.937 23:10:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:41.937 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:41.937 23:10:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:41.937 23:10:45 -- common/autotest_common.sh@10 -- # set +x 00:18:41.937 [2024-11-28 23:10:45.232088] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:41.937 [2024-11-28 23:10:45.232198] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:41.937 EAL: No free 2048 kB hugepages reported on node 1 00:18:41.937 [2024-11-28 23:10:45.298428] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:41.937 [2024-11-28 23:10:45.384983] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:41.937 [2024-11-28 23:10:45.385148] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:41.937 [2024-11-28 23:10:45.385181] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:41.937 [2024-11-28 23:10:45.385195] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:41.937 [2024-11-28 23:10:45.385235] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:42.872 23:10:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:42.872 23:10:46 -- common/autotest_common.sh@862 -- # return 0 00:18:42.872 23:10:46 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:42.872 23:10:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:42.872 23:10:46 -- common/autotest_common.sh@10 -- # set +x 00:18:42.872 23:10:46 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:42.872 23:10:46 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:42.872 23:10:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.872 23:10:46 -- common/autotest_common.sh@10 -- # set +x 00:18:42.872 [2024-11-28 23:10:46.239565] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:42.872 23:10:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.872 23:10:46 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:42.872 23:10:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.872 23:10:46 -- common/autotest_common.sh@10 -- # set +x 00:18:42.872 Malloc0 00:18:42.872 23:10:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.872 23:10:46 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:42.872 23:10:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.872 23:10:46 -- common/autotest_common.sh@10 -- # set +x 00:18:42.872 23:10:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.872 23:10:46 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:42.872 23:10:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.872 23:10:46 -- common/autotest_common.sh@10 -- # set +x 00:18:42.872 23:10:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.872 23:10:46 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:42.872 23:10:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.872 23:10:46 -- common/autotest_common.sh@10 -- # set +x 00:18:42.872 [2024-11-28 23:10:46.298294] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:42.872 23:10:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.872 23:10:46 -- target/queue_depth.sh@30 -- # bdevperf_pid=2452327 00:18:42.872 23:10:46 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:18:42.872 23:10:46 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:42.872 23:10:46 -- target/queue_depth.sh@33 -- # waitforlisten 2452327 /var/tmp/bdevperf.sock 00:18:42.872 23:10:46 -- common/autotest_common.sh@829 -- # '[' -z 2452327 ']' 00:18:42.872 23:10:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:42.872 23:10:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:42.872 23:10:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:42.872 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:42.872 23:10:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:42.872 23:10:46 -- common/autotest_common.sh@10 -- # set +x 00:18:42.872 [2024-11-28 23:10:46.344494] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:42.872 [2024-11-28 23:10:46.344554] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2452327 ] 00:18:42.872 EAL: No free 2048 kB hugepages reported on node 1 00:18:42.872 [2024-11-28 23:10:46.413183] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:43.131 [2024-11-28 23:10:46.502062] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:44.065 23:10:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:44.065 23:10:47 -- common/autotest_common.sh@862 -- # return 0 00:18:44.065 23:10:47 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:18:44.065 23:10:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:44.065 23:10:47 -- common/autotest_common.sh@10 -- # set +x 00:18:44.065 NVMe0n1 00:18:44.065 23:10:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:44.065 23:10:47 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:44.065 Running I/O for 10 seconds... 00:18:54.092 00:18:54.092 Latency(us) 00:18:54.092 [2024-11-28T22:10:57.698Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:54.092 [2024-11-28T22:10:57.698Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:18:54.092 Verification LBA range: start 0x0 length 0x4000 00:18:54.092 NVMe0n1 : 10.07 12373.07 48.33 0.00 0.00 82433.24 13495.56 60196.03 00:18:54.092 [2024-11-28T22:10:57.698Z] =================================================================================================================== 00:18:54.092 [2024-11-28T22:10:57.698Z] Total : 12373.07 48.33 0.00 0.00 82433.24 13495.56 60196.03 00:18:54.092 0 00:18:54.092 23:10:57 -- target/queue_depth.sh@39 -- # killprocess 2452327 00:18:54.092 23:10:57 -- common/autotest_common.sh@936 -- # '[' -z 2452327 ']' 00:18:54.092 23:10:57 -- common/autotest_common.sh@940 -- # kill -0 2452327 00:18:54.092 23:10:57 -- common/autotest_common.sh@941 -- # uname 00:18:54.092 23:10:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:54.092 23:10:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2452327 00:18:54.092 23:10:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:54.092 23:10:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:54.349 23:10:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2452327' 00:18:54.349 killing process with pid 2452327 00:18:54.349 23:10:57 -- common/autotest_common.sh@955 -- # kill 2452327 00:18:54.349 Received shutdown signal, test time was about 10.000000 seconds 00:18:54.349 00:18:54.349 Latency(us) 00:18:54.349 [2024-11-28T22:10:57.955Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:54.349 [2024-11-28T22:10:57.955Z] =================================================================================================================== 00:18:54.349 [2024-11-28T22:10:57.955Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:54.349 23:10:57 -- common/autotest_common.sh@960 -- # wait 2452327 00:18:54.349 23:10:57 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:18:54.349 23:10:57 -- target/queue_depth.sh@43 -- # nvmftestfini 00:18:54.349 23:10:57 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:54.349 23:10:57 -- nvmf/common.sh@116 -- # sync 00:18:54.349 23:10:57 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:54.349 23:10:57 -- nvmf/common.sh@119 -- # set +e 00:18:54.349 23:10:57 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:54.349 23:10:57 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:54.349 rmmod nvme_tcp 00:18:54.349 rmmod nvme_fabrics 00:18:54.606 rmmod nvme_keyring 00:18:54.606 23:10:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:54.606 23:10:57 -- nvmf/common.sh@123 -- # set -e 00:18:54.606 23:10:57 -- nvmf/common.sh@124 -- # return 0 00:18:54.606 23:10:57 -- nvmf/common.sh@477 -- # '[' -n 2452163 ']' 00:18:54.606 23:10:57 -- nvmf/common.sh@478 -- # killprocess 2452163 00:18:54.606 23:10:57 -- common/autotest_common.sh@936 -- # '[' -z 2452163 ']' 00:18:54.606 23:10:57 -- common/autotest_common.sh@940 -- # kill -0 2452163 00:18:54.606 23:10:57 -- common/autotest_common.sh@941 -- # uname 00:18:54.606 23:10:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:54.606 23:10:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2452163 00:18:54.606 23:10:58 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:54.606 23:10:58 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:54.606 23:10:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2452163' 00:18:54.606 killing process with pid 2452163 00:18:54.606 23:10:58 -- common/autotest_common.sh@955 -- # kill 2452163 00:18:54.606 23:10:58 -- common/autotest_common.sh@960 -- # wait 2452163 00:18:54.864 23:10:58 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:54.864 23:10:58 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:54.864 23:10:58 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:54.864 23:10:58 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:54.864 23:10:58 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:54.864 23:10:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:54.864 23:10:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:54.864 23:10:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:56.765 23:11:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:56.765 00:18:56.766 real 0m17.621s 00:18:56.766 user 0m25.134s 00:18:56.766 sys 0m3.227s 00:18:56.766 23:11:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:56.766 23:11:00 -- common/autotest_common.sh@10 -- # set +x 00:18:56.766 ************************************ 00:18:56.766 END TEST nvmf_queue_depth 00:18:56.766 ************************************ 00:18:57.025 23:11:00 -- nvmf/nvmf.sh@51 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:18:57.025 23:11:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:57.025 23:11:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:57.025 23:11:00 -- common/autotest_common.sh@10 -- # set +x 00:18:57.025 ************************************ 00:18:57.025 START TEST nvmf_multipath 00:18:57.025 ************************************ 00:18:57.025 23:11:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:18:57.025 * Looking for test storage... 00:18:57.025 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:57.025 23:11:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:57.025 23:11:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:57.025 23:11:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:57.025 23:11:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:57.025 23:11:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:57.025 23:11:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:57.025 23:11:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:57.025 23:11:00 -- scripts/common.sh@335 -- # IFS=.-: 00:18:57.025 23:11:00 -- scripts/common.sh@335 -- # read -ra ver1 00:18:57.025 23:11:00 -- scripts/common.sh@336 -- # IFS=.-: 00:18:57.025 23:11:00 -- scripts/common.sh@336 -- # read -ra ver2 00:18:57.025 23:11:00 -- scripts/common.sh@337 -- # local 'op=<' 00:18:57.025 23:11:00 -- scripts/common.sh@339 -- # ver1_l=2 00:18:57.025 23:11:00 -- scripts/common.sh@340 -- # ver2_l=1 00:18:57.025 23:11:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:57.025 23:11:00 -- scripts/common.sh@343 -- # case "$op" in 00:18:57.025 23:11:00 -- scripts/common.sh@344 -- # : 1 00:18:57.025 23:11:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:57.025 23:11:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:57.025 23:11:00 -- scripts/common.sh@364 -- # decimal 1 00:18:57.025 23:11:00 -- scripts/common.sh@352 -- # local d=1 00:18:57.025 23:11:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:57.025 23:11:00 -- scripts/common.sh@354 -- # echo 1 00:18:57.025 23:11:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:57.025 23:11:00 -- scripts/common.sh@365 -- # decimal 2 00:18:57.025 23:11:00 -- scripts/common.sh@352 -- # local d=2 00:18:57.025 23:11:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:57.025 23:11:00 -- scripts/common.sh@354 -- # echo 2 00:18:57.025 23:11:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:57.025 23:11:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:57.025 23:11:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:57.025 23:11:00 -- scripts/common.sh@367 -- # return 0 00:18:57.025 23:11:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:57.025 23:11:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:57.025 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:57.025 --rc genhtml_branch_coverage=1 00:18:57.025 --rc genhtml_function_coverage=1 00:18:57.025 --rc genhtml_legend=1 00:18:57.025 --rc geninfo_all_blocks=1 00:18:57.025 --rc geninfo_unexecuted_blocks=1 00:18:57.025 00:18:57.025 ' 00:18:57.025 23:11:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:57.025 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:57.025 --rc genhtml_branch_coverage=1 00:18:57.025 --rc genhtml_function_coverage=1 00:18:57.025 --rc genhtml_legend=1 00:18:57.025 --rc geninfo_all_blocks=1 00:18:57.025 --rc geninfo_unexecuted_blocks=1 00:18:57.025 00:18:57.025 ' 00:18:57.025 23:11:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:57.025 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:57.025 --rc genhtml_branch_coverage=1 00:18:57.025 --rc genhtml_function_coverage=1 00:18:57.025 --rc genhtml_legend=1 00:18:57.025 --rc geninfo_all_blocks=1 00:18:57.025 --rc geninfo_unexecuted_blocks=1 00:18:57.025 00:18:57.025 ' 00:18:57.025 23:11:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:57.025 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:57.025 --rc genhtml_branch_coverage=1 00:18:57.025 --rc genhtml_function_coverage=1 00:18:57.025 --rc genhtml_legend=1 00:18:57.025 --rc geninfo_all_blocks=1 00:18:57.025 --rc geninfo_unexecuted_blocks=1 00:18:57.025 00:18:57.025 ' 00:18:57.025 23:11:00 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:57.025 23:11:00 -- nvmf/common.sh@7 -- # uname -s 00:18:57.025 23:11:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:57.025 23:11:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:57.025 23:11:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:57.025 23:11:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:57.025 23:11:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:57.025 23:11:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:57.025 23:11:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:57.025 23:11:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:57.025 23:11:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:57.025 23:11:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:57.025 23:11:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:57.025 23:11:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:57.025 23:11:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:57.025 23:11:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:57.025 23:11:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:57.025 23:11:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:57.025 23:11:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:57.025 23:11:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:57.025 23:11:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:57.026 23:11:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:57.026 23:11:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:57.026 23:11:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:57.026 23:11:00 -- paths/export.sh@5 -- # export PATH 00:18:57.026 23:11:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:57.026 23:11:00 -- nvmf/common.sh@46 -- # : 0 00:18:57.026 23:11:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:57.026 23:11:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:57.026 23:11:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:57.026 23:11:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:57.026 23:11:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:57.026 23:11:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:57.026 23:11:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:57.026 23:11:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:57.026 23:11:00 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:57.026 23:11:00 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:57.026 23:11:00 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:18:57.026 23:11:00 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:57.026 23:11:00 -- target/multipath.sh@43 -- # nvmftestinit 00:18:57.026 23:11:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:57.026 23:11:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:57.026 23:11:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:57.026 23:11:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:57.026 23:11:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:57.026 23:11:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:57.026 23:11:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:57.026 23:11:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:57.026 23:11:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:57.026 23:11:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:57.026 23:11:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:57.026 23:11:00 -- common/autotest_common.sh@10 -- # set +x 00:18:59.557 23:11:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:59.558 23:11:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:59.558 23:11:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:59.558 23:11:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:59.558 23:11:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:59.558 23:11:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:59.558 23:11:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:59.558 23:11:02 -- nvmf/common.sh@294 -- # net_devs=() 00:18:59.558 23:11:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:59.558 23:11:02 -- nvmf/common.sh@295 -- # e810=() 00:18:59.558 23:11:02 -- nvmf/common.sh@295 -- # local -ga e810 00:18:59.558 23:11:02 -- nvmf/common.sh@296 -- # x722=() 00:18:59.558 23:11:02 -- nvmf/common.sh@296 -- # local -ga x722 00:18:59.558 23:11:02 -- nvmf/common.sh@297 -- # mlx=() 00:18:59.558 23:11:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:59.558 23:11:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:59.558 23:11:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:59.558 23:11:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:59.558 23:11:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:59.558 23:11:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:59.558 23:11:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:59.558 23:11:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:59.558 23:11:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:59.558 23:11:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:59.558 23:11:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:59.558 23:11:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:59.558 23:11:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:59.558 23:11:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:59.558 23:11:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:59.558 23:11:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:59.558 23:11:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:59.558 23:11:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:59.558 23:11:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:59.558 23:11:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:59.558 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:59.558 23:11:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:59.558 23:11:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:59.558 23:11:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:59.558 23:11:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:59.558 23:11:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:59.558 23:11:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:59.558 23:11:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:59.558 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:59.558 23:11:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:59.558 23:11:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:59.558 23:11:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:59.558 23:11:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:59.558 23:11:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:59.558 23:11:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:59.558 23:11:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:59.558 23:11:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:59.558 23:11:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:59.558 23:11:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:59.558 23:11:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:59.558 23:11:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:59.558 23:11:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:59.558 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:59.558 23:11:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:59.558 23:11:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:59.558 23:11:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:59.558 23:11:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:59.558 23:11:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:59.558 23:11:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:59.558 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:59.558 23:11:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:59.558 23:11:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:59.558 23:11:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:59.558 23:11:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:59.558 23:11:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:59.558 23:11:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:59.558 23:11:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:59.558 23:11:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:59.558 23:11:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:59.558 23:11:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:59.558 23:11:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:59.558 23:11:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:59.558 23:11:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:59.558 23:11:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:59.558 23:11:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:59.558 23:11:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:59.558 23:11:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:59.558 23:11:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:59.558 23:11:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:59.558 23:11:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:59.558 23:11:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:59.558 23:11:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:59.558 23:11:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:59.558 23:11:02 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:59.558 23:11:02 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:59.558 23:11:02 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:59.558 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:59.558 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.186 ms 00:18:59.558 00:18:59.558 --- 10.0.0.2 ping statistics --- 00:18:59.558 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:59.558 rtt min/avg/max/mdev = 0.186/0.186/0.186/0.000 ms 00:18:59.558 23:11:02 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:59.558 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:59.558 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.105 ms 00:18:59.558 00:18:59.558 --- 10.0.0.1 ping statistics --- 00:18:59.558 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:59.558 rtt min/avg/max/mdev = 0.105/0.105/0.105/0.000 ms 00:18:59.558 23:11:02 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:59.558 23:11:02 -- nvmf/common.sh@410 -- # return 0 00:18:59.558 23:11:02 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:59.558 23:11:02 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:59.558 23:11:02 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:59.558 23:11:02 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:59.558 23:11:02 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:59.558 23:11:02 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:59.558 23:11:02 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:59.558 23:11:02 -- target/multipath.sh@45 -- # '[' -z ']' 00:18:59.558 23:11:02 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:18:59.558 only one NIC for nvmf test 00:18:59.558 23:11:02 -- target/multipath.sh@47 -- # nvmftestfini 00:18:59.558 23:11:02 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:59.558 23:11:02 -- nvmf/common.sh@116 -- # sync 00:18:59.558 23:11:02 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:59.558 23:11:02 -- nvmf/common.sh@119 -- # set +e 00:18:59.558 23:11:02 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:59.558 23:11:02 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:59.558 rmmod nvme_tcp 00:18:59.558 rmmod nvme_fabrics 00:18:59.558 rmmod nvme_keyring 00:18:59.558 23:11:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:59.558 23:11:02 -- nvmf/common.sh@123 -- # set -e 00:18:59.558 23:11:02 -- nvmf/common.sh@124 -- # return 0 00:18:59.558 23:11:02 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:18:59.558 23:11:02 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:59.558 23:11:02 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:59.558 23:11:02 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:59.558 23:11:02 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:59.558 23:11:02 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:59.558 23:11:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:59.558 23:11:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:59.558 23:11:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:01.461 23:11:04 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:01.461 23:11:04 -- target/multipath.sh@48 -- # exit 0 00:19:01.461 23:11:04 -- target/multipath.sh@1 -- # nvmftestfini 00:19:01.461 23:11:04 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:01.461 23:11:04 -- nvmf/common.sh@116 -- # sync 00:19:01.461 23:11:04 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:01.461 23:11:04 -- nvmf/common.sh@119 -- # set +e 00:19:01.461 23:11:04 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:01.461 23:11:04 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:01.461 23:11:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:01.461 23:11:04 -- nvmf/common.sh@123 -- # set -e 00:19:01.461 23:11:04 -- nvmf/common.sh@124 -- # return 0 00:19:01.461 23:11:04 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:19:01.461 23:11:04 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:01.461 23:11:04 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:01.461 23:11:04 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:01.461 23:11:04 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:01.461 23:11:04 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:01.461 23:11:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:01.461 23:11:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:01.461 23:11:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:01.461 23:11:04 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:01.461 00:19:01.461 real 0m4.411s 00:19:01.461 user 0m0.863s 00:19:01.461 sys 0m1.544s 00:19:01.461 23:11:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:01.461 23:11:04 -- common/autotest_common.sh@10 -- # set +x 00:19:01.461 ************************************ 00:19:01.461 END TEST nvmf_multipath 00:19:01.461 ************************************ 00:19:01.461 23:11:04 -- nvmf/nvmf.sh@52 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:19:01.461 23:11:04 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:01.461 23:11:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:01.461 23:11:04 -- common/autotest_common.sh@10 -- # set +x 00:19:01.461 ************************************ 00:19:01.461 START TEST nvmf_zcopy 00:19:01.461 ************************************ 00:19:01.461 23:11:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:19:01.461 * Looking for test storage... 00:19:01.461 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:01.461 23:11:04 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:01.461 23:11:04 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:01.461 23:11:04 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:01.461 23:11:04 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:01.461 23:11:04 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:01.461 23:11:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:01.461 23:11:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:01.461 23:11:04 -- scripts/common.sh@335 -- # IFS=.-: 00:19:01.461 23:11:04 -- scripts/common.sh@335 -- # read -ra ver1 00:19:01.461 23:11:04 -- scripts/common.sh@336 -- # IFS=.-: 00:19:01.461 23:11:04 -- scripts/common.sh@336 -- # read -ra ver2 00:19:01.461 23:11:04 -- scripts/common.sh@337 -- # local 'op=<' 00:19:01.461 23:11:04 -- scripts/common.sh@339 -- # ver1_l=2 00:19:01.461 23:11:04 -- scripts/common.sh@340 -- # ver2_l=1 00:19:01.461 23:11:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:01.461 23:11:04 -- scripts/common.sh@343 -- # case "$op" in 00:19:01.461 23:11:04 -- scripts/common.sh@344 -- # : 1 00:19:01.461 23:11:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:01.461 23:11:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:01.461 23:11:04 -- scripts/common.sh@364 -- # decimal 1 00:19:01.461 23:11:04 -- scripts/common.sh@352 -- # local d=1 00:19:01.461 23:11:04 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:01.461 23:11:04 -- scripts/common.sh@354 -- # echo 1 00:19:01.461 23:11:04 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:01.461 23:11:04 -- scripts/common.sh@365 -- # decimal 2 00:19:01.461 23:11:04 -- scripts/common.sh@352 -- # local d=2 00:19:01.461 23:11:04 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:01.461 23:11:04 -- scripts/common.sh@354 -- # echo 2 00:19:01.461 23:11:04 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:01.461 23:11:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:01.461 23:11:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:01.461 23:11:04 -- scripts/common.sh@367 -- # return 0 00:19:01.461 23:11:04 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:01.461 23:11:04 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:01.461 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:01.461 --rc genhtml_branch_coverage=1 00:19:01.461 --rc genhtml_function_coverage=1 00:19:01.461 --rc genhtml_legend=1 00:19:01.461 --rc geninfo_all_blocks=1 00:19:01.461 --rc geninfo_unexecuted_blocks=1 00:19:01.461 00:19:01.461 ' 00:19:01.461 23:11:04 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:01.461 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:01.461 --rc genhtml_branch_coverage=1 00:19:01.461 --rc genhtml_function_coverage=1 00:19:01.461 --rc genhtml_legend=1 00:19:01.461 --rc geninfo_all_blocks=1 00:19:01.461 --rc geninfo_unexecuted_blocks=1 00:19:01.461 00:19:01.461 ' 00:19:01.461 23:11:04 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:01.461 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:01.461 --rc genhtml_branch_coverage=1 00:19:01.461 --rc genhtml_function_coverage=1 00:19:01.461 --rc genhtml_legend=1 00:19:01.461 --rc geninfo_all_blocks=1 00:19:01.461 --rc geninfo_unexecuted_blocks=1 00:19:01.461 00:19:01.461 ' 00:19:01.461 23:11:04 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:01.461 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:01.461 --rc genhtml_branch_coverage=1 00:19:01.461 --rc genhtml_function_coverage=1 00:19:01.461 --rc genhtml_legend=1 00:19:01.461 --rc geninfo_all_blocks=1 00:19:01.461 --rc geninfo_unexecuted_blocks=1 00:19:01.461 00:19:01.461 ' 00:19:01.461 23:11:04 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:01.461 23:11:04 -- nvmf/common.sh@7 -- # uname -s 00:19:01.461 23:11:04 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:01.461 23:11:04 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:01.461 23:11:04 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:01.461 23:11:04 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:01.461 23:11:04 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:01.461 23:11:04 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:01.461 23:11:04 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:01.461 23:11:04 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:01.461 23:11:04 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:01.461 23:11:04 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:01.461 23:11:04 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:01.461 23:11:04 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:01.461 23:11:04 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:01.461 23:11:04 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:01.461 23:11:04 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:01.462 23:11:04 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:01.462 23:11:04 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:01.462 23:11:04 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:01.462 23:11:04 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:01.462 23:11:04 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:01.462 23:11:04 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:01.462 23:11:04 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:01.462 23:11:04 -- paths/export.sh@5 -- # export PATH 00:19:01.462 23:11:04 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:01.462 23:11:04 -- nvmf/common.sh@46 -- # : 0 00:19:01.462 23:11:04 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:01.462 23:11:04 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:01.462 23:11:04 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:01.462 23:11:04 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:01.462 23:11:04 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:01.462 23:11:04 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:01.462 23:11:04 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:01.462 23:11:04 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:01.462 23:11:04 -- target/zcopy.sh@12 -- # nvmftestinit 00:19:01.462 23:11:04 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:01.462 23:11:04 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:01.462 23:11:04 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:01.462 23:11:04 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:01.462 23:11:04 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:01.462 23:11:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:01.462 23:11:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:01.462 23:11:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:01.462 23:11:04 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:01.462 23:11:04 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:01.462 23:11:04 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:01.462 23:11:04 -- common/autotest_common.sh@10 -- # set +x 00:19:04.006 23:11:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:04.006 23:11:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:04.006 23:11:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:04.006 23:11:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:04.006 23:11:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:04.006 23:11:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:04.006 23:11:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:04.006 23:11:06 -- nvmf/common.sh@294 -- # net_devs=() 00:19:04.006 23:11:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:04.006 23:11:06 -- nvmf/common.sh@295 -- # e810=() 00:19:04.006 23:11:06 -- nvmf/common.sh@295 -- # local -ga e810 00:19:04.006 23:11:06 -- nvmf/common.sh@296 -- # x722=() 00:19:04.006 23:11:06 -- nvmf/common.sh@296 -- # local -ga x722 00:19:04.006 23:11:06 -- nvmf/common.sh@297 -- # mlx=() 00:19:04.006 23:11:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:04.006 23:11:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:04.006 23:11:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:04.006 23:11:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:04.006 23:11:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:04.006 23:11:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:04.006 23:11:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:04.006 23:11:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:04.006 23:11:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:04.006 23:11:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:04.006 23:11:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:04.006 23:11:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:04.006 23:11:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:04.006 23:11:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:04.006 23:11:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:04.006 23:11:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:04.006 23:11:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:04.006 23:11:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:04.006 23:11:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:04.006 23:11:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:04.006 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:04.006 23:11:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:04.006 23:11:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:04.006 23:11:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:04.006 23:11:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:04.006 23:11:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:04.006 23:11:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:04.006 23:11:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:04.006 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:04.006 23:11:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:04.006 23:11:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:04.006 23:11:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:04.006 23:11:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:04.006 23:11:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:04.006 23:11:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:04.006 23:11:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:04.006 23:11:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:04.006 23:11:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:04.006 23:11:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:04.006 23:11:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:04.006 23:11:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:04.006 23:11:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:04.006 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:04.006 23:11:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:04.006 23:11:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:04.006 23:11:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:04.006 23:11:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:04.006 23:11:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:04.006 23:11:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:04.006 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:04.006 23:11:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:04.006 23:11:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:04.006 23:11:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:04.006 23:11:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:04.006 23:11:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:04.006 23:11:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:04.006 23:11:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:04.006 23:11:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:04.006 23:11:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:04.006 23:11:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:04.006 23:11:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:04.006 23:11:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:04.006 23:11:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:04.006 23:11:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:04.006 23:11:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:04.006 23:11:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:04.006 23:11:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:04.006 23:11:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:04.006 23:11:07 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:04.006 23:11:07 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:04.006 23:11:07 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:04.006 23:11:07 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:04.007 23:11:07 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:04.007 23:11:07 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:04.007 23:11:07 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:04.007 23:11:07 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:04.007 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:04.007 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.231 ms 00:19:04.007 00:19:04.007 --- 10.0.0.2 ping statistics --- 00:19:04.007 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:04.007 rtt min/avg/max/mdev = 0.231/0.231/0.231/0.000 ms 00:19:04.007 23:11:07 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:04.007 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:04.007 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.081 ms 00:19:04.007 00:19:04.007 --- 10.0.0.1 ping statistics --- 00:19:04.007 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:04.007 rtt min/avg/max/mdev = 0.081/0.081/0.081/0.000 ms 00:19:04.007 23:11:07 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:04.007 23:11:07 -- nvmf/common.sh@410 -- # return 0 00:19:04.007 23:11:07 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:04.007 23:11:07 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:04.007 23:11:07 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:04.007 23:11:07 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:04.007 23:11:07 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:04.007 23:11:07 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:04.007 23:11:07 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:04.007 23:11:07 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:19:04.007 23:11:07 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:04.007 23:11:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:04.007 23:11:07 -- common/autotest_common.sh@10 -- # set +x 00:19:04.007 23:11:07 -- nvmf/common.sh@469 -- # nvmfpid=2457580 00:19:04.007 23:11:07 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:19:04.007 23:11:07 -- nvmf/common.sh@470 -- # waitforlisten 2457580 00:19:04.007 23:11:07 -- common/autotest_common.sh@829 -- # '[' -z 2457580 ']' 00:19:04.007 23:11:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:04.007 23:11:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:04.007 23:11:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:04.007 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:04.007 23:11:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:04.007 23:11:07 -- common/autotest_common.sh@10 -- # set +x 00:19:04.007 [2024-11-28 23:11:07.185247] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:04.007 [2024-11-28 23:11:07.185330] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:04.007 EAL: No free 2048 kB hugepages reported on node 1 00:19:04.007 [2024-11-28 23:11:07.256272] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:04.007 [2024-11-28 23:11:07.348326] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:04.007 [2024-11-28 23:11:07.348498] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:04.007 [2024-11-28 23:11:07.348521] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:04.007 [2024-11-28 23:11:07.348536] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:04.007 [2024-11-28 23:11:07.348582] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:04.942 23:11:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:04.942 23:11:08 -- common/autotest_common.sh@862 -- # return 0 00:19:04.942 23:11:08 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:04.942 23:11:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:04.942 23:11:08 -- common/autotest_common.sh@10 -- # set +x 00:19:04.942 23:11:08 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:04.942 23:11:08 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:19:04.942 23:11:08 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:19:04.942 23:11:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:04.942 23:11:08 -- common/autotest_common.sh@10 -- # set +x 00:19:04.942 [2024-11-28 23:11:08.206749] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:04.942 23:11:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:04.942 23:11:08 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:19:04.942 23:11:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:04.942 23:11:08 -- common/autotest_common.sh@10 -- # set +x 00:19:04.942 23:11:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:04.942 23:11:08 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:04.942 23:11:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:04.942 23:11:08 -- common/autotest_common.sh@10 -- # set +x 00:19:04.942 [2024-11-28 23:11:08.222893] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:04.942 23:11:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:04.942 23:11:08 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:19:04.942 23:11:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:04.942 23:11:08 -- common/autotest_common.sh@10 -- # set +x 00:19:04.942 23:11:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:04.942 23:11:08 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:19:04.942 23:11:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:04.942 23:11:08 -- common/autotest_common.sh@10 -- # set +x 00:19:04.942 malloc0 00:19:04.942 23:11:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:04.942 23:11:08 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:19:04.942 23:11:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:04.942 23:11:08 -- common/autotest_common.sh@10 -- # set +x 00:19:04.942 23:11:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:04.943 23:11:08 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:19:04.943 23:11:08 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:19:04.943 23:11:08 -- nvmf/common.sh@520 -- # config=() 00:19:04.943 23:11:08 -- nvmf/common.sh@520 -- # local subsystem config 00:19:04.943 23:11:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:19:04.943 23:11:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:19:04.943 { 00:19:04.943 "params": { 00:19:04.943 "name": "Nvme$subsystem", 00:19:04.943 "trtype": "$TEST_TRANSPORT", 00:19:04.943 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:04.943 "adrfam": "ipv4", 00:19:04.943 "trsvcid": "$NVMF_PORT", 00:19:04.943 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:04.943 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:04.943 "hdgst": ${hdgst:-false}, 00:19:04.943 "ddgst": ${ddgst:-false} 00:19:04.943 }, 00:19:04.943 "method": "bdev_nvme_attach_controller" 00:19:04.943 } 00:19:04.943 EOF 00:19:04.943 )") 00:19:04.943 23:11:08 -- nvmf/common.sh@542 -- # cat 00:19:04.943 23:11:08 -- nvmf/common.sh@544 -- # jq . 00:19:04.943 23:11:08 -- nvmf/common.sh@545 -- # IFS=, 00:19:04.943 23:11:08 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:19:04.943 "params": { 00:19:04.943 "name": "Nvme1", 00:19:04.943 "trtype": "tcp", 00:19:04.943 "traddr": "10.0.0.2", 00:19:04.943 "adrfam": "ipv4", 00:19:04.943 "trsvcid": "4420", 00:19:04.943 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:04.943 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:04.943 "hdgst": false, 00:19:04.943 "ddgst": false 00:19:04.943 }, 00:19:04.943 "method": "bdev_nvme_attach_controller" 00:19:04.943 }' 00:19:04.943 [2024-11-28 23:11:08.293699] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:04.943 [2024-11-28 23:11:08.293771] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2457737 ] 00:19:04.943 EAL: No free 2048 kB hugepages reported on node 1 00:19:04.943 [2024-11-28 23:11:08.357126] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:04.943 [2024-11-28 23:11:08.451961] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:05.201 Running I/O for 10 seconds... 00:19:15.184 00:19:15.184 Latency(us) 00:19:15.184 [2024-11-28T22:11:18.790Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:15.184 [2024-11-28T22:11:18.790Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:19:15.184 Verification LBA range: start 0x0 length 0x1000 00:19:15.184 Nvme1n1 : 10.01 8645.54 67.54 0.00 0.00 14770.06 1298.58 22816.24 00:19:15.185 [2024-11-28T22:11:18.791Z] =================================================================================================================== 00:19:15.185 [2024-11-28T22:11:18.791Z] Total : 8645.54 67.54 0.00 0.00 14770.06 1298.58 22816.24 00:19:15.443 23:11:18 -- target/zcopy.sh@39 -- # perfpid=2459087 00:19:15.443 23:11:18 -- target/zcopy.sh@41 -- # xtrace_disable 00:19:15.443 23:11:18 -- common/autotest_common.sh@10 -- # set +x 00:19:15.443 23:11:18 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:19:15.443 23:11:18 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:19:15.443 23:11:18 -- nvmf/common.sh@520 -- # config=() 00:19:15.443 23:11:18 -- nvmf/common.sh@520 -- # local subsystem config 00:19:15.443 23:11:18 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:19:15.443 23:11:18 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:19:15.443 { 00:19:15.443 "params": { 00:19:15.443 "name": "Nvme$subsystem", 00:19:15.443 "trtype": "$TEST_TRANSPORT", 00:19:15.443 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:15.443 "adrfam": "ipv4", 00:19:15.443 "trsvcid": "$NVMF_PORT", 00:19:15.443 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:15.443 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:15.443 "hdgst": ${hdgst:-false}, 00:19:15.443 "ddgst": ${ddgst:-false} 00:19:15.443 }, 00:19:15.443 "method": "bdev_nvme_attach_controller" 00:19:15.443 } 00:19:15.443 EOF 00:19:15.443 )") 00:19:15.443 23:11:18 -- nvmf/common.sh@542 -- # cat 00:19:15.443 [2024-11-28 23:11:18.895424] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.443 [2024-11-28 23:11:18.895474] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.443 23:11:18 -- nvmf/common.sh@544 -- # jq . 00:19:15.443 23:11:18 -- nvmf/common.sh@545 -- # IFS=, 00:19:15.443 23:11:18 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:19:15.443 "params": { 00:19:15.443 "name": "Nvme1", 00:19:15.443 "trtype": "tcp", 00:19:15.443 "traddr": "10.0.0.2", 00:19:15.443 "adrfam": "ipv4", 00:19:15.443 "trsvcid": "4420", 00:19:15.443 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:15.443 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:15.443 "hdgst": false, 00:19:15.443 "ddgst": false 00:19:15.443 }, 00:19:15.443 "method": "bdev_nvme_attach_controller" 00:19:15.443 }' 00:19:15.443 [2024-11-28 23:11:18.903359] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.443 [2024-11-28 23:11:18.903385] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.443 [2024-11-28 23:11:18.911377] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.443 [2024-11-28 23:11:18.911411] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.443 [2024-11-28 23:11:18.919391] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.443 [2024-11-28 23:11:18.919420] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.443 [2024-11-28 23:11:18.927437] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.443 [2024-11-28 23:11:18.927458] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.443 [2024-11-28 23:11:18.932548] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:15.443 [2024-11-28 23:11:18.932611] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2459087 ] 00:19:15.443 [2024-11-28 23:11:18.935449] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.443 [2024-11-28 23:11:18.935470] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.443 [2024-11-28 23:11:18.943463] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.443 [2024-11-28 23:11:18.943483] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.443 [2024-11-28 23:11:18.951501] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.443 [2024-11-28 23:11:18.951521] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.443 [2024-11-28 23:11:18.959509] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.443 [2024-11-28 23:11:18.959529] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.443 EAL: No free 2048 kB hugepages reported on node 1 00:19:15.443 [2024-11-28 23:11:18.967532] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.443 [2024-11-28 23:11:18.967553] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.443 [2024-11-28 23:11:18.975555] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.443 [2024-11-28 23:11:18.975577] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.443 [2024-11-28 23:11:18.983574] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.443 [2024-11-28 23:11:18.983595] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.443 [2024-11-28 23:11:18.991595] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.443 [2024-11-28 23:11:18.991616] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.443 [2024-11-28 23:11:18.995425] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:15.443 [2024-11-28 23:11:18.999626] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.443 [2024-11-28 23:11:18.999649] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.443 [2024-11-28 23:11:19.007694] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.443 [2024-11-28 23:11:19.007736] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.443 [2024-11-28 23:11:19.015663] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.443 [2024-11-28 23:11:19.015702] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.443 [2024-11-28 23:11:19.023701] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.443 [2024-11-28 23:11:19.023725] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.443 [2024-11-28 23:11:19.031726] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.443 [2024-11-28 23:11:19.031750] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.443 [2024-11-28 23:11:19.039751] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.443 [2024-11-28 23:11:19.039775] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.443 [2024-11-28 23:11:19.047820] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.443 [2024-11-28 23:11:19.047859] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.702 [2024-11-28 23:11:19.055818] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.702 [2024-11-28 23:11:19.055853] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.702 [2024-11-28 23:11:19.063824] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.702 [2024-11-28 23:11:19.063849] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.702 [2024-11-28 23:11:19.071846] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.702 [2024-11-28 23:11:19.071870] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.702 [2024-11-28 23:11:19.079866] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.702 [2024-11-28 23:11:19.079890] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.702 [2024-11-28 23:11:19.085241] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:15.702 [2024-11-28 23:11:19.087888] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.702 [2024-11-28 23:11:19.087912] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.702 [2024-11-28 23:11:19.095909] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.702 [2024-11-28 23:11:19.095933] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.702 [2024-11-28 23:11:19.103959] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.702 [2024-11-28 23:11:19.104007] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.702 [2024-11-28 23:11:19.111991] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.702 [2024-11-28 23:11:19.112033] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.702 [2024-11-28 23:11:19.120008] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.702 [2024-11-28 23:11:19.120048] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.702 [2024-11-28 23:11:19.128033] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.702 [2024-11-28 23:11:19.128076] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.702 [2024-11-28 23:11:19.136052] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.702 [2024-11-28 23:11:19.136096] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.702 [2024-11-28 23:11:19.144075] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.702 [2024-11-28 23:11:19.144118] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.702 [2024-11-28 23:11:19.152098] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.702 [2024-11-28 23:11:19.152139] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.702 [2024-11-28 23:11:19.160091] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.702 [2024-11-28 23:11:19.160116] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.703 [2024-11-28 23:11:19.168149] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.703 [2024-11-28 23:11:19.168190] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.703 [2024-11-28 23:11:19.176171] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.703 [2024-11-28 23:11:19.176214] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.703 [2024-11-28 23:11:19.184158] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.703 [2024-11-28 23:11:19.184185] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.703 [2024-11-28 23:11:19.192179] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.703 [2024-11-28 23:11:19.192204] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.703 [2024-11-28 23:11:19.200212] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.703 [2024-11-28 23:11:19.200242] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.703 [2024-11-28 23:11:19.208232] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.703 [2024-11-28 23:11:19.208259] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.703 [2024-11-28 23:11:19.216256] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.703 [2024-11-28 23:11:19.216284] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.703 [2024-11-28 23:11:19.224280] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.703 [2024-11-28 23:11:19.224308] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.703 [2024-11-28 23:11:19.232304] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.703 [2024-11-28 23:11:19.232331] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.703 [2024-11-28 23:11:19.240326] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.703 [2024-11-28 23:11:19.240353] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.703 [2024-11-28 23:11:19.248348] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.703 [2024-11-28 23:11:19.248372] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.703 [2024-11-28 23:11:19.256371] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.703 [2024-11-28 23:11:19.256414] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.703 [2024-11-28 23:11:19.264404] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.703 [2024-11-28 23:11:19.264429] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.703 [2024-11-28 23:11:19.272423] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.703 [2024-11-28 23:11:19.272463] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.703 [2024-11-28 23:11:19.280465] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.703 [2024-11-28 23:11:19.280489] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.703 [2024-11-28 23:11:19.288482] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.703 [2024-11-28 23:11:19.288518] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.703 [2024-11-28 23:11:19.296515] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.703 [2024-11-28 23:11:19.296548] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.703 [2024-11-28 23:11:19.304533] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.703 [2024-11-28 23:11:19.304554] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.961 [2024-11-28 23:11:19.312532] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.961 [2024-11-28 23:11:19.312568] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.961 [2024-11-28 23:11:19.320554] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.961 [2024-11-28 23:11:19.320576] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.961 [2024-11-28 23:11:19.328576] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.961 [2024-11-28 23:11:19.328597] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.961 [2024-11-28 23:11:19.336609] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.961 [2024-11-28 23:11:19.336636] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.961 [2024-11-28 23:11:19.344624] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.961 [2024-11-28 23:11:19.344646] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.961 Running I/O for 5 seconds... 00:19:15.961 [2024-11-28 23:11:19.352647] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.961 [2024-11-28 23:11:19.352684] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.961 [2024-11-28 23:11:19.365994] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.961 [2024-11-28 23:11:19.366026] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.961 [2024-11-28 23:11:19.377029] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.961 [2024-11-28 23:11:19.377060] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.961 [2024-11-28 23:11:19.388365] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.961 [2024-11-28 23:11:19.388407] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.961 [2024-11-28 23:11:19.401497] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.961 [2024-11-28 23:11:19.401528] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.961 [2024-11-28 23:11:19.411622] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.961 [2024-11-28 23:11:19.411650] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.961 [2024-11-28 23:11:19.423294] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.961 [2024-11-28 23:11:19.423325] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.961 [2024-11-28 23:11:19.434623] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.961 [2024-11-28 23:11:19.434658] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.961 [2024-11-28 23:11:19.447502] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.961 [2024-11-28 23:11:19.447530] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.961 [2024-11-28 23:11:19.457755] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.961 [2024-11-28 23:11:19.457786] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.961 [2024-11-28 23:11:19.469039] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.961 [2024-11-28 23:11:19.469069] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.961 [2024-11-28 23:11:19.482304] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.961 [2024-11-28 23:11:19.482335] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.961 [2024-11-28 23:11:19.492602] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.961 [2024-11-28 23:11:19.492629] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.961 [2024-11-28 23:11:19.503607] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.961 [2024-11-28 23:11:19.503634] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.961 [2024-11-28 23:11:19.516259] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.961 [2024-11-28 23:11:19.516291] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.962 [2024-11-28 23:11:19.526637] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.962 [2024-11-28 23:11:19.526681] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.962 [2024-11-28 23:11:19.537609] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.962 [2024-11-28 23:11:19.537637] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.962 [2024-11-28 23:11:19.550660] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.962 [2024-11-28 23:11:19.550706] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:15.962 [2024-11-28 23:11:19.561075] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:15.962 [2024-11-28 23:11:19.561105] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.220 [2024-11-28 23:11:19.572061] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.220 [2024-11-28 23:11:19.572091] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.220 [2024-11-28 23:11:19.582834] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.220 [2024-11-28 23:11:19.582865] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.220 [2024-11-28 23:11:19.593727] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.220 [2024-11-28 23:11:19.593758] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.220 [2024-11-28 23:11:19.604549] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.220 [2024-11-28 23:11:19.604576] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.220 [2024-11-28 23:11:19.615629] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.220 [2024-11-28 23:11:19.615656] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.220 [2024-11-28 23:11:19.627129] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.220 [2024-11-28 23:11:19.627159] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.220 [2024-11-28 23:11:19.638302] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.220 [2024-11-28 23:11:19.638333] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.220 [2024-11-28 23:11:19.649323] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.220 [2024-11-28 23:11:19.649354] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.220 [2024-11-28 23:11:19.660322] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.220 [2024-11-28 23:11:19.660353] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.220 [2024-11-28 23:11:19.671787] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.220 [2024-11-28 23:11:19.671819] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.220 [2024-11-28 23:11:19.682878] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.220 [2024-11-28 23:11:19.682910] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.221 [2024-11-28 23:11:19.693669] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.221 [2024-11-28 23:11:19.693719] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.221 [2024-11-28 23:11:19.704874] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.221 [2024-11-28 23:11:19.704913] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.221 [2024-11-28 23:11:19.718486] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.221 [2024-11-28 23:11:19.718513] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.221 [2024-11-28 23:11:19.728851] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.221 [2024-11-28 23:11:19.728881] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.221 [2024-11-28 23:11:19.739799] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.221 [2024-11-28 23:11:19.739829] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.221 [2024-11-28 23:11:19.752606] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.221 [2024-11-28 23:11:19.752635] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.221 [2024-11-28 23:11:19.762723] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.221 [2024-11-28 23:11:19.762753] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.221 [2024-11-28 23:11:19.773662] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.221 [2024-11-28 23:11:19.773709] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.221 [2024-11-28 23:11:19.786520] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.221 [2024-11-28 23:11:19.786548] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.221 [2024-11-28 23:11:19.796982] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.221 [2024-11-28 23:11:19.797012] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.221 [2024-11-28 23:11:19.808336] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.221 [2024-11-28 23:11:19.808365] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.221 [2024-11-28 23:11:19.820096] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.221 [2024-11-28 23:11:19.820126] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.479 [2024-11-28 23:11:19.831120] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.479 [2024-11-28 23:11:19.831151] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.479 [2024-11-28 23:11:19.842013] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.479 [2024-11-28 23:11:19.842044] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.479 [2024-11-28 23:11:19.853126] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.479 [2024-11-28 23:11:19.853156] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.479 [2024-11-28 23:11:19.863630] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.479 [2024-11-28 23:11:19.863658] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.479 [2024-11-28 23:11:19.875144] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.479 [2024-11-28 23:11:19.875175] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.479 [2024-11-28 23:11:19.887743] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.479 [2024-11-28 23:11:19.887775] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.479 [2024-11-28 23:11:19.897832] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.479 [2024-11-28 23:11:19.897863] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.479 [2024-11-28 23:11:19.909113] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.479 [2024-11-28 23:11:19.909143] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.479 [2024-11-28 23:11:19.921905] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.479 [2024-11-28 23:11:19.921935] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.479 [2024-11-28 23:11:19.931879] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.479 [2024-11-28 23:11:19.931909] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.479 [2024-11-28 23:11:19.943089] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.479 [2024-11-28 23:11:19.943120] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.479 [2024-11-28 23:11:19.956005] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.479 [2024-11-28 23:11:19.956036] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.479 [2024-11-28 23:11:19.965934] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.479 [2024-11-28 23:11:19.965965] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.479 [2024-11-28 23:11:19.977363] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.479 [2024-11-28 23:11:19.977402] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.479 [2024-11-28 23:11:19.987590] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.479 [2024-11-28 23:11:19.987618] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.479 [2024-11-28 23:11:19.998302] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.479 [2024-11-28 23:11:19.998332] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.479 [2024-11-28 23:11:20.009484] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.479 [2024-11-28 23:11:20.009519] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.479 [2024-11-28 23:11:20.020690] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.479 [2024-11-28 23:11:20.020722] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.479 [2024-11-28 23:11:20.031792] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.479 [2024-11-28 23:11:20.031824] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.479 [2024-11-28 23:11:20.042323] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.479 [2024-11-28 23:11:20.042356] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.479 [2024-11-28 23:11:20.052405] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.479 [2024-11-28 23:11:20.052433] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.479 [2024-11-28 23:11:20.062420] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.479 [2024-11-28 23:11:20.062459] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.479 [2024-11-28 23:11:20.073924] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.479 [2024-11-28 23:11:20.073956] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.738 [2024-11-28 23:11:20.084813] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.738 [2024-11-28 23:11:20.084843] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.738 [2024-11-28 23:11:20.095837] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.738 [2024-11-28 23:11:20.095867] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.738 [2024-11-28 23:11:20.106917] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.738 [2024-11-28 23:11:20.106961] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.738 [2024-11-28 23:11:20.117516] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.738 [2024-11-28 23:11:20.117547] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.738 [2024-11-28 23:11:20.128612] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.738 [2024-11-28 23:11:20.128640] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.738 [2024-11-28 23:11:20.139871] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.738 [2024-11-28 23:11:20.139901] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.738 [2024-11-28 23:11:20.152136] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.738 [2024-11-28 23:11:20.152166] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.738 [2024-11-28 23:11:20.161942] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.738 [2024-11-28 23:11:20.161972] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.738 [2024-11-28 23:11:20.173750] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.738 [2024-11-28 23:11:20.173793] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.738 [2024-11-28 23:11:20.184729] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.738 [2024-11-28 23:11:20.184759] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.738 [2024-11-28 23:11:20.195583] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.738 [2024-11-28 23:11:20.195610] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.738 [2024-11-28 23:11:20.208301] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.738 [2024-11-28 23:11:20.208331] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.738 [2024-11-28 23:11:20.218538] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.738 [2024-11-28 23:11:20.218565] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.738 [2024-11-28 23:11:20.229637] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.738 [2024-11-28 23:11:20.229664] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.738 [2024-11-28 23:11:20.240917] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.738 [2024-11-28 23:11:20.240947] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.738 [2024-11-28 23:11:20.252018] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.738 [2024-11-28 23:11:20.252048] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.738 [2024-11-28 23:11:20.264810] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.738 [2024-11-28 23:11:20.264840] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.738 [2024-11-28 23:11:20.275346] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.738 [2024-11-28 23:11:20.275376] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.738 [2024-11-28 23:11:20.286257] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.738 [2024-11-28 23:11:20.286287] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.738 [2024-11-28 23:11:20.298754] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.738 [2024-11-28 23:11:20.298784] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.738 [2024-11-28 23:11:20.308931] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.738 [2024-11-28 23:11:20.308961] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.738 [2024-11-28 23:11:20.320468] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.738 [2024-11-28 23:11:20.320497] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.738 [2024-11-28 23:11:20.331523] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.738 [2024-11-28 23:11:20.331549] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.738 [2024-11-28 23:11:20.342341] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.738 [2024-11-28 23:11:20.342371] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.996 [2024-11-28 23:11:20.354831] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.996 [2024-11-28 23:11:20.354861] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.996 [2024-11-28 23:11:20.365292] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.996 [2024-11-28 23:11:20.365322] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.996 [2024-11-28 23:11:20.376206] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.996 [2024-11-28 23:11:20.376236] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.997 [2024-11-28 23:11:20.389297] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.997 [2024-11-28 23:11:20.389327] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.997 [2024-11-28 23:11:20.399657] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.997 [2024-11-28 23:11:20.399684] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.997 [2024-11-28 23:11:20.410600] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.997 [2024-11-28 23:11:20.410627] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.997 [2024-11-28 23:11:20.423511] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.997 [2024-11-28 23:11:20.423539] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.997 [2024-11-28 23:11:20.434048] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.997 [2024-11-28 23:11:20.434075] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.997 [2024-11-28 23:11:20.444357] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.997 [2024-11-28 23:11:20.444387] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.997 [2024-11-28 23:11:20.454768] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.997 [2024-11-28 23:11:20.454796] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.997 [2024-11-28 23:11:20.466051] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.997 [2024-11-28 23:11:20.466081] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.997 [2024-11-28 23:11:20.477313] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.997 [2024-11-28 23:11:20.477343] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.997 [2024-11-28 23:11:20.488562] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.997 [2024-11-28 23:11:20.488597] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.997 [2024-11-28 23:11:20.501658] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.997 [2024-11-28 23:11:20.501686] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.997 [2024-11-28 23:11:20.512211] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.997 [2024-11-28 23:11:20.512256] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.997 [2024-11-28 23:11:20.523254] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.997 [2024-11-28 23:11:20.523285] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.997 [2024-11-28 23:11:20.536220] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.997 [2024-11-28 23:11:20.536251] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.997 [2024-11-28 23:11:20.546628] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.997 [2024-11-28 23:11:20.546655] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.997 [2024-11-28 23:11:20.558056] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.997 [2024-11-28 23:11:20.558087] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.997 [2024-11-28 23:11:20.569136] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.997 [2024-11-28 23:11:20.569165] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.997 [2024-11-28 23:11:20.580577] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.997 [2024-11-28 23:11:20.580614] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.997 [2024-11-28 23:11:20.591951] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:16.997 [2024-11-28 23:11:20.591981] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.256 [2024-11-28 23:11:20.603244] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.256 [2024-11-28 23:11:20.603275] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.256 [2024-11-28 23:11:20.614025] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.256 [2024-11-28 23:11:20.614055] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.256 [2024-11-28 23:11:20.626922] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.256 [2024-11-28 23:11:20.626952] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.256 [2024-11-28 23:11:20.637016] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.256 [2024-11-28 23:11:20.637046] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.256 [2024-11-28 23:11:20.648803] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.256 [2024-11-28 23:11:20.648833] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.256 [2024-11-28 23:11:20.659507] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.256 [2024-11-28 23:11:20.659534] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.256 [2024-11-28 23:11:20.670863] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.256 [2024-11-28 23:11:20.670893] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.256 [2024-11-28 23:11:20.682299] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.256 [2024-11-28 23:11:20.682330] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.256 [2024-11-28 23:11:20.695607] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.256 [2024-11-28 23:11:20.695635] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.256 [2024-11-28 23:11:20.705896] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.256 [2024-11-28 23:11:20.705935] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.256 [2024-11-28 23:11:20.717192] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.256 [2024-11-28 23:11:20.717223] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.256 [2024-11-28 23:11:20.730459] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.256 [2024-11-28 23:11:20.730486] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.256 [2024-11-28 23:11:20.740839] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.256 [2024-11-28 23:11:20.740869] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.256 [2024-11-28 23:11:20.751652] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.256 [2024-11-28 23:11:20.751679] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.256 [2024-11-28 23:11:20.764470] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.256 [2024-11-28 23:11:20.764497] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.256 [2024-11-28 23:11:20.774323] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.256 [2024-11-28 23:11:20.774353] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.256 [2024-11-28 23:11:20.785580] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.256 [2024-11-28 23:11:20.785607] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.256 [2024-11-28 23:11:20.797003] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.256 [2024-11-28 23:11:20.797032] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.256 [2024-11-28 23:11:20.808448] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.256 [2024-11-28 23:11:20.808475] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.256 [2024-11-28 23:11:20.819576] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.256 [2024-11-28 23:11:20.819604] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.256 [2024-11-28 23:11:20.832515] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.256 [2024-11-28 23:11:20.832542] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.256 [2024-11-28 23:11:20.844537] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.256 [2024-11-28 23:11:20.844565] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.256 [2024-11-28 23:11:20.853999] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.256 [2024-11-28 23:11:20.854028] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.514 [2024-11-28 23:11:20.865614] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.514 [2024-11-28 23:11:20.865641] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.514 [2024-11-28 23:11:20.876632] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.514 [2024-11-28 23:11:20.876659] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.514 [2024-11-28 23:11:20.887577] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.514 [2024-11-28 23:11:20.887604] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.514 [2024-11-28 23:11:20.898954] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.514 [2024-11-28 23:11:20.898984] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.514 [2024-11-28 23:11:20.911846] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.514 [2024-11-28 23:11:20.911877] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.514 [2024-11-28 23:11:20.922263] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.514 [2024-11-28 23:11:20.922302] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.514 [2024-11-28 23:11:20.933681] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.514 [2024-11-28 23:11:20.933711] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.514 [2024-11-28 23:11:20.944149] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.514 [2024-11-28 23:11:20.944179] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.514 [2024-11-28 23:11:20.955120] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.514 [2024-11-28 23:11:20.955150] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.514 [2024-11-28 23:11:20.965780] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.514 [2024-11-28 23:11:20.965810] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.514 [2024-11-28 23:11:20.976623] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.514 [2024-11-28 23:11:20.976649] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.514 [2024-11-28 23:11:20.989523] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.514 [2024-11-28 23:11:20.989551] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.514 [2024-11-28 23:11:20.999259] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.514 [2024-11-28 23:11:20.999290] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.514 [2024-11-28 23:11:21.010720] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.514 [2024-11-28 23:11:21.010751] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.514 [2024-11-28 23:11:21.021988] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.514 [2024-11-28 23:11:21.022020] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.514 [2024-11-28 23:11:21.033192] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.514 [2024-11-28 23:11:21.033226] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.514 [2024-11-28 23:11:21.044211] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.514 [2024-11-28 23:11:21.044241] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.514 [2024-11-28 23:11:21.055430] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.514 [2024-11-28 23:11:21.055478] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.514 [2024-11-28 23:11:21.066297] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.514 [2024-11-28 23:11:21.066329] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.514 [2024-11-28 23:11:21.076972] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.514 [2024-11-28 23:11:21.077003] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.514 [2024-11-28 23:11:21.087966] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.514 [2024-11-28 23:11:21.087997] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.514 [2024-11-28 23:11:21.098685] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.514 [2024-11-28 23:11:21.098716] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.514 [2024-11-28 23:11:21.109882] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.514 [2024-11-28 23:11:21.109913] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.773 [2024-11-28 23:11:21.120535] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.773 [2024-11-28 23:11:21.120562] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.773 [2024-11-28 23:11:21.133247] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.773 [2024-11-28 23:11:21.133286] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.773 [2024-11-28 23:11:21.143594] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.773 [2024-11-28 23:11:21.143621] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.773 [2024-11-28 23:11:21.154165] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.773 [2024-11-28 23:11:21.154195] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.773 [2024-11-28 23:11:21.165208] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.773 [2024-11-28 23:11:21.165238] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.773 [2024-11-28 23:11:21.176193] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.773 [2024-11-28 23:11:21.176223] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.773 [2024-11-28 23:11:21.189245] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.773 [2024-11-28 23:11:21.189275] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.773 [2024-11-28 23:11:21.199788] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.773 [2024-11-28 23:11:21.199818] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.773 [2024-11-28 23:11:21.210487] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.773 [2024-11-28 23:11:21.210514] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.773 [2024-11-28 23:11:21.221011] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.773 [2024-11-28 23:11:21.221041] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.773 [2024-11-28 23:11:21.232039] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.773 [2024-11-28 23:11:21.232069] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.773 [2024-11-28 23:11:21.243198] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.773 [2024-11-28 23:11:21.243229] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.773 [2024-11-28 23:11:21.254728] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.773 [2024-11-28 23:11:21.254758] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.773 [2024-11-28 23:11:21.265930] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.773 [2024-11-28 23:11:21.265961] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.773 [2024-11-28 23:11:21.277390] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.773 [2024-11-28 23:11:21.277428] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.773 [2024-11-28 23:11:21.290404] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.773 [2024-11-28 23:11:21.290457] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.773 [2024-11-28 23:11:21.300785] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.773 [2024-11-28 23:11:21.300816] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.773 [2024-11-28 23:11:21.311948] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.773 [2024-11-28 23:11:21.311979] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.773 [2024-11-28 23:11:21.323223] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.773 [2024-11-28 23:11:21.323252] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.773 [2024-11-28 23:11:21.334717] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.773 [2024-11-28 23:11:21.334747] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.773 [2024-11-28 23:11:21.348231] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.773 [2024-11-28 23:11:21.348261] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.773 [2024-11-28 23:11:21.358830] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.773 [2024-11-28 23:11:21.358860] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.773 [2024-11-28 23:11:21.369624] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:17.773 [2024-11-28 23:11:21.369652] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.032 [2024-11-28 23:11:21.382309] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.032 [2024-11-28 23:11:21.382340] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.032 [2024-11-28 23:11:21.392784] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.032 [2024-11-28 23:11:21.392814] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.032 [2024-11-28 23:11:21.403917] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.032 [2024-11-28 23:11:21.403947] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.032 [2024-11-28 23:11:21.415035] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.032 [2024-11-28 23:11:21.415065] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.032 [2024-11-28 23:11:21.425984] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.032 [2024-11-28 23:11:21.426014] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.032 [2024-11-28 23:11:21.436435] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.032 [2024-11-28 23:11:21.436478] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.032 [2024-11-28 23:11:21.447301] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.032 [2024-11-28 23:11:21.447331] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.032 [2024-11-28 23:11:21.458498] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.032 [2024-11-28 23:11:21.458526] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.032 [2024-11-28 23:11:21.471407] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.032 [2024-11-28 23:11:21.471437] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.032 [2024-11-28 23:11:21.481504] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.032 [2024-11-28 23:11:21.481542] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.032 [2024-11-28 23:11:21.492590] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.032 [2024-11-28 23:11:21.492617] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.032 [2024-11-28 23:11:21.505379] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.032 [2024-11-28 23:11:21.505417] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.032 [2024-11-28 23:11:21.516162] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.032 [2024-11-28 23:11:21.516192] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.032 [2024-11-28 23:11:21.527103] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.032 [2024-11-28 23:11:21.527132] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.032 [2024-11-28 23:11:21.538359] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.032 [2024-11-28 23:11:21.538389] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.032 [2024-11-28 23:11:21.549141] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.032 [2024-11-28 23:11:21.549171] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.032 [2024-11-28 23:11:21.562479] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.032 [2024-11-28 23:11:21.562506] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.032 [2024-11-28 23:11:21.572524] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.032 [2024-11-28 23:11:21.572551] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.032 [2024-11-28 23:11:21.583952] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.032 [2024-11-28 23:11:21.583982] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.032 [2024-11-28 23:11:21.594748] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.032 [2024-11-28 23:11:21.594778] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.032 [2024-11-28 23:11:21.607286] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.032 [2024-11-28 23:11:21.607316] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.032 [2024-11-28 23:11:21.617582] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.032 [2024-11-28 23:11:21.617608] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.032 [2024-11-28 23:11:21.628601] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.032 [2024-11-28 23:11:21.628628] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.291 [2024-11-28 23:11:21.641362] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.291 [2024-11-28 23:11:21.641402] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.291 [2024-11-28 23:11:21.651443] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.291 [2024-11-28 23:11:21.651486] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.291 [2024-11-28 23:11:21.662364] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.291 [2024-11-28 23:11:21.662403] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.291 [2024-11-28 23:11:21.673599] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.291 [2024-11-28 23:11:21.673627] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.291 [2024-11-28 23:11:21.684838] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.291 [2024-11-28 23:11:21.684869] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.291 [2024-11-28 23:11:21.696070] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.291 [2024-11-28 23:11:21.696101] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.291 [2024-11-28 23:11:21.709476] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.291 [2024-11-28 23:11:21.709505] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.291 [2024-11-28 23:11:21.719024] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.291 [2024-11-28 23:11:21.719054] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.291 [2024-11-28 23:11:21.730699] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.291 [2024-11-28 23:11:21.730729] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.291 [2024-11-28 23:11:21.741754] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.291 [2024-11-28 23:11:21.741784] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.291 [2024-11-28 23:11:21.753228] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.291 [2024-11-28 23:11:21.753258] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.291 [2024-11-28 23:11:21.764768] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.291 [2024-11-28 23:11:21.764798] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.291 [2024-11-28 23:11:21.775948] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.291 [2024-11-28 23:11:21.775977] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.291 [2024-11-28 23:11:21.789706] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.291 [2024-11-28 23:11:21.789737] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.291 [2024-11-28 23:11:21.799946] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.291 [2024-11-28 23:11:21.799977] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.291 [2024-11-28 23:11:21.810902] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.291 [2024-11-28 23:11:21.810932] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.291 [2024-11-28 23:11:21.822222] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.291 [2024-11-28 23:11:21.822252] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.291 [2024-11-28 23:11:21.833386] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.291 [2024-11-28 23:11:21.833425] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.291 [2024-11-28 23:11:21.845799] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.291 [2024-11-28 23:11:21.845829] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.291 [2024-11-28 23:11:21.855697] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.291 [2024-11-28 23:11:21.855727] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.291 [2024-11-28 23:11:21.867410] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.291 [2024-11-28 23:11:21.867455] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.291 [2024-11-28 23:11:21.878204] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.291 [2024-11-28 23:11:21.878234] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.291 [2024-11-28 23:11:21.888711] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.291 [2024-11-28 23:11:21.888741] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.549 [2024-11-28 23:11:21.899750] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.549 [2024-11-28 23:11:21.899780] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.549 [2024-11-28 23:11:21.910782] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.549 [2024-11-28 23:11:21.910812] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.549 [2024-11-28 23:11:21.923642] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.549 [2024-11-28 23:11:21.923687] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.549 [2024-11-28 23:11:21.934182] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.549 [2024-11-28 23:11:21.934211] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.549 [2024-11-28 23:11:21.945076] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.549 [2024-11-28 23:11:21.945106] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.549 [2024-11-28 23:11:21.956134] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.549 [2024-11-28 23:11:21.956164] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.549 [2024-11-28 23:11:21.967699] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.549 [2024-11-28 23:11:21.967730] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.549 [2024-11-28 23:11:21.978488] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.549 [2024-11-28 23:11:21.978516] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.549 [2024-11-28 23:11:21.989546] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.549 [2024-11-28 23:11:21.989573] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.549 [2024-11-28 23:11:22.000831] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.549 [2024-11-28 23:11:22.000861] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.549 [2024-11-28 23:11:22.011906] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.549 [2024-11-28 23:11:22.011936] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.549 [2024-11-28 23:11:22.024869] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.549 [2024-11-28 23:11:22.024900] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.549 [2024-11-28 23:11:22.035238] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.549 [2024-11-28 23:11:22.035268] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.549 [2024-11-28 23:11:22.046034] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.549 [2024-11-28 23:11:22.046065] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.549 [2024-11-28 23:11:22.058963] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.549 [2024-11-28 23:11:22.058993] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.549 [2024-11-28 23:11:22.068469] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.549 [2024-11-28 23:11:22.068496] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.549 [2024-11-28 23:11:22.079184] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.549 [2024-11-28 23:11:22.079214] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.549 [2024-11-28 23:11:22.090550] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.549 [2024-11-28 23:11:22.090579] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.550 [2024-11-28 23:11:22.102007] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.550 [2024-11-28 23:11:22.102037] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.550 [2024-11-28 23:11:22.112939] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.550 [2024-11-28 23:11:22.112970] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.550 [2024-11-28 23:11:22.123996] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.550 [2024-11-28 23:11:22.124027] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.550 [2024-11-28 23:11:22.137140] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.550 [2024-11-28 23:11:22.137172] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.550 [2024-11-28 23:11:22.147098] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.550 [2024-11-28 23:11:22.147128] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.808 [2024-11-28 23:11:22.158083] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.808 [2024-11-28 23:11:22.158114] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.808 [2024-11-28 23:11:22.170844] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.808 [2024-11-28 23:11:22.170876] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.808 [2024-11-28 23:11:22.181347] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.808 [2024-11-28 23:11:22.181378] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.808 [2024-11-28 23:11:22.192283] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.808 [2024-11-28 23:11:22.192322] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.808 [2024-11-28 23:11:22.205274] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.808 [2024-11-28 23:11:22.205304] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.808 [2024-11-28 23:11:22.215741] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.808 [2024-11-28 23:11:22.215772] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.808 [2024-11-28 23:11:22.226797] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.808 [2024-11-28 23:11:22.226828] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.808 [2024-11-28 23:11:22.239794] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.808 [2024-11-28 23:11:22.239824] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.808 [2024-11-28 23:11:22.250161] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.808 [2024-11-28 23:11:22.250191] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.808 [2024-11-28 23:11:22.261569] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.808 [2024-11-28 23:11:22.261597] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.808 [2024-11-28 23:11:22.272684] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.808 [2024-11-28 23:11:22.272715] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.808 [2024-11-28 23:11:22.283965] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.808 [2024-11-28 23:11:22.283995] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.808 [2024-11-28 23:11:22.294716] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.808 [2024-11-28 23:11:22.294747] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.808 [2024-11-28 23:11:22.305948] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.808 [2024-11-28 23:11:22.305978] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.808 [2024-11-28 23:11:22.316702] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.808 [2024-11-28 23:11:22.316732] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.808 [2024-11-28 23:11:22.327665] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.808 [2024-11-28 23:11:22.327709] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.808 [2024-11-28 23:11:22.340362] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.808 [2024-11-28 23:11:22.340404] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.808 [2024-11-28 23:11:22.350862] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.808 [2024-11-28 23:11:22.350892] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.808 [2024-11-28 23:11:22.361984] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.808 [2024-11-28 23:11:22.362015] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.808 [2024-11-28 23:11:22.374900] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.808 [2024-11-28 23:11:22.374931] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.808 [2024-11-28 23:11:22.384783] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.808 [2024-11-28 23:11:22.384813] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.808 [2024-11-28 23:11:22.396073] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.808 [2024-11-28 23:11:22.396103] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.808 [2024-11-28 23:11:22.407006] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:18.808 [2024-11-28 23:11:22.407044] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.067 [2024-11-28 23:11:22.418619] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.067 [2024-11-28 23:11:22.418646] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.067 [2024-11-28 23:11:22.431538] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.067 [2024-11-28 23:11:22.431565] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.067 [2024-11-28 23:11:22.442309] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.067 [2024-11-28 23:11:22.442338] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.067 [2024-11-28 23:11:22.453098] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.067 [2024-11-28 23:11:22.453128] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.067 [2024-11-28 23:11:22.465947] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.067 [2024-11-28 23:11:22.465978] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.067 [2024-11-28 23:11:22.476063] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.067 [2024-11-28 23:11:22.476093] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.067 [2024-11-28 23:11:22.487271] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.067 [2024-11-28 23:11:22.487301] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.067 [2024-11-28 23:11:22.498493] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.067 [2024-11-28 23:11:22.498520] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.067 [2024-11-28 23:11:22.509627] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.067 [2024-11-28 23:11:22.509655] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.067 [2024-11-28 23:11:22.522927] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.067 [2024-11-28 23:11:22.522957] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.067 [2024-11-28 23:11:22.533666] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.067 [2024-11-28 23:11:22.533710] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.067 [2024-11-28 23:11:22.545012] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.067 [2024-11-28 23:11:22.545042] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.067 [2024-11-28 23:11:22.558123] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.067 [2024-11-28 23:11:22.558153] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.067 [2024-11-28 23:11:22.568065] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.067 [2024-11-28 23:11:22.568095] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.067 [2024-11-28 23:11:22.579577] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.067 [2024-11-28 23:11:22.579604] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.067 [2024-11-28 23:11:22.590892] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.067 [2024-11-28 23:11:22.590922] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.067 [2024-11-28 23:11:22.602178] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.067 [2024-11-28 23:11:22.602208] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.067 [2024-11-28 23:11:22.613469] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.067 [2024-11-28 23:11:22.613497] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.067 [2024-11-28 23:11:22.626625] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.067 [2024-11-28 23:11:22.626661] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.067 [2024-11-28 23:11:22.636783] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.067 [2024-11-28 23:11:22.636814] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.067 [2024-11-28 23:11:22.648114] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.067 [2024-11-28 23:11:22.648145] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.067 [2024-11-28 23:11:22.658871] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.067 [2024-11-28 23:11:22.658901] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.067 [2024-11-28 23:11:22.669821] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.067 [2024-11-28 23:11:22.669851] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.326 [2024-11-28 23:11:22.682467] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.326 [2024-11-28 23:11:22.682497] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.326 [2024-11-28 23:11:22.692607] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.326 [2024-11-28 23:11:22.692637] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.326 [2024-11-28 23:11:22.703604] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.326 [2024-11-28 23:11:22.703634] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.326 [2024-11-28 23:11:22.716852] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.326 [2024-11-28 23:11:22.716882] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.326 [2024-11-28 23:11:22.728034] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.326 [2024-11-28 23:11:22.728064] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.326 [2024-11-28 23:11:22.739162] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.326 [2024-11-28 23:11:22.739193] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.326 [2024-11-28 23:11:22.750284] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.326 [2024-11-28 23:11:22.750315] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.326 [2024-11-28 23:11:22.762610] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.326 [2024-11-28 23:11:22.762640] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.326 [2024-11-28 23:11:22.771425] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.326 [2024-11-28 23:11:22.771456] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.326 [2024-11-28 23:11:22.783564] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.326 [2024-11-28 23:11:22.783594] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.326 [2024-11-28 23:11:22.796138] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.326 [2024-11-28 23:11:22.796168] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.326 [2024-11-28 23:11:22.806274] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.326 [2024-11-28 23:11:22.806305] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.326 [2024-11-28 23:11:22.817313] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.326 [2024-11-28 23:11:22.817342] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.326 [2024-11-28 23:11:22.830432] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.326 [2024-11-28 23:11:22.830463] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.326 [2024-11-28 23:11:22.841261] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.326 [2024-11-28 23:11:22.841300] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.326 [2024-11-28 23:11:22.852451] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.326 [2024-11-28 23:11:22.852481] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.326 [2024-11-28 23:11:22.865454] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.326 [2024-11-28 23:11:22.865484] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.326 [2024-11-28 23:11:22.876216] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.326 [2024-11-28 23:11:22.876246] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.326 [2024-11-28 23:11:22.886589] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.326 [2024-11-28 23:11:22.886619] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.326 [2024-11-28 23:11:22.897971] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.326 [2024-11-28 23:11:22.898001] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.326 [2024-11-28 23:11:22.910679] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.326 [2024-11-28 23:11:22.910709] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.326 [2024-11-28 23:11:22.920763] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.326 [2024-11-28 23:11:22.920794] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.585 [2024-11-28 23:11:22.931993] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.585 [2024-11-28 23:11:22.932024] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.585 [2024-11-28 23:11:22.945077] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.585 [2024-11-28 23:11:22.945109] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.585 [2024-11-28 23:11:22.955606] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.585 [2024-11-28 23:11:22.955636] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.585 [2024-11-28 23:11:22.966770] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.585 [2024-11-28 23:11:22.966800] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.585 [2024-11-28 23:11:22.977874] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.585 [2024-11-28 23:11:22.977904] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.585 [2024-11-28 23:11:22.989291] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.585 [2024-11-28 23:11:22.989321] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.585 [2024-11-28 23:11:23.000938] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.585 [2024-11-28 23:11:23.000968] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.585 [2024-11-28 23:11:23.011845] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.585 [2024-11-28 23:11:23.011876] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.585 [2024-11-28 23:11:23.022765] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.585 [2024-11-28 23:11:23.022796] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.585 [2024-11-28 23:11:23.033814] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.585 [2024-11-28 23:11:23.033843] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.585 [2024-11-28 23:11:23.045095] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.585 [2024-11-28 23:11:23.045125] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.585 [2024-11-28 23:11:23.056000] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.585 [2024-11-28 23:11:23.056030] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.585 [2024-11-28 23:11:23.066984] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.585 [2024-11-28 23:11:23.067015] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.585 [2024-11-28 23:11:23.077967] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.585 [2024-11-28 23:11:23.077996] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.585 [2024-11-28 23:11:23.088777] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.585 [2024-11-28 23:11:23.088807] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.585 [2024-11-28 23:11:23.099620] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.585 [2024-11-28 23:11:23.099650] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.585 [2024-11-28 23:11:23.110457] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.585 [2024-11-28 23:11:23.110487] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.585 [2024-11-28 23:11:23.123162] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.585 [2024-11-28 23:11:23.123192] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.585 [2024-11-28 23:11:23.133218] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.585 [2024-11-28 23:11:23.133249] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.585 [2024-11-28 23:11:23.144501] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.585 [2024-11-28 23:11:23.144543] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.585 [2024-11-28 23:11:23.155629] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.585 [2024-11-28 23:11:23.155659] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.585 [2024-11-28 23:11:23.166406] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.585 [2024-11-28 23:11:23.166435] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.585 [2024-11-28 23:11:23.179164] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.585 [2024-11-28 23:11:23.179194] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.843 [2024-11-28 23:11:23.190187] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.843 [2024-11-28 23:11:23.190218] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.843 [2024-11-28 23:11:23.201323] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.843 [2024-11-28 23:11:23.201353] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.843 [2024-11-28 23:11:23.214267] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.843 [2024-11-28 23:11:23.214297] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.843 [2024-11-28 23:11:23.224636] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.843 [2024-11-28 23:11:23.224667] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.843 [2024-11-28 23:11:23.235546] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.843 [2024-11-28 23:11:23.235575] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.843 [2024-11-28 23:11:23.248598] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.843 [2024-11-28 23:11:23.248628] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.843 [2024-11-28 23:11:23.258936] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.843 [2024-11-28 23:11:23.258966] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.843 [2024-11-28 23:11:23.270675] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.843 [2024-11-28 23:11:23.270704] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.843 [2024-11-28 23:11:23.281121] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.843 [2024-11-28 23:11:23.281151] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.843 [2024-11-28 23:11:23.292555] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.843 [2024-11-28 23:11:23.292586] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.843 [2024-11-28 23:11:23.305289] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.843 [2024-11-28 23:11:23.305319] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.843 [2024-11-28 23:11:23.315177] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.843 [2024-11-28 23:11:23.315207] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.843 [2024-11-28 23:11:23.325923] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.843 [2024-11-28 23:11:23.325953] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.843 [2024-11-28 23:11:23.336749] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.843 [2024-11-28 23:11:23.336779] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.843 [2024-11-28 23:11:23.347784] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.843 [2024-11-28 23:11:23.347814] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.843 [2024-11-28 23:11:23.359208] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.843 [2024-11-28 23:11:23.359239] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.843 [2024-11-28 23:11:23.370016] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.843 [2024-11-28 23:11:23.370047] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.843 [2024-11-28 23:11:23.380290] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.843 [2024-11-28 23:11:23.380320] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.843 [2024-11-28 23:11:23.391192] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.843 [2024-11-28 23:11:23.391223] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.843 [2024-11-28 23:11:23.402381] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.843 [2024-11-28 23:11:23.402424] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.843 [2024-11-28 23:11:23.415096] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.843 [2024-11-28 23:11:23.415126] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.843 [2024-11-28 23:11:23.425806] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.843 [2024-11-28 23:11:23.425835] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.843 [2024-11-28 23:11:23.437276] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.843 [2024-11-28 23:11:23.437305] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:19.843 [2024-11-28 23:11:23.448386] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:19.843 [2024-11-28 23:11:23.448428] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.102 [2024-11-28 23:11:23.461365] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.102 [2024-11-28 23:11:23.461404] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.102 [2024-11-28 23:11:23.471758] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.102 [2024-11-28 23:11:23.471788] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.102 [2024-11-28 23:11:23.483054] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.102 [2024-11-28 23:11:23.483084] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.102 [2024-11-28 23:11:23.494028] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.102 [2024-11-28 23:11:23.494059] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.102 [2024-11-28 23:11:23.504934] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.102 [2024-11-28 23:11:23.504964] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.102 [2024-11-28 23:11:23.515997] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.102 [2024-11-28 23:11:23.516027] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.102 [2024-11-28 23:11:23.529202] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.102 [2024-11-28 23:11:23.529232] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.102 [2024-11-28 23:11:23.539574] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.102 [2024-11-28 23:11:23.539604] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.102 [2024-11-28 23:11:23.550594] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.102 [2024-11-28 23:11:23.550623] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.102 [2024-11-28 23:11:23.561964] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.102 [2024-11-28 23:11:23.561994] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.102 [2024-11-28 23:11:23.572829] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.102 [2024-11-28 23:11:23.572859] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.102 [2024-11-28 23:11:23.583959] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.102 [2024-11-28 23:11:23.583989] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.102 [2024-11-28 23:11:23.594583] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.102 [2024-11-28 23:11:23.594613] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.102 [2024-11-28 23:11:23.607747] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.102 [2024-11-28 23:11:23.607777] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.102 [2024-11-28 23:11:23.618327] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.102 [2024-11-28 23:11:23.618356] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.102 [2024-11-28 23:11:23.629228] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.102 [2024-11-28 23:11:23.629257] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.102 [2024-11-28 23:11:23.642043] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.102 [2024-11-28 23:11:23.642073] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.102 [2024-11-28 23:11:23.651901] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.102 [2024-11-28 23:11:23.651931] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.102 [2024-11-28 23:11:23.663509] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.102 [2024-11-28 23:11:23.663539] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.102 [2024-11-28 23:11:23.674588] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.102 [2024-11-28 23:11:23.674618] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.102 [2024-11-28 23:11:23.685515] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.102 [2024-11-28 23:11:23.685546] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.102 [2024-11-28 23:11:23.696442] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.102 [2024-11-28 23:11:23.696472] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.360 [2024-11-28 23:11:23.709469] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.360 [2024-11-28 23:11:23.709499] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.360 [2024-11-28 23:11:23.720310] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.360 [2024-11-28 23:11:23.720341] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.360 [2024-11-28 23:11:23.731231] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.360 [2024-11-28 23:11:23.731262] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.360 [2024-11-28 23:11:23.744097] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.360 [2024-11-28 23:11:23.744128] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.360 [2024-11-28 23:11:23.754474] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.360 [2024-11-28 23:11:23.754504] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.360 [2024-11-28 23:11:23.765838] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.360 [2024-11-28 23:11:23.765868] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.361 [2024-11-28 23:11:23.776827] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.361 [2024-11-28 23:11:23.776857] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.361 [2024-11-28 23:11:23.787637] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.361 [2024-11-28 23:11:23.787667] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.361 [2024-11-28 23:11:23.798507] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.361 [2024-11-28 23:11:23.798537] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.361 [2024-11-28 23:11:23.811132] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.361 [2024-11-28 23:11:23.811162] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.361 [2024-11-28 23:11:23.821676] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.361 [2024-11-28 23:11:23.821706] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.361 [2024-11-28 23:11:23.832809] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.361 [2024-11-28 23:11:23.832839] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.361 [2024-11-28 23:11:23.845642] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.361 [2024-11-28 23:11:23.845672] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.361 [2024-11-28 23:11:23.855643] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.361 [2024-11-28 23:11:23.855673] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.361 [2024-11-28 23:11:23.866736] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.361 [2024-11-28 23:11:23.866766] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.361 [2024-11-28 23:11:23.879488] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.361 [2024-11-28 23:11:23.879518] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.361 [2024-11-28 23:11:23.889793] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.361 [2024-11-28 23:11:23.889823] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.361 [2024-11-28 23:11:23.900919] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.361 [2024-11-28 23:11:23.900958] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.361 [2024-11-28 23:11:23.911501] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.361 [2024-11-28 23:11:23.911531] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.361 [2024-11-28 23:11:23.922362] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.361 [2024-11-28 23:11:23.922402] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.361 [2024-11-28 23:11:23.932965] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.361 [2024-11-28 23:11:23.932995] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.361 [2024-11-28 23:11:23.944113] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.361 [2024-11-28 23:11:23.944143] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.361 [2024-11-28 23:11:23.956750] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.361 [2024-11-28 23:11:23.956781] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.619 [2024-11-28 23:11:23.966790] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.619 [2024-11-28 23:11:23.966820] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.619 [2024-11-28 23:11:23.977975] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.619 [2024-11-28 23:11:23.978005] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.619 [2024-11-28 23:11:23.991299] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.619 [2024-11-28 23:11:23.991329] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.619 [2024-11-28 23:11:24.001892] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.619 [2024-11-28 23:11:24.001922] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.619 [2024-11-28 23:11:24.012588] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.619 [2024-11-28 23:11:24.012619] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.619 [2024-11-28 23:11:24.023470] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.619 [2024-11-28 23:11:24.023500] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.619 [2024-11-28 23:11:24.034725] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.619 [2024-11-28 23:11:24.034755] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.619 [2024-11-28 23:11:24.047725] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.619 [2024-11-28 23:11:24.047755] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.619 [2024-11-28 23:11:24.058031] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.619 [2024-11-28 23:11:24.058061] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.619 [2024-11-28 23:11:24.068917] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.619 [2024-11-28 23:11:24.068948] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.619 [2024-11-28 23:11:24.079515] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.619 [2024-11-28 23:11:24.079546] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.619 [2024-11-28 23:11:24.090361] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.619 [2024-11-28 23:11:24.090401] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.619 [2024-11-28 23:11:24.101089] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.619 [2024-11-28 23:11:24.101120] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.619 [2024-11-28 23:11:24.111813] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.619 [2024-11-28 23:11:24.111852] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.619 [2024-11-28 23:11:24.124158] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.619 [2024-11-28 23:11:24.124189] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.619 [2024-11-28 23:11:24.134376] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.619 [2024-11-28 23:11:24.134414] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.619 [2024-11-28 23:11:24.145522] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.619 [2024-11-28 23:11:24.145552] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.619 [2024-11-28 23:11:24.158271] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.619 [2024-11-28 23:11:24.158300] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.619 [2024-11-28 23:11:24.167841] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.619 [2024-11-28 23:11:24.167872] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.619 [2024-11-28 23:11:24.178826] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.619 [2024-11-28 23:11:24.178856] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.619 [2024-11-28 23:11:24.190216] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.619 [2024-11-28 23:11:24.190246] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.619 [2024-11-28 23:11:24.200713] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.619 [2024-11-28 23:11:24.200743] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.620 [2024-11-28 23:11:24.213361] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.620 [2024-11-28 23:11:24.213399] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.620 [2024-11-28 23:11:24.223103] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.620 [2024-11-28 23:11:24.223133] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.878 [2024-11-28 23:11:24.234729] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.878 [2024-11-28 23:11:24.234758] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.878 [2024-11-28 23:11:24.245788] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.878 [2024-11-28 23:11:24.245818] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.878 [2024-11-28 23:11:24.256792] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.878 [2024-11-28 23:11:24.256822] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.878 [2024-11-28 23:11:24.269465] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.878 [2024-11-28 23:11:24.269497] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.878 [2024-11-28 23:11:24.279908] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.878 [2024-11-28 23:11:24.279939] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.878 [2024-11-28 23:11:24.291006] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.878 [2024-11-28 23:11:24.291036] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.878 [2024-11-28 23:11:24.302549] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.878 [2024-11-28 23:11:24.302580] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.878 [2024-11-28 23:11:24.313675] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.878 [2024-11-28 23:11:24.313706] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.878 [2024-11-28 23:11:24.326747] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.878 [2024-11-28 23:11:24.326787] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.878 [2024-11-28 23:11:24.343537] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.878 [2024-11-28 23:11:24.343569] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.878 [2024-11-28 23:11:24.353881] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.878 [2024-11-28 23:11:24.353910] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.878 [2024-11-28 23:11:24.364948] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.878 [2024-11-28 23:11:24.364978] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.878 [2024-11-28 23:11:24.372179] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.878 [2024-11-28 23:11:24.372208] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.878 00:19:20.878 Latency(us) 00:19:20.878 [2024-11-28T22:11:24.484Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:20.878 [2024-11-28T22:11:24.484Z] Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:19:20.878 Nvme1n1 : 5.01 11546.49 90.21 0.00 0.00 11070.19 4927.34 21651.15 00:19:20.878 [2024-11-28T22:11:24.484Z] =================================================================================================================== 00:19:20.878 [2024-11-28T22:11:24.484Z] Total : 11546.49 90.21 0.00 0.00 11070.19 4927.34 21651.15 00:19:20.878 [2024-11-28 23:11:24.380199] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.878 [2024-11-28 23:11:24.380227] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.878 [2024-11-28 23:11:24.388220] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.878 [2024-11-28 23:11:24.388251] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.878 [2024-11-28 23:11:24.396305] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.878 [2024-11-28 23:11:24.396356] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.878 [2024-11-28 23:11:24.404322] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.878 [2024-11-28 23:11:24.404373] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.878 [2024-11-28 23:11:24.412339] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.878 [2024-11-28 23:11:24.412402] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.878 [2024-11-28 23:11:24.420355] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.878 [2024-11-28 23:11:24.420411] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.878 [2024-11-28 23:11:24.428388] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.878 [2024-11-28 23:11:24.428448] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.878 [2024-11-28 23:11:24.436414] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.878 [2024-11-28 23:11:24.436465] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.878 [2024-11-28 23:11:24.444437] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.878 [2024-11-28 23:11:24.444486] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.878 [2024-11-28 23:11:24.452456] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.878 [2024-11-28 23:11:24.452506] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.878 [2024-11-28 23:11:24.460478] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.878 [2024-11-28 23:11:24.460524] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.878 [2024-11-28 23:11:24.468506] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.878 [2024-11-28 23:11:24.468578] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:20.878 [2024-11-28 23:11:24.476525] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:20.878 [2024-11-28 23:11:24.476576] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:21.136 [2024-11-28 23:11:24.484549] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:21.136 [2024-11-28 23:11:24.484598] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:21.136 [2024-11-28 23:11:24.492568] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:21.136 [2024-11-28 23:11:24.492619] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:21.136 [2024-11-28 23:11:24.500592] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:21.136 [2024-11-28 23:11:24.500645] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:21.136 [2024-11-28 23:11:24.508580] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:21.136 [2024-11-28 23:11:24.508618] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:21.136 [2024-11-28 23:11:24.516588] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:21.136 [2024-11-28 23:11:24.516616] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:21.136 [2024-11-28 23:11:24.524649] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:21.136 [2024-11-28 23:11:24.524697] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:21.136 [2024-11-28 23:11:24.532679] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:21.136 [2024-11-28 23:11:24.532731] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:21.136 [2024-11-28 23:11:24.540693] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:21.136 [2024-11-28 23:11:24.540743] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:21.136 [2024-11-28 23:11:24.548668] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:21.136 [2024-11-28 23:11:24.548694] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:21.136 [2024-11-28 23:11:24.556713] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:21.136 [2024-11-28 23:11:24.556750] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:21.136 [2024-11-28 23:11:24.564771] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:21.136 [2024-11-28 23:11:24.564825] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:21.137 [2024-11-28 23:11:24.572783] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:21.137 [2024-11-28 23:11:24.572835] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:21.137 [2024-11-28 23:11:24.580758] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:21.137 [2024-11-28 23:11:24.580783] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:21.137 [2024-11-28 23:11:24.588778] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:21.137 [2024-11-28 23:11:24.588802] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:21.137 [2024-11-28 23:11:24.596801] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:21.137 [2024-11-28 23:11:24.596825] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:21.137 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (2459087) - No such process 00:19:21.137 23:11:24 -- target/zcopy.sh@49 -- # wait 2459087 00:19:21.137 23:11:24 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:19:21.137 23:11:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:21.137 23:11:24 -- common/autotest_common.sh@10 -- # set +x 00:19:21.137 23:11:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:21.137 23:11:24 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:19:21.137 23:11:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:21.137 23:11:24 -- common/autotest_common.sh@10 -- # set +x 00:19:21.137 delay0 00:19:21.137 23:11:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:21.137 23:11:24 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:19:21.137 23:11:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:21.137 23:11:24 -- common/autotest_common.sh@10 -- # set +x 00:19:21.137 23:11:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:21.137 23:11:24 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:19:21.137 EAL: No free 2048 kB hugepages reported on node 1 00:19:21.137 [2024-11-28 23:11:24.711308] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:19:27.702 Initializing NVMe Controllers 00:19:27.703 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:19:27.703 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:19:27.703 Initialization complete. Launching workers. 00:19:27.703 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 320, failed: 1919 00:19:27.703 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 2206, failed to submit 33 00:19:27.703 success 2022, unsuccess 184, failed 0 00:19:27.703 23:11:31 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:19:27.703 23:11:31 -- target/zcopy.sh@60 -- # nvmftestfini 00:19:27.703 23:11:31 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:27.703 23:11:31 -- nvmf/common.sh@116 -- # sync 00:19:27.703 23:11:31 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:27.703 23:11:31 -- nvmf/common.sh@119 -- # set +e 00:19:27.703 23:11:31 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:27.703 23:11:31 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:27.703 rmmod nvme_tcp 00:19:27.703 rmmod nvme_fabrics 00:19:27.703 rmmod nvme_keyring 00:19:27.703 23:11:31 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:27.703 23:11:31 -- nvmf/common.sh@123 -- # set -e 00:19:27.703 23:11:31 -- nvmf/common.sh@124 -- # return 0 00:19:27.703 23:11:31 -- nvmf/common.sh@477 -- # '[' -n 2457580 ']' 00:19:27.703 23:11:31 -- nvmf/common.sh@478 -- # killprocess 2457580 00:19:27.703 23:11:31 -- common/autotest_common.sh@936 -- # '[' -z 2457580 ']' 00:19:27.703 23:11:31 -- common/autotest_common.sh@940 -- # kill -0 2457580 00:19:27.703 23:11:31 -- common/autotest_common.sh@941 -- # uname 00:19:27.703 23:11:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:27.703 23:11:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2457580 00:19:27.703 23:11:31 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:19:27.703 23:11:31 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:19:27.703 23:11:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2457580' 00:19:27.703 killing process with pid 2457580 00:19:27.703 23:11:31 -- common/autotest_common.sh@955 -- # kill 2457580 00:19:27.703 23:11:31 -- common/autotest_common.sh@960 -- # wait 2457580 00:19:27.961 23:11:31 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:27.961 23:11:31 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:27.961 23:11:31 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:27.961 23:11:31 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:27.961 23:11:31 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:27.961 23:11:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:27.961 23:11:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:27.961 23:11:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:30.498 23:11:33 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:30.498 00:19:30.498 real 0m28.656s 00:19:30.498 user 0m42.342s 00:19:30.498 sys 0m8.118s 00:19:30.498 23:11:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:30.498 23:11:33 -- common/autotest_common.sh@10 -- # set +x 00:19:30.498 ************************************ 00:19:30.498 END TEST nvmf_zcopy 00:19:30.498 ************************************ 00:19:30.498 23:11:33 -- nvmf/nvmf.sh@53 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:19:30.498 23:11:33 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:30.498 23:11:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:30.498 23:11:33 -- common/autotest_common.sh@10 -- # set +x 00:19:30.498 ************************************ 00:19:30.498 START TEST nvmf_nmic 00:19:30.498 ************************************ 00:19:30.498 23:11:33 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:19:30.498 * Looking for test storage... 00:19:30.498 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:30.498 23:11:33 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:30.498 23:11:33 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:30.498 23:11:33 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:30.498 23:11:33 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:30.498 23:11:33 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:30.498 23:11:33 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:30.498 23:11:33 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:30.498 23:11:33 -- scripts/common.sh@335 -- # IFS=.-: 00:19:30.498 23:11:33 -- scripts/common.sh@335 -- # read -ra ver1 00:19:30.498 23:11:33 -- scripts/common.sh@336 -- # IFS=.-: 00:19:30.498 23:11:33 -- scripts/common.sh@336 -- # read -ra ver2 00:19:30.498 23:11:33 -- scripts/common.sh@337 -- # local 'op=<' 00:19:30.498 23:11:33 -- scripts/common.sh@339 -- # ver1_l=2 00:19:30.498 23:11:33 -- scripts/common.sh@340 -- # ver2_l=1 00:19:30.498 23:11:33 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:30.498 23:11:33 -- scripts/common.sh@343 -- # case "$op" in 00:19:30.498 23:11:33 -- scripts/common.sh@344 -- # : 1 00:19:30.498 23:11:33 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:30.498 23:11:33 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:30.498 23:11:33 -- scripts/common.sh@364 -- # decimal 1 00:19:30.498 23:11:33 -- scripts/common.sh@352 -- # local d=1 00:19:30.498 23:11:33 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:30.498 23:11:33 -- scripts/common.sh@354 -- # echo 1 00:19:30.498 23:11:33 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:30.498 23:11:33 -- scripts/common.sh@365 -- # decimal 2 00:19:30.498 23:11:33 -- scripts/common.sh@352 -- # local d=2 00:19:30.498 23:11:33 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:30.498 23:11:33 -- scripts/common.sh@354 -- # echo 2 00:19:30.498 23:11:33 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:30.498 23:11:33 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:30.498 23:11:33 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:30.498 23:11:33 -- scripts/common.sh@367 -- # return 0 00:19:30.498 23:11:33 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:30.498 23:11:33 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:30.498 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:30.498 --rc genhtml_branch_coverage=1 00:19:30.498 --rc genhtml_function_coverage=1 00:19:30.498 --rc genhtml_legend=1 00:19:30.498 --rc geninfo_all_blocks=1 00:19:30.498 --rc geninfo_unexecuted_blocks=1 00:19:30.498 00:19:30.498 ' 00:19:30.498 23:11:33 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:30.498 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:30.498 --rc genhtml_branch_coverage=1 00:19:30.498 --rc genhtml_function_coverage=1 00:19:30.498 --rc genhtml_legend=1 00:19:30.498 --rc geninfo_all_blocks=1 00:19:30.498 --rc geninfo_unexecuted_blocks=1 00:19:30.498 00:19:30.498 ' 00:19:30.498 23:11:33 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:30.498 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:30.498 --rc genhtml_branch_coverage=1 00:19:30.498 --rc genhtml_function_coverage=1 00:19:30.498 --rc genhtml_legend=1 00:19:30.498 --rc geninfo_all_blocks=1 00:19:30.498 --rc geninfo_unexecuted_blocks=1 00:19:30.498 00:19:30.498 ' 00:19:30.498 23:11:33 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:30.498 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:30.498 --rc genhtml_branch_coverage=1 00:19:30.498 --rc genhtml_function_coverage=1 00:19:30.498 --rc genhtml_legend=1 00:19:30.498 --rc geninfo_all_blocks=1 00:19:30.498 --rc geninfo_unexecuted_blocks=1 00:19:30.498 00:19:30.498 ' 00:19:30.498 23:11:33 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:30.498 23:11:33 -- nvmf/common.sh@7 -- # uname -s 00:19:30.498 23:11:33 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:30.498 23:11:33 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:30.498 23:11:33 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:30.498 23:11:33 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:30.498 23:11:33 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:30.498 23:11:33 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:30.498 23:11:33 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:30.498 23:11:33 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:30.498 23:11:33 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:30.498 23:11:33 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:30.498 23:11:33 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:30.499 23:11:33 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:30.499 23:11:33 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:30.499 23:11:33 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:30.499 23:11:33 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:30.499 23:11:33 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:30.499 23:11:33 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:30.499 23:11:33 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:30.499 23:11:33 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:30.499 23:11:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:30.499 23:11:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:30.499 23:11:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:30.499 23:11:33 -- paths/export.sh@5 -- # export PATH 00:19:30.499 23:11:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:30.499 23:11:33 -- nvmf/common.sh@46 -- # : 0 00:19:30.499 23:11:33 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:30.499 23:11:33 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:30.499 23:11:33 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:30.499 23:11:33 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:30.499 23:11:33 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:30.499 23:11:33 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:30.499 23:11:33 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:30.499 23:11:33 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:30.499 23:11:33 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:30.499 23:11:33 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:30.499 23:11:33 -- target/nmic.sh@14 -- # nvmftestinit 00:19:30.499 23:11:33 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:30.499 23:11:33 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:30.499 23:11:33 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:30.499 23:11:33 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:30.499 23:11:33 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:30.499 23:11:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:30.499 23:11:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:30.499 23:11:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:30.499 23:11:33 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:30.499 23:11:33 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:30.499 23:11:33 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:30.499 23:11:33 -- common/autotest_common.sh@10 -- # set +x 00:19:32.425 23:11:35 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:32.425 23:11:35 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:32.425 23:11:35 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:32.425 23:11:35 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:32.425 23:11:35 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:32.425 23:11:35 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:32.425 23:11:35 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:32.425 23:11:35 -- nvmf/common.sh@294 -- # net_devs=() 00:19:32.425 23:11:35 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:32.425 23:11:35 -- nvmf/common.sh@295 -- # e810=() 00:19:32.425 23:11:35 -- nvmf/common.sh@295 -- # local -ga e810 00:19:32.425 23:11:35 -- nvmf/common.sh@296 -- # x722=() 00:19:32.425 23:11:35 -- nvmf/common.sh@296 -- # local -ga x722 00:19:32.425 23:11:35 -- nvmf/common.sh@297 -- # mlx=() 00:19:32.425 23:11:35 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:32.425 23:11:35 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:32.425 23:11:35 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:32.425 23:11:35 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:32.425 23:11:35 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:32.425 23:11:35 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:32.425 23:11:35 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:32.425 23:11:35 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:32.425 23:11:35 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:32.425 23:11:35 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:32.425 23:11:35 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:32.425 23:11:35 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:32.425 23:11:35 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:32.425 23:11:35 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:32.425 23:11:35 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:32.425 23:11:35 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:32.425 23:11:35 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:32.425 23:11:35 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:32.425 23:11:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:32.425 23:11:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:32.425 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:32.425 23:11:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:32.425 23:11:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:32.425 23:11:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:32.425 23:11:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:32.425 23:11:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:32.425 23:11:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:32.425 23:11:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:32.425 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:32.425 23:11:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:32.425 23:11:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:32.425 23:11:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:32.425 23:11:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:32.425 23:11:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:32.425 23:11:35 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:32.425 23:11:35 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:32.425 23:11:35 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:32.425 23:11:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:32.425 23:11:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:32.425 23:11:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:32.425 23:11:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:32.425 23:11:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:32.425 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:32.425 23:11:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:32.425 23:11:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:32.425 23:11:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:32.425 23:11:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:32.425 23:11:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:32.425 23:11:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:32.425 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:32.425 23:11:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:32.425 23:11:35 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:32.425 23:11:35 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:32.425 23:11:35 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:32.425 23:11:35 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:32.425 23:11:35 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:32.425 23:11:35 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:32.425 23:11:35 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:32.425 23:11:35 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:32.425 23:11:35 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:32.425 23:11:35 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:32.425 23:11:35 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:32.425 23:11:35 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:32.425 23:11:35 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:32.425 23:11:35 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:32.425 23:11:35 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:32.425 23:11:35 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:32.425 23:11:35 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:32.425 23:11:35 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:32.425 23:11:35 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:32.425 23:11:35 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:32.425 23:11:35 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:32.425 23:11:35 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:32.425 23:11:35 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:32.425 23:11:35 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:32.425 23:11:35 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:32.425 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:32.425 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.250 ms 00:19:32.426 00:19:32.426 --- 10.0.0.2 ping statistics --- 00:19:32.426 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:32.426 rtt min/avg/max/mdev = 0.250/0.250/0.250/0.000 ms 00:19:32.426 23:11:35 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:32.426 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:32.426 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.088 ms 00:19:32.426 00:19:32.426 --- 10.0.0.1 ping statistics --- 00:19:32.426 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:32.426 rtt min/avg/max/mdev = 0.088/0.088/0.088/0.000 ms 00:19:32.426 23:11:35 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:32.426 23:11:35 -- nvmf/common.sh@410 -- # return 0 00:19:32.426 23:11:35 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:32.426 23:11:35 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:32.426 23:11:35 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:32.426 23:11:35 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:32.426 23:11:35 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:32.426 23:11:35 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:32.426 23:11:35 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:32.426 23:11:35 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:19:32.426 23:11:35 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:32.426 23:11:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:32.426 23:11:35 -- common/autotest_common.sh@10 -- # set +x 00:19:32.426 23:11:35 -- nvmf/common.sh@469 -- # nvmfpid=2462533 00:19:32.426 23:11:35 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:32.426 23:11:35 -- nvmf/common.sh@470 -- # waitforlisten 2462533 00:19:32.426 23:11:35 -- common/autotest_common.sh@829 -- # '[' -z 2462533 ']' 00:19:32.426 23:11:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:32.426 23:11:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:32.426 23:11:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:32.426 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:32.426 23:11:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:32.426 23:11:35 -- common/autotest_common.sh@10 -- # set +x 00:19:32.426 [2024-11-28 23:11:35.942266] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:32.426 [2024-11-28 23:11:35.942336] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:32.426 EAL: No free 2048 kB hugepages reported on node 1 00:19:32.426 [2024-11-28 23:11:36.015337] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:32.684 [2024-11-28 23:11:36.110208] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:32.684 [2024-11-28 23:11:36.110383] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:32.684 [2024-11-28 23:11:36.110412] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:32.684 [2024-11-28 23:11:36.110428] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:32.684 [2024-11-28 23:11:36.110495] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:32.684 [2024-11-28 23:11:36.110552] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:32.684 [2024-11-28 23:11:36.110608] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:32.684 [2024-11-28 23:11:36.110614] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:33.618 23:11:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:33.618 23:11:36 -- common/autotest_common.sh@862 -- # return 0 00:19:33.618 23:11:36 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:33.618 23:11:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:33.618 23:11:36 -- common/autotest_common.sh@10 -- # set +x 00:19:33.619 23:11:36 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:33.619 23:11:36 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:33.619 23:11:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:33.619 23:11:36 -- common/autotest_common.sh@10 -- # set +x 00:19:33.619 [2024-11-28 23:11:36.945047] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:33.619 23:11:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:33.619 23:11:36 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:33.619 23:11:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:33.619 23:11:36 -- common/autotest_common.sh@10 -- # set +x 00:19:33.619 Malloc0 00:19:33.619 23:11:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:33.619 23:11:36 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:19:33.619 23:11:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:33.619 23:11:36 -- common/autotest_common.sh@10 -- # set +x 00:19:33.619 23:11:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:33.619 23:11:36 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:33.619 23:11:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:33.619 23:11:36 -- common/autotest_common.sh@10 -- # set +x 00:19:33.619 23:11:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:33.619 23:11:36 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:33.619 23:11:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:33.619 23:11:36 -- common/autotest_common.sh@10 -- # set +x 00:19:33.619 [2024-11-28 23:11:36.997015] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:33.619 23:11:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:33.619 23:11:36 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:19:33.619 test case1: single bdev can't be used in multiple subsystems 00:19:33.619 23:11:36 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:19:33.619 23:11:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:33.619 23:11:37 -- common/autotest_common.sh@10 -- # set +x 00:19:33.619 23:11:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:33.619 23:11:37 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:19:33.619 23:11:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:33.619 23:11:37 -- common/autotest_common.sh@10 -- # set +x 00:19:33.619 23:11:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:33.619 23:11:37 -- target/nmic.sh@28 -- # nmic_status=0 00:19:33.619 23:11:37 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:19:33.619 23:11:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:33.619 23:11:37 -- common/autotest_common.sh@10 -- # set +x 00:19:33.619 [2024-11-28 23:11:37.020870] bdev.c:7940:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:19:33.619 [2024-11-28 23:11:37.020899] subsystem.c:1819:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:19:33.619 [2024-11-28 23:11:37.020928] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:33.619 request: 00:19:33.619 { 00:19:33.619 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:19:33.619 "namespace": { 00:19:33.619 "bdev_name": "Malloc0" 00:19:33.619 }, 00:19:33.619 "method": "nvmf_subsystem_add_ns", 00:19:33.619 "req_id": 1 00:19:33.619 } 00:19:33.619 Got JSON-RPC error response 00:19:33.619 response: 00:19:33.619 { 00:19:33.619 "code": -32602, 00:19:33.619 "message": "Invalid parameters" 00:19:33.619 } 00:19:33.619 23:11:37 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:19:33.619 23:11:37 -- target/nmic.sh@29 -- # nmic_status=1 00:19:33.619 23:11:37 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:19:33.619 23:11:37 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:19:33.619 Adding namespace failed - expected result. 00:19:33.619 23:11:37 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:19:33.619 test case2: host connect to nvmf target in multiple paths 00:19:33.619 23:11:37 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:19:33.619 23:11:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:33.619 23:11:37 -- common/autotest_common.sh@10 -- # set +x 00:19:33.619 [2024-11-28 23:11:37.028988] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:19:33.619 23:11:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:33.619 23:11:37 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:34.185 23:11:37 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:19:35.120 23:11:38 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:19:35.120 23:11:38 -- common/autotest_common.sh@1187 -- # local i=0 00:19:35.120 23:11:38 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:35.120 23:11:38 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:35.120 23:11:38 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:37.017 23:11:40 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:37.017 23:11:40 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:37.017 23:11:40 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:19:37.017 23:11:40 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:37.017 23:11:40 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:37.017 23:11:40 -- common/autotest_common.sh@1197 -- # return 0 00:19:37.017 23:11:40 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:19:37.017 [global] 00:19:37.017 thread=1 00:19:37.017 invalidate=1 00:19:37.017 rw=write 00:19:37.017 time_based=1 00:19:37.017 runtime=1 00:19:37.017 ioengine=libaio 00:19:37.017 direct=1 00:19:37.017 bs=4096 00:19:37.017 iodepth=1 00:19:37.017 norandommap=0 00:19:37.017 numjobs=1 00:19:37.017 00:19:37.017 verify_dump=1 00:19:37.017 verify_backlog=512 00:19:37.017 verify_state_save=0 00:19:37.017 do_verify=1 00:19:37.017 verify=crc32c-intel 00:19:37.017 [job0] 00:19:37.017 filename=/dev/nvme0n1 00:19:37.017 Could not set queue depth (nvme0n1) 00:19:37.017 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:37.017 fio-3.35 00:19:37.017 Starting 1 thread 00:19:38.389 00:19:38.389 job0: (groupid=0, jobs=1): err= 0: pid=2463193: Thu Nov 28 23:11:41 2024 00:19:38.389 read: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec) 00:19:38.389 slat (nsec): min=6122, max=74800, avg=14093.57, stdev=5941.60 00:19:38.389 clat (usec): min=177, max=843, avg=237.04, stdev=32.00 00:19:38.389 lat (usec): min=185, max=852, avg=251.14, stdev=33.98 00:19:38.389 clat percentiles (usec): 00:19:38.389 | 1.00th=[ 192], 5.00th=[ 200], 10.00th=[ 204], 20.00th=[ 212], 00:19:38.389 | 30.00th=[ 221], 40.00th=[ 229], 50.00th=[ 237], 60.00th=[ 245], 00:19:38.389 | 70.00th=[ 251], 80.00th=[ 258], 90.00th=[ 265], 95.00th=[ 277], 00:19:38.389 | 99.00th=[ 306], 99.50th=[ 326], 99.90th=[ 660], 99.95th=[ 717], 00:19:38.389 | 99.99th=[ 840] 00:19:38.389 write: IOPS=2263, BW=9055KiB/s (9272kB/s)(9064KiB/1001msec); 0 zone resets 00:19:38.389 slat (usec): min=6, max=28466, avg=30.84, stdev=597.65 00:19:38.389 clat (usec): min=127, max=376, avg=174.75, stdev=32.26 00:19:38.389 lat (usec): min=137, max=28652, avg=205.58, stdev=598.89 00:19:38.389 clat percentiles (usec): 00:19:38.389 | 1.00th=[ 135], 5.00th=[ 141], 10.00th=[ 145], 20.00th=[ 151], 00:19:38.389 | 30.00th=[ 157], 40.00th=[ 163], 50.00th=[ 169], 60.00th=[ 174], 00:19:38.389 | 70.00th=[ 180], 80.00th=[ 188], 90.00th=[ 221], 95.00th=[ 237], 00:19:38.389 | 99.00th=[ 302], 99.50th=[ 310], 99.90th=[ 363], 99.95th=[ 363], 00:19:38.389 | 99.99th=[ 375] 00:19:38.389 bw ( KiB/s): min= 8192, max= 8192, per=90.47%, avg=8192.00, stdev= 0.00, samples=1 00:19:38.389 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:19:38.389 lat (usec) : 250=83.73%, 500=16.20%, 750=0.05%, 1000=0.02% 00:19:38.390 cpu : usr=5.00%, sys=8.90%, ctx=4317, majf=0, minf=1 00:19:38.390 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:38.390 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.390 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.390 issued rwts: total=2048,2266,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:38.390 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:38.390 00:19:38.390 Run status group 0 (all jobs): 00:19:38.390 READ: bw=8184KiB/s (8380kB/s), 8184KiB/s-8184KiB/s (8380kB/s-8380kB/s), io=8192KiB (8389kB), run=1001-1001msec 00:19:38.390 WRITE: bw=9055KiB/s (9272kB/s), 9055KiB/s-9055KiB/s (9272kB/s-9272kB/s), io=9064KiB (9282kB), run=1001-1001msec 00:19:38.390 00:19:38.390 Disk stats (read/write): 00:19:38.390 nvme0n1: ios=1833/2048, merge=0/0, ticks=1355/328, in_queue=1683, util=98.60% 00:19:38.390 23:11:41 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:19:38.390 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:19:38.390 23:11:41 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:19:38.390 23:11:41 -- common/autotest_common.sh@1208 -- # local i=0 00:19:38.390 23:11:41 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:38.390 23:11:41 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:38.390 23:11:41 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:38.390 23:11:41 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:38.390 23:11:41 -- common/autotest_common.sh@1220 -- # return 0 00:19:38.390 23:11:41 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:19:38.390 23:11:41 -- target/nmic.sh@53 -- # nvmftestfini 00:19:38.390 23:11:41 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:38.390 23:11:41 -- nvmf/common.sh@116 -- # sync 00:19:38.390 23:11:41 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:38.390 23:11:41 -- nvmf/common.sh@119 -- # set +e 00:19:38.390 23:11:41 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:38.390 23:11:41 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:38.390 rmmod nvme_tcp 00:19:38.390 rmmod nvme_fabrics 00:19:38.390 rmmod nvme_keyring 00:19:38.390 23:11:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:38.390 23:11:41 -- nvmf/common.sh@123 -- # set -e 00:19:38.390 23:11:41 -- nvmf/common.sh@124 -- # return 0 00:19:38.390 23:11:41 -- nvmf/common.sh@477 -- # '[' -n 2462533 ']' 00:19:38.390 23:11:41 -- nvmf/common.sh@478 -- # killprocess 2462533 00:19:38.390 23:11:41 -- common/autotest_common.sh@936 -- # '[' -z 2462533 ']' 00:19:38.390 23:11:41 -- common/autotest_common.sh@940 -- # kill -0 2462533 00:19:38.390 23:11:41 -- common/autotest_common.sh@941 -- # uname 00:19:38.390 23:11:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:38.390 23:11:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2462533 00:19:38.390 23:11:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:38.390 23:11:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:38.390 23:11:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2462533' 00:19:38.390 killing process with pid 2462533 00:19:38.390 23:11:41 -- common/autotest_common.sh@955 -- # kill 2462533 00:19:38.390 23:11:41 -- common/autotest_common.sh@960 -- # wait 2462533 00:19:38.649 23:11:42 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:38.649 23:11:42 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:38.649 23:11:42 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:38.649 23:11:42 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:38.649 23:11:42 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:38.649 23:11:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:38.649 23:11:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:38.649 23:11:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:41.186 23:11:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:41.186 00:19:41.186 real 0m10.756s 00:19:41.186 user 0m25.417s 00:19:41.186 sys 0m2.578s 00:19:41.186 23:11:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:41.186 23:11:44 -- common/autotest_common.sh@10 -- # set +x 00:19:41.186 ************************************ 00:19:41.186 END TEST nvmf_nmic 00:19:41.186 ************************************ 00:19:41.186 23:11:44 -- nvmf/nvmf.sh@54 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:19:41.186 23:11:44 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:41.186 23:11:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:41.186 23:11:44 -- common/autotest_common.sh@10 -- # set +x 00:19:41.186 ************************************ 00:19:41.186 START TEST nvmf_fio_target 00:19:41.186 ************************************ 00:19:41.186 23:11:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:19:41.186 * Looking for test storage... 00:19:41.186 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:41.186 23:11:44 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:41.186 23:11:44 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:41.186 23:11:44 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:41.186 23:11:44 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:41.186 23:11:44 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:41.186 23:11:44 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:41.186 23:11:44 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:41.186 23:11:44 -- scripts/common.sh@335 -- # IFS=.-: 00:19:41.186 23:11:44 -- scripts/common.sh@335 -- # read -ra ver1 00:19:41.186 23:11:44 -- scripts/common.sh@336 -- # IFS=.-: 00:19:41.186 23:11:44 -- scripts/common.sh@336 -- # read -ra ver2 00:19:41.187 23:11:44 -- scripts/common.sh@337 -- # local 'op=<' 00:19:41.187 23:11:44 -- scripts/common.sh@339 -- # ver1_l=2 00:19:41.187 23:11:44 -- scripts/common.sh@340 -- # ver2_l=1 00:19:41.187 23:11:44 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:41.187 23:11:44 -- scripts/common.sh@343 -- # case "$op" in 00:19:41.187 23:11:44 -- scripts/common.sh@344 -- # : 1 00:19:41.187 23:11:44 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:41.187 23:11:44 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:41.187 23:11:44 -- scripts/common.sh@364 -- # decimal 1 00:19:41.187 23:11:44 -- scripts/common.sh@352 -- # local d=1 00:19:41.187 23:11:44 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:41.187 23:11:44 -- scripts/common.sh@354 -- # echo 1 00:19:41.187 23:11:44 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:41.187 23:11:44 -- scripts/common.sh@365 -- # decimal 2 00:19:41.187 23:11:44 -- scripts/common.sh@352 -- # local d=2 00:19:41.187 23:11:44 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:41.187 23:11:44 -- scripts/common.sh@354 -- # echo 2 00:19:41.187 23:11:44 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:41.187 23:11:44 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:41.187 23:11:44 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:41.187 23:11:44 -- scripts/common.sh@367 -- # return 0 00:19:41.187 23:11:44 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:41.187 23:11:44 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:41.187 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:41.187 --rc genhtml_branch_coverage=1 00:19:41.187 --rc genhtml_function_coverage=1 00:19:41.187 --rc genhtml_legend=1 00:19:41.187 --rc geninfo_all_blocks=1 00:19:41.187 --rc geninfo_unexecuted_blocks=1 00:19:41.187 00:19:41.187 ' 00:19:41.187 23:11:44 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:41.187 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:41.187 --rc genhtml_branch_coverage=1 00:19:41.187 --rc genhtml_function_coverage=1 00:19:41.187 --rc genhtml_legend=1 00:19:41.187 --rc geninfo_all_blocks=1 00:19:41.187 --rc geninfo_unexecuted_blocks=1 00:19:41.187 00:19:41.187 ' 00:19:41.187 23:11:44 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:41.187 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:41.187 --rc genhtml_branch_coverage=1 00:19:41.187 --rc genhtml_function_coverage=1 00:19:41.187 --rc genhtml_legend=1 00:19:41.187 --rc geninfo_all_blocks=1 00:19:41.187 --rc geninfo_unexecuted_blocks=1 00:19:41.187 00:19:41.187 ' 00:19:41.187 23:11:44 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:41.187 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:41.187 --rc genhtml_branch_coverage=1 00:19:41.187 --rc genhtml_function_coverage=1 00:19:41.187 --rc genhtml_legend=1 00:19:41.187 --rc geninfo_all_blocks=1 00:19:41.187 --rc geninfo_unexecuted_blocks=1 00:19:41.187 00:19:41.187 ' 00:19:41.187 23:11:44 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:41.187 23:11:44 -- nvmf/common.sh@7 -- # uname -s 00:19:41.187 23:11:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:41.187 23:11:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:41.187 23:11:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:41.187 23:11:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:41.187 23:11:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:41.187 23:11:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:41.187 23:11:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:41.187 23:11:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:41.187 23:11:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:41.187 23:11:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:41.187 23:11:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:41.187 23:11:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:41.187 23:11:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:41.187 23:11:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:41.187 23:11:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:41.187 23:11:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:41.187 23:11:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:41.187 23:11:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:41.187 23:11:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:41.187 23:11:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:41.187 23:11:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:41.187 23:11:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:41.187 23:11:44 -- paths/export.sh@5 -- # export PATH 00:19:41.187 23:11:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:41.187 23:11:44 -- nvmf/common.sh@46 -- # : 0 00:19:41.187 23:11:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:41.187 23:11:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:41.187 23:11:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:41.187 23:11:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:41.187 23:11:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:41.187 23:11:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:41.187 23:11:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:41.187 23:11:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:41.187 23:11:44 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:41.187 23:11:44 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:41.187 23:11:44 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:19:41.187 23:11:44 -- target/fio.sh@16 -- # nvmftestinit 00:19:41.187 23:11:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:41.187 23:11:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:41.187 23:11:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:41.187 23:11:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:41.187 23:11:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:41.187 23:11:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:41.187 23:11:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:41.187 23:11:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:41.187 23:11:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:41.187 23:11:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:41.187 23:11:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:41.187 23:11:44 -- common/autotest_common.sh@10 -- # set +x 00:19:43.089 23:11:46 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:43.089 23:11:46 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:43.089 23:11:46 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:43.089 23:11:46 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:43.089 23:11:46 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:43.089 23:11:46 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:43.089 23:11:46 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:43.089 23:11:46 -- nvmf/common.sh@294 -- # net_devs=() 00:19:43.089 23:11:46 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:43.089 23:11:46 -- nvmf/common.sh@295 -- # e810=() 00:19:43.089 23:11:46 -- nvmf/common.sh@295 -- # local -ga e810 00:19:43.089 23:11:46 -- nvmf/common.sh@296 -- # x722=() 00:19:43.089 23:11:46 -- nvmf/common.sh@296 -- # local -ga x722 00:19:43.089 23:11:46 -- nvmf/common.sh@297 -- # mlx=() 00:19:43.089 23:11:46 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:43.089 23:11:46 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:43.089 23:11:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:43.089 23:11:46 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:43.089 23:11:46 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:43.089 23:11:46 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:43.089 23:11:46 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:43.089 23:11:46 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:43.089 23:11:46 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:43.089 23:11:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:43.089 23:11:46 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:43.089 23:11:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:43.089 23:11:46 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:43.089 23:11:46 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:43.089 23:11:46 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:43.089 23:11:46 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:43.089 23:11:46 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:43.089 23:11:46 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:43.089 23:11:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:43.089 23:11:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:43.089 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:43.089 23:11:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:43.089 23:11:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:43.089 23:11:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:43.089 23:11:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:43.089 23:11:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:43.089 23:11:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:43.089 23:11:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:43.089 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:43.089 23:11:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:43.089 23:11:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:43.089 23:11:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:43.089 23:11:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:43.089 23:11:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:43.089 23:11:46 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:43.089 23:11:46 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:43.089 23:11:46 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:43.089 23:11:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:43.089 23:11:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:43.089 23:11:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:43.089 23:11:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:43.089 23:11:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:43.089 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:43.089 23:11:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:43.089 23:11:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:43.089 23:11:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:43.089 23:11:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:43.089 23:11:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:43.089 23:11:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:43.089 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:43.089 23:11:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:43.089 23:11:46 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:43.089 23:11:46 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:43.089 23:11:46 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:43.089 23:11:46 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:43.089 23:11:46 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:43.089 23:11:46 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:43.089 23:11:46 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:43.089 23:11:46 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:43.089 23:11:46 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:43.090 23:11:46 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:43.090 23:11:46 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:43.090 23:11:46 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:43.090 23:11:46 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:43.090 23:11:46 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:43.090 23:11:46 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:43.090 23:11:46 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:43.090 23:11:46 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:43.090 23:11:46 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:43.090 23:11:46 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:43.090 23:11:46 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:43.090 23:11:46 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:43.090 23:11:46 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:43.348 23:11:46 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:43.348 23:11:46 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:43.348 23:11:46 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:43.348 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:43.348 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.195 ms 00:19:43.348 00:19:43.348 --- 10.0.0.2 ping statistics --- 00:19:43.348 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:43.348 rtt min/avg/max/mdev = 0.195/0.195/0.195/0.000 ms 00:19:43.348 23:11:46 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:43.348 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:43.348 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.092 ms 00:19:43.348 00:19:43.348 --- 10.0.0.1 ping statistics --- 00:19:43.348 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:43.348 rtt min/avg/max/mdev = 0.092/0.092/0.092/0.000 ms 00:19:43.348 23:11:46 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:43.348 23:11:46 -- nvmf/common.sh@410 -- # return 0 00:19:43.348 23:11:46 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:43.348 23:11:46 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:43.348 23:11:46 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:43.348 23:11:46 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:43.348 23:11:46 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:43.348 23:11:46 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:43.348 23:11:46 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:43.348 23:11:46 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:19:43.348 23:11:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:43.348 23:11:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:43.348 23:11:46 -- common/autotest_common.sh@10 -- # set +x 00:19:43.348 23:11:46 -- nvmf/common.sh@469 -- # nvmfpid=2465289 00:19:43.348 23:11:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:43.348 23:11:46 -- nvmf/common.sh@470 -- # waitforlisten 2465289 00:19:43.349 23:11:46 -- common/autotest_common.sh@829 -- # '[' -z 2465289 ']' 00:19:43.349 23:11:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:43.349 23:11:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:43.349 23:11:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:43.349 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:43.349 23:11:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:43.349 23:11:46 -- common/autotest_common.sh@10 -- # set +x 00:19:43.349 [2024-11-28 23:11:46.791338] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:43.349 [2024-11-28 23:11:46.791411] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:43.349 EAL: No free 2048 kB hugepages reported on node 1 00:19:43.349 [2024-11-28 23:11:46.865140] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:43.607 [2024-11-28 23:11:46.960498] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:43.607 [2024-11-28 23:11:46.960655] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:43.607 [2024-11-28 23:11:46.960675] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:43.607 [2024-11-28 23:11:46.960699] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:43.607 [2024-11-28 23:11:46.960757] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:43.607 [2024-11-28 23:11:46.960822] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:43.607 [2024-11-28 23:11:46.960793] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:43.607 [2024-11-28 23:11:46.960836] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:44.541 23:11:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:44.541 23:11:47 -- common/autotest_common.sh@862 -- # return 0 00:19:44.541 23:11:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:44.541 23:11:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:44.541 23:11:47 -- common/autotest_common.sh@10 -- # set +x 00:19:44.541 23:11:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:44.541 23:11:47 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:19:44.541 [2024-11-28 23:11:48.134279] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:44.798 23:11:48 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:45.056 23:11:48 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:19:45.056 23:11:48 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:45.315 23:11:48 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:19:45.315 23:11:48 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:45.573 23:11:48 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:19:45.573 23:11:48 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:45.831 23:11:49 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:19:45.831 23:11:49 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:19:46.089 23:11:49 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:46.347 23:11:49 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:19:46.347 23:11:49 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:46.604 23:11:50 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:19:46.604 23:11:50 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:46.861 23:11:50 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:19:46.861 23:11:50 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:19:47.118 23:11:50 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:19:47.375 23:11:50 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:19:47.375 23:11:50 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:47.632 23:11:51 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:19:47.632 23:11:51 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:19:47.890 23:11:51 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:48.147 [2024-11-28 23:11:51.555080] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:48.147 23:11:51 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:19:48.404 23:11:51 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:19:48.661 23:11:52 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:49.226 23:11:52 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:19:49.226 23:11:52 -- common/autotest_common.sh@1187 -- # local i=0 00:19:49.226 23:11:52 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:49.226 23:11:52 -- common/autotest_common.sh@1189 -- # [[ -n 4 ]] 00:19:49.226 23:11:52 -- common/autotest_common.sh@1190 -- # nvme_device_counter=4 00:19:49.226 23:11:52 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:51.122 23:11:54 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:51.122 23:11:54 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:51.122 23:11:54 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:19:51.122 23:11:54 -- common/autotest_common.sh@1196 -- # nvme_devices=4 00:19:51.122 23:11:54 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:51.122 23:11:54 -- common/autotest_common.sh@1197 -- # return 0 00:19:51.122 23:11:54 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:19:51.122 [global] 00:19:51.122 thread=1 00:19:51.122 invalidate=1 00:19:51.122 rw=write 00:19:51.122 time_based=1 00:19:51.122 runtime=1 00:19:51.122 ioengine=libaio 00:19:51.122 direct=1 00:19:51.122 bs=4096 00:19:51.122 iodepth=1 00:19:51.122 norandommap=0 00:19:51.122 numjobs=1 00:19:51.122 00:19:51.122 verify_dump=1 00:19:51.122 verify_backlog=512 00:19:51.122 verify_state_save=0 00:19:51.122 do_verify=1 00:19:51.122 verify=crc32c-intel 00:19:51.122 [job0] 00:19:51.122 filename=/dev/nvme0n1 00:19:51.122 [job1] 00:19:51.122 filename=/dev/nvme0n2 00:19:51.122 [job2] 00:19:51.122 filename=/dev/nvme0n3 00:19:51.122 [job3] 00:19:51.122 filename=/dev/nvme0n4 00:19:51.380 Could not set queue depth (nvme0n1) 00:19:51.380 Could not set queue depth (nvme0n2) 00:19:51.380 Could not set queue depth (nvme0n3) 00:19:51.380 Could not set queue depth (nvme0n4) 00:19:51.380 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:51.380 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:51.380 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:51.380 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:51.380 fio-3.35 00:19:51.380 Starting 4 threads 00:19:52.753 00:19:52.753 job0: (groupid=0, jobs=1): err= 0: pid=2466400: Thu Nov 28 23:11:56 2024 00:19:52.753 read: IOPS=1927, BW=7708KiB/s (7893kB/s)(7716KiB/1001msec) 00:19:52.753 slat (nsec): min=5798, max=59508, avg=11294.86, stdev=6633.13 00:19:52.753 clat (usec): min=195, max=625, avg=282.49, stdev=68.80 00:19:52.753 lat (usec): min=202, max=646, avg=293.79, stdev=72.07 00:19:52.753 clat percentiles (usec): 00:19:52.753 | 1.00th=[ 208], 5.00th=[ 227], 10.00th=[ 231], 20.00th=[ 239], 00:19:52.753 | 30.00th=[ 245], 40.00th=[ 251], 50.00th=[ 258], 60.00th=[ 265], 00:19:52.753 | 70.00th=[ 289], 80.00th=[ 318], 90.00th=[ 371], 95.00th=[ 424], 00:19:52.753 | 99.00th=[ 578], 99.50th=[ 586], 99.90th=[ 627], 99.95th=[ 627], 00:19:52.753 | 99.99th=[ 627] 00:19:52.753 write: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec); 0 zone resets 00:19:52.753 slat (usec): min=7, max=1093, avg=12.74, stdev=24.75 00:19:52.753 clat (usec): min=125, max=472, avg=192.25, stdev=42.04 00:19:52.753 lat (usec): min=132, max=1273, avg=204.99, stdev=49.50 00:19:52.753 clat percentiles (usec): 00:19:52.753 | 1.00th=[ 133], 5.00th=[ 139], 10.00th=[ 147], 20.00th=[ 159], 00:19:52.753 | 30.00th=[ 169], 40.00th=[ 176], 50.00th=[ 184], 60.00th=[ 192], 00:19:52.753 | 70.00th=[ 208], 80.00th=[ 227], 90.00th=[ 247], 95.00th=[ 260], 00:19:52.753 | 99.00th=[ 338], 99.50th=[ 367], 99.90th=[ 433], 99.95th=[ 445], 00:19:52.753 | 99.99th=[ 474] 00:19:52.753 bw ( KiB/s): min= 8192, max= 8192, per=33.01%, avg=8192.00, stdev= 0.00, samples=1 00:19:52.753 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:19:52.753 lat (usec) : 250=66.51%, 500=32.41%, 750=1.08% 00:19:52.753 cpu : usr=3.60%, sys=6.10%, ctx=3982, majf=0, minf=1 00:19:52.753 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:52.753 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:52.753 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:52.753 issued rwts: total=1929,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:52.753 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:52.753 job1: (groupid=0, jobs=1): err= 0: pid=2466401: Thu Nov 28 23:11:56 2024 00:19:52.753 read: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec) 00:19:52.753 slat (nsec): min=5485, max=38715, avg=10727.47, stdev=5844.90 00:19:52.753 clat (usec): min=195, max=925, avg=253.05, stdev=29.74 00:19:52.753 lat (usec): min=201, max=940, avg=263.78, stdev=32.03 00:19:52.753 clat percentiles (usec): 00:19:52.753 | 1.00th=[ 208], 5.00th=[ 217], 10.00th=[ 223], 20.00th=[ 229], 00:19:52.753 | 30.00th=[ 237], 40.00th=[ 243], 50.00th=[ 251], 60.00th=[ 260], 00:19:52.753 | 70.00th=[ 265], 80.00th=[ 273], 90.00th=[ 285], 95.00th=[ 297], 00:19:52.753 | 99.00th=[ 322], 99.50th=[ 330], 99.90th=[ 388], 99.95th=[ 408], 00:19:52.753 | 99.99th=[ 922] 00:19:52.753 write: IOPS=2323, BW=9295KiB/s (9518kB/s)(9304KiB/1001msec); 0 zone resets 00:19:52.753 slat (nsec): min=6088, max=49108, avg=11630.75, stdev=6207.95 00:19:52.753 clat (usec): min=138, max=634, avg=179.63, stdev=27.92 00:19:52.753 lat (usec): min=146, max=641, avg=191.27, stdev=29.94 00:19:52.753 clat percentiles (usec): 00:19:52.753 | 1.00th=[ 143], 5.00th=[ 149], 10.00th=[ 153], 20.00th=[ 159], 00:19:52.753 | 30.00th=[ 163], 40.00th=[ 169], 50.00th=[ 176], 60.00th=[ 182], 00:19:52.753 | 70.00th=[ 188], 80.00th=[ 196], 90.00th=[ 210], 95.00th=[ 231], 00:19:52.753 | 99.00th=[ 258], 99.50th=[ 277], 99.90th=[ 400], 99.95th=[ 412], 00:19:52.753 | 99.99th=[ 635] 00:19:52.753 bw ( KiB/s): min= 8192, max= 8192, per=33.01%, avg=8192.00, stdev= 0.00, samples=1 00:19:52.753 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:19:52.753 lat (usec) : 250=74.67%, 500=25.29%, 750=0.02%, 1000=0.02% 00:19:52.753 cpu : usr=3.50%, sys=6.80%, ctx=4375, majf=0, minf=2 00:19:52.753 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:52.753 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:52.753 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:52.753 issued rwts: total=2048,2326,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:52.753 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:52.753 job2: (groupid=0, jobs=1): err= 0: pid=2466403: Thu Nov 28 23:11:56 2024 00:19:52.753 read: IOPS=649, BW=2597KiB/s (2659kB/s)(2688KiB/1035msec) 00:19:52.753 slat (nsec): min=5164, max=57160, avg=20330.15, stdev=10942.62 00:19:52.753 clat (usec): min=199, max=42000, avg=1167.69, stdev=5626.83 00:19:52.753 lat (usec): min=207, max=42014, avg=1188.02, stdev=5625.94 00:19:52.753 clat percentiles (usec): 00:19:52.753 | 1.00th=[ 225], 5.00th=[ 241], 10.00th=[ 269], 20.00th=[ 285], 00:19:52.753 | 30.00th=[ 302], 40.00th=[ 343], 50.00th=[ 392], 60.00th=[ 412], 00:19:52.753 | 70.00th=[ 441], 80.00th=[ 474], 90.00th=[ 515], 95.00th=[ 553], 00:19:52.753 | 99.00th=[41157], 99.50th=[41157], 99.90th=[42206], 99.95th=[42206], 00:19:52.753 | 99.99th=[42206] 00:19:52.753 write: IOPS=989, BW=3957KiB/s (4052kB/s)(4096KiB/1035msec); 0 zone resets 00:19:52.753 slat (nsec): min=6355, max=45447, avg=12892.08, stdev=6258.79 00:19:52.753 clat (usec): min=146, max=431, avg=210.94, stdev=32.02 00:19:52.753 lat (usec): min=159, max=449, avg=223.83, stdev=31.25 00:19:52.753 clat percentiles (usec): 00:19:52.753 | 1.00th=[ 159], 5.00th=[ 167], 10.00th=[ 176], 20.00th=[ 186], 00:19:52.753 | 30.00th=[ 192], 40.00th=[ 202], 50.00th=[ 210], 60.00th=[ 217], 00:19:52.753 | 70.00th=[ 223], 80.00th=[ 233], 90.00th=[ 247], 95.00th=[ 260], 00:19:52.753 | 99.00th=[ 302], 99.50th=[ 375], 99.90th=[ 420], 99.95th=[ 433], 00:19:52.753 | 99.99th=[ 433] 00:19:52.753 bw ( KiB/s): min= 8192, max= 8192, per=33.01%, avg=8192.00, stdev= 0.00, samples=1 00:19:52.753 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:19:52.753 lat (usec) : 250=58.49%, 500=36.67%, 750=4.07% 00:19:52.753 lat (msec) : 50=0.77% 00:19:52.753 cpu : usr=1.35%, sys=2.61%, ctx=1696, majf=0, minf=2 00:19:52.753 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:52.753 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:52.753 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:52.753 issued rwts: total=672,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:52.753 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:52.753 job3: (groupid=0, jobs=1): err= 0: pid=2466404: Thu Nov 28 23:11:56 2024 00:19:52.753 read: IOPS=914, BW=3657KiB/s (3744kB/s)(3664KiB/1002msec) 00:19:52.753 slat (nsec): min=4943, max=35447, avg=7410.82, stdev=3477.23 00:19:52.753 clat (usec): min=203, max=42003, avg=830.49, stdev=4694.13 00:19:52.753 lat (usec): min=209, max=42010, avg=837.90, stdev=4694.89 00:19:52.753 clat percentiles (usec): 00:19:52.753 | 1.00th=[ 210], 5.00th=[ 217], 10.00th=[ 221], 20.00th=[ 227], 00:19:52.753 | 30.00th=[ 231], 40.00th=[ 235], 50.00th=[ 239], 60.00th=[ 241], 00:19:52.753 | 70.00th=[ 247], 80.00th=[ 269], 90.00th=[ 519], 95.00th=[ 537], 00:19:52.753 | 99.00th=[41157], 99.50th=[41681], 99.90th=[42206], 99.95th=[42206], 00:19:52.753 | 99.99th=[42206] 00:19:52.753 write: IOPS=1021, BW=4088KiB/s (4186kB/s)(4096KiB/1002msec); 0 zone resets 00:19:52.753 slat (nsec): min=6576, max=46505, avg=10658.44, stdev=5856.28 00:19:52.753 clat (usec): min=143, max=408, avg=211.01, stdev=42.47 00:19:52.753 lat (usec): min=151, max=419, avg=221.67, stdev=44.62 00:19:52.753 clat percentiles (usec): 00:19:52.753 | 1.00th=[ 157], 5.00th=[ 163], 10.00th=[ 165], 20.00th=[ 172], 00:19:52.753 | 30.00th=[ 180], 40.00th=[ 188], 50.00th=[ 200], 60.00th=[ 223], 00:19:52.753 | 70.00th=[ 239], 80.00th=[ 245], 90.00th=[ 260], 95.00th=[ 289], 00:19:52.753 | 99.00th=[ 334], 99.50th=[ 359], 99.90th=[ 400], 99.95th=[ 408], 00:19:52.753 | 99.99th=[ 408] 00:19:52.753 bw ( KiB/s): min= 4096, max= 4096, per=16.50%, avg=4096.00, stdev= 0.00, samples=2 00:19:52.753 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=2 00:19:52.753 lat (usec) : 250=78.61%, 500=15.88%, 750=4.79%, 1000=0.05% 00:19:52.753 lat (msec) : 20=0.05%, 50=0.62% 00:19:52.753 cpu : usr=1.30%, sys=1.50%, ctx=1944, majf=0, minf=1 00:19:52.753 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:52.753 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:52.753 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:52.753 issued rwts: total=916,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:52.753 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:52.753 00:19:52.753 Run status group 0 (all jobs): 00:19:52.753 READ: bw=21.0MiB/s (22.0MB/s), 2597KiB/s-8184KiB/s (2659kB/s-8380kB/s), io=21.7MiB (22.8MB), run=1001-1035msec 00:19:52.753 WRITE: bw=24.2MiB/s (25.4MB/s), 3957KiB/s-9295KiB/s (4052kB/s-9518kB/s), io=25.1MiB (26.3MB), run=1001-1035msec 00:19:52.753 00:19:52.753 Disk stats (read/write): 00:19:52.753 nvme0n1: ios=1583/1788, merge=0/0, ticks=620/339, in_queue=959, util=98.40% 00:19:52.753 nvme0n2: ios=1646/2048, merge=0/0, ticks=758/344, in_queue=1102, util=91.05% 00:19:52.753 nvme0n3: ios=666/1024, merge=0/0, ticks=573/208, in_queue=781, util=88.91% 00:19:52.753 nvme0n4: ios=569/736, merge=0/0, ticks=1432/160, in_queue=1592, util=97.79% 00:19:52.753 23:11:56 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:19:52.753 [global] 00:19:52.753 thread=1 00:19:52.753 invalidate=1 00:19:52.753 rw=randwrite 00:19:52.753 time_based=1 00:19:52.753 runtime=1 00:19:52.753 ioengine=libaio 00:19:52.753 direct=1 00:19:52.753 bs=4096 00:19:52.753 iodepth=1 00:19:52.753 norandommap=0 00:19:52.754 numjobs=1 00:19:52.754 00:19:52.754 verify_dump=1 00:19:52.754 verify_backlog=512 00:19:52.754 verify_state_save=0 00:19:52.754 do_verify=1 00:19:52.754 verify=crc32c-intel 00:19:52.754 [job0] 00:19:52.754 filename=/dev/nvme0n1 00:19:52.754 [job1] 00:19:52.754 filename=/dev/nvme0n2 00:19:52.754 [job2] 00:19:52.754 filename=/dev/nvme0n3 00:19:52.754 [job3] 00:19:52.754 filename=/dev/nvme0n4 00:19:52.754 Could not set queue depth (nvme0n1) 00:19:52.754 Could not set queue depth (nvme0n2) 00:19:52.754 Could not set queue depth (nvme0n3) 00:19:52.754 Could not set queue depth (nvme0n4) 00:19:53.011 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:53.011 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:53.011 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:53.011 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:53.011 fio-3.35 00:19:53.011 Starting 4 threads 00:19:54.385 00:19:54.385 job0: (groupid=0, jobs=1): err= 0: pid=2466760: Thu Nov 28 23:11:57 2024 00:19:54.385 read: IOPS=1027, BW=4112KiB/s (4210kB/s)(4124KiB/1003msec) 00:19:54.385 slat (nsec): min=4892, max=52415, avg=17295.37, stdev=8283.75 00:19:54.385 clat (usec): min=166, max=41018, avg=593.59, stdev=3337.22 00:19:54.385 lat (usec): min=171, max=41031, avg=610.88, stdev=3336.97 00:19:54.385 clat percentiles (usec): 00:19:54.385 | 1.00th=[ 176], 5.00th=[ 184], 10.00th=[ 190], 20.00th=[ 210], 00:19:54.385 | 30.00th=[ 237], 40.00th=[ 245], 50.00th=[ 253], 60.00th=[ 269], 00:19:54.385 | 70.00th=[ 379], 80.00th=[ 461], 90.00th=[ 570], 95.00th=[ 586], 00:19:54.385 | 99.00th=[ 619], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:54.385 | 99.99th=[41157] 00:19:54.385 write: IOPS=1531, BW=6126KiB/s (6273kB/s)(6144KiB/1003msec); 0 zone resets 00:19:54.385 slat (nsec): min=6829, max=76187, avg=16858.45, stdev=7408.29 00:19:54.385 clat (usec): min=138, max=1014, avg=217.62, stdev=52.08 00:19:54.385 lat (usec): min=146, max=1022, avg=234.48, stdev=54.30 00:19:54.385 clat percentiles (usec): 00:19:54.385 | 1.00th=[ 145], 5.00th=[ 153], 10.00th=[ 161], 20.00th=[ 184], 00:19:54.385 | 30.00th=[ 194], 40.00th=[ 202], 50.00th=[ 210], 60.00th=[ 223], 00:19:54.385 | 70.00th=[ 237], 80.00th=[ 253], 90.00th=[ 269], 95.00th=[ 285], 00:19:54.385 | 99.00th=[ 388], 99.50th=[ 445], 99.90th=[ 750], 99.95th=[ 1012], 00:19:54.385 | 99.99th=[ 1012] 00:19:54.385 bw ( KiB/s): min= 4096, max= 8192, per=30.93%, avg=6144.00, stdev=2896.31, samples=2 00:19:54.385 iops : min= 1024, max= 2048, avg=1536.00, stdev=724.08, samples=2 00:19:54.385 lat (usec) : 250=65.80%, 500=27.46%, 750=6.35%, 1000=0.08% 00:19:54.385 lat (msec) : 2=0.04%, 50=0.27% 00:19:54.385 cpu : usr=3.49%, sys=5.69%, ctx=2567, majf=0, minf=1 00:19:54.385 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:54.385 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:54.385 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:54.385 issued rwts: total=1031,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:54.385 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:54.385 job1: (groupid=0, jobs=1): err= 0: pid=2466761: Thu Nov 28 23:11:57 2024 00:19:54.385 read: IOPS=1025, BW=4103KiB/s (4202kB/s)(4132KiB/1007msec) 00:19:54.385 slat (nsec): min=7216, max=51944, avg=18442.30, stdev=2959.86 00:19:54.385 clat (usec): min=205, max=42009, avg=626.33, stdev=3810.68 00:19:54.385 lat (usec): min=215, max=42024, avg=644.78, stdev=3810.21 00:19:54.385 clat percentiles (usec): 00:19:54.385 | 1.00th=[ 227], 5.00th=[ 235], 10.00th=[ 239], 20.00th=[ 245], 00:19:54.385 | 30.00th=[ 247], 40.00th=[ 251], 50.00th=[ 255], 60.00th=[ 260], 00:19:54.385 | 70.00th=[ 269], 80.00th=[ 277], 90.00th=[ 318], 95.00th=[ 392], 00:19:54.385 | 99.00th=[ 529], 99.50th=[41157], 99.90th=[42206], 99.95th=[42206], 00:19:54.385 | 99.99th=[42206] 00:19:54.385 write: IOPS=1525, BW=6101KiB/s (6248kB/s)(6144KiB/1007msec); 0 zone resets 00:19:54.385 slat (nsec): min=7121, max=59595, avg=19248.89, stdev=7015.83 00:19:54.385 clat (usec): min=132, max=824, avg=193.26, stdev=37.84 00:19:54.385 lat (usec): min=140, max=835, avg=212.51, stdev=39.91 00:19:54.385 clat percentiles (usec): 00:19:54.385 | 1.00th=[ 139], 5.00th=[ 145], 10.00th=[ 151], 20.00th=[ 167], 00:19:54.385 | 30.00th=[ 176], 40.00th=[ 182], 50.00th=[ 188], 60.00th=[ 194], 00:19:54.385 | 70.00th=[ 204], 80.00th=[ 221], 90.00th=[ 239], 95.00th=[ 258], 00:19:54.385 | 99.00th=[ 281], 99.50th=[ 330], 99.90th=[ 392], 99.95th=[ 824], 00:19:54.385 | 99.99th=[ 824] 00:19:54.385 bw ( KiB/s): min= 4096, max= 8192, per=30.93%, avg=6144.00, stdev=2896.31, samples=2 00:19:54.385 iops : min= 1024, max= 2048, avg=1536.00, stdev=724.08, samples=2 00:19:54.385 lat (usec) : 250=70.34%, 500=29.19%, 750=0.04%, 1000=0.04% 00:19:54.385 lat (msec) : 2=0.04%, 50=0.35% 00:19:54.385 cpu : usr=3.48%, sys=6.56%, ctx=2570, majf=0, minf=1 00:19:54.385 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:54.385 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:54.385 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:54.386 issued rwts: total=1033,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:54.386 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:54.386 job2: (groupid=0, jobs=1): err= 0: pid=2466762: Thu Nov 28 23:11:57 2024 00:19:54.386 read: IOPS=20, BW=82.8KiB/s (84.8kB/s)(84.0KiB/1014msec) 00:19:54.386 slat (nsec): min=13208, max=38855, avg=26251.24, stdev=10918.22 00:19:54.386 clat (usec): min=40818, max=42008, avg=41304.69, stdev=498.95 00:19:54.386 lat (usec): min=40855, max=42023, avg=41330.94, stdev=490.58 00:19:54.386 clat percentiles (usec): 00:19:54.386 | 1.00th=[40633], 5.00th=[40633], 10.00th=[40633], 20.00th=[41157], 00:19:54.386 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:19:54.386 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:19:54.386 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:54.386 | 99.99th=[42206] 00:19:54.386 write: IOPS=504, BW=2020KiB/s (2068kB/s)(2048KiB/1014msec); 0 zone resets 00:19:54.386 slat (nsec): min=8634, max=45010, avg=22366.01, stdev=6995.75 00:19:54.386 clat (usec): min=204, max=437, avg=256.72, stdev=31.25 00:19:54.386 lat (usec): min=217, max=466, avg=279.08, stdev=30.52 00:19:54.386 clat percentiles (usec): 00:19:54.386 | 1.00th=[ 210], 5.00th=[ 225], 10.00th=[ 231], 20.00th=[ 237], 00:19:54.386 | 30.00th=[ 241], 40.00th=[ 247], 50.00th=[ 251], 60.00th=[ 255], 00:19:54.386 | 70.00th=[ 262], 80.00th=[ 269], 90.00th=[ 285], 95.00th=[ 326], 00:19:54.386 | 99.00th=[ 392], 99.50th=[ 420], 99.90th=[ 437], 99.95th=[ 437], 00:19:54.386 | 99.99th=[ 437] 00:19:54.386 bw ( KiB/s): min= 4096, max= 4096, per=20.62%, avg=4096.00, stdev= 0.00, samples=1 00:19:54.386 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:54.386 lat (usec) : 250=46.15%, 500=49.91% 00:19:54.386 lat (msec) : 50=3.94% 00:19:54.386 cpu : usr=0.39%, sys=1.78%, ctx=534, majf=0, minf=1 00:19:54.386 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:54.386 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:54.386 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:54.386 issued rwts: total=21,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:54.386 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:54.386 job3: (groupid=0, jobs=1): err= 0: pid=2466763: Thu Nov 28 23:11:57 2024 00:19:54.386 read: IOPS=1140, BW=4563KiB/s (4672kB/s)(4704KiB/1031msec) 00:19:54.386 slat (nsec): min=5500, max=54250, avg=14452.02, stdev=6253.22 00:19:54.386 clat (usec): min=202, max=41986, avg=578.13, stdev=3553.72 00:19:54.386 lat (usec): min=209, max=41998, avg=592.58, stdev=3553.66 00:19:54.386 clat percentiles (usec): 00:19:54.386 | 1.00th=[ 215], 5.00th=[ 225], 10.00th=[ 235], 20.00th=[ 245], 00:19:54.386 | 30.00th=[ 251], 40.00th=[ 258], 50.00th=[ 262], 60.00th=[ 269], 00:19:54.386 | 70.00th=[ 273], 80.00th=[ 281], 90.00th=[ 297], 95.00th=[ 343], 00:19:54.386 | 99.00th=[ 400], 99.50th=[41157], 99.90th=[41157], 99.95th=[42206], 00:19:54.386 | 99.99th=[42206] 00:19:54.386 write: IOPS=1489, BW=5959KiB/s (6102kB/s)(6144KiB/1031msec); 0 zone resets 00:19:54.386 slat (nsec): min=6323, max=38831, avg=14202.27, stdev=5094.29 00:19:54.386 clat (usec): min=146, max=403, avg=196.21, stdev=28.71 00:19:54.386 lat (usec): min=153, max=428, avg=210.41, stdev=30.81 00:19:54.386 clat percentiles (usec): 00:19:54.386 | 1.00th=[ 155], 5.00th=[ 159], 10.00th=[ 165], 20.00th=[ 174], 00:19:54.386 | 30.00th=[ 182], 40.00th=[ 186], 50.00th=[ 194], 60.00th=[ 200], 00:19:54.386 | 70.00th=[ 206], 80.00th=[ 215], 90.00th=[ 231], 95.00th=[ 245], 00:19:54.386 | 99.00th=[ 293], 99.50th=[ 326], 99.90th=[ 379], 99.95th=[ 404], 00:19:54.386 | 99.99th=[ 404] 00:19:54.386 bw ( KiB/s): min= 4096, max= 8192, per=30.93%, avg=6144.00, stdev=2896.31, samples=2 00:19:54.386 iops : min= 1024, max= 2048, avg=1536.00, stdev=724.08, samples=2 00:19:54.386 lat (usec) : 250=66.89%, 500=32.74% 00:19:54.386 lat (msec) : 2=0.04%, 50=0.33% 00:19:54.386 cpu : usr=2.23%, sys=4.17%, ctx=2712, majf=0, minf=2 00:19:54.386 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:54.386 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:54.386 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:54.386 issued rwts: total=1176,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:54.386 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:54.386 00:19:54.386 Run status group 0 (all jobs): 00:19:54.386 READ: bw=12.4MiB/s (13.0MB/s), 82.8KiB/s-4563KiB/s (84.8kB/s-4672kB/s), io=12.7MiB (13.4MB), run=1003-1031msec 00:19:54.386 WRITE: bw=19.4MiB/s (20.3MB/s), 2020KiB/s-6126KiB/s (2068kB/s-6273kB/s), io=20.0MiB (21.0MB), run=1003-1031msec 00:19:54.386 00:19:54.386 Disk stats (read/write): 00:19:54.386 nvme0n1: ios=1077/1536, merge=0/0, ticks=465/314, in_queue=779, util=87.78% 00:19:54.386 nvme0n2: ios=1073/1536, merge=0/0, ticks=1200/285, in_queue=1485, util=98.48% 00:19:54.386 nvme0n3: ios=67/512, merge=0/0, ticks=1548/122, in_queue=1670, util=98.34% 00:19:54.386 nvme0n4: ios=1226/1536, merge=0/0, ticks=496/282, in_queue=778, util=91.09% 00:19:54.386 23:11:57 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:19:54.386 [global] 00:19:54.386 thread=1 00:19:54.386 invalidate=1 00:19:54.386 rw=write 00:19:54.386 time_based=1 00:19:54.386 runtime=1 00:19:54.386 ioengine=libaio 00:19:54.386 direct=1 00:19:54.386 bs=4096 00:19:54.386 iodepth=128 00:19:54.386 norandommap=0 00:19:54.386 numjobs=1 00:19:54.386 00:19:54.386 verify_dump=1 00:19:54.386 verify_backlog=512 00:19:54.386 verify_state_save=0 00:19:54.386 do_verify=1 00:19:54.386 verify=crc32c-intel 00:19:54.386 [job0] 00:19:54.386 filename=/dev/nvme0n1 00:19:54.386 [job1] 00:19:54.386 filename=/dev/nvme0n2 00:19:54.386 [job2] 00:19:54.386 filename=/dev/nvme0n3 00:19:54.386 [job3] 00:19:54.386 filename=/dev/nvme0n4 00:19:54.386 Could not set queue depth (nvme0n1) 00:19:54.386 Could not set queue depth (nvme0n2) 00:19:54.386 Could not set queue depth (nvme0n3) 00:19:54.386 Could not set queue depth (nvme0n4) 00:19:54.386 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:54.386 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:54.386 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:54.386 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:54.386 fio-3.35 00:19:54.386 Starting 4 threads 00:19:55.760 00:19:55.760 job0: (groupid=0, jobs=1): err= 0: pid=2466993: Thu Nov 28 23:11:59 2024 00:19:55.760 read: IOPS=5099, BW=19.9MiB/s (20.9MB/s)(20.0MiB/1004msec) 00:19:55.760 slat (usec): min=2, max=12337, avg=98.24, stdev=727.58 00:19:55.760 clat (usec): min=3112, max=71439, avg=12595.37, stdev=10052.05 00:19:55.760 lat (usec): min=3118, max=71463, avg=12693.61, stdev=10129.79 00:19:55.760 clat percentiles (usec): 00:19:55.760 | 1.00th=[ 6063], 5.00th=[ 6718], 10.00th=[ 7963], 20.00th=[ 8979], 00:19:55.760 | 30.00th=[ 9372], 40.00th=[ 9634], 50.00th=[ 9896], 60.00th=[10290], 00:19:55.760 | 70.00th=[11207], 80.00th=[12780], 90.00th=[16319], 95.00th=[23987], 00:19:55.760 | 99.00th=[64226], 99.50th=[70779], 99.90th=[71828], 99.95th=[71828], 00:19:55.760 | 99.99th=[71828] 00:19:55.760 write: IOPS=5473, BW=21.4MiB/s (22.4MB/s)(21.5MiB/1004msec); 0 zone resets 00:19:55.760 slat (usec): min=3, max=17688, avg=82.56, stdev=599.98 00:19:55.760 clat (usec): min=393, max=50996, avg=11438.94, stdev=6390.82 00:19:55.760 lat (usec): min=872, max=51007, avg=11521.50, stdev=6428.44 00:19:55.760 clat percentiles (usec): 00:19:55.760 | 1.00th=[ 3556], 5.00th=[ 5669], 10.00th=[ 6718], 20.00th=[ 9241], 00:19:55.760 | 30.00th=[10028], 40.00th=[10159], 50.00th=[10421], 60.00th=[10814], 00:19:55.760 | 70.00th=[10945], 80.00th=[11207], 90.00th=[15401], 95.00th=[21627], 00:19:55.760 | 99.00th=[43779], 99.50th=[51119], 99.90th=[51119], 99.95th=[51119], 00:19:55.760 | 99.99th=[51119] 00:19:55.760 bw ( KiB/s): min=20480, max=22456, per=32.63%, avg=21468.00, stdev=1397.24, samples=2 00:19:55.760 iops : min= 5120, max= 5614, avg=5367.00, stdev=349.31, samples=2 00:19:55.760 lat (usec) : 500=0.01%, 1000=0.03% 00:19:55.760 lat (msec) : 2=0.06%, 4=0.71%, 10=40.98%, 20=52.39%, 50=3.94% 00:19:55.760 lat (msec) : 100=1.89% 00:19:55.760 cpu : usr=4.59%, sys=7.18%, ctx=447, majf=0, minf=2 00:19:55.760 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:19:55.760 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:55.760 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:55.760 issued rwts: total=5120,5495,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:55.760 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:55.760 job1: (groupid=0, jobs=1): err= 0: pid=2466994: Thu Nov 28 23:11:59 2024 00:19:55.760 read: IOPS=3315, BW=12.9MiB/s (13.6MB/s)(13.0MiB/1003msec) 00:19:55.760 slat (usec): min=2, max=11506, avg=137.45, stdev=823.39 00:19:55.760 clat (usec): min=794, max=56865, avg=18153.31, stdev=8989.28 00:19:55.760 lat (usec): min=2603, max=56886, avg=18290.77, stdev=9052.57 00:19:55.760 clat percentiles (usec): 00:19:55.760 | 1.00th=[ 5276], 5.00th=[ 8586], 10.00th=[ 9634], 20.00th=[ 9896], 00:19:55.760 | 30.00th=[11731], 40.00th=[12387], 50.00th=[15795], 60.00th=[19792], 00:19:55.760 | 70.00th=[21890], 80.00th=[26608], 90.00th=[30540], 95.00th=[33424], 00:19:55.760 | 99.00th=[47973], 99.50th=[47973], 99.90th=[51119], 99.95th=[51119], 00:19:55.760 | 99.99th=[56886] 00:19:55.760 write: IOPS=3573, BW=14.0MiB/s (14.6MB/s)(14.0MiB/1003msec); 0 zone resets 00:19:55.760 slat (usec): min=3, max=13146, avg=143.57, stdev=828.47 00:19:55.760 clat (usec): min=5661, max=69989, avg=18565.81, stdev=13481.11 00:19:55.760 lat (usec): min=5673, max=69997, avg=18709.38, stdev=13588.75 00:19:55.760 clat percentiles (usec): 00:19:55.760 | 1.00th=[ 6521], 5.00th=[ 9765], 10.00th=[ 9896], 20.00th=[10290], 00:19:55.760 | 30.00th=[10421], 40.00th=[11076], 50.00th=[12518], 60.00th=[14746], 00:19:55.760 | 70.00th=[17695], 80.00th=[22938], 90.00th=[44303], 95.00th=[50070], 00:19:55.760 | 99.00th=[64750], 99.50th=[64750], 99.90th=[69731], 99.95th=[69731], 00:19:55.760 | 99.99th=[69731] 00:19:55.760 bw ( KiB/s): min=11640, max=17032, per=21.79%, avg=14336.00, stdev=3812.72, samples=2 00:19:55.760 iops : min= 2910, max= 4258, avg=3584.00, stdev=953.18, samples=2 00:19:55.760 lat (usec) : 1000=0.01% 00:19:55.760 lat (msec) : 4=0.33%, 10=17.72%, 20=51.69%, 50=27.49%, 100=2.76% 00:19:55.760 cpu : usr=3.09%, sys=6.69%, ctx=278, majf=0, minf=1 00:19:55.760 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:19:55.760 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:55.760 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:55.760 issued rwts: total=3325,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:55.761 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:55.761 job2: (groupid=0, jobs=1): err= 0: pid=2466995: Thu Nov 28 23:11:59 2024 00:19:55.761 read: IOPS=2542, BW=9.93MiB/s (10.4MB/s)(10.0MiB/1007msec) 00:19:55.761 slat (usec): min=2, max=52246, avg=192.96, stdev=1702.55 00:19:55.761 clat (msec): min=11, max=120, avg=25.39, stdev=20.08 00:19:55.761 lat (msec): min=11, max=120, avg=25.58, stdev=20.19 00:19:55.761 clat percentiles (msec): 00:19:55.761 | 1.00th=[ 13], 5.00th=[ 15], 10.00th=[ 16], 20.00th=[ 16], 00:19:55.761 | 30.00th=[ 17], 40.00th=[ 18], 50.00th=[ 19], 60.00th=[ 20], 00:19:55.761 | 70.00th=[ 23], 80.00th=[ 27], 90.00th=[ 46], 95.00th=[ 63], 00:19:55.761 | 99.00th=[ 112], 99.50th=[ 121], 99.90th=[ 121], 99.95th=[ 121], 00:19:55.761 | 99.99th=[ 121] 00:19:55.761 write: IOPS=2782, BW=10.9MiB/s (11.4MB/s)(10.9MiB/1007msec); 0 zone resets 00:19:55.761 slat (usec): min=3, max=11896, avg=172.60, stdev=1075.27 00:19:55.761 clat (usec): min=6045, max=69615, avg=21789.57, stdev=9971.86 00:19:55.761 lat (usec): min=7550, max=69620, avg=21962.17, stdev=10033.72 00:19:55.761 clat percentiles (usec): 00:19:55.761 | 1.00th=[10814], 5.00th=[13173], 10.00th=[14615], 20.00th=[15795], 00:19:55.761 | 30.00th=[16319], 40.00th=[18220], 50.00th=[18744], 60.00th=[19792], 00:19:55.761 | 70.00th=[21103], 80.00th=[25035], 90.00th=[34341], 95.00th=[36963], 00:19:55.761 | 99.00th=[63177], 99.50th=[63701], 99.90th=[69731], 99.95th=[69731], 00:19:55.761 | 99.99th=[69731] 00:19:55.761 bw ( KiB/s): min= 9112, max=12288, per=16.26%, avg=10700.00, stdev=2245.77, samples=2 00:19:55.761 iops : min= 2278, max= 3072, avg=2675.00, stdev=561.44, samples=2 00:19:55.761 lat (msec) : 10=0.43%, 20=62.16%, 50=32.10%, 100=3.54%, 250=1.77% 00:19:55.761 cpu : usr=3.68%, sys=3.58%, ctx=171, majf=0, minf=1 00:19:55.761 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:19:55.761 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:55.761 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:55.761 issued rwts: total=2560,2802,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:55.761 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:55.761 job3: (groupid=0, jobs=1): err= 0: pid=2466996: Thu Nov 28 23:11:59 2024 00:19:55.761 read: IOPS=4548, BW=17.8MiB/s (18.6MB/s)(18.0MiB/1013msec) 00:19:55.761 slat (usec): min=3, max=11363, avg=99.80, stdev=646.27 00:19:55.761 clat (usec): min=4011, max=34179, avg=12827.50, stdev=3352.79 00:19:55.761 lat (usec): min=4026, max=34187, avg=12927.30, stdev=3396.15 00:19:55.761 clat percentiles (usec): 00:19:55.761 | 1.00th=[ 7570], 5.00th=[ 9634], 10.00th=[10159], 20.00th=[10683], 00:19:55.761 | 30.00th=[11469], 40.00th=[11863], 50.00th=[12125], 60.00th=[12387], 00:19:55.761 | 70.00th=[12911], 80.00th=[13829], 90.00th=[16319], 95.00th=[20579], 00:19:55.761 | 99.00th=[24511], 99.50th=[28443], 99.90th=[34341], 99.95th=[34341], 00:19:55.761 | 99.99th=[34341] 00:19:55.761 write: IOPS=4720, BW=18.4MiB/s (19.3MB/s)(18.7MiB/1013msec); 0 zone resets 00:19:55.761 slat (usec): min=4, max=8544, avg=103.49, stdev=602.35 00:19:55.761 clat (usec): min=3608, max=43796, avg=14450.67, stdev=7176.48 00:19:55.761 lat (usec): min=3630, max=43803, avg=14554.15, stdev=7225.13 00:19:55.761 clat percentiles (usec): 00:19:55.761 | 1.00th=[ 5014], 5.00th=[ 7504], 10.00th=[ 9241], 20.00th=[10421], 00:19:55.761 | 30.00th=[11600], 40.00th=[12125], 50.00th=[12518], 60.00th=[13042], 00:19:55.761 | 70.00th=[13304], 80.00th=[13829], 90.00th=[26084], 95.00th=[32375], 00:19:55.761 | 99.00th=[40109], 99.50th=[40109], 99.90th=[43779], 99.95th=[43779], 00:19:55.761 | 99.99th=[43779] 00:19:55.761 bw ( KiB/s): min=16760, max=20480, per=28.30%, avg=18620.00, stdev=2630.44, samples=2 00:19:55.761 iops : min= 4190, max= 5120, avg=4655.00, stdev=657.61, samples=2 00:19:55.761 lat (msec) : 4=0.26%, 10=10.68%, 20=78.41%, 50=10.65% 00:19:55.761 cpu : usr=5.43%, sys=9.68%, ctx=365, majf=0, minf=1 00:19:55.761 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:19:55.761 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:55.761 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:55.761 issued rwts: total=4608,4782,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:55.761 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:55.761 00:19:55.761 Run status group 0 (all jobs): 00:19:55.761 READ: bw=60.2MiB/s (63.1MB/s), 9.93MiB/s-19.9MiB/s (10.4MB/s-20.9MB/s), io=61.0MiB (63.9MB), run=1003-1013msec 00:19:55.761 WRITE: bw=64.3MiB/s (67.4MB/s), 10.9MiB/s-21.4MiB/s (11.4MB/s-22.4MB/s), io=65.1MiB (68.3MB), run=1003-1013msec 00:19:55.761 00:19:55.761 Disk stats (read/write): 00:19:55.761 nvme0n1: ios=4274/4608, merge=0/0, ticks=41665/40075, in_queue=81740, util=98.30% 00:19:55.761 nvme0n2: ios=2579/2678, merge=0/0, ticks=25091/27124, in_queue=52215, util=91.07% 00:19:55.761 nvme0n3: ios=2142/2560, merge=0/0, ticks=25100/20489, in_queue=45589, util=99.58% 00:19:55.761 nvme0n4: ios=4148/4255, merge=0/0, ticks=30707/30786, in_queue=61493, util=100.00% 00:19:55.761 23:11:59 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:19:55.761 [global] 00:19:55.761 thread=1 00:19:55.761 invalidate=1 00:19:55.761 rw=randwrite 00:19:55.761 time_based=1 00:19:55.761 runtime=1 00:19:55.761 ioengine=libaio 00:19:55.761 direct=1 00:19:55.761 bs=4096 00:19:55.761 iodepth=128 00:19:55.761 norandommap=0 00:19:55.761 numjobs=1 00:19:55.761 00:19:55.761 verify_dump=1 00:19:55.761 verify_backlog=512 00:19:55.761 verify_state_save=0 00:19:55.761 do_verify=1 00:19:55.761 verify=crc32c-intel 00:19:55.761 [job0] 00:19:55.761 filename=/dev/nvme0n1 00:19:55.761 [job1] 00:19:55.761 filename=/dev/nvme0n2 00:19:55.761 [job2] 00:19:55.761 filename=/dev/nvme0n3 00:19:55.761 [job3] 00:19:55.761 filename=/dev/nvme0n4 00:19:55.761 Could not set queue depth (nvme0n1) 00:19:55.761 Could not set queue depth (nvme0n2) 00:19:55.761 Could not set queue depth (nvme0n3) 00:19:55.761 Could not set queue depth (nvme0n4) 00:19:55.761 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:55.761 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:55.761 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:55.761 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:55.761 fio-3.35 00:19:55.761 Starting 4 threads 00:19:57.136 00:19:57.136 job0: (groupid=0, jobs=1): err= 0: pid=2467230: Thu Nov 28 23:12:00 2024 00:19:57.136 read: IOPS=4724, BW=18.5MiB/s (19.4MB/s)(18.6MiB/1006msec) 00:19:57.136 slat (usec): min=2, max=18125, avg=92.40, stdev=746.61 00:19:57.136 clat (usec): min=2738, max=50981, avg=12088.42, stdev=4987.38 00:19:57.136 lat (usec): min=2743, max=50997, avg=12180.82, stdev=5047.99 00:19:57.136 clat percentiles (usec): 00:19:57.136 | 1.00th=[ 4686], 5.00th=[ 6849], 10.00th=[ 7767], 20.00th=[ 9241], 00:19:57.136 | 30.00th=[ 9634], 40.00th=[10028], 50.00th=[10552], 60.00th=[11469], 00:19:57.136 | 70.00th=[12780], 80.00th=[15270], 90.00th=[17695], 95.00th=[18220], 00:19:57.136 | 99.00th=[35390], 99.50th=[38536], 99.90th=[38536], 99.95th=[38536], 00:19:57.136 | 99.99th=[51119] 00:19:57.136 write: IOPS=5089, BW=19.9MiB/s (20.8MB/s)(20.0MiB/1006msec); 0 zone resets 00:19:57.136 slat (usec): min=3, max=19701, avg=101.27, stdev=793.95 00:19:57.136 clat (usec): min=774, max=64061, avg=13642.80, stdev=8341.71 00:19:57.136 lat (usec): min=783, max=64072, avg=13744.07, stdev=8406.95 00:19:57.136 clat percentiles (usec): 00:19:57.136 | 1.00th=[ 3752], 5.00th=[ 6652], 10.00th=[ 7898], 20.00th=[ 9765], 00:19:57.136 | 30.00th=[10421], 40.00th=[10683], 50.00th=[11076], 60.00th=[11731], 00:19:57.136 | 70.00th=[14091], 80.00th=[14746], 90.00th=[21365], 95.00th=[30802], 00:19:57.136 | 99.00th=[55313], 99.50th=[62129], 99.90th=[64226], 99.95th=[64226], 00:19:57.136 | 99.99th=[64226] 00:19:57.136 bw ( KiB/s): min=16384, max=24576, per=31.75%, avg=20480.00, stdev=5792.62, samples=2 00:19:57.136 iops : min= 4096, max= 6144, avg=5120.00, stdev=1448.15, samples=2 00:19:57.136 lat (usec) : 1000=0.06% 00:19:57.136 lat (msec) : 2=0.11%, 4=0.62%, 10=29.91%, 20=60.66%, 50=7.91% 00:19:57.136 lat (msec) : 100=0.73% 00:19:57.136 cpu : usr=4.78%, sys=6.47%, ctx=329, majf=0, minf=2 00:19:57.136 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:19:57.136 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:57.136 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:57.136 issued rwts: total=4753,5120,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:57.136 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:57.136 job1: (groupid=0, jobs=1): err= 0: pid=2467231: Thu Nov 28 23:12:00 2024 00:19:57.136 read: IOPS=3513, BW=13.7MiB/s (14.4MB/s)(14.3MiB/1044msec) 00:19:57.136 slat (usec): min=2, max=12064, avg=113.85, stdev=685.38 00:19:57.136 clat (usec): min=7622, max=51130, avg=14969.66, stdev=6699.71 00:19:57.136 lat (usec): min=7636, max=51138, avg=15083.50, stdev=6739.71 00:19:57.136 clat percentiles (usec): 00:19:57.136 | 1.00th=[ 8586], 5.00th=[ 9372], 10.00th=[ 9896], 20.00th=[10552], 00:19:57.136 | 30.00th=[11207], 40.00th=[11863], 50.00th=[12780], 60.00th=[14877], 00:19:57.136 | 70.00th=[16450], 80.00th=[17433], 90.00th=[21365], 95.00th=[25822], 00:19:57.136 | 99.00th=[47973], 99.50th=[49546], 99.90th=[50594], 99.95th=[50594], 00:19:57.136 | 99.99th=[51119] 00:19:57.136 write: IOPS=3923, BW=15.3MiB/s (16.1MB/s)(16.0MiB/1044msec); 0 zone resets 00:19:57.136 slat (usec): min=3, max=9880, avg=134.65, stdev=721.38 00:19:57.136 clat (usec): min=6300, max=61322, avg=18918.24, stdev=14053.05 00:19:57.136 lat (usec): min=6307, max=61343, avg=19052.89, stdev=14151.17 00:19:57.136 clat percentiles (usec): 00:19:57.136 | 1.00th=[ 7504], 5.00th=[ 9634], 10.00th=[10028], 20.00th=[10683], 00:19:57.136 | 30.00th=[10945], 40.00th=[11207], 50.00th=[11469], 60.00th=[12125], 00:19:57.136 | 70.00th=[15795], 80.00th=[27132], 90.00th=[45351], 95.00th=[53740], 00:19:57.136 | 99.00th=[58983], 99.50th=[59507], 99.90th=[61080], 99.95th=[61080], 00:19:57.136 | 99.99th=[61080] 00:19:57.136 bw ( KiB/s): min=13944, max=18472, per=25.13%, avg=16208.00, stdev=3201.78, samples=2 00:19:57.136 iops : min= 3486, max= 4618, avg=4052.00, stdev=800.44, samples=2 00:19:57.136 lat (msec) : 10=10.41%, 20=70.32%, 50=15.03%, 100=4.24% 00:19:57.136 cpu : usr=4.51%, sys=5.85%, ctx=393, majf=0, minf=1 00:19:57.136 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:19:57.136 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:57.136 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:57.136 issued rwts: total=3668,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:57.137 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:57.137 job2: (groupid=0, jobs=1): err= 0: pid=2467232: Thu Nov 28 23:12:00 2024 00:19:57.137 read: IOPS=3541, BW=13.8MiB/s (14.5MB/s)(14.0MiB/1012msec) 00:19:57.137 slat (usec): min=2, max=18026, avg=125.82, stdev=912.27 00:19:57.137 clat (usec): min=1964, max=64934, avg=16340.65, stdev=9730.47 00:19:57.137 lat (usec): min=1979, max=64972, avg=16466.46, stdev=9797.90 00:19:57.137 clat percentiles (usec): 00:19:57.137 | 1.00th=[ 2311], 5.00th=[ 8586], 10.00th=[10159], 20.00th=[11076], 00:19:57.137 | 30.00th=[11469], 40.00th=[12125], 50.00th=[13042], 60.00th=[14615], 00:19:57.137 | 70.00th=[15533], 80.00th=[17957], 90.00th=[30540], 95.00th=[37487], 00:19:57.137 | 99.00th=[57934], 99.50th=[57934], 99.90th=[57934], 99.95th=[57934], 00:19:57.137 | 99.99th=[64750] 00:19:57.137 write: IOPS=3974, BW=15.5MiB/s (16.3MB/s)(15.7MiB/1012msec); 0 zone resets 00:19:57.137 slat (usec): min=3, max=21902, avg=123.75, stdev=835.08 00:19:57.137 clat (usec): min=1575, max=64861, avg=17274.39, stdev=11467.16 00:19:57.137 lat (usec): min=1585, max=64869, avg=17398.14, stdev=11544.11 00:19:57.137 clat percentiles (usec): 00:19:57.137 | 1.00th=[ 4883], 5.00th=[ 6718], 10.00th=[10028], 20.00th=[11731], 00:19:57.137 | 30.00th=[11863], 40.00th=[12256], 50.00th=[12649], 60.00th=[13304], 00:19:57.137 | 70.00th=[15139], 80.00th=[19792], 90.00th=[36439], 95.00th=[43254], 00:19:57.137 | 99.00th=[57410], 99.50th=[58459], 99.90th=[64750], 99.95th=[64750], 00:19:57.137 | 99.99th=[64750] 00:19:57.137 bw ( KiB/s): min=14768, max=16384, per=24.15%, avg=15576.00, stdev=1142.68, samples=2 00:19:57.137 iops : min= 3692, max= 4096, avg=3894.00, stdev=285.67, samples=2 00:19:57.137 lat (msec) : 2=0.13%, 4=0.85%, 10=7.42%, 20=72.92%, 50=15.90% 00:19:57.137 lat (msec) : 100=2.79% 00:19:57.137 cpu : usr=3.56%, sys=6.03%, ctx=299, majf=0, minf=1 00:19:57.137 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:19:57.137 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:57.137 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:57.137 issued rwts: total=3584,4022,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:57.137 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:57.137 job3: (groupid=0, jobs=1): err= 0: pid=2467233: Thu Nov 28 23:12:00 2024 00:19:57.137 read: IOPS=3573, BW=14.0MiB/s (14.6MB/s)(14.0MiB/1003msec) 00:19:57.137 slat (usec): min=3, max=9294, avg=127.60, stdev=708.27 00:19:57.137 clat (usec): min=3589, max=39242, avg=15744.70, stdev=4775.09 00:19:57.137 lat (usec): min=3595, max=39252, avg=15872.30, stdev=4830.04 00:19:57.137 clat percentiles (usec): 00:19:57.137 | 1.00th=[ 6390], 5.00th=[ 9896], 10.00th=[10945], 20.00th=[11600], 00:19:57.137 | 30.00th=[12518], 40.00th=[13698], 50.00th=[14746], 60.00th=[16188], 00:19:57.137 | 70.00th=[17695], 80.00th=[19006], 90.00th=[22676], 95.00th=[24511], 00:19:57.137 | 99.00th=[29492], 99.50th=[33817], 99.90th=[39060], 99.95th=[39060], 00:19:57.137 | 99.99th=[39060] 00:19:57.137 write: IOPS=3587, BW=14.0MiB/s (14.7MB/s)(14.1MiB/1003msec); 0 zone resets 00:19:57.137 slat (usec): min=4, max=7939, avg=141.76, stdev=633.71 00:19:57.137 clat (usec): min=1023, max=53195, avg=19557.11, stdev=10424.20 00:19:57.137 lat (usec): min=3447, max=53212, avg=19698.88, stdev=10491.69 00:19:57.137 clat percentiles (usec): 00:19:57.137 | 1.00th=[ 8094], 5.00th=[11207], 10.00th=[11469], 20.00th=[11994], 00:19:57.137 | 30.00th=[12780], 40.00th=[13960], 50.00th=[14877], 60.00th=[16319], 00:19:57.137 | 70.00th=[20055], 80.00th=[27132], 90.00th=[38011], 95.00th=[43254], 00:19:57.137 | 99.00th=[47973], 99.50th=[49021], 99.90th=[53216], 99.95th=[53216], 00:19:57.137 | 99.99th=[53216] 00:19:57.137 bw ( KiB/s): min=13064, max=15608, per=22.22%, avg=14336.00, stdev=1798.88, samples=2 00:19:57.137 iops : min= 3266, max= 3902, avg=3584.00, stdev=449.72, samples=2 00:19:57.137 lat (msec) : 2=0.01%, 4=0.38%, 10=3.88%, 20=71.92%, 50=23.71% 00:19:57.137 lat (msec) : 100=0.10% 00:19:57.137 cpu : usr=4.39%, sys=6.89%, ctx=443, majf=0, minf=1 00:19:57.137 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:19:57.137 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:57.137 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:57.137 issued rwts: total=3584,3598,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:57.137 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:57.137 00:19:57.137 Run status group 0 (all jobs): 00:19:57.137 READ: bw=58.3MiB/s (61.2MB/s), 13.7MiB/s-18.5MiB/s (14.4MB/s-19.4MB/s), io=60.9MiB (63.9MB), run=1003-1044msec 00:19:57.137 WRITE: bw=63.0MiB/s (66.1MB/s), 14.0MiB/s-19.9MiB/s (14.7MB/s-20.8MB/s), io=65.8MiB (69.0MB), run=1003-1044msec 00:19:57.137 00:19:57.137 Disk stats (read/write): 00:19:57.137 nvme0n1: ios=4174/4608, merge=0/0, ticks=33072/42565, in_queue=75637, util=97.80% 00:19:57.137 nvme0n2: ios=2977/3072, merge=0/0, ticks=22407/32913, in_queue=55320, util=97.66% 00:19:57.137 nvme0n3: ios=3295/3584, merge=0/0, ticks=36748/36680, in_queue=73428, util=88.85% 00:19:57.137 nvme0n4: ios=2586/2990, merge=0/0, ticks=21012/27975, in_queue=48987, util=91.08% 00:19:57.137 23:12:00 -- target/fio.sh@55 -- # sync 00:19:57.137 23:12:00 -- target/fio.sh@59 -- # fio_pid=2467415 00:19:57.137 23:12:00 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:19:57.137 23:12:00 -- target/fio.sh@61 -- # sleep 3 00:19:57.137 [global] 00:19:57.137 thread=1 00:19:57.137 invalidate=1 00:19:57.137 rw=read 00:19:57.137 time_based=1 00:19:57.137 runtime=10 00:19:57.137 ioengine=libaio 00:19:57.137 direct=1 00:19:57.137 bs=4096 00:19:57.137 iodepth=1 00:19:57.137 norandommap=1 00:19:57.137 numjobs=1 00:19:57.137 00:19:57.137 [job0] 00:19:57.137 filename=/dev/nvme0n1 00:19:57.137 [job1] 00:19:57.137 filename=/dev/nvme0n2 00:19:57.137 [job2] 00:19:57.137 filename=/dev/nvme0n3 00:19:57.137 [job3] 00:19:57.137 filename=/dev/nvme0n4 00:19:57.137 Could not set queue depth (nvme0n1) 00:19:57.137 Could not set queue depth (nvme0n2) 00:19:57.137 Could not set queue depth (nvme0n3) 00:19:57.137 Could not set queue depth (nvme0n4) 00:19:57.395 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:57.395 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:57.395 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:57.395 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:57.395 fio-3.35 00:19:57.395 Starting 4 threads 00:20:00.705 23:12:03 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:20:00.705 23:12:03 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:20:00.705 fio: io_u error on file /dev/nvme0n4: Operation not supported: read offset=1552384, buflen=4096 00:20:00.705 fio: pid=2467645, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:20:00.705 23:12:04 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:20:00.705 23:12:04 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:20:00.705 fio: io_u error on file /dev/nvme0n3: Operation not supported: read offset=380928, buflen=4096 00:20:00.705 fio: pid=2467644, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:20:00.989 23:12:04 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:20:00.989 23:12:04 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:20:00.989 fio: io_u error on file /dev/nvme0n1: Operation not supported: read offset=3551232, buflen=4096 00:20:00.989 fio: pid=2467627, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:20:01.247 23:12:04 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:20:01.247 23:12:04 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:20:01.247 fio: io_u error on file /dev/nvme0n2: Operation not supported: read offset=44404736, buflen=4096 00:20:01.247 fio: pid=2467643, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:20:01.247 00:20:01.247 job0: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=2467627: Thu Nov 28 23:12:04 2024 00:20:01.247 read: IOPS=250, BW=1002KiB/s (1026kB/s)(3468KiB/3462msec) 00:20:01.247 slat (usec): min=5, max=10941, avg=22.26, stdev=371.10 00:20:01.247 clat (usec): min=197, max=45607, avg=3940.55, stdev=11751.87 00:20:01.247 lat (usec): min=209, max=53054, avg=3962.82, stdev=11801.83 00:20:01.247 clat percentiles (usec): 00:20:01.247 | 1.00th=[ 217], 5.00th=[ 227], 10.00th=[ 233], 20.00th=[ 243], 00:20:01.247 | 30.00th=[ 247], 40.00th=[ 255], 50.00th=[ 265], 60.00th=[ 289], 00:20:01.247 | 70.00th=[ 396], 80.00th=[ 408], 90.00th=[ 461], 95.00th=[42206], 00:20:01.248 | 99.00th=[42206], 99.50th=[42206], 99.90th=[45351], 99.95th=[45351], 00:20:01.248 | 99.99th=[45351] 00:20:01.248 bw ( KiB/s): min= 96, max= 6352, per=8.71%, avg=1138.67, stdev=2554.00, samples=6 00:20:01.248 iops : min= 24, max= 1588, avg=284.67, stdev=638.50, samples=6 00:20:01.248 lat (usec) : 250=33.53%, 500=57.14%, 750=0.46% 00:20:01.248 lat (msec) : 50=8.76% 00:20:01.248 cpu : usr=0.09%, sys=0.40%, ctx=871, majf=0, minf=2 00:20:01.248 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:20:01.248 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:01.248 complete : 0=0.1%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:01.248 issued rwts: total=868,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:01.248 latency : target=0, window=0, percentile=100.00%, depth=1 00:20:01.248 job1: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=2467643: Thu Nov 28 23:12:04 2024 00:20:01.248 read: IOPS=2905, BW=11.3MiB/s (11.9MB/s)(42.3MiB/3731msec) 00:20:01.248 slat (usec): min=5, max=15692, avg=12.56, stdev=254.58 00:20:01.248 clat (usec): min=167, max=42277, avg=327.20, stdev=2190.33 00:20:01.248 lat (usec): min=173, max=56037, avg=339.76, stdev=2230.78 00:20:01.248 clat percentiles (usec): 00:20:01.248 | 1.00th=[ 176], 5.00th=[ 182], 10.00th=[ 184], 20.00th=[ 188], 00:20:01.248 | 30.00th=[ 192], 40.00th=[ 196], 50.00th=[ 200], 60.00th=[ 206], 00:20:01.248 | 70.00th=[ 215], 80.00th=[ 227], 90.00th=[ 245], 95.00th=[ 269], 00:20:01.248 | 99.00th=[ 318], 99.50th=[ 482], 99.90th=[41157], 99.95th=[41681], 00:20:01.248 | 99.99th=[42206] 00:20:01.248 bw ( KiB/s): min= 3176, max=18592, per=91.60%, avg=11961.29, stdev=6474.09, samples=7 00:20:01.248 iops : min= 794, max= 4648, avg=2990.29, stdev=1618.50, samples=7 00:20:01.248 lat (usec) : 250=91.82%, 500=7.68%, 750=0.06%, 1000=0.09% 00:20:01.248 lat (msec) : 2=0.03%, 4=0.02%, 50=0.29% 00:20:01.248 cpu : usr=2.04%, sys=3.40%, ctx=10847, majf=0, minf=1 00:20:01.248 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:20:01.248 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:01.248 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:01.248 issued rwts: total=10842,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:01.248 latency : target=0, window=0, percentile=100.00%, depth=1 00:20:01.248 job2: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=2467644: Thu Nov 28 23:12:04 2024 00:20:01.248 read: IOPS=29, BW=117KiB/s (120kB/s)(372KiB/3170msec) 00:20:01.248 slat (usec): min=5, max=6931, avg=90.96, stdev=713.14 00:20:01.248 clat (usec): min=216, max=42097, avg=33743.57, stdev=15914.08 00:20:01.248 lat (usec): min=223, max=47987, avg=33835.34, stdev=15966.49 00:20:01.248 clat percentiles (usec): 00:20:01.248 | 1.00th=[ 217], 5.00th=[ 237], 10.00th=[ 265], 20.00th=[40633], 00:20:01.248 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:20:01.248 | 70.00th=[41157], 80.00th=[41681], 90.00th=[42206], 95.00th=[42206], 00:20:01.248 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:20:01.248 | 99.99th=[42206] 00:20:01.248 bw ( KiB/s): min= 96, max= 224, per=0.90%, avg=118.67, stdev=51.70, samples=6 00:20:01.248 iops : min= 24, max= 56, avg=29.67, stdev=12.93, samples=6 00:20:01.248 lat (usec) : 250=9.57%, 500=8.51% 00:20:01.248 lat (msec) : 50=80.85% 00:20:01.248 cpu : usr=0.00%, sys=0.06%, ctx=95, majf=0, minf=2 00:20:01.248 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:20:01.248 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:01.248 complete : 0=1.1%, 4=98.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:01.248 issued rwts: total=94,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:01.248 latency : target=0, window=0, percentile=100.00%, depth=1 00:20:01.248 job3: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=2467645: Thu Nov 28 23:12:04 2024 00:20:01.248 read: IOPS=130, BW=520KiB/s (533kB/s)(1516KiB/2914msec) 00:20:01.248 slat (nsec): min=5622, max=51186, avg=13616.09, stdev=6986.00 00:20:01.248 clat (usec): min=192, max=42248, avg=7608.66, stdev=15744.55 00:20:01.248 lat (usec): min=200, max=42264, avg=7622.28, stdev=15746.77 00:20:01.248 clat percentiles (usec): 00:20:01.248 | 1.00th=[ 194], 5.00th=[ 210], 10.00th=[ 217], 20.00th=[ 229], 00:20:01.248 | 30.00th=[ 235], 40.00th=[ 241], 50.00th=[ 247], 60.00th=[ 253], 00:20:01.248 | 70.00th=[ 273], 80.00th=[ 553], 90.00th=[41157], 95.00th=[41157], 00:20:01.248 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:20:01.248 | 99.99th=[42206] 00:20:01.248 bw ( KiB/s): min= 96, max= 2512, per=4.52%, avg=590.40, stdev=1074.39, samples=5 00:20:01.248 iops : min= 24, max= 628, avg=147.60, stdev=268.60, samples=5 00:20:01.248 lat (usec) : 250=56.32%, 500=23.16%, 750=2.37% 00:20:01.248 lat (msec) : 50=17.89% 00:20:01.248 cpu : usr=0.03%, sys=0.31%, ctx=380, majf=0, minf=1 00:20:01.248 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:20:01.248 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:01.248 complete : 0=0.3%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:01.248 issued rwts: total=380,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:01.248 latency : target=0, window=0, percentile=100.00%, depth=1 00:20:01.248 00:20:01.248 Run status group 0 (all jobs): 00:20:01.248 READ: bw=12.8MiB/s (13.4MB/s), 117KiB/s-11.3MiB/s (120kB/s-11.9MB/s), io=47.6MiB (49.9MB), run=2914-3731msec 00:20:01.248 00:20:01.248 Disk stats (read/write): 00:20:01.248 nvme0n1: ios=894/0, merge=0/0, ticks=4078/0, in_queue=4078, util=99.83% 00:20:01.248 nvme0n2: ios=10838/0, merge=0/0, ticks=3304/0, in_queue=3304, util=95.34% 00:20:01.248 nvme0n3: ios=91/0, merge=0/0, ticks=3058/0, in_queue=3058, util=96.54% 00:20:01.248 nvme0n4: ios=378/0, merge=0/0, ticks=2844/0, in_queue=2844, util=96.71% 00:20:01.507 23:12:04 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:20:01.507 23:12:04 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:20:01.764 23:12:05 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:20:01.764 23:12:05 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:20:02.021 23:12:05 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:20:02.021 23:12:05 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:20:02.279 23:12:05 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:20:02.279 23:12:05 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:20:02.537 23:12:06 -- target/fio.sh@69 -- # fio_status=0 00:20:02.537 23:12:06 -- target/fio.sh@70 -- # wait 2467415 00:20:02.537 23:12:06 -- target/fio.sh@70 -- # fio_status=4 00:20:02.537 23:12:06 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:20:02.794 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:20:02.794 23:12:06 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:20:02.794 23:12:06 -- common/autotest_common.sh@1208 -- # local i=0 00:20:02.794 23:12:06 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:02.794 23:12:06 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:20:02.794 23:12:06 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:02.794 23:12:06 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:20:02.794 23:12:06 -- common/autotest_common.sh@1220 -- # return 0 00:20:02.794 23:12:06 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:20:02.794 23:12:06 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:20:02.794 nvmf hotplug test: fio failed as expected 00:20:02.794 23:12:06 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:03.051 23:12:06 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:20:03.051 23:12:06 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:20:03.051 23:12:06 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:20:03.051 23:12:06 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:20:03.051 23:12:06 -- target/fio.sh@91 -- # nvmftestfini 00:20:03.051 23:12:06 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:03.051 23:12:06 -- nvmf/common.sh@116 -- # sync 00:20:03.051 23:12:06 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:03.051 23:12:06 -- nvmf/common.sh@119 -- # set +e 00:20:03.051 23:12:06 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:03.051 23:12:06 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:03.051 rmmod nvme_tcp 00:20:03.051 rmmod nvme_fabrics 00:20:03.051 rmmod nvme_keyring 00:20:03.051 23:12:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:03.051 23:12:06 -- nvmf/common.sh@123 -- # set -e 00:20:03.051 23:12:06 -- nvmf/common.sh@124 -- # return 0 00:20:03.051 23:12:06 -- nvmf/common.sh@477 -- # '[' -n 2465289 ']' 00:20:03.051 23:12:06 -- nvmf/common.sh@478 -- # killprocess 2465289 00:20:03.051 23:12:06 -- common/autotest_common.sh@936 -- # '[' -z 2465289 ']' 00:20:03.051 23:12:06 -- common/autotest_common.sh@940 -- # kill -0 2465289 00:20:03.051 23:12:06 -- common/autotest_common.sh@941 -- # uname 00:20:03.051 23:12:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:03.051 23:12:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2465289 00:20:03.051 23:12:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:20:03.051 23:12:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:20:03.051 23:12:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2465289' 00:20:03.051 killing process with pid 2465289 00:20:03.051 23:12:06 -- common/autotest_common.sh@955 -- # kill 2465289 00:20:03.051 23:12:06 -- common/autotest_common.sh@960 -- # wait 2465289 00:20:03.309 23:12:06 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:03.309 23:12:06 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:03.309 23:12:06 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:03.309 23:12:06 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:03.309 23:12:06 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:03.309 23:12:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:03.309 23:12:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:03.309 23:12:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:05.839 23:12:08 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:05.839 00:20:05.839 real 0m24.565s 00:20:05.839 user 1m26.386s 00:20:05.839 sys 0m6.697s 00:20:05.839 23:12:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:20:05.839 23:12:08 -- common/autotest_common.sh@10 -- # set +x 00:20:05.839 ************************************ 00:20:05.839 END TEST nvmf_fio_target 00:20:05.839 ************************************ 00:20:05.839 23:12:08 -- nvmf/nvmf.sh@55 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:20:05.839 23:12:08 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:05.839 23:12:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:05.839 23:12:08 -- common/autotest_common.sh@10 -- # set +x 00:20:05.839 ************************************ 00:20:05.839 START TEST nvmf_bdevio 00:20:05.839 ************************************ 00:20:05.839 23:12:08 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:20:05.839 * Looking for test storage... 00:20:05.839 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:20:05.839 23:12:08 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:20:05.839 23:12:08 -- common/autotest_common.sh@1690 -- # lcov --version 00:20:05.839 23:12:08 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:20:05.839 23:12:09 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:20:05.839 23:12:09 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:20:05.839 23:12:09 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:20:05.839 23:12:09 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:20:05.839 23:12:09 -- scripts/common.sh@335 -- # IFS=.-: 00:20:05.839 23:12:09 -- scripts/common.sh@335 -- # read -ra ver1 00:20:05.839 23:12:09 -- scripts/common.sh@336 -- # IFS=.-: 00:20:05.839 23:12:09 -- scripts/common.sh@336 -- # read -ra ver2 00:20:05.839 23:12:09 -- scripts/common.sh@337 -- # local 'op=<' 00:20:05.839 23:12:09 -- scripts/common.sh@339 -- # ver1_l=2 00:20:05.839 23:12:09 -- scripts/common.sh@340 -- # ver2_l=1 00:20:05.839 23:12:09 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:20:05.839 23:12:09 -- scripts/common.sh@343 -- # case "$op" in 00:20:05.839 23:12:09 -- scripts/common.sh@344 -- # : 1 00:20:05.839 23:12:09 -- scripts/common.sh@363 -- # (( v = 0 )) 00:20:05.839 23:12:09 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:05.839 23:12:09 -- scripts/common.sh@364 -- # decimal 1 00:20:05.839 23:12:09 -- scripts/common.sh@352 -- # local d=1 00:20:05.839 23:12:09 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:20:05.839 23:12:09 -- scripts/common.sh@354 -- # echo 1 00:20:05.839 23:12:09 -- scripts/common.sh@364 -- # ver1[v]=1 00:20:05.839 23:12:09 -- scripts/common.sh@365 -- # decimal 2 00:20:05.839 23:12:09 -- scripts/common.sh@352 -- # local d=2 00:20:05.839 23:12:09 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:20:05.839 23:12:09 -- scripts/common.sh@354 -- # echo 2 00:20:05.839 23:12:09 -- scripts/common.sh@365 -- # ver2[v]=2 00:20:05.839 23:12:09 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:05.839 23:12:09 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:05.839 23:12:09 -- scripts/common.sh@367 -- # return 0 00:20:05.839 23:12:09 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:20:05.839 23:12:09 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:20:05.839 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:05.839 --rc genhtml_branch_coverage=1 00:20:05.839 --rc genhtml_function_coverage=1 00:20:05.839 --rc genhtml_legend=1 00:20:05.839 --rc geninfo_all_blocks=1 00:20:05.839 --rc geninfo_unexecuted_blocks=1 00:20:05.839 00:20:05.839 ' 00:20:05.839 23:12:09 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:20:05.839 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:05.840 --rc genhtml_branch_coverage=1 00:20:05.840 --rc genhtml_function_coverage=1 00:20:05.840 --rc genhtml_legend=1 00:20:05.840 --rc geninfo_all_blocks=1 00:20:05.840 --rc geninfo_unexecuted_blocks=1 00:20:05.840 00:20:05.840 ' 00:20:05.840 23:12:09 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:20:05.840 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:05.840 --rc genhtml_branch_coverage=1 00:20:05.840 --rc genhtml_function_coverage=1 00:20:05.840 --rc genhtml_legend=1 00:20:05.840 --rc geninfo_all_blocks=1 00:20:05.840 --rc geninfo_unexecuted_blocks=1 00:20:05.840 00:20:05.840 ' 00:20:05.840 23:12:09 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:20:05.840 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:05.840 --rc genhtml_branch_coverage=1 00:20:05.840 --rc genhtml_function_coverage=1 00:20:05.840 --rc genhtml_legend=1 00:20:05.840 --rc geninfo_all_blocks=1 00:20:05.840 --rc geninfo_unexecuted_blocks=1 00:20:05.840 00:20:05.840 ' 00:20:05.840 23:12:09 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:05.840 23:12:09 -- nvmf/common.sh@7 -- # uname -s 00:20:05.840 23:12:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:05.840 23:12:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:05.840 23:12:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:05.840 23:12:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:05.840 23:12:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:05.840 23:12:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:05.840 23:12:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:05.840 23:12:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:05.840 23:12:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:05.840 23:12:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:05.840 23:12:09 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:20:05.840 23:12:09 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:20:05.840 23:12:09 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:05.840 23:12:09 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:05.840 23:12:09 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:05.840 23:12:09 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:05.840 23:12:09 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:05.840 23:12:09 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:05.840 23:12:09 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:05.840 23:12:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:05.840 23:12:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:05.840 23:12:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:05.840 23:12:09 -- paths/export.sh@5 -- # export PATH 00:20:05.840 23:12:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:05.840 23:12:09 -- nvmf/common.sh@46 -- # : 0 00:20:05.840 23:12:09 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:05.840 23:12:09 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:05.840 23:12:09 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:05.840 23:12:09 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:05.840 23:12:09 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:05.840 23:12:09 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:05.840 23:12:09 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:05.840 23:12:09 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:05.840 23:12:09 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:20:05.840 23:12:09 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:20:05.840 23:12:09 -- target/bdevio.sh@14 -- # nvmftestinit 00:20:05.840 23:12:09 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:05.840 23:12:09 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:05.840 23:12:09 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:05.840 23:12:09 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:05.840 23:12:09 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:05.840 23:12:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:05.840 23:12:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:05.840 23:12:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:05.840 23:12:09 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:05.840 23:12:09 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:05.840 23:12:09 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:05.840 23:12:09 -- common/autotest_common.sh@10 -- # set +x 00:20:07.743 23:12:11 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:07.743 23:12:11 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:07.743 23:12:11 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:07.743 23:12:11 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:07.743 23:12:11 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:07.743 23:12:11 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:07.743 23:12:11 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:07.743 23:12:11 -- nvmf/common.sh@294 -- # net_devs=() 00:20:07.743 23:12:11 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:07.743 23:12:11 -- nvmf/common.sh@295 -- # e810=() 00:20:07.743 23:12:11 -- nvmf/common.sh@295 -- # local -ga e810 00:20:07.743 23:12:11 -- nvmf/common.sh@296 -- # x722=() 00:20:07.743 23:12:11 -- nvmf/common.sh@296 -- # local -ga x722 00:20:07.743 23:12:11 -- nvmf/common.sh@297 -- # mlx=() 00:20:07.743 23:12:11 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:07.743 23:12:11 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:07.743 23:12:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:07.743 23:12:11 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:07.743 23:12:11 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:07.743 23:12:11 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:07.743 23:12:11 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:07.743 23:12:11 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:07.743 23:12:11 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:07.743 23:12:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:07.743 23:12:11 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:07.743 23:12:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:07.743 23:12:11 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:07.743 23:12:11 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:07.743 23:12:11 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:07.743 23:12:11 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:07.743 23:12:11 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:07.743 23:12:11 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:07.743 23:12:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:07.743 23:12:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:07.743 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:07.743 23:12:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:07.743 23:12:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:07.743 23:12:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:07.743 23:12:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:07.743 23:12:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:07.743 23:12:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:07.743 23:12:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:07.743 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:07.743 23:12:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:07.743 23:12:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:07.743 23:12:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:07.743 23:12:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:07.743 23:12:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:07.743 23:12:11 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:07.743 23:12:11 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:07.743 23:12:11 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:07.743 23:12:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:07.743 23:12:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:07.743 23:12:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:07.743 23:12:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:07.743 23:12:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:07.743 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:07.743 23:12:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:07.743 23:12:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:07.743 23:12:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:07.743 23:12:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:07.743 23:12:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:07.743 23:12:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:07.743 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:07.743 23:12:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:07.743 23:12:11 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:07.743 23:12:11 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:07.743 23:12:11 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:07.743 23:12:11 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:07.743 23:12:11 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:07.743 23:12:11 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:07.743 23:12:11 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:07.743 23:12:11 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:07.743 23:12:11 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:07.743 23:12:11 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:07.743 23:12:11 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:07.743 23:12:11 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:07.743 23:12:11 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:07.743 23:12:11 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:07.743 23:12:11 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:07.743 23:12:11 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:07.743 23:12:11 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:07.743 23:12:11 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:07.743 23:12:11 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:07.743 23:12:11 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:07.743 23:12:11 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:07.743 23:12:11 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:07.743 23:12:11 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:07.743 23:12:11 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:07.743 23:12:11 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:07.743 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:07.743 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.247 ms 00:20:07.743 00:20:07.743 --- 10.0.0.2 ping statistics --- 00:20:07.743 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:07.743 rtt min/avg/max/mdev = 0.247/0.247/0.247/0.000 ms 00:20:07.743 23:12:11 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:07.743 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:07.743 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.141 ms 00:20:07.743 00:20:07.743 --- 10.0.0.1 ping statistics --- 00:20:07.743 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:07.743 rtt min/avg/max/mdev = 0.141/0.141/0.141/0.000 ms 00:20:07.743 23:12:11 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:07.743 23:12:11 -- nvmf/common.sh@410 -- # return 0 00:20:07.743 23:12:11 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:07.743 23:12:11 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:07.743 23:12:11 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:07.743 23:12:11 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:07.743 23:12:11 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:07.743 23:12:11 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:07.743 23:12:11 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:07.743 23:12:11 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:20:07.743 23:12:11 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:07.743 23:12:11 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:07.743 23:12:11 -- common/autotest_common.sh@10 -- # set +x 00:20:08.002 23:12:11 -- nvmf/common.sh@469 -- # nvmfpid=2470870 00:20:08.002 23:12:11 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:20:08.002 23:12:11 -- nvmf/common.sh@470 -- # waitforlisten 2470870 00:20:08.002 23:12:11 -- common/autotest_common.sh@829 -- # '[' -z 2470870 ']' 00:20:08.002 23:12:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:08.002 23:12:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:08.002 23:12:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:08.002 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:08.002 23:12:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:08.002 23:12:11 -- common/autotest_common.sh@10 -- # set +x 00:20:08.002 [2024-11-28 23:12:11.397779] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:08.002 [2024-11-28 23:12:11.397875] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:08.002 EAL: No free 2048 kB hugepages reported on node 1 00:20:08.002 [2024-11-28 23:12:11.466923] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:20:08.002 [2024-11-28 23:12:11.557782] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:08.002 [2024-11-28 23:12:11.557940] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:08.002 [2024-11-28 23:12:11.557974] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:08.002 [2024-11-28 23:12:11.557988] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:08.002 [2024-11-28 23:12:11.558077] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:20:08.002 [2024-11-28 23:12:11.558110] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:20:08.002 [2024-11-28 23:12:11.558160] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:20:08.002 [2024-11-28 23:12:11.558163] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:08.936 23:12:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:08.936 23:12:12 -- common/autotest_common.sh@862 -- # return 0 00:20:08.936 23:12:12 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:08.936 23:12:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:08.936 23:12:12 -- common/autotest_common.sh@10 -- # set +x 00:20:08.936 23:12:12 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:08.936 23:12:12 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:20:08.936 23:12:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:08.936 23:12:12 -- common/autotest_common.sh@10 -- # set +x 00:20:08.936 [2024-11-28 23:12:12.438213] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:08.936 23:12:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:08.936 23:12:12 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:20:08.936 23:12:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:08.936 23:12:12 -- common/autotest_common.sh@10 -- # set +x 00:20:08.936 Malloc0 00:20:08.936 23:12:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:08.936 23:12:12 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:20:08.936 23:12:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:08.936 23:12:12 -- common/autotest_common.sh@10 -- # set +x 00:20:08.936 23:12:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:08.936 23:12:12 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:20:08.936 23:12:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:08.936 23:12:12 -- common/autotest_common.sh@10 -- # set +x 00:20:08.936 23:12:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:08.936 23:12:12 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:20:08.936 23:12:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:08.936 23:12:12 -- common/autotest_common.sh@10 -- # set +x 00:20:08.936 [2024-11-28 23:12:12.492056] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:08.936 23:12:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:08.936 23:12:12 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:20:08.936 23:12:12 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:20:08.936 23:12:12 -- nvmf/common.sh@520 -- # config=() 00:20:08.936 23:12:12 -- nvmf/common.sh@520 -- # local subsystem config 00:20:08.936 23:12:12 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:20:08.936 23:12:12 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:20:08.936 { 00:20:08.936 "params": { 00:20:08.936 "name": "Nvme$subsystem", 00:20:08.936 "trtype": "$TEST_TRANSPORT", 00:20:08.936 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:08.936 "adrfam": "ipv4", 00:20:08.936 "trsvcid": "$NVMF_PORT", 00:20:08.936 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:08.936 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:08.936 "hdgst": ${hdgst:-false}, 00:20:08.936 "ddgst": ${ddgst:-false} 00:20:08.936 }, 00:20:08.936 "method": "bdev_nvme_attach_controller" 00:20:08.936 } 00:20:08.936 EOF 00:20:08.936 )") 00:20:08.936 23:12:12 -- nvmf/common.sh@542 -- # cat 00:20:08.936 23:12:12 -- nvmf/common.sh@544 -- # jq . 00:20:08.936 23:12:12 -- nvmf/common.sh@545 -- # IFS=, 00:20:08.937 23:12:12 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:20:08.937 "params": { 00:20:08.937 "name": "Nvme1", 00:20:08.937 "trtype": "tcp", 00:20:08.937 "traddr": "10.0.0.2", 00:20:08.937 "adrfam": "ipv4", 00:20:08.937 "trsvcid": "4420", 00:20:08.937 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:08.937 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:08.937 "hdgst": false, 00:20:08.937 "ddgst": false 00:20:08.937 }, 00:20:08.937 "method": "bdev_nvme_attach_controller" 00:20:08.937 }' 00:20:08.937 [2024-11-28 23:12:12.536131] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:08.937 [2024-11-28 23:12:12.536206] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2471033 ] 00:20:09.195 EAL: No free 2048 kB hugepages reported on node 1 00:20:09.196 [2024-11-28 23:12:12.599559] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:20:09.196 [2024-11-28 23:12:12.690074] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:09.196 [2024-11-28 23:12:12.690123] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:09.196 [2024-11-28 23:12:12.690126] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:09.453 [2024-11-28 23:12:12.904363] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:20:09.453 [2024-11-28 23:12:12.904425] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:20:09.453 I/O targets: 00:20:09.453 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:20:09.453 00:20:09.454 00:20:09.454 CUnit - A unit testing framework for C - Version 2.1-3 00:20:09.454 http://cunit.sourceforge.net/ 00:20:09.454 00:20:09.454 00:20:09.454 Suite: bdevio tests on: Nvme1n1 00:20:09.454 Test: blockdev write read block ...passed 00:20:09.454 Test: blockdev write zeroes read block ...passed 00:20:09.454 Test: blockdev write zeroes read no split ...passed 00:20:09.454 Test: blockdev write zeroes read split ...passed 00:20:09.711 Test: blockdev write zeroes read split partial ...passed 00:20:09.711 Test: blockdev reset ...[2024-11-28 23:12:13.102222] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:20:09.711 [2024-11-28 23:12:13.102323] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1a56670 (9): Bad file descriptor 00:20:09.711 [2024-11-28 23:12:13.113880] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:20:09.711 passed 00:20:09.711 Test: blockdev write read 8 blocks ...passed 00:20:09.711 Test: blockdev write read size > 128k ...passed 00:20:09.711 Test: blockdev write read invalid size ...passed 00:20:09.711 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:20:09.711 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:20:09.711 Test: blockdev write read max offset ...passed 00:20:09.711 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:20:09.969 Test: blockdev writev readv 8 blocks ...passed 00:20:09.969 Test: blockdev writev readv 30 x 1block ...passed 00:20:09.969 Test: blockdev writev readv block ...passed 00:20:09.969 Test: blockdev writev readv size > 128k ...passed 00:20:09.969 Test: blockdev writev readv size > 128k in two iovs ...passed 00:20:09.969 Test: blockdev comparev and writev ...[2024-11-28 23:12:13.367863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:09.969 [2024-11-28 23:12:13.367899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:09.969 [2024-11-28 23:12:13.367936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:09.969 [2024-11-28 23:12:13.367967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:20:09.969 [2024-11-28 23:12:13.368308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:09.969 [2024-11-28 23:12:13.368337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:20:09.969 [2024-11-28 23:12:13.368375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:09.969 [2024-11-28 23:12:13.368410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:20:09.969 [2024-11-28 23:12:13.368757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:09.969 [2024-11-28 23:12:13.368783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:20:09.969 [2024-11-28 23:12:13.368817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:09.969 [2024-11-28 23:12:13.368852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:20:09.969 [2024-11-28 23:12:13.369207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:09.969 [2024-11-28 23:12:13.369233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:20:09.969 [2024-11-28 23:12:13.369267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:09.969 [2024-11-28 23:12:13.369295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:20:09.969 passed 00:20:09.969 Test: blockdev nvme passthru rw ...passed 00:20:09.969 Test: blockdev nvme passthru vendor specific ...[2024-11-28 23:12:13.452649] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:09.969 [2024-11-28 23:12:13.452677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:20:09.969 [2024-11-28 23:12:13.452837] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:09.969 [2024-11-28 23:12:13.452863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:20:09.969 [2024-11-28 23:12:13.453022] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:09.969 [2024-11-28 23:12:13.453048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:20:09.969 [2024-11-28 23:12:13.453201] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:09.969 [2024-11-28 23:12:13.453226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:20:09.969 passed 00:20:09.969 Test: blockdev nvme admin passthru ...passed 00:20:09.969 Test: blockdev copy ...passed 00:20:09.969 00:20:09.969 Run Summary: Type Total Ran Passed Failed Inactive 00:20:09.969 suites 1 1 n/a 0 0 00:20:09.969 tests 23 23 23 0 0 00:20:09.969 asserts 152 152 152 0 n/a 00:20:09.969 00:20:09.969 Elapsed time = 1.217 seconds 00:20:10.227 23:12:13 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:10.227 23:12:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:10.227 23:12:13 -- common/autotest_common.sh@10 -- # set +x 00:20:10.227 23:12:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:10.227 23:12:13 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:20:10.227 23:12:13 -- target/bdevio.sh@30 -- # nvmftestfini 00:20:10.227 23:12:13 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:10.227 23:12:13 -- nvmf/common.sh@116 -- # sync 00:20:10.227 23:12:13 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:10.227 23:12:13 -- nvmf/common.sh@119 -- # set +e 00:20:10.227 23:12:13 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:10.227 23:12:13 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:10.227 rmmod nvme_tcp 00:20:10.227 rmmod nvme_fabrics 00:20:10.227 rmmod nvme_keyring 00:20:10.227 23:12:13 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:10.227 23:12:13 -- nvmf/common.sh@123 -- # set -e 00:20:10.227 23:12:13 -- nvmf/common.sh@124 -- # return 0 00:20:10.227 23:12:13 -- nvmf/common.sh@477 -- # '[' -n 2470870 ']' 00:20:10.227 23:12:13 -- nvmf/common.sh@478 -- # killprocess 2470870 00:20:10.227 23:12:13 -- common/autotest_common.sh@936 -- # '[' -z 2470870 ']' 00:20:10.227 23:12:13 -- common/autotest_common.sh@940 -- # kill -0 2470870 00:20:10.227 23:12:13 -- common/autotest_common.sh@941 -- # uname 00:20:10.227 23:12:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:10.227 23:12:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2470870 00:20:10.227 23:12:13 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:20:10.227 23:12:13 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:20:10.227 23:12:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2470870' 00:20:10.227 killing process with pid 2470870 00:20:10.227 23:12:13 -- common/autotest_common.sh@955 -- # kill 2470870 00:20:10.227 23:12:13 -- common/autotest_common.sh@960 -- # wait 2470870 00:20:10.486 23:12:14 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:10.486 23:12:14 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:10.486 23:12:14 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:10.486 23:12:14 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:10.486 23:12:14 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:10.486 23:12:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:10.486 23:12:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:10.486 23:12:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:13.020 23:12:16 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:13.020 00:20:13.021 real 0m7.253s 00:20:13.021 user 0m13.264s 00:20:13.021 sys 0m2.183s 00:20:13.021 23:12:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:20:13.021 23:12:16 -- common/autotest_common.sh@10 -- # set +x 00:20:13.021 ************************************ 00:20:13.021 END TEST nvmf_bdevio 00:20:13.021 ************************************ 00:20:13.021 23:12:16 -- nvmf/nvmf.sh@57 -- # '[' tcp = tcp ']' 00:20:13.021 23:12:16 -- nvmf/nvmf.sh@58 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:20:13.021 23:12:16 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:20:13.021 23:12:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:13.021 23:12:16 -- common/autotest_common.sh@10 -- # set +x 00:20:13.021 ************************************ 00:20:13.021 START TEST nvmf_bdevio_no_huge 00:20:13.021 ************************************ 00:20:13.021 23:12:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:20:13.021 * Looking for test storage... 00:20:13.021 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:20:13.021 23:12:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:20:13.021 23:12:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:20:13.021 23:12:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:20:13.021 23:12:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:20:13.021 23:12:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:20:13.021 23:12:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:20:13.021 23:12:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:20:13.021 23:12:16 -- scripts/common.sh@335 -- # IFS=.-: 00:20:13.021 23:12:16 -- scripts/common.sh@335 -- # read -ra ver1 00:20:13.021 23:12:16 -- scripts/common.sh@336 -- # IFS=.-: 00:20:13.021 23:12:16 -- scripts/common.sh@336 -- # read -ra ver2 00:20:13.021 23:12:16 -- scripts/common.sh@337 -- # local 'op=<' 00:20:13.021 23:12:16 -- scripts/common.sh@339 -- # ver1_l=2 00:20:13.021 23:12:16 -- scripts/common.sh@340 -- # ver2_l=1 00:20:13.021 23:12:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:20:13.021 23:12:16 -- scripts/common.sh@343 -- # case "$op" in 00:20:13.021 23:12:16 -- scripts/common.sh@344 -- # : 1 00:20:13.021 23:12:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:20:13.021 23:12:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:13.021 23:12:16 -- scripts/common.sh@364 -- # decimal 1 00:20:13.021 23:12:16 -- scripts/common.sh@352 -- # local d=1 00:20:13.021 23:12:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:20:13.021 23:12:16 -- scripts/common.sh@354 -- # echo 1 00:20:13.021 23:12:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:20:13.021 23:12:16 -- scripts/common.sh@365 -- # decimal 2 00:20:13.021 23:12:16 -- scripts/common.sh@352 -- # local d=2 00:20:13.021 23:12:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:20:13.021 23:12:16 -- scripts/common.sh@354 -- # echo 2 00:20:13.021 23:12:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:20:13.021 23:12:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:13.021 23:12:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:13.021 23:12:16 -- scripts/common.sh@367 -- # return 0 00:20:13.021 23:12:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:20:13.021 23:12:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:20:13.021 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:13.021 --rc genhtml_branch_coverage=1 00:20:13.021 --rc genhtml_function_coverage=1 00:20:13.021 --rc genhtml_legend=1 00:20:13.021 --rc geninfo_all_blocks=1 00:20:13.021 --rc geninfo_unexecuted_blocks=1 00:20:13.021 00:20:13.021 ' 00:20:13.021 23:12:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:20:13.021 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:13.021 --rc genhtml_branch_coverage=1 00:20:13.021 --rc genhtml_function_coverage=1 00:20:13.021 --rc genhtml_legend=1 00:20:13.021 --rc geninfo_all_blocks=1 00:20:13.021 --rc geninfo_unexecuted_blocks=1 00:20:13.021 00:20:13.021 ' 00:20:13.021 23:12:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:20:13.021 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:13.021 --rc genhtml_branch_coverage=1 00:20:13.021 --rc genhtml_function_coverage=1 00:20:13.021 --rc genhtml_legend=1 00:20:13.021 --rc geninfo_all_blocks=1 00:20:13.021 --rc geninfo_unexecuted_blocks=1 00:20:13.021 00:20:13.021 ' 00:20:13.021 23:12:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:20:13.021 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:13.021 --rc genhtml_branch_coverage=1 00:20:13.021 --rc genhtml_function_coverage=1 00:20:13.021 --rc genhtml_legend=1 00:20:13.021 --rc geninfo_all_blocks=1 00:20:13.021 --rc geninfo_unexecuted_blocks=1 00:20:13.021 00:20:13.021 ' 00:20:13.021 23:12:16 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:13.021 23:12:16 -- nvmf/common.sh@7 -- # uname -s 00:20:13.021 23:12:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:13.021 23:12:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:13.021 23:12:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:13.021 23:12:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:13.021 23:12:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:13.021 23:12:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:13.021 23:12:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:13.021 23:12:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:13.021 23:12:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:13.021 23:12:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:13.021 23:12:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:20:13.021 23:12:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:20:13.021 23:12:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:13.021 23:12:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:13.021 23:12:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:13.021 23:12:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:13.021 23:12:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:13.021 23:12:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:13.021 23:12:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:13.021 23:12:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:13.021 23:12:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:13.021 23:12:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:13.021 23:12:16 -- paths/export.sh@5 -- # export PATH 00:20:13.022 23:12:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:13.022 23:12:16 -- nvmf/common.sh@46 -- # : 0 00:20:13.022 23:12:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:13.022 23:12:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:13.022 23:12:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:13.022 23:12:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:13.022 23:12:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:13.022 23:12:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:13.022 23:12:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:13.022 23:12:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:13.022 23:12:16 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:20:13.022 23:12:16 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:20:13.022 23:12:16 -- target/bdevio.sh@14 -- # nvmftestinit 00:20:13.022 23:12:16 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:13.022 23:12:16 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:13.022 23:12:16 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:13.022 23:12:16 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:13.022 23:12:16 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:13.022 23:12:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:13.022 23:12:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:13.022 23:12:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:13.022 23:12:16 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:13.022 23:12:16 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:13.022 23:12:16 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:13.022 23:12:16 -- common/autotest_common.sh@10 -- # set +x 00:20:14.926 23:12:18 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:14.926 23:12:18 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:14.926 23:12:18 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:14.926 23:12:18 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:14.926 23:12:18 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:14.926 23:12:18 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:14.926 23:12:18 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:14.926 23:12:18 -- nvmf/common.sh@294 -- # net_devs=() 00:20:14.926 23:12:18 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:14.926 23:12:18 -- nvmf/common.sh@295 -- # e810=() 00:20:14.926 23:12:18 -- nvmf/common.sh@295 -- # local -ga e810 00:20:14.926 23:12:18 -- nvmf/common.sh@296 -- # x722=() 00:20:14.926 23:12:18 -- nvmf/common.sh@296 -- # local -ga x722 00:20:14.926 23:12:18 -- nvmf/common.sh@297 -- # mlx=() 00:20:14.926 23:12:18 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:14.926 23:12:18 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:14.926 23:12:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:14.926 23:12:18 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:14.926 23:12:18 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:14.926 23:12:18 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:14.926 23:12:18 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:14.926 23:12:18 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:14.926 23:12:18 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:14.926 23:12:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:14.926 23:12:18 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:14.926 23:12:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:14.926 23:12:18 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:14.926 23:12:18 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:14.926 23:12:18 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:14.926 23:12:18 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:14.926 23:12:18 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:14.926 23:12:18 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:14.926 23:12:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:14.926 23:12:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:14.926 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:14.926 23:12:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:14.926 23:12:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:14.926 23:12:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:14.926 23:12:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:14.926 23:12:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:14.926 23:12:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:14.926 23:12:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:14.926 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:14.926 23:12:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:14.926 23:12:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:14.926 23:12:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:14.926 23:12:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:14.926 23:12:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:14.926 23:12:18 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:14.926 23:12:18 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:14.926 23:12:18 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:14.926 23:12:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:14.926 23:12:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:14.926 23:12:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:14.926 23:12:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:14.926 23:12:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:14.926 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:14.926 23:12:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:14.926 23:12:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:14.926 23:12:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:14.926 23:12:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:14.926 23:12:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:14.926 23:12:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:14.926 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:14.926 23:12:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:14.926 23:12:18 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:14.926 23:12:18 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:14.926 23:12:18 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:14.926 23:12:18 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:14.926 23:12:18 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:14.926 23:12:18 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:14.926 23:12:18 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:14.926 23:12:18 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:14.926 23:12:18 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:14.926 23:12:18 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:14.926 23:12:18 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:14.926 23:12:18 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:14.926 23:12:18 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:14.926 23:12:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:14.926 23:12:18 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:14.926 23:12:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:14.926 23:12:18 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:14.926 23:12:18 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:14.926 23:12:18 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:14.926 23:12:18 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:14.926 23:12:18 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:14.926 23:12:18 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:14.926 23:12:18 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:14.926 23:12:18 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:14.926 23:12:18 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:14.926 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:14.926 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.357 ms 00:20:14.926 00:20:14.926 --- 10.0.0.2 ping statistics --- 00:20:14.926 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:14.926 rtt min/avg/max/mdev = 0.357/0.357/0.357/0.000 ms 00:20:14.926 23:12:18 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:14.926 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:14.926 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.133 ms 00:20:14.926 00:20:14.926 --- 10.0.0.1 ping statistics --- 00:20:14.926 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:14.926 rtt min/avg/max/mdev = 0.133/0.133/0.133/0.000 ms 00:20:14.926 23:12:18 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:14.926 23:12:18 -- nvmf/common.sh@410 -- # return 0 00:20:14.926 23:12:18 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:14.926 23:12:18 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:14.926 23:12:18 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:14.926 23:12:18 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:14.926 23:12:18 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:14.926 23:12:18 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:14.926 23:12:18 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:14.926 23:12:18 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:20:14.926 23:12:18 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:14.926 23:12:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:14.926 23:12:18 -- common/autotest_common.sh@10 -- # set +x 00:20:14.926 23:12:18 -- nvmf/common.sh@469 -- # nvmfpid=2473127 00:20:14.927 23:12:18 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:20:14.927 23:12:18 -- nvmf/common.sh@470 -- # waitforlisten 2473127 00:20:14.927 23:12:18 -- common/autotest_common.sh@829 -- # '[' -z 2473127 ']' 00:20:14.927 23:12:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:14.927 23:12:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:14.927 23:12:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:14.927 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:14.927 23:12:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:14.927 23:12:18 -- common/autotest_common.sh@10 -- # set +x 00:20:14.927 [2024-11-28 23:12:18.523505] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:14.927 [2024-11-28 23:12:18.523605] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:20:15.185 [2024-11-28 23:12:18.599332] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:20:15.185 [2024-11-28 23:12:18.695610] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:15.185 [2024-11-28 23:12:18.695780] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:15.185 [2024-11-28 23:12:18.695800] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:15.185 [2024-11-28 23:12:18.695815] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:15.185 [2024-11-28 23:12:18.695906] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:20:15.185 [2024-11-28 23:12:18.695963] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:20:15.185 [2024-11-28 23:12:18.696017] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:20:15.185 [2024-11-28 23:12:18.696020] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:16.118 23:12:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:16.118 23:12:19 -- common/autotest_common.sh@862 -- # return 0 00:20:16.118 23:12:19 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:16.118 23:12:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:16.118 23:12:19 -- common/autotest_common.sh@10 -- # set +x 00:20:16.118 23:12:19 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:16.118 23:12:19 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:20:16.118 23:12:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:16.118 23:12:19 -- common/autotest_common.sh@10 -- # set +x 00:20:16.118 [2024-11-28 23:12:19.550225] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:16.118 23:12:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:16.118 23:12:19 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:20:16.118 23:12:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:16.118 23:12:19 -- common/autotest_common.sh@10 -- # set +x 00:20:16.118 Malloc0 00:20:16.118 23:12:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:16.118 23:12:19 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:20:16.118 23:12:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:16.118 23:12:19 -- common/autotest_common.sh@10 -- # set +x 00:20:16.118 23:12:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:16.118 23:12:19 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:20:16.118 23:12:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:16.118 23:12:19 -- common/autotest_common.sh@10 -- # set +x 00:20:16.118 23:12:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:16.118 23:12:19 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:20:16.118 23:12:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:16.118 23:12:19 -- common/autotest_common.sh@10 -- # set +x 00:20:16.118 [2024-11-28 23:12:19.588088] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:16.118 23:12:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:16.118 23:12:19 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:20:16.118 23:12:19 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:20:16.118 23:12:19 -- nvmf/common.sh@520 -- # config=() 00:20:16.118 23:12:19 -- nvmf/common.sh@520 -- # local subsystem config 00:20:16.118 23:12:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:20:16.118 23:12:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:20:16.118 { 00:20:16.118 "params": { 00:20:16.119 "name": "Nvme$subsystem", 00:20:16.119 "trtype": "$TEST_TRANSPORT", 00:20:16.119 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:16.119 "adrfam": "ipv4", 00:20:16.119 "trsvcid": "$NVMF_PORT", 00:20:16.119 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:16.119 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:16.119 "hdgst": ${hdgst:-false}, 00:20:16.119 "ddgst": ${ddgst:-false} 00:20:16.119 }, 00:20:16.119 "method": "bdev_nvme_attach_controller" 00:20:16.119 } 00:20:16.119 EOF 00:20:16.119 )") 00:20:16.119 23:12:19 -- nvmf/common.sh@542 -- # cat 00:20:16.119 23:12:19 -- nvmf/common.sh@544 -- # jq . 00:20:16.119 23:12:19 -- nvmf/common.sh@545 -- # IFS=, 00:20:16.119 23:12:19 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:20:16.119 "params": { 00:20:16.119 "name": "Nvme1", 00:20:16.119 "trtype": "tcp", 00:20:16.119 "traddr": "10.0.0.2", 00:20:16.119 "adrfam": "ipv4", 00:20:16.119 "trsvcid": "4420", 00:20:16.119 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:16.119 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:16.119 "hdgst": false, 00:20:16.119 "ddgst": false 00:20:16.119 }, 00:20:16.119 "method": "bdev_nvme_attach_controller" 00:20:16.119 }' 00:20:16.119 [2024-11-28 23:12:19.628931] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:16.119 [2024-11-28 23:12:19.629006] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid2473287 ] 00:20:16.119 [2024-11-28 23:12:19.689499] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:20:16.377 [2024-11-28 23:12:19.772954] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:16.377 [2024-11-28 23:12:19.772997] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:16.377 [2024-11-28 23:12:19.773000] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:16.377 [2024-11-28 23:12:19.923137] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:20:16.377 [2024-11-28 23:12:19.923196] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:20:16.377 I/O targets: 00:20:16.377 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:20:16.377 00:20:16.377 00:20:16.377 CUnit - A unit testing framework for C - Version 2.1-3 00:20:16.377 http://cunit.sourceforge.net/ 00:20:16.377 00:20:16.377 00:20:16.377 Suite: bdevio tests on: Nvme1n1 00:20:16.377 Test: blockdev write read block ...passed 00:20:16.634 Test: blockdev write zeroes read block ...passed 00:20:16.634 Test: blockdev write zeroes read no split ...passed 00:20:16.634 Test: blockdev write zeroes read split ...passed 00:20:16.634 Test: blockdev write zeroes read split partial ...passed 00:20:16.634 Test: blockdev reset ...[2024-11-28 23:12:20.086977] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:20:16.634 [2024-11-28 23:12:20.087096] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15a9150 (9): Bad file descriptor 00:20:16.634 [2024-11-28 23:12:20.102303] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:20:16.634 passed 00:20:16.634 Test: blockdev write read 8 blocks ...passed 00:20:16.634 Test: blockdev write read size > 128k ...passed 00:20:16.634 Test: blockdev write read invalid size ...passed 00:20:16.634 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:20:16.634 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:20:16.634 Test: blockdev write read max offset ...passed 00:20:16.634 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:20:16.634 Test: blockdev writev readv 8 blocks ...passed 00:20:16.634 Test: blockdev writev readv 30 x 1block ...passed 00:20:16.892 Test: blockdev writev readv block ...passed 00:20:16.892 Test: blockdev writev readv size > 128k ...passed 00:20:16.892 Test: blockdev writev readv size > 128k in two iovs ...passed 00:20:16.892 Test: blockdev comparev and writev ...[2024-11-28 23:12:20.317425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:16.892 [2024-11-28 23:12:20.317461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:16.892 [2024-11-28 23:12:20.317499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:16.892 [2024-11-28 23:12:20.317528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:20:16.892 [2024-11-28 23:12:20.317895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:16.892 [2024-11-28 23:12:20.317923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:20:16.893 [2024-11-28 23:12:20.317957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:16.893 [2024-11-28 23:12:20.317984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:20:16.893 [2024-11-28 23:12:20.318325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:16.893 [2024-11-28 23:12:20.318352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:20:16.893 [2024-11-28 23:12:20.318386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:16.893 [2024-11-28 23:12:20.318426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:20:16.893 [2024-11-28 23:12:20.318744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:16.893 [2024-11-28 23:12:20.318770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:20:16.893 [2024-11-28 23:12:20.318804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:16.893 [2024-11-28 23:12:20.318832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:20:16.893 passed 00:20:16.893 Test: blockdev nvme passthru rw ...passed 00:20:16.893 Test: blockdev nvme passthru vendor specific ...[2024-11-28 23:12:20.401642] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:16.893 [2024-11-28 23:12:20.401671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:20:16.893 [2024-11-28 23:12:20.401826] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:16.893 [2024-11-28 23:12:20.401854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:20:16.893 [2024-11-28 23:12:20.402021] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:16.893 [2024-11-28 23:12:20.402046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:20:16.893 [2024-11-28 23:12:20.402200] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:16.893 [2024-11-28 23:12:20.402225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:20:16.893 passed 00:20:16.893 Test: blockdev nvme admin passthru ...passed 00:20:16.893 Test: blockdev copy ...passed 00:20:16.893 00:20:16.893 Run Summary: Type Total Ran Passed Failed Inactive 00:20:16.893 suites 1 1 n/a 0 0 00:20:16.893 tests 23 23 23 0 0 00:20:16.893 asserts 152 152 152 0 n/a 00:20:16.893 00:20:16.893 Elapsed time = 1.076 seconds 00:20:17.459 23:12:20 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:17.459 23:12:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:17.459 23:12:20 -- common/autotest_common.sh@10 -- # set +x 00:20:17.459 23:12:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:17.459 23:12:20 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:20:17.459 23:12:20 -- target/bdevio.sh@30 -- # nvmftestfini 00:20:17.459 23:12:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:17.459 23:12:20 -- nvmf/common.sh@116 -- # sync 00:20:17.459 23:12:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:17.459 23:12:20 -- nvmf/common.sh@119 -- # set +e 00:20:17.459 23:12:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:17.459 23:12:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:17.459 rmmod nvme_tcp 00:20:17.459 rmmod nvme_fabrics 00:20:17.459 rmmod nvme_keyring 00:20:17.459 23:12:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:17.459 23:12:20 -- nvmf/common.sh@123 -- # set -e 00:20:17.459 23:12:20 -- nvmf/common.sh@124 -- # return 0 00:20:17.459 23:12:20 -- nvmf/common.sh@477 -- # '[' -n 2473127 ']' 00:20:17.459 23:12:20 -- nvmf/common.sh@478 -- # killprocess 2473127 00:20:17.459 23:12:20 -- common/autotest_common.sh@936 -- # '[' -z 2473127 ']' 00:20:17.459 23:12:20 -- common/autotest_common.sh@940 -- # kill -0 2473127 00:20:17.459 23:12:20 -- common/autotest_common.sh@941 -- # uname 00:20:17.459 23:12:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:17.459 23:12:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2473127 00:20:17.459 23:12:20 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:20:17.459 23:12:20 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:20:17.459 23:12:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2473127' 00:20:17.459 killing process with pid 2473127 00:20:17.459 23:12:20 -- common/autotest_common.sh@955 -- # kill 2473127 00:20:17.459 23:12:20 -- common/autotest_common.sh@960 -- # wait 2473127 00:20:17.718 23:12:21 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:17.718 23:12:21 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:17.718 23:12:21 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:17.718 23:12:21 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:17.718 23:12:21 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:17.718 23:12:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:17.718 23:12:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:17.718 23:12:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:20.261 23:12:23 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:20.261 00:20:20.261 real 0m7.140s 00:20:20.261 user 0m12.853s 00:20:20.261 sys 0m2.552s 00:20:20.261 23:12:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:20:20.261 23:12:23 -- common/autotest_common.sh@10 -- # set +x 00:20:20.261 ************************************ 00:20:20.262 END TEST nvmf_bdevio_no_huge 00:20:20.262 ************************************ 00:20:20.262 23:12:23 -- nvmf/nvmf.sh@59 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:20:20.262 23:12:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:20.262 23:12:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:20.262 23:12:23 -- common/autotest_common.sh@10 -- # set +x 00:20:20.262 ************************************ 00:20:20.262 START TEST nvmf_tls 00:20:20.262 ************************************ 00:20:20.262 23:12:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:20:20.262 * Looking for test storage... 00:20:20.262 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:20:20.262 23:12:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:20:20.262 23:12:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:20:20.262 23:12:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:20:20.262 23:12:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:20:20.262 23:12:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:20:20.262 23:12:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:20:20.262 23:12:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:20:20.262 23:12:23 -- scripts/common.sh@335 -- # IFS=.-: 00:20:20.262 23:12:23 -- scripts/common.sh@335 -- # read -ra ver1 00:20:20.262 23:12:23 -- scripts/common.sh@336 -- # IFS=.-: 00:20:20.262 23:12:23 -- scripts/common.sh@336 -- # read -ra ver2 00:20:20.262 23:12:23 -- scripts/common.sh@337 -- # local 'op=<' 00:20:20.262 23:12:23 -- scripts/common.sh@339 -- # ver1_l=2 00:20:20.262 23:12:23 -- scripts/common.sh@340 -- # ver2_l=1 00:20:20.262 23:12:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:20:20.262 23:12:23 -- scripts/common.sh@343 -- # case "$op" in 00:20:20.262 23:12:23 -- scripts/common.sh@344 -- # : 1 00:20:20.262 23:12:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:20:20.262 23:12:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:20.262 23:12:23 -- scripts/common.sh@364 -- # decimal 1 00:20:20.262 23:12:23 -- scripts/common.sh@352 -- # local d=1 00:20:20.262 23:12:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:20:20.262 23:12:23 -- scripts/common.sh@354 -- # echo 1 00:20:20.262 23:12:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:20:20.262 23:12:23 -- scripts/common.sh@365 -- # decimal 2 00:20:20.262 23:12:23 -- scripts/common.sh@352 -- # local d=2 00:20:20.262 23:12:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:20:20.262 23:12:23 -- scripts/common.sh@354 -- # echo 2 00:20:20.262 23:12:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:20:20.263 23:12:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:20.263 23:12:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:20.263 23:12:23 -- scripts/common.sh@367 -- # return 0 00:20:20.263 23:12:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:20:20.263 23:12:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:20:20.263 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:20.263 --rc genhtml_branch_coverage=1 00:20:20.263 --rc genhtml_function_coverage=1 00:20:20.263 --rc genhtml_legend=1 00:20:20.263 --rc geninfo_all_blocks=1 00:20:20.263 --rc geninfo_unexecuted_blocks=1 00:20:20.263 00:20:20.263 ' 00:20:20.263 23:12:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:20:20.263 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:20.263 --rc genhtml_branch_coverage=1 00:20:20.263 --rc genhtml_function_coverage=1 00:20:20.263 --rc genhtml_legend=1 00:20:20.263 --rc geninfo_all_blocks=1 00:20:20.263 --rc geninfo_unexecuted_blocks=1 00:20:20.263 00:20:20.263 ' 00:20:20.263 23:12:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:20:20.263 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:20.263 --rc genhtml_branch_coverage=1 00:20:20.263 --rc genhtml_function_coverage=1 00:20:20.263 --rc genhtml_legend=1 00:20:20.263 --rc geninfo_all_blocks=1 00:20:20.263 --rc geninfo_unexecuted_blocks=1 00:20:20.263 00:20:20.263 ' 00:20:20.263 23:12:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:20:20.263 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:20.263 --rc genhtml_branch_coverage=1 00:20:20.263 --rc genhtml_function_coverage=1 00:20:20.263 --rc genhtml_legend=1 00:20:20.263 --rc geninfo_all_blocks=1 00:20:20.263 --rc geninfo_unexecuted_blocks=1 00:20:20.263 00:20:20.263 ' 00:20:20.263 23:12:23 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:20.263 23:12:23 -- nvmf/common.sh@7 -- # uname -s 00:20:20.263 23:12:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:20.263 23:12:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:20.263 23:12:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:20.263 23:12:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:20.263 23:12:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:20.263 23:12:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:20.263 23:12:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:20.263 23:12:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:20.263 23:12:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:20.263 23:12:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:20.263 23:12:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:20:20.263 23:12:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:20:20.263 23:12:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:20.263 23:12:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:20.263 23:12:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:20.263 23:12:23 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:20.263 23:12:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:20.263 23:12:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:20.263 23:12:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:20.263 23:12:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:20.263 23:12:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:20.263 23:12:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:20.263 23:12:23 -- paths/export.sh@5 -- # export PATH 00:20:20.263 23:12:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:20.263 23:12:23 -- nvmf/common.sh@46 -- # : 0 00:20:20.263 23:12:23 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:20.263 23:12:23 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:20.263 23:12:23 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:20.263 23:12:23 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:20.263 23:12:23 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:20.263 23:12:23 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:20.263 23:12:23 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:20.263 23:12:23 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:20.263 23:12:23 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:20:20.263 23:12:23 -- target/tls.sh@71 -- # nvmftestinit 00:20:20.263 23:12:23 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:20.263 23:12:23 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:20.264 23:12:23 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:20.264 23:12:23 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:20.264 23:12:23 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:20.264 23:12:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:20.264 23:12:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:20.264 23:12:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:20.264 23:12:23 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:20.264 23:12:23 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:20.264 23:12:23 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:20.264 23:12:23 -- common/autotest_common.sh@10 -- # set +x 00:20:22.166 23:12:25 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:22.166 23:12:25 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:22.166 23:12:25 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:22.166 23:12:25 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:22.166 23:12:25 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:22.166 23:12:25 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:22.166 23:12:25 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:22.166 23:12:25 -- nvmf/common.sh@294 -- # net_devs=() 00:20:22.166 23:12:25 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:22.166 23:12:25 -- nvmf/common.sh@295 -- # e810=() 00:20:22.166 23:12:25 -- nvmf/common.sh@295 -- # local -ga e810 00:20:22.166 23:12:25 -- nvmf/common.sh@296 -- # x722=() 00:20:22.166 23:12:25 -- nvmf/common.sh@296 -- # local -ga x722 00:20:22.166 23:12:25 -- nvmf/common.sh@297 -- # mlx=() 00:20:22.166 23:12:25 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:22.166 23:12:25 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:22.166 23:12:25 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:22.166 23:12:25 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:22.166 23:12:25 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:22.166 23:12:25 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:22.166 23:12:25 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:22.166 23:12:25 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:22.166 23:12:25 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:22.166 23:12:25 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:22.166 23:12:25 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:22.166 23:12:25 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:22.166 23:12:25 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:22.166 23:12:25 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:22.166 23:12:25 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:22.166 23:12:25 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:22.166 23:12:25 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:22.166 23:12:25 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:22.166 23:12:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:22.166 23:12:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:22.166 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:22.166 23:12:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:22.166 23:12:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:22.166 23:12:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:22.166 23:12:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:22.166 23:12:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:22.166 23:12:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:22.166 23:12:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:22.166 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:22.166 23:12:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:22.166 23:12:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:22.166 23:12:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:22.166 23:12:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:22.166 23:12:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:22.166 23:12:25 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:22.166 23:12:25 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:22.166 23:12:25 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:22.166 23:12:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:22.166 23:12:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:22.166 23:12:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:22.166 23:12:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:22.166 23:12:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:22.166 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:22.166 23:12:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:22.166 23:12:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:22.166 23:12:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:22.166 23:12:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:22.166 23:12:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:22.166 23:12:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:22.166 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:22.166 23:12:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:22.166 23:12:25 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:22.166 23:12:25 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:22.166 23:12:25 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:22.166 23:12:25 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:22.166 23:12:25 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:22.166 23:12:25 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:22.166 23:12:25 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:22.166 23:12:25 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:22.166 23:12:25 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:22.166 23:12:25 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:22.166 23:12:25 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:22.166 23:12:25 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:22.166 23:12:25 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:22.166 23:12:25 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:22.166 23:12:25 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:22.166 23:12:25 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:22.166 23:12:25 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:22.166 23:12:25 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:22.166 23:12:25 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:22.166 23:12:25 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:22.166 23:12:25 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:22.166 23:12:25 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:22.166 23:12:25 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:22.166 23:12:25 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:22.166 23:12:25 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:22.166 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:22.166 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.223 ms 00:20:22.166 00:20:22.166 --- 10.0.0.2 ping statistics --- 00:20:22.166 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:22.166 rtt min/avg/max/mdev = 0.223/0.223/0.223/0.000 ms 00:20:22.166 23:12:25 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:22.166 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:22.166 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.105 ms 00:20:22.166 00:20:22.166 --- 10.0.0.1 ping statistics --- 00:20:22.166 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:22.166 rtt min/avg/max/mdev = 0.105/0.105/0.105/0.000 ms 00:20:22.166 23:12:25 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:22.166 23:12:25 -- nvmf/common.sh@410 -- # return 0 00:20:22.166 23:12:25 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:22.166 23:12:25 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:22.166 23:12:25 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:22.166 23:12:25 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:22.166 23:12:25 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:22.166 23:12:25 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:22.166 23:12:25 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:22.166 23:12:25 -- target/tls.sh@72 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:20:22.166 23:12:25 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:22.166 23:12:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:22.167 23:12:25 -- common/autotest_common.sh@10 -- # set +x 00:20:22.167 23:12:25 -- nvmf/common.sh@469 -- # nvmfpid=2475470 00:20:22.167 23:12:25 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:20:22.167 23:12:25 -- nvmf/common.sh@470 -- # waitforlisten 2475470 00:20:22.167 23:12:25 -- common/autotest_common.sh@829 -- # '[' -z 2475470 ']' 00:20:22.167 23:12:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:22.167 23:12:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:22.167 23:12:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:22.167 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:22.167 23:12:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:22.167 23:12:25 -- common/autotest_common.sh@10 -- # set +x 00:20:22.425 [2024-11-28 23:12:25.803104] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:22.425 [2024-11-28 23:12:25.803173] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:22.425 EAL: No free 2048 kB hugepages reported on node 1 00:20:22.425 [2024-11-28 23:12:25.873776] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:22.425 [2024-11-28 23:12:25.961664] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:22.425 [2024-11-28 23:12:25.961828] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:22.425 [2024-11-28 23:12:25.961849] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:22.425 [2024-11-28 23:12:25.961863] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:22.425 [2024-11-28 23:12:25.961895] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:22.425 23:12:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:22.425 23:12:26 -- common/autotest_common.sh@862 -- # return 0 00:20:22.425 23:12:26 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:22.425 23:12:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:22.425 23:12:26 -- common/autotest_common.sh@10 -- # set +x 00:20:22.682 23:12:26 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:22.682 23:12:26 -- target/tls.sh@74 -- # '[' tcp '!=' tcp ']' 00:20:22.682 23:12:26 -- target/tls.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:20:22.682 true 00:20:22.941 23:12:26 -- target/tls.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:22.941 23:12:26 -- target/tls.sh@82 -- # jq -r .tls_version 00:20:22.941 23:12:26 -- target/tls.sh@82 -- # version=0 00:20:22.941 23:12:26 -- target/tls.sh@83 -- # [[ 0 != \0 ]] 00:20:22.941 23:12:26 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:20:23.199 23:12:26 -- target/tls.sh@90 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:23.199 23:12:26 -- target/tls.sh@90 -- # jq -r .tls_version 00:20:23.457 23:12:27 -- target/tls.sh@90 -- # version=13 00:20:23.457 23:12:27 -- target/tls.sh@91 -- # [[ 13 != \1\3 ]] 00:20:23.457 23:12:27 -- target/tls.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:20:23.715 23:12:27 -- target/tls.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:23.715 23:12:27 -- target/tls.sh@98 -- # jq -r .tls_version 00:20:23.973 23:12:27 -- target/tls.sh@98 -- # version=7 00:20:23.973 23:12:27 -- target/tls.sh@99 -- # [[ 7 != \7 ]] 00:20:23.973 23:12:27 -- target/tls.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:23.973 23:12:27 -- target/tls.sh@105 -- # jq -r .enable_ktls 00:20:24.232 23:12:27 -- target/tls.sh@105 -- # ktls=false 00:20:24.232 23:12:27 -- target/tls.sh@106 -- # [[ false != \f\a\l\s\e ]] 00:20:24.232 23:12:27 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:20:24.798 23:12:28 -- target/tls.sh@113 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:24.798 23:12:28 -- target/tls.sh@113 -- # jq -r .enable_ktls 00:20:24.798 23:12:28 -- target/tls.sh@113 -- # ktls=true 00:20:24.798 23:12:28 -- target/tls.sh@114 -- # [[ true != \t\r\u\e ]] 00:20:24.798 23:12:28 -- target/tls.sh@120 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:20:25.056 23:12:28 -- target/tls.sh@121 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:25.056 23:12:28 -- target/tls.sh@121 -- # jq -r .enable_ktls 00:20:25.315 23:12:28 -- target/tls.sh@121 -- # ktls=false 00:20:25.316 23:12:28 -- target/tls.sh@122 -- # [[ false != \f\a\l\s\e ]] 00:20:25.316 23:12:28 -- target/tls.sh@127 -- # format_interchange_psk 00112233445566778899aabbccddeeff 00:20:25.316 23:12:28 -- target/tls.sh@49 -- # local key hash crc 00:20:25.316 23:12:28 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff 00:20:25.316 23:12:28 -- target/tls.sh@51 -- # hash=01 00:20:25.316 23:12:28 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff 00:20:25.316 23:12:28 -- target/tls.sh@52 -- # gzip -1 -c 00:20:25.316 23:12:28 -- target/tls.sh@52 -- # tail -c8 00:20:25.316 23:12:28 -- target/tls.sh@52 -- # head -c 4 00:20:25.316 23:12:28 -- target/tls.sh@52 -- # crc='p$H�' 00:20:25.316 23:12:28 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:20:25.316 23:12:28 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeffp$H�' 00:20:25.316 23:12:28 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:20:25.316 23:12:28 -- target/tls.sh@127 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:20:25.316 23:12:28 -- target/tls.sh@128 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 00:20:25.316 23:12:28 -- target/tls.sh@49 -- # local key hash crc 00:20:25.316 23:12:28 -- target/tls.sh@51 -- # key=ffeeddccbbaa99887766554433221100 00:20:25.316 23:12:28 -- target/tls.sh@51 -- # hash=01 00:20:25.316 23:12:28 -- target/tls.sh@52 -- # echo -n ffeeddccbbaa99887766554433221100 00:20:25.316 23:12:28 -- target/tls.sh@52 -- # gzip -1 -c 00:20:25.316 23:12:28 -- target/tls.sh@52 -- # tail -c8 00:20:25.316 23:12:28 -- target/tls.sh@52 -- # head -c 4 00:20:25.316 23:12:28 -- target/tls.sh@52 -- # crc=$'_\006o\330' 00:20:25.316 23:12:28 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:20:25.316 23:12:28 -- target/tls.sh@54 -- # echo -n $'ffeeddccbbaa99887766554433221100_\006o\330' 00:20:25.316 23:12:28 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:20:25.316 23:12:28 -- target/tls.sh@128 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:20:25.316 23:12:28 -- target/tls.sh@130 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:25.316 23:12:28 -- target/tls.sh@131 -- # key_2_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:25.316 23:12:28 -- target/tls.sh@133 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:20:25.316 23:12:28 -- target/tls.sh@134 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:20:25.316 23:12:28 -- target/tls.sh@136 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:25.316 23:12:28 -- target/tls.sh@137 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:25.316 23:12:28 -- target/tls.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:20:25.574 23:12:29 -- target/tls.sh@140 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:20:26.140 23:12:29 -- target/tls.sh@142 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:26.140 23:12:29 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:26.140 23:12:29 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:26.398 [2024-11-28 23:12:29.786797] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:26.398 23:12:29 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:26.656 23:12:30 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:26.915 [2024-11-28 23:12:30.292199] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:26.915 [2024-11-28 23:12:30.292474] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:26.915 23:12:30 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:27.174 malloc0 00:20:27.174 23:12:30 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:27.444 23:12:30 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:27.702 23:12:31 -- target/tls.sh@146 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:27.702 EAL: No free 2048 kB hugepages reported on node 1 00:20:37.748 Initializing NVMe Controllers 00:20:37.748 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:20:37.748 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:20:37.748 Initialization complete. Launching workers. 00:20:37.748 ======================================================== 00:20:37.748 Latency(us) 00:20:37.748 Device Information : IOPS MiB/s Average min max 00:20:37.748 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7754.40 30.29 8256.08 1292.16 10327.74 00:20:37.748 ======================================================== 00:20:37.748 Total : 7754.40 30.29 8256.08 1292.16 10327.74 00:20:37.748 00:20:37.748 23:12:41 -- target/tls.sh@152 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:37.749 23:12:41 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:37.749 23:12:41 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:37.749 23:12:41 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:37.749 23:12:41 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:37.749 23:12:41 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:37.749 23:12:41 -- target/tls.sh@28 -- # bdevperf_pid=2477336 00:20:37.749 23:12:41 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:37.749 23:12:41 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:37.749 23:12:41 -- target/tls.sh@31 -- # waitforlisten 2477336 /var/tmp/bdevperf.sock 00:20:37.749 23:12:41 -- common/autotest_common.sh@829 -- # '[' -z 2477336 ']' 00:20:37.749 23:12:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:37.749 23:12:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:37.749 23:12:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:37.749 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:37.749 23:12:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:37.749 23:12:41 -- common/autotest_common.sh@10 -- # set +x 00:20:37.749 [2024-11-28 23:12:41.259633] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:37.749 [2024-11-28 23:12:41.259708] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2477336 ] 00:20:37.749 EAL: No free 2048 kB hugepages reported on node 1 00:20:37.749 [2024-11-28 23:12:41.316671] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:38.007 [2024-11-28 23:12:41.400568] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:38.941 23:12:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:38.941 23:12:42 -- common/autotest_common.sh@862 -- # return 0 00:20:38.941 23:12:42 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:38.941 [2024-11-28 23:12:42.488036] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:39.199 TLSTESTn1 00:20:39.199 23:12:42 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:20:39.199 Running I/O for 10 seconds... 00:20:49.163 00:20:49.163 Latency(us) 00:20:49.163 [2024-11-28T22:12:52.769Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:49.163 [2024-11-28T22:12:52.769Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:49.163 Verification LBA range: start 0x0 length 0x2000 00:20:49.163 TLSTESTn1 : 10.03 4728.32 18.47 0.00 0.00 27033.34 4757.43 44661.57 00:20:49.163 [2024-11-28T22:12:52.769Z] =================================================================================================================== 00:20:49.163 [2024-11-28T22:12:52.769Z] Total : 4728.32 18.47 0.00 0.00 27033.34 4757.43 44661.57 00:20:49.163 0 00:20:49.163 23:12:52 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:49.163 23:12:52 -- target/tls.sh@45 -- # killprocess 2477336 00:20:49.163 23:12:52 -- common/autotest_common.sh@936 -- # '[' -z 2477336 ']' 00:20:49.163 23:12:52 -- common/autotest_common.sh@940 -- # kill -0 2477336 00:20:49.163 23:12:52 -- common/autotest_common.sh@941 -- # uname 00:20:49.163 23:12:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:49.163 23:12:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2477336 00:20:49.421 23:12:52 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:49.421 23:12:52 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:49.421 23:12:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2477336' 00:20:49.421 killing process with pid 2477336 00:20:49.421 23:12:52 -- common/autotest_common.sh@955 -- # kill 2477336 00:20:49.421 Received shutdown signal, test time was about 10.000000 seconds 00:20:49.421 00:20:49.421 Latency(us) 00:20:49.421 [2024-11-28T22:12:53.027Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:49.421 [2024-11-28T22:12:53.027Z] =================================================================================================================== 00:20:49.421 [2024-11-28T22:12:53.027Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:49.421 23:12:52 -- common/autotest_common.sh@960 -- # wait 2477336 00:20:49.679 23:12:53 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:49.679 23:12:53 -- common/autotest_common.sh@650 -- # local es=0 00:20:49.679 23:12:53 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:49.679 23:12:53 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:49.679 23:12:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:49.679 23:12:53 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:49.679 23:12:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:49.679 23:12:53 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:49.679 23:12:53 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:49.679 23:12:53 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:49.679 23:12:53 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:49.679 23:12:53 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt' 00:20:49.679 23:12:53 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:49.679 23:12:53 -- target/tls.sh@28 -- # bdevperf_pid=2478777 00:20:49.679 23:12:53 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:49.679 23:12:53 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:49.679 23:12:53 -- target/tls.sh@31 -- # waitforlisten 2478777 /var/tmp/bdevperf.sock 00:20:49.679 23:12:53 -- common/autotest_common.sh@829 -- # '[' -z 2478777 ']' 00:20:49.679 23:12:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:49.679 23:12:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:49.679 23:12:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:49.679 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:49.679 23:12:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:49.679 23:12:53 -- common/autotest_common.sh@10 -- # set +x 00:20:49.679 [2024-11-28 23:12:53.075611] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:49.680 [2024-11-28 23:12:53.075702] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2478777 ] 00:20:49.680 EAL: No free 2048 kB hugepages reported on node 1 00:20:49.680 [2024-11-28 23:12:53.143530] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:49.680 [2024-11-28 23:12:53.235354] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:50.613 23:12:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:50.613 23:12:54 -- common/autotest_common.sh@862 -- # return 0 00:20:50.613 23:12:54 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:50.872 [2024-11-28 23:12:54.370341] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:50.872 [2024-11-28 23:12:54.378212] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:50.872 [2024-11-28 23:12:54.378318] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1846cf0 (107): Transport endpoint is not connected 00:20:50.872 [2024-11-28 23:12:54.379301] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1846cf0 (9): Bad file descriptor 00:20:50.872 [2024-11-28 23:12:54.380299] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:50.872 [2024-11-28 23:12:54.380324] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:50.873 [2024-11-28 23:12:54.380345] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:50.873 request: 00:20:50.873 { 00:20:50.873 "name": "TLSTEST", 00:20:50.873 "trtype": "tcp", 00:20:50.873 "traddr": "10.0.0.2", 00:20:50.873 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:50.873 "adrfam": "ipv4", 00:20:50.873 "trsvcid": "4420", 00:20:50.873 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:50.873 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt", 00:20:50.873 "method": "bdev_nvme_attach_controller", 00:20:50.873 "req_id": 1 00:20:50.873 } 00:20:50.873 Got JSON-RPC error response 00:20:50.873 response: 00:20:50.873 { 00:20:50.873 "code": -32602, 00:20:50.873 "message": "Invalid parameters" 00:20:50.873 } 00:20:50.873 23:12:54 -- target/tls.sh@36 -- # killprocess 2478777 00:20:50.873 23:12:54 -- common/autotest_common.sh@936 -- # '[' -z 2478777 ']' 00:20:50.873 23:12:54 -- common/autotest_common.sh@940 -- # kill -0 2478777 00:20:50.873 23:12:54 -- common/autotest_common.sh@941 -- # uname 00:20:50.873 23:12:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:50.873 23:12:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2478777 00:20:50.873 23:12:54 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:50.873 23:12:54 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:50.873 23:12:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2478777' 00:20:50.873 killing process with pid 2478777 00:20:50.873 23:12:54 -- common/autotest_common.sh@955 -- # kill 2478777 00:20:50.873 Received shutdown signal, test time was about 10.000000 seconds 00:20:50.873 00:20:50.873 Latency(us) 00:20:50.873 [2024-11-28T22:12:54.479Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:50.873 [2024-11-28T22:12:54.479Z] =================================================================================================================== 00:20:50.873 [2024-11-28T22:12:54.479Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:50.873 23:12:54 -- common/autotest_common.sh@960 -- # wait 2478777 00:20:51.132 23:12:54 -- target/tls.sh@37 -- # return 1 00:20:51.132 23:12:54 -- common/autotest_common.sh@653 -- # es=1 00:20:51.132 23:12:54 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:51.132 23:12:54 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:51.132 23:12:54 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:51.132 23:12:54 -- target/tls.sh@158 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:51.132 23:12:54 -- common/autotest_common.sh@650 -- # local es=0 00:20:51.132 23:12:54 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:51.132 23:12:54 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:51.132 23:12:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:51.132 23:12:54 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:51.132 23:12:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:51.132 23:12:54 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:51.132 23:12:54 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:51.132 23:12:54 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:51.132 23:12:54 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:20:51.132 23:12:54 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:51.132 23:12:54 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:51.132 23:12:54 -- target/tls.sh@28 -- # bdevperf_pid=2478976 00:20:51.132 23:12:54 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:51.132 23:12:54 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:51.132 23:12:54 -- target/tls.sh@31 -- # waitforlisten 2478976 /var/tmp/bdevperf.sock 00:20:51.132 23:12:54 -- common/autotest_common.sh@829 -- # '[' -z 2478976 ']' 00:20:51.132 23:12:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:51.132 23:12:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:51.132 23:12:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:51.132 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:51.132 23:12:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:51.132 23:12:54 -- common/autotest_common.sh@10 -- # set +x 00:20:51.132 [2024-11-28 23:12:54.709130] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:51.132 [2024-11-28 23:12:54.709208] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2478976 ] 00:20:51.391 EAL: No free 2048 kB hugepages reported on node 1 00:20:51.391 [2024-11-28 23:12:54.770169] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:51.391 [2024-11-28 23:12:54.853633] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:52.325 23:12:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:52.325 23:12:55 -- common/autotest_common.sh@862 -- # return 0 00:20:52.325 23:12:55 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:52.583 [2024-11-28 23:12:55.995896] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:52.583 [2024-11-28 23:12:56.002213] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:20:52.583 [2024-11-28 23:12:56.002243] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:20:52.583 [2024-11-28 23:12:56.002281] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:52.583 [2024-11-28 23:12:56.002883] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218ecf0 (107): Transport endpoint is not connected 00:20:52.583 [2024-11-28 23:12:56.003868] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218ecf0 (9): Bad file descriptor 00:20:52.583 [2024-11-28 23:12:56.004868] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:52.583 [2024-11-28 23:12:56.004892] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:52.583 [2024-11-28 23:12:56.004913] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:52.583 request: 00:20:52.583 { 00:20:52.583 "name": "TLSTEST", 00:20:52.583 "trtype": "tcp", 00:20:52.583 "traddr": "10.0.0.2", 00:20:52.583 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:20:52.583 "adrfam": "ipv4", 00:20:52.583 "trsvcid": "4420", 00:20:52.583 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:52.583 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:20:52.583 "method": "bdev_nvme_attach_controller", 00:20:52.583 "req_id": 1 00:20:52.583 } 00:20:52.583 Got JSON-RPC error response 00:20:52.583 response: 00:20:52.583 { 00:20:52.583 "code": -32602, 00:20:52.583 "message": "Invalid parameters" 00:20:52.583 } 00:20:52.583 23:12:56 -- target/tls.sh@36 -- # killprocess 2478976 00:20:52.583 23:12:56 -- common/autotest_common.sh@936 -- # '[' -z 2478976 ']' 00:20:52.583 23:12:56 -- common/autotest_common.sh@940 -- # kill -0 2478976 00:20:52.584 23:12:56 -- common/autotest_common.sh@941 -- # uname 00:20:52.584 23:12:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:52.584 23:12:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2478976 00:20:52.584 23:12:56 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:52.584 23:12:56 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:52.584 23:12:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2478976' 00:20:52.584 killing process with pid 2478976 00:20:52.584 23:12:56 -- common/autotest_common.sh@955 -- # kill 2478976 00:20:52.584 Received shutdown signal, test time was about 10.000000 seconds 00:20:52.584 00:20:52.584 Latency(us) 00:20:52.584 [2024-11-28T22:12:56.190Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:52.584 [2024-11-28T22:12:56.190Z] =================================================================================================================== 00:20:52.584 [2024-11-28T22:12:56.190Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:52.584 23:12:56 -- common/autotest_common.sh@960 -- # wait 2478976 00:20:52.842 23:12:56 -- target/tls.sh@37 -- # return 1 00:20:52.842 23:12:56 -- common/autotest_common.sh@653 -- # es=1 00:20:52.842 23:12:56 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:52.842 23:12:56 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:52.842 23:12:56 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:52.842 23:12:56 -- target/tls.sh@161 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:52.842 23:12:56 -- common/autotest_common.sh@650 -- # local es=0 00:20:52.842 23:12:56 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:52.842 23:12:56 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:52.842 23:12:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:52.842 23:12:56 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:52.842 23:12:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:52.842 23:12:56 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:52.842 23:12:56 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:52.842 23:12:56 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:20:52.843 23:12:56 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:52.843 23:12:56 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:52.843 23:12:56 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:52.843 23:12:56 -- target/tls.sh@28 -- # bdevperf_pid=2479133 00:20:52.843 23:12:56 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:52.843 23:12:56 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:52.843 23:12:56 -- target/tls.sh@31 -- # waitforlisten 2479133 /var/tmp/bdevperf.sock 00:20:52.843 23:12:56 -- common/autotest_common.sh@829 -- # '[' -z 2479133 ']' 00:20:52.843 23:12:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:52.843 23:12:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:52.843 23:12:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:52.843 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:52.843 23:12:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:52.843 23:12:56 -- common/autotest_common.sh@10 -- # set +x 00:20:52.843 [2024-11-28 23:12:56.329406] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:52.843 [2024-11-28 23:12:56.329487] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2479133 ] 00:20:52.843 EAL: No free 2048 kB hugepages reported on node 1 00:20:52.843 [2024-11-28 23:12:56.391366] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:53.101 [2024-11-28 23:12:56.477475] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:54.034 23:12:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:54.034 23:12:57 -- common/autotest_common.sh@862 -- # return 0 00:20:54.034 23:12:57 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:54.034 [2024-11-28 23:12:57.558165] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:54.034 [2024-11-28 23:12:57.566241] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:20:54.034 [2024-11-28 23:12:57.566285] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:20:54.034 [2024-11-28 23:12:57.566338] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:54.034 [2024-11-28 23:12:57.567263] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18dacf0 (107): Transport endpoint is not connected 00:20:54.034 [2024-11-28 23:12:57.568251] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18dacf0 (9): Bad file descriptor 00:20:54.034 [2024-11-28 23:12:57.569250] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:20:54.034 [2024-11-28 23:12:57.569273] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:54.034 [2024-11-28 23:12:57.569302] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:20:54.034 request: 00:20:54.034 { 00:20:54.034 "name": "TLSTEST", 00:20:54.034 "trtype": "tcp", 00:20:54.034 "traddr": "10.0.0.2", 00:20:54.034 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:54.034 "adrfam": "ipv4", 00:20:54.034 "trsvcid": "4420", 00:20:54.034 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:20:54.034 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:20:54.034 "method": "bdev_nvme_attach_controller", 00:20:54.034 "req_id": 1 00:20:54.034 } 00:20:54.034 Got JSON-RPC error response 00:20:54.034 response: 00:20:54.034 { 00:20:54.034 "code": -32602, 00:20:54.034 "message": "Invalid parameters" 00:20:54.034 } 00:20:54.034 23:12:57 -- target/tls.sh@36 -- # killprocess 2479133 00:20:54.034 23:12:57 -- common/autotest_common.sh@936 -- # '[' -z 2479133 ']' 00:20:54.034 23:12:57 -- common/autotest_common.sh@940 -- # kill -0 2479133 00:20:54.034 23:12:57 -- common/autotest_common.sh@941 -- # uname 00:20:54.034 23:12:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:54.034 23:12:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2479133 00:20:54.034 23:12:57 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:54.034 23:12:57 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:54.034 23:12:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2479133' 00:20:54.034 killing process with pid 2479133 00:20:54.034 23:12:57 -- common/autotest_common.sh@955 -- # kill 2479133 00:20:54.034 Received shutdown signal, test time was about 10.000000 seconds 00:20:54.034 00:20:54.034 Latency(us) 00:20:54.034 [2024-11-28T22:12:57.640Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:54.034 [2024-11-28T22:12:57.640Z] =================================================================================================================== 00:20:54.034 [2024-11-28T22:12:57.640Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:54.034 23:12:57 -- common/autotest_common.sh@960 -- # wait 2479133 00:20:54.293 23:12:57 -- target/tls.sh@37 -- # return 1 00:20:54.293 23:12:57 -- common/autotest_common.sh@653 -- # es=1 00:20:54.293 23:12:57 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:54.293 23:12:57 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:54.293 23:12:57 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:54.293 23:12:57 -- target/tls.sh@164 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:54.293 23:12:57 -- common/autotest_common.sh@650 -- # local es=0 00:20:54.293 23:12:57 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:54.293 23:12:57 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:54.293 23:12:57 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:54.293 23:12:57 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:54.293 23:12:57 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:54.293 23:12:57 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:54.293 23:12:57 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:54.293 23:12:57 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:54.293 23:12:57 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:54.293 23:12:57 -- target/tls.sh@23 -- # psk= 00:20:54.293 23:12:57 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:54.293 23:12:57 -- target/tls.sh@28 -- # bdevperf_pid=2479401 00:20:54.293 23:12:57 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:54.293 23:12:57 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:54.293 23:12:57 -- target/tls.sh@31 -- # waitforlisten 2479401 /var/tmp/bdevperf.sock 00:20:54.293 23:12:57 -- common/autotest_common.sh@829 -- # '[' -z 2479401 ']' 00:20:54.293 23:12:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:54.293 23:12:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:54.293 23:12:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:54.293 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:54.293 23:12:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:54.293 23:12:57 -- common/autotest_common.sh@10 -- # set +x 00:20:54.293 [2024-11-28 23:12:57.869409] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:54.293 [2024-11-28 23:12:57.869497] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2479401 ] 00:20:54.293 EAL: No free 2048 kB hugepages reported on node 1 00:20:54.551 [2024-11-28 23:12:57.928579] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:54.551 [2024-11-28 23:12:58.012281] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:55.484 23:12:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:55.484 23:12:58 -- common/autotest_common.sh@862 -- # return 0 00:20:55.484 23:12:58 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:20:55.742 [2024-11-28 23:12:59.180455] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:55.742 [2024-11-28 23:12:59.182286] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x568720 (9): Bad file descriptor 00:20:55.742 [2024-11-28 23:12:59.183281] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:55.742 [2024-11-28 23:12:59.183306] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:55.742 [2024-11-28 23:12:59.183329] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:55.742 request: 00:20:55.742 { 00:20:55.742 "name": "TLSTEST", 00:20:55.742 "trtype": "tcp", 00:20:55.742 "traddr": "10.0.0.2", 00:20:55.742 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:55.742 "adrfam": "ipv4", 00:20:55.742 "trsvcid": "4420", 00:20:55.742 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:55.742 "method": "bdev_nvme_attach_controller", 00:20:55.742 "req_id": 1 00:20:55.742 } 00:20:55.742 Got JSON-RPC error response 00:20:55.742 response: 00:20:55.742 { 00:20:55.742 "code": -32602, 00:20:55.742 "message": "Invalid parameters" 00:20:55.742 } 00:20:55.742 23:12:59 -- target/tls.sh@36 -- # killprocess 2479401 00:20:55.742 23:12:59 -- common/autotest_common.sh@936 -- # '[' -z 2479401 ']' 00:20:55.742 23:12:59 -- common/autotest_common.sh@940 -- # kill -0 2479401 00:20:55.742 23:12:59 -- common/autotest_common.sh@941 -- # uname 00:20:55.742 23:12:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:55.742 23:12:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2479401 00:20:55.742 23:12:59 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:55.742 23:12:59 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:55.742 23:12:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2479401' 00:20:55.742 killing process with pid 2479401 00:20:55.742 23:12:59 -- common/autotest_common.sh@955 -- # kill 2479401 00:20:55.742 Received shutdown signal, test time was about 10.000000 seconds 00:20:55.742 00:20:55.742 Latency(us) 00:20:55.742 [2024-11-28T22:12:59.348Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:55.742 [2024-11-28T22:12:59.348Z] =================================================================================================================== 00:20:55.742 [2024-11-28T22:12:59.348Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:55.743 23:12:59 -- common/autotest_common.sh@960 -- # wait 2479401 00:20:56.001 23:12:59 -- target/tls.sh@37 -- # return 1 00:20:56.001 23:12:59 -- common/autotest_common.sh@653 -- # es=1 00:20:56.001 23:12:59 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:56.001 23:12:59 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:56.001 23:12:59 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:56.001 23:12:59 -- target/tls.sh@167 -- # killprocess 2475470 00:20:56.001 23:12:59 -- common/autotest_common.sh@936 -- # '[' -z 2475470 ']' 00:20:56.001 23:12:59 -- common/autotest_common.sh@940 -- # kill -0 2475470 00:20:56.001 23:12:59 -- common/autotest_common.sh@941 -- # uname 00:20:56.001 23:12:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:56.001 23:12:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2475470 00:20:56.001 23:12:59 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:56.001 23:12:59 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:56.001 23:12:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2475470' 00:20:56.001 killing process with pid 2475470 00:20:56.001 23:12:59 -- common/autotest_common.sh@955 -- # kill 2475470 00:20:56.001 23:12:59 -- common/autotest_common.sh@960 -- # wait 2475470 00:20:56.259 23:12:59 -- target/tls.sh@168 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 02 00:20:56.259 23:12:59 -- target/tls.sh@49 -- # local key hash crc 00:20:56.259 23:12:59 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:20:56.259 23:12:59 -- target/tls.sh@51 -- # hash=02 00:20:56.259 23:12:59 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff0011223344556677 00:20:56.259 23:12:59 -- target/tls.sh@52 -- # gzip -1 -c 00:20:56.259 23:12:59 -- target/tls.sh@52 -- # tail -c8 00:20:56.259 23:12:59 -- target/tls.sh@52 -- # head -c 4 00:20:56.259 23:12:59 -- target/tls.sh@52 -- # crc='�e�'\''' 00:20:56.259 23:12:59 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:20:56.259 23:12:59 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeff0011223344556677�e�'\''' 00:20:56.259 23:12:59 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:56.259 23:12:59 -- target/tls.sh@168 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:56.259 23:12:59 -- target/tls.sh@169 -- # key_long_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:56.259 23:12:59 -- target/tls.sh@170 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:56.259 23:12:59 -- target/tls.sh@171 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:56.259 23:12:59 -- target/tls.sh@172 -- # nvmfappstart -m 0x2 00:20:56.259 23:12:59 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:56.259 23:12:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:56.259 23:12:59 -- common/autotest_common.sh@10 -- # set +x 00:20:56.259 23:12:59 -- nvmf/common.sh@469 -- # nvmfpid=2479597 00:20:56.259 23:12:59 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:56.259 23:12:59 -- nvmf/common.sh@470 -- # waitforlisten 2479597 00:20:56.259 23:12:59 -- common/autotest_common.sh@829 -- # '[' -z 2479597 ']' 00:20:56.259 23:12:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:56.259 23:12:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:56.259 23:12:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:56.259 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:56.259 23:12:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:56.259 23:12:59 -- common/autotest_common.sh@10 -- # set +x 00:20:56.259 [2024-11-28 23:12:59.794760] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:56.259 [2024-11-28 23:12:59.794848] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:56.259 EAL: No free 2048 kB hugepages reported on node 1 00:20:56.259 [2024-11-28 23:12:59.859037] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:56.517 [2024-11-28 23:12:59.944600] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:56.517 [2024-11-28 23:12:59.944729] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:56.517 [2024-11-28 23:12:59.944745] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:56.517 [2024-11-28 23:12:59.944758] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:56.517 [2024-11-28 23:12:59.944791] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:56.517 23:13:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:56.517 23:13:00 -- common/autotest_common.sh@862 -- # return 0 00:20:56.517 23:13:00 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:56.517 23:13:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:56.517 23:13:00 -- common/autotest_common.sh@10 -- # set +x 00:20:56.517 23:13:00 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:56.517 23:13:00 -- target/tls.sh@174 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:56.517 23:13:00 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:56.517 23:13:00 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:56.774 [2024-11-28 23:13:00.375132] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:57.032 23:13:00 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:57.290 23:13:00 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:57.547 [2024-11-28 23:13:00.908568] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:57.547 [2024-11-28 23:13:00.908837] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:57.547 23:13:00 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:57.805 malloc0 00:20:57.805 23:13:01 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:58.063 23:13:01 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:58.322 23:13:01 -- target/tls.sh@176 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:58.322 23:13:01 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:58.322 23:13:01 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:58.322 23:13:01 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:58.322 23:13:01 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:20:58.322 23:13:01 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:58.322 23:13:01 -- target/tls.sh@28 -- # bdevperf_pid=2479863 00:20:58.322 23:13:01 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:58.322 23:13:01 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:58.322 23:13:01 -- target/tls.sh@31 -- # waitforlisten 2479863 /var/tmp/bdevperf.sock 00:20:58.322 23:13:01 -- common/autotest_common.sh@829 -- # '[' -z 2479863 ']' 00:20:58.322 23:13:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:58.322 23:13:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:58.322 23:13:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:58.322 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:58.322 23:13:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:58.322 23:13:01 -- common/autotest_common.sh@10 -- # set +x 00:20:58.322 [2024-11-28 23:13:01.727942] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:58.322 [2024-11-28 23:13:01.728015] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2479863 ] 00:20:58.322 EAL: No free 2048 kB hugepages reported on node 1 00:20:58.322 [2024-11-28 23:13:01.788535] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:58.322 [2024-11-28 23:13:01.870281] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:59.256 23:13:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:59.256 23:13:02 -- common/autotest_common.sh@862 -- # return 0 00:20:59.256 23:13:02 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:59.514 [2024-11-28 23:13:02.910920] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:59.514 TLSTESTn1 00:20:59.514 23:13:02 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:20:59.514 Running I/O for 10 seconds... 00:21:11.722 00:21:11.722 Latency(us) 00:21:11.722 [2024-11-28T22:13:15.328Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:11.722 [2024-11-28T22:13:15.328Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:21:11.722 Verification LBA range: start 0x0 length 0x2000 00:21:11.722 TLSTESTn1 : 10.01 4007.68 15.65 0.00 0.00 31898.70 3883.61 45244.11 00:21:11.722 [2024-11-28T22:13:15.328Z] =================================================================================================================== 00:21:11.722 [2024-11-28T22:13:15.328Z] Total : 4007.68 15.65 0.00 0.00 31898.70 3883.61 45244.11 00:21:11.722 0 00:21:11.722 23:13:13 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:21:11.722 23:13:13 -- target/tls.sh@45 -- # killprocess 2479863 00:21:11.722 23:13:13 -- common/autotest_common.sh@936 -- # '[' -z 2479863 ']' 00:21:11.722 23:13:13 -- common/autotest_common.sh@940 -- # kill -0 2479863 00:21:11.722 23:13:13 -- common/autotest_common.sh@941 -- # uname 00:21:11.722 23:13:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:11.722 23:13:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2479863 00:21:11.722 23:13:13 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:11.722 23:13:13 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:11.722 23:13:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2479863' 00:21:11.722 killing process with pid 2479863 00:21:11.722 23:13:13 -- common/autotest_common.sh@955 -- # kill 2479863 00:21:11.722 Received shutdown signal, test time was about 10.000000 seconds 00:21:11.722 00:21:11.722 Latency(us) 00:21:11.722 [2024-11-28T22:13:15.328Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:11.722 [2024-11-28T22:13:15.328Z] =================================================================================================================== 00:21:11.722 [2024-11-28T22:13:15.328Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:11.722 23:13:13 -- common/autotest_common.sh@960 -- # wait 2479863 00:21:11.722 23:13:13 -- target/tls.sh@179 -- # chmod 0666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:11.722 23:13:13 -- target/tls.sh@180 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:11.722 23:13:13 -- common/autotest_common.sh@650 -- # local es=0 00:21:11.722 23:13:13 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:11.722 23:13:13 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:21:11.722 23:13:13 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:11.722 23:13:13 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:21:11.722 23:13:13 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:11.722 23:13:13 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:11.722 23:13:13 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:21:11.722 23:13:13 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:21:11.722 23:13:13 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:21:11.722 23:13:13 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:21:11.722 23:13:13 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:21:11.722 23:13:13 -- target/tls.sh@28 -- # bdevperf_pid=2481276 00:21:11.722 23:13:13 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:21:11.722 23:13:13 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:21:11.722 23:13:13 -- target/tls.sh@31 -- # waitforlisten 2481276 /var/tmp/bdevperf.sock 00:21:11.722 23:13:13 -- common/autotest_common.sh@829 -- # '[' -z 2481276 ']' 00:21:11.722 23:13:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:11.722 23:13:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:11.722 23:13:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:11.722 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:11.722 23:13:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:11.722 23:13:13 -- common/autotest_common.sh@10 -- # set +x 00:21:11.722 [2024-11-28 23:13:13.455963] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:11.722 [2024-11-28 23:13:13.456046] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2481276 ] 00:21:11.722 EAL: No free 2048 kB hugepages reported on node 1 00:21:11.722 [2024-11-28 23:13:13.515489] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:11.722 [2024-11-28 23:13:13.596852] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:11.722 23:13:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:11.722 23:13:14 -- common/autotest_common.sh@862 -- # return 0 00:21:11.722 23:13:14 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:11.722 [2024-11-28 23:13:14.670489] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:11.722 [2024-11-28 23:13:14.670535] bdev_nvme_rpc.c: 336:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:21:11.722 request: 00:21:11.722 { 00:21:11.722 "name": "TLSTEST", 00:21:11.722 "trtype": "tcp", 00:21:11.722 "traddr": "10.0.0.2", 00:21:11.722 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:11.722 "adrfam": "ipv4", 00:21:11.722 "trsvcid": "4420", 00:21:11.722 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:11.722 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:21:11.722 "method": "bdev_nvme_attach_controller", 00:21:11.722 "req_id": 1 00:21:11.722 } 00:21:11.722 Got JSON-RPC error response 00:21:11.722 response: 00:21:11.722 { 00:21:11.722 "code": -22, 00:21:11.722 "message": "Could not retrieve PSK from file: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:21:11.722 } 00:21:11.722 23:13:14 -- target/tls.sh@36 -- # killprocess 2481276 00:21:11.722 23:13:14 -- common/autotest_common.sh@936 -- # '[' -z 2481276 ']' 00:21:11.722 23:13:14 -- common/autotest_common.sh@940 -- # kill -0 2481276 00:21:11.722 23:13:14 -- common/autotest_common.sh@941 -- # uname 00:21:11.722 23:13:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:11.722 23:13:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2481276 00:21:11.722 23:13:14 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:11.722 23:13:14 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:11.722 23:13:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2481276' 00:21:11.722 killing process with pid 2481276 00:21:11.722 23:13:14 -- common/autotest_common.sh@955 -- # kill 2481276 00:21:11.722 Received shutdown signal, test time was about 10.000000 seconds 00:21:11.722 00:21:11.722 Latency(us) 00:21:11.722 [2024-11-28T22:13:15.328Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:11.722 [2024-11-28T22:13:15.328Z] =================================================================================================================== 00:21:11.722 [2024-11-28T22:13:15.328Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:21:11.722 23:13:14 -- common/autotest_common.sh@960 -- # wait 2481276 00:21:11.722 23:13:14 -- target/tls.sh@37 -- # return 1 00:21:11.722 23:13:14 -- common/autotest_common.sh@653 -- # es=1 00:21:11.722 23:13:14 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:21:11.722 23:13:14 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:21:11.722 23:13:14 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:21:11.722 23:13:14 -- target/tls.sh@183 -- # killprocess 2479597 00:21:11.722 23:13:14 -- common/autotest_common.sh@936 -- # '[' -z 2479597 ']' 00:21:11.722 23:13:14 -- common/autotest_common.sh@940 -- # kill -0 2479597 00:21:11.722 23:13:14 -- common/autotest_common.sh@941 -- # uname 00:21:11.722 23:13:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:11.722 23:13:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2479597 00:21:11.722 23:13:14 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:11.722 23:13:14 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:11.722 23:13:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2479597' 00:21:11.722 killing process with pid 2479597 00:21:11.722 23:13:14 -- common/autotest_common.sh@955 -- # kill 2479597 00:21:11.722 23:13:14 -- common/autotest_common.sh@960 -- # wait 2479597 00:21:11.722 23:13:15 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:21:11.722 23:13:15 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:11.722 23:13:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:11.722 23:13:15 -- common/autotest_common.sh@10 -- # set +x 00:21:11.722 23:13:15 -- nvmf/common.sh@469 -- # nvmfpid=2481524 00:21:11.722 23:13:15 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:21:11.722 23:13:15 -- nvmf/common.sh@470 -- # waitforlisten 2481524 00:21:11.722 23:13:15 -- common/autotest_common.sh@829 -- # '[' -z 2481524 ']' 00:21:11.722 23:13:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:11.722 23:13:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:11.722 23:13:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:11.722 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:11.722 23:13:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:11.722 23:13:15 -- common/autotest_common.sh@10 -- # set +x 00:21:11.722 [2024-11-28 23:13:15.290714] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:11.722 [2024-11-28 23:13:15.290813] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:11.722 EAL: No free 2048 kB hugepages reported on node 1 00:21:11.981 [2024-11-28 23:13:15.360974] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:11.981 [2024-11-28 23:13:15.448293] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:11.981 [2024-11-28 23:13:15.448458] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:11.981 [2024-11-28 23:13:15.448477] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:11.981 [2024-11-28 23:13:15.448490] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:11.981 [2024-11-28 23:13:15.448519] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:12.911 23:13:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:12.911 23:13:16 -- common/autotest_common.sh@862 -- # return 0 00:21:12.911 23:13:16 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:12.911 23:13:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:12.911 23:13:16 -- common/autotest_common.sh@10 -- # set +x 00:21:12.911 23:13:16 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:12.911 23:13:16 -- target/tls.sh@186 -- # NOT setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:12.912 23:13:16 -- common/autotest_common.sh@650 -- # local es=0 00:21:12.912 23:13:16 -- common/autotest_common.sh@652 -- # valid_exec_arg setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:12.912 23:13:16 -- common/autotest_common.sh@638 -- # local arg=setup_nvmf_tgt 00:21:12.912 23:13:16 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:12.912 23:13:16 -- common/autotest_common.sh@642 -- # type -t setup_nvmf_tgt 00:21:12.912 23:13:16 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:12.912 23:13:16 -- common/autotest_common.sh@653 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:12.912 23:13:16 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:12.912 23:13:16 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:21:13.169 [2024-11-28 23:13:16.595811] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:13.169 23:13:16 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:21:13.427 23:13:16 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:21:13.684 [2024-11-28 23:13:17.177405] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:13.684 [2024-11-28 23:13:17.177664] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:13.684 23:13:17 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:21:13.943 malloc0 00:21:13.943 23:13:17 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:21:14.201 23:13:17 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:14.459 [2024-11-28 23:13:17.926711] tcp.c:3551:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:21:14.459 [2024-11-28 23:13:17.926753] tcp.c:3620:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:21:14.459 [2024-11-28 23:13:17.926789] subsystem.c: 880:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:21:14.459 request: 00:21:14.459 { 00:21:14.459 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:14.459 "host": "nqn.2016-06.io.spdk:host1", 00:21:14.459 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:21:14.459 "method": "nvmf_subsystem_add_host", 00:21:14.459 "req_id": 1 00:21:14.459 } 00:21:14.459 Got JSON-RPC error response 00:21:14.459 response: 00:21:14.459 { 00:21:14.459 "code": -32603, 00:21:14.459 "message": "Internal error" 00:21:14.459 } 00:21:14.459 23:13:17 -- common/autotest_common.sh@653 -- # es=1 00:21:14.459 23:13:17 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:21:14.459 23:13:17 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:21:14.459 23:13:17 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:21:14.459 23:13:17 -- target/tls.sh@189 -- # killprocess 2481524 00:21:14.459 23:13:17 -- common/autotest_common.sh@936 -- # '[' -z 2481524 ']' 00:21:14.459 23:13:17 -- common/autotest_common.sh@940 -- # kill -0 2481524 00:21:14.459 23:13:17 -- common/autotest_common.sh@941 -- # uname 00:21:14.459 23:13:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:14.459 23:13:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2481524 00:21:14.459 23:13:17 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:14.459 23:13:17 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:14.459 23:13:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2481524' 00:21:14.459 killing process with pid 2481524 00:21:14.459 23:13:17 -- common/autotest_common.sh@955 -- # kill 2481524 00:21:14.459 23:13:17 -- common/autotest_common.sh@960 -- # wait 2481524 00:21:14.718 23:13:18 -- target/tls.sh@190 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:14.718 23:13:18 -- target/tls.sh@193 -- # nvmfappstart -m 0x2 00:21:14.718 23:13:18 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:14.718 23:13:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:14.718 23:13:18 -- common/autotest_common.sh@10 -- # set +x 00:21:14.718 23:13:18 -- nvmf/common.sh@469 -- # nvmfpid=2481961 00:21:14.718 23:13:18 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:21:14.718 23:13:18 -- nvmf/common.sh@470 -- # waitforlisten 2481961 00:21:14.718 23:13:18 -- common/autotest_common.sh@829 -- # '[' -z 2481961 ']' 00:21:14.718 23:13:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:14.718 23:13:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:14.718 23:13:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:14.718 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:14.718 23:13:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:14.718 23:13:18 -- common/autotest_common.sh@10 -- # set +x 00:21:14.718 [2024-11-28 23:13:18.293810] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:14.718 [2024-11-28 23:13:18.293900] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:15.001 EAL: No free 2048 kB hugepages reported on node 1 00:21:15.001 [2024-11-28 23:13:18.362944] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:15.001 [2024-11-28 23:13:18.448035] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:15.001 [2024-11-28 23:13:18.448202] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:15.001 [2024-11-28 23:13:18.448221] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:15.001 [2024-11-28 23:13:18.448236] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:15.001 [2024-11-28 23:13:18.448275] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:15.981 23:13:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:15.981 23:13:19 -- common/autotest_common.sh@862 -- # return 0 00:21:15.981 23:13:19 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:15.981 23:13:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:15.981 23:13:19 -- common/autotest_common.sh@10 -- # set +x 00:21:15.981 23:13:19 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:15.981 23:13:19 -- target/tls.sh@194 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:15.981 23:13:19 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:15.981 23:13:19 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:21:15.981 [2024-11-28 23:13:19.488688] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:15.981 23:13:19 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:21:16.238 23:13:19 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:21:16.495 [2024-11-28 23:13:19.961930] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:16.495 [2024-11-28 23:13:19.962172] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:16.495 23:13:19 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:21:16.753 malloc0 00:21:16.753 23:13:20 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:21:17.011 23:13:20 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:17.269 23:13:20 -- target/tls.sh@197 -- # bdevperf_pid=2482263 00:21:17.269 23:13:20 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:21:17.269 23:13:20 -- target/tls.sh@199 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:21:17.269 23:13:20 -- target/tls.sh@200 -- # waitforlisten 2482263 /var/tmp/bdevperf.sock 00:21:17.269 23:13:20 -- common/autotest_common.sh@829 -- # '[' -z 2482263 ']' 00:21:17.269 23:13:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:17.269 23:13:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:17.269 23:13:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:17.269 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:17.269 23:13:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:17.269 23:13:20 -- common/autotest_common.sh@10 -- # set +x 00:21:17.269 [2024-11-28 23:13:20.824290] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:17.269 [2024-11-28 23:13:20.824363] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2482263 ] 00:21:17.269 EAL: No free 2048 kB hugepages reported on node 1 00:21:17.527 [2024-11-28 23:13:20.882109] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:17.527 [2024-11-28 23:13:20.963210] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:18.459 23:13:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:18.459 23:13:21 -- common/autotest_common.sh@862 -- # return 0 00:21:18.459 23:13:21 -- target/tls.sh@201 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:18.459 [2024-11-28 23:13:21.983597] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:18.459 TLSTESTn1 00:21:18.716 23:13:22 -- target/tls.sh@205 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:21:18.974 23:13:22 -- target/tls.sh@205 -- # tgtconf='{ 00:21:18.974 "subsystems": [ 00:21:18.974 { 00:21:18.974 "subsystem": "iobuf", 00:21:18.974 "config": [ 00:21:18.974 { 00:21:18.974 "method": "iobuf_set_options", 00:21:18.974 "params": { 00:21:18.974 "small_pool_count": 8192, 00:21:18.974 "large_pool_count": 1024, 00:21:18.974 "small_bufsize": 8192, 00:21:18.974 "large_bufsize": 135168 00:21:18.974 } 00:21:18.974 } 00:21:18.974 ] 00:21:18.974 }, 00:21:18.974 { 00:21:18.974 "subsystem": "sock", 00:21:18.974 "config": [ 00:21:18.974 { 00:21:18.975 "method": "sock_impl_set_options", 00:21:18.975 "params": { 00:21:18.975 "impl_name": "posix", 00:21:18.975 "recv_buf_size": 2097152, 00:21:18.975 "send_buf_size": 2097152, 00:21:18.975 "enable_recv_pipe": true, 00:21:18.975 "enable_quickack": false, 00:21:18.975 "enable_placement_id": 0, 00:21:18.975 "enable_zerocopy_send_server": true, 00:21:18.975 "enable_zerocopy_send_client": false, 00:21:18.975 "zerocopy_threshold": 0, 00:21:18.975 "tls_version": 0, 00:21:18.975 "enable_ktls": false 00:21:18.975 } 00:21:18.975 }, 00:21:18.975 { 00:21:18.975 "method": "sock_impl_set_options", 00:21:18.975 "params": { 00:21:18.975 "impl_name": "ssl", 00:21:18.975 "recv_buf_size": 4096, 00:21:18.975 "send_buf_size": 4096, 00:21:18.975 "enable_recv_pipe": true, 00:21:18.975 "enable_quickack": false, 00:21:18.975 "enable_placement_id": 0, 00:21:18.975 "enable_zerocopy_send_server": true, 00:21:18.975 "enable_zerocopy_send_client": false, 00:21:18.975 "zerocopy_threshold": 0, 00:21:18.975 "tls_version": 0, 00:21:18.975 "enable_ktls": false 00:21:18.975 } 00:21:18.975 } 00:21:18.975 ] 00:21:18.975 }, 00:21:18.975 { 00:21:18.975 "subsystem": "vmd", 00:21:18.975 "config": [] 00:21:18.975 }, 00:21:18.975 { 00:21:18.975 "subsystem": "accel", 00:21:18.975 "config": [ 00:21:18.975 { 00:21:18.975 "method": "accel_set_options", 00:21:18.975 "params": { 00:21:18.975 "small_cache_size": 128, 00:21:18.975 "large_cache_size": 16, 00:21:18.975 "task_count": 2048, 00:21:18.975 "sequence_count": 2048, 00:21:18.975 "buf_count": 2048 00:21:18.975 } 00:21:18.975 } 00:21:18.975 ] 00:21:18.975 }, 00:21:18.975 { 00:21:18.975 "subsystem": "bdev", 00:21:18.975 "config": [ 00:21:18.975 { 00:21:18.975 "method": "bdev_set_options", 00:21:18.975 "params": { 00:21:18.975 "bdev_io_pool_size": 65535, 00:21:18.975 "bdev_io_cache_size": 256, 00:21:18.975 "bdev_auto_examine": true, 00:21:18.975 "iobuf_small_cache_size": 128, 00:21:18.975 "iobuf_large_cache_size": 16 00:21:18.975 } 00:21:18.975 }, 00:21:18.975 { 00:21:18.975 "method": "bdev_raid_set_options", 00:21:18.975 "params": { 00:21:18.975 "process_window_size_kb": 1024 00:21:18.975 } 00:21:18.975 }, 00:21:18.975 { 00:21:18.975 "method": "bdev_iscsi_set_options", 00:21:18.975 "params": { 00:21:18.975 "timeout_sec": 30 00:21:18.975 } 00:21:18.975 }, 00:21:18.975 { 00:21:18.975 "method": "bdev_nvme_set_options", 00:21:18.975 "params": { 00:21:18.975 "action_on_timeout": "none", 00:21:18.975 "timeout_us": 0, 00:21:18.975 "timeout_admin_us": 0, 00:21:18.975 "keep_alive_timeout_ms": 10000, 00:21:18.975 "transport_retry_count": 4, 00:21:18.975 "arbitration_burst": 0, 00:21:18.975 "low_priority_weight": 0, 00:21:18.975 "medium_priority_weight": 0, 00:21:18.975 "high_priority_weight": 0, 00:21:18.975 "nvme_adminq_poll_period_us": 10000, 00:21:18.975 "nvme_ioq_poll_period_us": 0, 00:21:18.975 "io_queue_requests": 0, 00:21:18.975 "delay_cmd_submit": true, 00:21:18.975 "bdev_retry_count": 3, 00:21:18.975 "transport_ack_timeout": 0, 00:21:18.975 "ctrlr_loss_timeout_sec": 0, 00:21:18.975 "reconnect_delay_sec": 0, 00:21:18.975 "fast_io_fail_timeout_sec": 0, 00:21:18.975 "generate_uuids": false, 00:21:18.975 "transport_tos": 0, 00:21:18.975 "io_path_stat": false, 00:21:18.975 "allow_accel_sequence": false 00:21:18.975 } 00:21:18.975 }, 00:21:18.975 { 00:21:18.975 "method": "bdev_nvme_set_hotplug", 00:21:18.975 "params": { 00:21:18.975 "period_us": 100000, 00:21:18.975 "enable": false 00:21:18.975 } 00:21:18.975 }, 00:21:18.975 { 00:21:18.975 "method": "bdev_malloc_create", 00:21:18.975 "params": { 00:21:18.975 "name": "malloc0", 00:21:18.975 "num_blocks": 8192, 00:21:18.975 "block_size": 4096, 00:21:18.975 "physical_block_size": 4096, 00:21:18.975 "uuid": "6c8f2f60-9e62-4417-bb8b-2fd374846ee5", 00:21:18.975 "optimal_io_boundary": 0 00:21:18.975 } 00:21:18.975 }, 00:21:18.975 { 00:21:18.975 "method": "bdev_wait_for_examine" 00:21:18.975 } 00:21:18.975 ] 00:21:18.975 }, 00:21:18.975 { 00:21:18.975 "subsystem": "nbd", 00:21:18.975 "config": [] 00:21:18.975 }, 00:21:18.975 { 00:21:18.975 "subsystem": "scheduler", 00:21:18.975 "config": [ 00:21:18.975 { 00:21:18.975 "method": "framework_set_scheduler", 00:21:18.975 "params": { 00:21:18.975 "name": "static" 00:21:18.975 } 00:21:18.975 } 00:21:18.975 ] 00:21:18.975 }, 00:21:18.975 { 00:21:18.975 "subsystem": "nvmf", 00:21:18.975 "config": [ 00:21:18.975 { 00:21:18.975 "method": "nvmf_set_config", 00:21:18.975 "params": { 00:21:18.975 "discovery_filter": "match_any", 00:21:18.975 "admin_cmd_passthru": { 00:21:18.975 "identify_ctrlr": false 00:21:18.975 } 00:21:18.975 } 00:21:18.975 }, 00:21:18.975 { 00:21:18.975 "method": "nvmf_set_max_subsystems", 00:21:18.975 "params": { 00:21:18.975 "max_subsystems": 1024 00:21:18.975 } 00:21:18.975 }, 00:21:18.975 { 00:21:18.975 "method": "nvmf_set_crdt", 00:21:18.975 "params": { 00:21:18.975 "crdt1": 0, 00:21:18.975 "crdt2": 0, 00:21:18.975 "crdt3": 0 00:21:18.975 } 00:21:18.975 }, 00:21:18.975 { 00:21:18.975 "method": "nvmf_create_transport", 00:21:18.975 "params": { 00:21:18.975 "trtype": "TCP", 00:21:18.975 "max_queue_depth": 128, 00:21:18.975 "max_io_qpairs_per_ctrlr": 127, 00:21:18.975 "in_capsule_data_size": 4096, 00:21:18.975 "max_io_size": 131072, 00:21:18.975 "io_unit_size": 131072, 00:21:18.975 "max_aq_depth": 128, 00:21:18.975 "num_shared_buffers": 511, 00:21:18.975 "buf_cache_size": 4294967295, 00:21:18.975 "dif_insert_or_strip": false, 00:21:18.975 "zcopy": false, 00:21:18.975 "c2h_success": false, 00:21:18.975 "sock_priority": 0, 00:21:18.975 "abort_timeout_sec": 1 00:21:18.975 } 00:21:18.975 }, 00:21:18.975 { 00:21:18.975 "method": "nvmf_create_subsystem", 00:21:18.975 "params": { 00:21:18.975 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:18.975 "allow_any_host": false, 00:21:18.975 "serial_number": "SPDK00000000000001", 00:21:18.975 "model_number": "SPDK bdev Controller", 00:21:18.975 "max_namespaces": 10, 00:21:18.975 "min_cntlid": 1, 00:21:18.975 "max_cntlid": 65519, 00:21:18.975 "ana_reporting": false 00:21:18.975 } 00:21:18.975 }, 00:21:18.975 { 00:21:18.975 "method": "nvmf_subsystem_add_host", 00:21:18.975 "params": { 00:21:18.975 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:18.975 "host": "nqn.2016-06.io.spdk:host1", 00:21:18.975 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:21:18.975 } 00:21:18.975 }, 00:21:18.975 { 00:21:18.975 "method": "nvmf_subsystem_add_ns", 00:21:18.975 "params": { 00:21:18.975 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:18.975 "namespace": { 00:21:18.975 "nsid": 1, 00:21:18.975 "bdev_name": "malloc0", 00:21:18.975 "nguid": "6C8F2F609E624417BB8B2FD374846EE5", 00:21:18.975 "uuid": "6c8f2f60-9e62-4417-bb8b-2fd374846ee5" 00:21:18.975 } 00:21:18.975 } 00:21:18.975 }, 00:21:18.975 { 00:21:18.976 "method": "nvmf_subsystem_add_listener", 00:21:18.976 "params": { 00:21:18.976 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:18.976 "listen_address": { 00:21:18.976 "trtype": "TCP", 00:21:18.976 "adrfam": "IPv4", 00:21:18.976 "traddr": "10.0.0.2", 00:21:18.976 "trsvcid": "4420" 00:21:18.976 }, 00:21:18.976 "secure_channel": true 00:21:18.976 } 00:21:18.976 } 00:21:18.976 ] 00:21:18.976 } 00:21:18.976 ] 00:21:18.976 }' 00:21:18.976 23:13:22 -- target/tls.sh@206 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:21:19.234 23:13:22 -- target/tls.sh@206 -- # bdevperfconf='{ 00:21:19.234 "subsystems": [ 00:21:19.234 { 00:21:19.234 "subsystem": "iobuf", 00:21:19.234 "config": [ 00:21:19.234 { 00:21:19.234 "method": "iobuf_set_options", 00:21:19.234 "params": { 00:21:19.234 "small_pool_count": 8192, 00:21:19.234 "large_pool_count": 1024, 00:21:19.234 "small_bufsize": 8192, 00:21:19.234 "large_bufsize": 135168 00:21:19.234 } 00:21:19.234 } 00:21:19.234 ] 00:21:19.234 }, 00:21:19.234 { 00:21:19.234 "subsystem": "sock", 00:21:19.234 "config": [ 00:21:19.234 { 00:21:19.234 "method": "sock_impl_set_options", 00:21:19.234 "params": { 00:21:19.234 "impl_name": "posix", 00:21:19.234 "recv_buf_size": 2097152, 00:21:19.234 "send_buf_size": 2097152, 00:21:19.234 "enable_recv_pipe": true, 00:21:19.234 "enable_quickack": false, 00:21:19.234 "enable_placement_id": 0, 00:21:19.234 "enable_zerocopy_send_server": true, 00:21:19.234 "enable_zerocopy_send_client": false, 00:21:19.234 "zerocopy_threshold": 0, 00:21:19.234 "tls_version": 0, 00:21:19.234 "enable_ktls": false 00:21:19.234 } 00:21:19.234 }, 00:21:19.234 { 00:21:19.234 "method": "sock_impl_set_options", 00:21:19.234 "params": { 00:21:19.234 "impl_name": "ssl", 00:21:19.234 "recv_buf_size": 4096, 00:21:19.234 "send_buf_size": 4096, 00:21:19.235 "enable_recv_pipe": true, 00:21:19.235 "enable_quickack": false, 00:21:19.235 "enable_placement_id": 0, 00:21:19.235 "enable_zerocopy_send_server": true, 00:21:19.235 "enable_zerocopy_send_client": false, 00:21:19.235 "zerocopy_threshold": 0, 00:21:19.235 "tls_version": 0, 00:21:19.235 "enable_ktls": false 00:21:19.235 } 00:21:19.235 } 00:21:19.235 ] 00:21:19.235 }, 00:21:19.235 { 00:21:19.235 "subsystem": "vmd", 00:21:19.235 "config": [] 00:21:19.235 }, 00:21:19.235 { 00:21:19.235 "subsystem": "accel", 00:21:19.235 "config": [ 00:21:19.235 { 00:21:19.235 "method": "accel_set_options", 00:21:19.235 "params": { 00:21:19.235 "small_cache_size": 128, 00:21:19.235 "large_cache_size": 16, 00:21:19.235 "task_count": 2048, 00:21:19.235 "sequence_count": 2048, 00:21:19.235 "buf_count": 2048 00:21:19.235 } 00:21:19.235 } 00:21:19.235 ] 00:21:19.235 }, 00:21:19.235 { 00:21:19.235 "subsystem": "bdev", 00:21:19.235 "config": [ 00:21:19.235 { 00:21:19.235 "method": "bdev_set_options", 00:21:19.235 "params": { 00:21:19.235 "bdev_io_pool_size": 65535, 00:21:19.235 "bdev_io_cache_size": 256, 00:21:19.235 "bdev_auto_examine": true, 00:21:19.235 "iobuf_small_cache_size": 128, 00:21:19.235 "iobuf_large_cache_size": 16 00:21:19.235 } 00:21:19.235 }, 00:21:19.235 { 00:21:19.235 "method": "bdev_raid_set_options", 00:21:19.235 "params": { 00:21:19.235 "process_window_size_kb": 1024 00:21:19.235 } 00:21:19.235 }, 00:21:19.235 { 00:21:19.235 "method": "bdev_iscsi_set_options", 00:21:19.235 "params": { 00:21:19.235 "timeout_sec": 30 00:21:19.235 } 00:21:19.235 }, 00:21:19.235 { 00:21:19.235 "method": "bdev_nvme_set_options", 00:21:19.235 "params": { 00:21:19.235 "action_on_timeout": "none", 00:21:19.235 "timeout_us": 0, 00:21:19.235 "timeout_admin_us": 0, 00:21:19.235 "keep_alive_timeout_ms": 10000, 00:21:19.235 "transport_retry_count": 4, 00:21:19.235 "arbitration_burst": 0, 00:21:19.235 "low_priority_weight": 0, 00:21:19.235 "medium_priority_weight": 0, 00:21:19.235 "high_priority_weight": 0, 00:21:19.235 "nvme_adminq_poll_period_us": 10000, 00:21:19.235 "nvme_ioq_poll_period_us": 0, 00:21:19.235 "io_queue_requests": 512, 00:21:19.235 "delay_cmd_submit": true, 00:21:19.235 "bdev_retry_count": 3, 00:21:19.235 "transport_ack_timeout": 0, 00:21:19.235 "ctrlr_loss_timeout_sec": 0, 00:21:19.235 "reconnect_delay_sec": 0, 00:21:19.235 "fast_io_fail_timeout_sec": 0, 00:21:19.235 "generate_uuids": false, 00:21:19.235 "transport_tos": 0, 00:21:19.235 "io_path_stat": false, 00:21:19.235 "allow_accel_sequence": false 00:21:19.235 } 00:21:19.235 }, 00:21:19.235 { 00:21:19.235 "method": "bdev_nvme_attach_controller", 00:21:19.235 "params": { 00:21:19.235 "name": "TLSTEST", 00:21:19.235 "trtype": "TCP", 00:21:19.235 "adrfam": "IPv4", 00:21:19.235 "traddr": "10.0.0.2", 00:21:19.235 "trsvcid": "4420", 00:21:19.235 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:19.235 "prchk_reftag": false, 00:21:19.235 "prchk_guard": false, 00:21:19.235 "ctrlr_loss_timeout_sec": 0, 00:21:19.235 "reconnect_delay_sec": 0, 00:21:19.235 "fast_io_fail_timeout_sec": 0, 00:21:19.235 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:21:19.235 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:19.235 "hdgst": false, 00:21:19.235 "ddgst": false 00:21:19.235 } 00:21:19.235 }, 00:21:19.235 { 00:21:19.235 "method": "bdev_nvme_set_hotplug", 00:21:19.235 "params": { 00:21:19.235 "period_us": 100000, 00:21:19.235 "enable": false 00:21:19.235 } 00:21:19.235 }, 00:21:19.235 { 00:21:19.235 "method": "bdev_wait_for_examine" 00:21:19.235 } 00:21:19.235 ] 00:21:19.235 }, 00:21:19.235 { 00:21:19.235 "subsystem": "nbd", 00:21:19.235 "config": [] 00:21:19.235 } 00:21:19.235 ] 00:21:19.235 }' 00:21:19.235 23:13:22 -- target/tls.sh@208 -- # killprocess 2482263 00:21:19.235 23:13:22 -- common/autotest_common.sh@936 -- # '[' -z 2482263 ']' 00:21:19.235 23:13:22 -- common/autotest_common.sh@940 -- # kill -0 2482263 00:21:19.235 23:13:22 -- common/autotest_common.sh@941 -- # uname 00:21:19.235 23:13:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:19.235 23:13:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2482263 00:21:19.235 23:13:22 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:19.235 23:13:22 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:19.235 23:13:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2482263' 00:21:19.235 killing process with pid 2482263 00:21:19.235 23:13:22 -- common/autotest_common.sh@955 -- # kill 2482263 00:21:19.235 Received shutdown signal, test time was about 10.000000 seconds 00:21:19.235 00:21:19.235 Latency(us) 00:21:19.235 [2024-11-28T22:13:22.841Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:19.235 [2024-11-28T22:13:22.841Z] =================================================================================================================== 00:21:19.235 [2024-11-28T22:13:22.841Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:21:19.235 23:13:22 -- common/autotest_common.sh@960 -- # wait 2482263 00:21:19.493 23:13:23 -- target/tls.sh@209 -- # killprocess 2481961 00:21:19.493 23:13:23 -- common/autotest_common.sh@936 -- # '[' -z 2481961 ']' 00:21:19.493 23:13:23 -- common/autotest_common.sh@940 -- # kill -0 2481961 00:21:19.493 23:13:23 -- common/autotest_common.sh@941 -- # uname 00:21:19.493 23:13:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:19.493 23:13:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2481961 00:21:19.493 23:13:23 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:19.493 23:13:23 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:19.493 23:13:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2481961' 00:21:19.493 killing process with pid 2481961 00:21:19.493 23:13:23 -- common/autotest_common.sh@955 -- # kill 2481961 00:21:19.493 23:13:23 -- common/autotest_common.sh@960 -- # wait 2481961 00:21:19.752 23:13:23 -- target/tls.sh@212 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:21:19.752 23:13:23 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:19.752 23:13:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:19.752 23:13:23 -- target/tls.sh@212 -- # echo '{ 00:21:19.752 "subsystems": [ 00:21:19.752 { 00:21:19.752 "subsystem": "iobuf", 00:21:19.752 "config": [ 00:21:19.752 { 00:21:19.752 "method": "iobuf_set_options", 00:21:19.752 "params": { 00:21:19.752 "small_pool_count": 8192, 00:21:19.752 "large_pool_count": 1024, 00:21:19.752 "small_bufsize": 8192, 00:21:19.752 "large_bufsize": 135168 00:21:19.752 } 00:21:19.752 } 00:21:19.752 ] 00:21:19.752 }, 00:21:19.752 { 00:21:19.752 "subsystem": "sock", 00:21:19.752 "config": [ 00:21:19.752 { 00:21:19.752 "method": "sock_impl_set_options", 00:21:19.752 "params": { 00:21:19.752 "impl_name": "posix", 00:21:19.752 "recv_buf_size": 2097152, 00:21:19.752 "send_buf_size": 2097152, 00:21:19.752 "enable_recv_pipe": true, 00:21:19.752 "enable_quickack": false, 00:21:19.752 "enable_placement_id": 0, 00:21:19.752 "enable_zerocopy_send_server": true, 00:21:19.752 "enable_zerocopy_send_client": false, 00:21:19.752 "zerocopy_threshold": 0, 00:21:19.752 "tls_version": 0, 00:21:19.752 "enable_ktls": false 00:21:19.752 } 00:21:19.752 }, 00:21:19.752 { 00:21:19.752 "method": "sock_impl_set_options", 00:21:19.752 "params": { 00:21:19.752 "impl_name": "ssl", 00:21:19.752 "recv_buf_size": 4096, 00:21:19.752 "send_buf_size": 4096, 00:21:19.752 "enable_recv_pipe": true, 00:21:19.752 "enable_quickack": false, 00:21:19.752 "enable_placement_id": 0, 00:21:19.752 "enable_zerocopy_send_server": true, 00:21:19.752 "enable_zerocopy_send_client": false, 00:21:19.752 "zerocopy_threshold": 0, 00:21:19.752 "tls_version": 0, 00:21:19.752 "enable_ktls": false 00:21:19.752 } 00:21:19.752 } 00:21:19.752 ] 00:21:19.752 }, 00:21:19.752 { 00:21:19.752 "subsystem": "vmd", 00:21:19.752 "config": [] 00:21:19.752 }, 00:21:19.752 { 00:21:19.752 "subsystem": "accel", 00:21:19.752 "config": [ 00:21:19.752 { 00:21:19.752 "method": "accel_set_options", 00:21:19.752 "params": { 00:21:19.752 "small_cache_size": 128, 00:21:19.752 "large_cache_size": 16, 00:21:19.752 "task_count": 2048, 00:21:19.752 "sequence_count": 2048, 00:21:19.752 "buf_count": 2048 00:21:19.752 } 00:21:19.752 } 00:21:19.752 ] 00:21:19.752 }, 00:21:19.752 { 00:21:19.752 "subsystem": "bdev", 00:21:19.752 "config": [ 00:21:19.752 { 00:21:19.752 "method": "bdev_set_options", 00:21:19.752 "params": { 00:21:19.752 "bdev_io_pool_size": 65535, 00:21:19.752 "bdev_io_cache_size": 256, 00:21:19.752 "bdev_auto_examine": true, 00:21:19.752 "iobuf_small_cache_size": 128, 00:21:19.752 "iobuf_large_cache_size": 16 00:21:19.752 } 00:21:19.752 }, 00:21:19.752 { 00:21:19.752 "method": "bdev_raid_set_options", 00:21:19.752 "params": { 00:21:19.752 "process_window_size_kb": 1024 00:21:19.752 } 00:21:19.752 }, 00:21:19.752 { 00:21:19.752 "method": "bdev_iscsi_set_options", 00:21:19.752 "params": { 00:21:19.752 "timeout_sec": 30 00:21:19.752 } 00:21:19.752 }, 00:21:19.752 { 00:21:19.752 "method": "bdev_nvme_set_options", 00:21:19.752 "params": { 00:21:19.752 "action_on_timeout": "none", 00:21:19.752 "timeout_us": 0, 00:21:19.752 "timeout_admin_us": 0, 00:21:19.752 "keep_alive_timeout_ms": 10000, 00:21:19.752 "transport_retry_count": 4, 00:21:19.752 "arbitration_burst": 0, 00:21:19.752 "low_priority_weight": 0, 00:21:19.752 "medium_priority_weight": 0, 00:21:19.752 "high_priority_weight": 0, 00:21:19.752 "nvme_adminq_poll_period_us": 10000, 00:21:19.752 "nvme_ioq_poll_period_us": 0, 00:21:19.752 "io_queue_requests": 0, 00:21:19.752 "delay_cmd_submit": true, 00:21:19.752 "bdev_retry_count": 3, 00:21:19.752 "transport_ack_timeout": 0, 00:21:19.752 "ctrlr_loss_timeout_sec": 0, 00:21:19.752 "reconnect_delay_sec": 0, 00:21:19.752 "fast_io_fail_timeout_sec": 0, 00:21:19.752 "generate_uuids": false, 00:21:19.752 "transport_tos": 0, 00:21:19.752 "io_path_stat": false, 00:21:19.752 "allow_accel_sequence": false 00:21:19.752 } 00:21:19.752 }, 00:21:19.752 { 00:21:19.752 "method": "bdev_nvme_set_hotplug", 00:21:19.752 "params": { 00:21:19.752 "period_us": 100000, 00:21:19.752 "enable": false 00:21:19.752 } 00:21:19.752 }, 00:21:19.752 { 00:21:19.752 "method": "bdev_malloc_create", 00:21:19.752 "params": { 00:21:19.752 "name": "malloc0", 00:21:19.752 "num_blocks": 8192, 00:21:19.752 "block_size": 4096, 00:21:19.752 "physical_block_size": 4096, 00:21:19.752 "uuid": "6c8f2f60-9e62-4417-bb8b-2fd374846ee5", 00:21:19.752 "optimal_io_boundary": 0 00:21:19.752 } 00:21:19.752 }, 00:21:19.752 { 00:21:19.752 "method": "bdev_wait_for_examine" 00:21:19.752 } 00:21:19.752 ] 00:21:19.752 }, 00:21:19.752 { 00:21:19.752 "subsystem": "nbd", 00:21:19.752 "config": [] 00:21:19.752 }, 00:21:19.752 { 00:21:19.752 "subsystem": "scheduler", 00:21:19.752 "config": [ 00:21:19.752 { 00:21:19.752 "method": "framework_set_scheduler", 00:21:19.752 "params": { 00:21:19.752 "name": "static" 00:21:19.752 } 00:21:19.752 } 00:21:19.752 ] 00:21:19.752 }, 00:21:19.752 { 00:21:19.752 "subsystem": "nvmf", 00:21:19.752 "config": [ 00:21:19.752 { 00:21:19.752 "method": "nvmf_set_config", 00:21:19.752 "params": { 00:21:19.752 "discovery_filter": "match_any", 00:21:19.752 "admin_cmd_passthru": { 00:21:19.752 "identify_ctrlr": false 00:21:19.752 } 00:21:19.752 } 00:21:19.752 }, 00:21:19.752 { 00:21:19.752 "method": "nvmf_set_max_subsystems", 00:21:19.752 "params": { 00:21:19.752 "max_subsystems": 1024 00:21:19.752 } 00:21:19.752 }, 00:21:19.752 { 00:21:19.752 "method": "nvmf_set_crdt", 00:21:19.752 "params": { 00:21:19.752 "crdt1": 0, 00:21:19.752 "crdt2": 0, 00:21:19.752 "crdt3": 0 00:21:19.752 } 00:21:19.753 }, 00:21:19.753 { 00:21:19.753 "method": "nvmf_create_transport", 00:21:19.753 "params": { 00:21:19.753 "trtype": "TCP", 00:21:19.753 "max_queue_depth": 128, 00:21:19.753 "max_io_qpairs_per_ctrlr": 127, 00:21:19.753 "in_capsule_data_size": 4096, 00:21:19.753 "max_io_size": 131072, 00:21:19.753 "io_unit_size": 131072, 00:21:19.753 "max_aq_depth": 128, 00:21:19.753 "num_shared_buffers": 511, 00:21:19.753 "buf_cache_size": 4294967295, 00:21:19.753 "dif_insert_or_strip": false, 00:21:19.753 "zcopy": false, 00:21:19.753 "c2h_success": false, 00:21:19.753 "sock_priority": 0, 00:21:19.753 "abort_timeout_sec": 1 00:21:19.753 } 00:21:19.753 }, 00:21:19.753 { 00:21:19.753 "method": "nvmf_create_subsystem", 00:21:19.753 "params": { 00:21:19.753 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:19.753 "allow_any_host": false, 00:21:19.753 "serial_number": "SPDK00000000000001", 00:21:19.753 "model_number": "SPDK bdev Controller", 00:21:19.753 "max_namespaces": 10, 00:21:19.753 "min_cntlid": 1, 00:21:19.753 "max_cntlid": 65519, 00:21:19.753 "ana_reporting": false 00:21:19.753 } 00:21:19.753 }, 00:21:19.753 { 00:21:19.753 "method": "nvmf_subsystem_add_host", 00:21:19.753 "params": { 00:21:19.753 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:19.753 "host": "nqn.2016-06.io.spdk:host1", 00:21:19.753 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:21:19.753 } 00:21:19.753 }, 00:21:19.753 { 00:21:19.753 "method": "nvmf_subsystem_add_ns", 00:21:19.753 "params": { 00:21:19.753 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:19.753 "namespace": { 00:21:19.753 "nsid": 1, 00:21:19.753 "bdev_name": "malloc0", 00:21:19.753 "nguid": "6C8F2F609E624417BB8B2FD374846EE5", 00:21:19.753 "uuid": "6c8f2f60-9e62-4417-bb8b-2fd374846ee5" 00:21:19.753 } 00:21:19.753 } 00:21:19.753 }, 00:21:19.753 { 00:21:19.753 "method": "nvmf_subsystem_add_listener", 00:21:19.753 "params": { 00:21:19.753 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:19.753 "listen_address": { 00:21:19.753 "trtype": "TCP", 00:21:19.753 "adrfam": "IPv4", 00:21:19.753 "traddr": "10.0.0.2", 00:21:19.753 "trsvcid": "4420" 00:21:19.753 }, 00:21:19.753 "secure_channel": true 00:21:19.753 } 00:21:19.753 } 00:21:19.753 ] 00:21:19.753 } 00:21:19.753 ] 00:21:19.753 }' 00:21:19.753 23:13:23 -- common/autotest_common.sh@10 -- # set +x 00:21:19.753 23:13:23 -- nvmf/common.sh@469 -- # nvmfpid=2482560 00:21:19.753 23:13:23 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:21:19.753 23:13:23 -- nvmf/common.sh@470 -- # waitforlisten 2482560 00:21:19.753 23:13:23 -- common/autotest_common.sh@829 -- # '[' -z 2482560 ']' 00:21:19.753 23:13:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:19.753 23:13:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:19.753 23:13:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:19.753 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:19.753 23:13:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:19.753 23:13:23 -- common/autotest_common.sh@10 -- # set +x 00:21:20.011 [2024-11-28 23:13:23.359538] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:20.011 [2024-11-28 23:13:23.359625] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:20.011 EAL: No free 2048 kB hugepages reported on node 1 00:21:20.011 [2024-11-28 23:13:23.432701] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:20.011 [2024-11-28 23:13:23.525408] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:20.011 [2024-11-28 23:13:23.525556] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:20.011 [2024-11-28 23:13:23.525580] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:20.011 [2024-11-28 23:13:23.525593] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:20.011 [2024-11-28 23:13:23.525628] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:20.269 [2024-11-28 23:13:23.746480] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:20.269 [2024-11-28 23:13:23.778503] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:20.269 [2024-11-28 23:13:23.778750] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:20.835 23:13:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:20.835 23:13:24 -- common/autotest_common.sh@862 -- # return 0 00:21:20.835 23:13:24 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:20.835 23:13:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:20.835 23:13:24 -- common/autotest_common.sh@10 -- # set +x 00:21:20.835 23:13:24 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:20.835 23:13:24 -- target/tls.sh@216 -- # bdevperf_pid=2482716 00:21:20.835 23:13:24 -- target/tls.sh@217 -- # waitforlisten 2482716 /var/tmp/bdevperf.sock 00:21:20.835 23:13:24 -- common/autotest_common.sh@829 -- # '[' -z 2482716 ']' 00:21:20.835 23:13:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:20.835 23:13:24 -- target/tls.sh@213 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:21:20.835 23:13:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:20.835 23:13:24 -- target/tls.sh@213 -- # echo '{ 00:21:20.835 "subsystems": [ 00:21:20.835 { 00:21:20.835 "subsystem": "iobuf", 00:21:20.835 "config": [ 00:21:20.835 { 00:21:20.835 "method": "iobuf_set_options", 00:21:20.835 "params": { 00:21:20.835 "small_pool_count": 8192, 00:21:20.835 "large_pool_count": 1024, 00:21:20.835 "small_bufsize": 8192, 00:21:20.835 "large_bufsize": 135168 00:21:20.835 } 00:21:20.835 } 00:21:20.835 ] 00:21:20.835 }, 00:21:20.835 { 00:21:20.835 "subsystem": "sock", 00:21:20.835 "config": [ 00:21:20.835 { 00:21:20.835 "method": "sock_impl_set_options", 00:21:20.835 "params": { 00:21:20.835 "impl_name": "posix", 00:21:20.835 "recv_buf_size": 2097152, 00:21:20.835 "send_buf_size": 2097152, 00:21:20.835 "enable_recv_pipe": true, 00:21:20.835 "enable_quickack": false, 00:21:20.835 "enable_placement_id": 0, 00:21:20.835 "enable_zerocopy_send_server": true, 00:21:20.835 "enable_zerocopy_send_client": false, 00:21:20.835 "zerocopy_threshold": 0, 00:21:20.835 "tls_version": 0, 00:21:20.835 "enable_ktls": false 00:21:20.835 } 00:21:20.835 }, 00:21:20.835 { 00:21:20.835 "method": "sock_impl_set_options", 00:21:20.835 "params": { 00:21:20.835 "impl_name": "ssl", 00:21:20.835 "recv_buf_size": 4096, 00:21:20.836 "send_buf_size": 4096, 00:21:20.836 "enable_recv_pipe": true, 00:21:20.836 "enable_quickack": false, 00:21:20.836 "enable_placement_id": 0, 00:21:20.836 "enable_zerocopy_send_server": true, 00:21:20.836 "enable_zerocopy_send_client": false, 00:21:20.836 "zerocopy_threshold": 0, 00:21:20.836 "tls_version": 0, 00:21:20.836 "enable_ktls": false 00:21:20.836 } 00:21:20.836 } 00:21:20.836 ] 00:21:20.836 }, 00:21:20.836 { 00:21:20.836 "subsystem": "vmd", 00:21:20.836 "config": [] 00:21:20.836 }, 00:21:20.836 { 00:21:20.836 "subsystem": "accel", 00:21:20.836 "config": [ 00:21:20.836 { 00:21:20.836 "method": "accel_set_options", 00:21:20.836 "params": { 00:21:20.836 "small_cache_size": 128, 00:21:20.836 "large_cache_size": 16, 00:21:20.836 "task_count": 2048, 00:21:20.836 "sequence_count": 2048, 00:21:20.836 "buf_count": 2048 00:21:20.836 } 00:21:20.836 } 00:21:20.836 ] 00:21:20.836 }, 00:21:20.836 { 00:21:20.836 "subsystem": "bdev", 00:21:20.836 "config": [ 00:21:20.836 { 00:21:20.836 "method": "bdev_set_options", 00:21:20.836 "params": { 00:21:20.836 "bdev_io_pool_size": 65535, 00:21:20.836 "bdev_io_cache_size": 256, 00:21:20.836 "bdev_auto_examine": true, 00:21:20.836 "iobuf_small_cache_size": 128, 00:21:20.836 "iobuf_large_cache_size": 16 00:21:20.836 } 00:21:20.836 }, 00:21:20.836 { 00:21:20.836 "method": "bdev_raid_set_options", 00:21:20.836 "params": { 00:21:20.836 "process_window_size_kb": 1024 00:21:20.836 } 00:21:20.836 }, 00:21:20.836 { 00:21:20.836 "method": "bdev_iscsi_set_options", 00:21:20.836 "params": { 00:21:20.836 "timeout_sec": 30 00:21:20.836 } 00:21:20.836 }, 00:21:20.836 { 00:21:20.836 "method": "bdev_nvme_set_options", 00:21:20.836 "params": { 00:21:20.836 "action_on_timeout": "none", 00:21:20.836 "timeout_us": 0, 00:21:20.836 "timeout_admin_us": 0, 00:21:20.836 "keep_alive_timeout_ms": 10000, 00:21:20.836 "transport_retry_count": 4, 00:21:20.836 "arbitration_burst": 0, 00:21:20.836 "low_priority_weight": 0, 00:21:20.836 "medium_priority_weight": 0, 00:21:20.836 "high_priority_weight": 0, 00:21:20.836 "nvme_adminq_poll_period_us": 10000, 00:21:20.836 "nvme_ioq_poll_period_us": 0, 00:21:20.836 "io_queue_requests": 512, 00:21:20.836 "delay_cmd_submit": true, 00:21:20.836 "bdev_retry_count": 3, 00:21:20.836 "transport_ack_timeout": 0, 00:21:20.836 "ctrlr_loss_timeout_sec": 0, 00:21:20.836 "reconnect_delay_sec": 0, 00:21:20.836 "fast_io_fail_timeout_sec": 0, 00:21:20.836 "generate_uuids": false, 00:21:20.836 "transport_tos": 0, 00:21:20.836 "io_path_stat": false, 00:21:20.836 "allow_accel_sequence": false 00:21:20.836 } 00:21:20.836 }, 00:21:20.836 { 00:21:20.836 "method": "bdev_nvme_attach_controller", 00:21:20.836 "params": { 00:21:20.836 "name": "TLSTEST", 00:21:20.836 "trtype": "TCP", 00:21:20.836 "adrfam": "IPv4", 00:21:20.836 "traddr": "10.0.0.2", 00:21:20.836 "trsvcid": "4420", 00:21:20.836 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:20.836 "prchk_reftag": false, 00:21:20.836 "prchk_guard": false, 00:21:20.836 "ctrlr_loss_timeout_sec": 0, 00:21:20.836 "reconnect_delay_sec": 0, 00:21:20.836 "fast_io_fail_timeout_sec": 0, 00:21:20.836 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:21:20.836 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:20.836 "hdgst": false, 00:21:20.836 "ddgst": false 00:21:20.836 } 00:21:20.836 }, 00:21:20.836 { 00:21:20.836 "method": "bdev_nvme_set_hotplug", 00:21:20.836 "params": { 00:21:20.836 "period_us": 100000, 00:21:20.836 "enable": false 00:21:20.836 } 00:21:20.836 }, 00:21:20.836 { 00:21:20.836 "method": "bdev_wait_for_examine" 00:21:20.836 } 00:21:20.836 ] 00:21:20.836 }, 00:21:20.836 { 00:21:20.836 "subsystem": "nbd", 00:21:20.836 "config": [] 00:21:20.836 } 00:21:20.836 ] 00:21:20.836 }' 00:21:20.836 23:13:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:20.836 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:20.836 23:13:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:20.836 23:13:24 -- common/autotest_common.sh@10 -- # set +x 00:21:21.095 [2024-11-28 23:13:24.444793] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:21.095 [2024-11-28 23:13:24.444857] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2482716 ] 00:21:21.095 EAL: No free 2048 kB hugepages reported on node 1 00:21:21.095 [2024-11-28 23:13:24.503603] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:21.095 [2024-11-28 23:13:24.592088] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:21.353 [2024-11-28 23:13:24.747985] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:21.919 23:13:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:21.919 23:13:25 -- common/autotest_common.sh@862 -- # return 0 00:21:21.919 23:13:25 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:21:21.919 Running I/O for 10 seconds... 00:21:34.115 00:21:34.115 Latency(us) 00:21:34.115 [2024-11-28T22:13:37.721Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:34.115 [2024-11-28T22:13:37.721Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:21:34.115 Verification LBA range: start 0x0 length 0x2000 00:21:34.115 TLSTESTn1 : 10.07 3309.97 12.93 0.00 0.00 38584.98 7378.87 88158.06 00:21:34.115 [2024-11-28T22:13:37.721Z] =================================================================================================================== 00:21:34.115 [2024-11-28T22:13:37.721Z] Total : 3309.97 12.93 0.00 0.00 38584.98 7378.87 88158.06 00:21:34.115 0 00:21:34.115 23:13:35 -- target/tls.sh@222 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:21:34.115 23:13:35 -- target/tls.sh@223 -- # killprocess 2482716 00:21:34.115 23:13:35 -- common/autotest_common.sh@936 -- # '[' -z 2482716 ']' 00:21:34.115 23:13:35 -- common/autotest_common.sh@940 -- # kill -0 2482716 00:21:34.115 23:13:35 -- common/autotest_common.sh@941 -- # uname 00:21:34.115 23:13:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:34.115 23:13:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2482716 00:21:34.115 23:13:35 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:34.115 23:13:35 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:34.115 23:13:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2482716' 00:21:34.115 killing process with pid 2482716 00:21:34.115 23:13:35 -- common/autotest_common.sh@955 -- # kill 2482716 00:21:34.115 Received shutdown signal, test time was about 10.000000 seconds 00:21:34.115 00:21:34.115 Latency(us) 00:21:34.115 [2024-11-28T22:13:37.721Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:34.115 [2024-11-28T22:13:37.721Z] =================================================================================================================== 00:21:34.115 [2024-11-28T22:13:37.721Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:34.115 23:13:35 -- common/autotest_common.sh@960 -- # wait 2482716 00:21:34.115 23:13:35 -- target/tls.sh@224 -- # killprocess 2482560 00:21:34.115 23:13:35 -- common/autotest_common.sh@936 -- # '[' -z 2482560 ']' 00:21:34.115 23:13:35 -- common/autotest_common.sh@940 -- # kill -0 2482560 00:21:34.115 23:13:35 -- common/autotest_common.sh@941 -- # uname 00:21:34.115 23:13:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:34.115 23:13:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2482560 00:21:34.115 23:13:35 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:34.115 23:13:35 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:34.115 23:13:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2482560' 00:21:34.115 killing process with pid 2482560 00:21:34.115 23:13:35 -- common/autotest_common.sh@955 -- # kill 2482560 00:21:34.115 23:13:35 -- common/autotest_common.sh@960 -- # wait 2482560 00:21:34.115 23:13:36 -- target/tls.sh@226 -- # trap - SIGINT SIGTERM EXIT 00:21:34.115 23:13:36 -- target/tls.sh@227 -- # cleanup 00:21:34.115 23:13:36 -- target/tls.sh@15 -- # process_shm --id 0 00:21:34.115 23:13:36 -- common/autotest_common.sh@806 -- # type=--id 00:21:34.115 23:13:36 -- common/autotest_common.sh@807 -- # id=0 00:21:34.115 23:13:36 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:21:34.115 23:13:36 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:21:34.115 23:13:36 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:21:34.115 23:13:36 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:21:34.115 23:13:36 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:21:34.115 23:13:36 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:21:34.115 nvmf_trace.0 00:21:34.115 23:13:36 -- common/autotest_common.sh@821 -- # return 0 00:21:34.115 23:13:36 -- target/tls.sh@16 -- # killprocess 2482716 00:21:34.115 23:13:36 -- common/autotest_common.sh@936 -- # '[' -z 2482716 ']' 00:21:34.115 23:13:36 -- common/autotest_common.sh@940 -- # kill -0 2482716 00:21:34.115 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2482716) - No such process 00:21:34.115 23:13:36 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2482716 is not found' 00:21:34.115 Process with pid 2482716 is not found 00:21:34.115 23:13:36 -- target/tls.sh@17 -- # nvmftestfini 00:21:34.115 23:13:36 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:34.115 23:13:36 -- nvmf/common.sh@116 -- # sync 00:21:34.115 23:13:36 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:34.115 23:13:36 -- nvmf/common.sh@119 -- # set +e 00:21:34.115 23:13:36 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:34.115 23:13:36 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:34.115 rmmod nvme_tcp 00:21:34.115 rmmod nvme_fabrics 00:21:34.115 rmmod nvme_keyring 00:21:34.115 23:13:36 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:34.115 23:13:36 -- nvmf/common.sh@123 -- # set -e 00:21:34.115 23:13:36 -- nvmf/common.sh@124 -- # return 0 00:21:34.115 23:13:36 -- nvmf/common.sh@477 -- # '[' -n 2482560 ']' 00:21:34.115 23:13:36 -- nvmf/common.sh@478 -- # killprocess 2482560 00:21:34.115 23:13:36 -- common/autotest_common.sh@936 -- # '[' -z 2482560 ']' 00:21:34.115 23:13:36 -- common/autotest_common.sh@940 -- # kill -0 2482560 00:21:34.115 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2482560) - No such process 00:21:34.115 23:13:36 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2482560 is not found' 00:21:34.115 Process with pid 2482560 is not found 00:21:34.115 23:13:36 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:34.115 23:13:36 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:34.115 23:13:36 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:34.115 23:13:36 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:34.115 23:13:36 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:34.115 23:13:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:34.115 23:13:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:34.115 23:13:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:35.053 23:13:38 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:35.053 23:13:38 -- target/tls.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:35.053 00:21:35.053 real 1m14.986s 00:21:35.053 user 1m56.660s 00:21:35.053 sys 0m24.846s 00:21:35.053 23:13:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:35.053 23:13:38 -- common/autotest_common.sh@10 -- # set +x 00:21:35.053 ************************************ 00:21:35.053 END TEST nvmf_tls 00:21:35.053 ************************************ 00:21:35.053 23:13:38 -- nvmf/nvmf.sh@60 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:21:35.053 23:13:38 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:35.053 23:13:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:35.053 23:13:38 -- common/autotest_common.sh@10 -- # set +x 00:21:35.053 ************************************ 00:21:35.053 START TEST nvmf_fips 00:21:35.053 ************************************ 00:21:35.053 23:13:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:21:35.053 * Looking for test storage... 00:21:35.053 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:21:35.053 23:13:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:35.053 23:13:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:35.053 23:13:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:35.053 23:13:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:35.053 23:13:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:35.053 23:13:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:35.053 23:13:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:35.053 23:13:38 -- scripts/common.sh@335 -- # IFS=.-: 00:21:35.053 23:13:38 -- scripts/common.sh@335 -- # read -ra ver1 00:21:35.053 23:13:38 -- scripts/common.sh@336 -- # IFS=.-: 00:21:35.053 23:13:38 -- scripts/common.sh@336 -- # read -ra ver2 00:21:35.053 23:13:38 -- scripts/common.sh@337 -- # local 'op=<' 00:21:35.053 23:13:38 -- scripts/common.sh@339 -- # ver1_l=2 00:21:35.053 23:13:38 -- scripts/common.sh@340 -- # ver2_l=1 00:21:35.053 23:13:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:35.053 23:13:38 -- scripts/common.sh@343 -- # case "$op" in 00:21:35.053 23:13:38 -- scripts/common.sh@344 -- # : 1 00:21:35.053 23:13:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:35.053 23:13:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:35.053 23:13:38 -- scripts/common.sh@364 -- # decimal 1 00:21:35.053 23:13:38 -- scripts/common.sh@352 -- # local d=1 00:21:35.053 23:13:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:35.053 23:13:38 -- scripts/common.sh@354 -- # echo 1 00:21:35.053 23:13:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:35.053 23:13:38 -- scripts/common.sh@365 -- # decimal 2 00:21:35.053 23:13:38 -- scripts/common.sh@352 -- # local d=2 00:21:35.053 23:13:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:35.053 23:13:38 -- scripts/common.sh@354 -- # echo 2 00:21:35.053 23:13:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:35.053 23:13:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:35.053 23:13:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:35.053 23:13:38 -- scripts/common.sh@367 -- # return 0 00:21:35.053 23:13:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:35.053 23:13:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:35.053 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:35.053 --rc genhtml_branch_coverage=1 00:21:35.053 --rc genhtml_function_coverage=1 00:21:35.053 --rc genhtml_legend=1 00:21:35.053 --rc geninfo_all_blocks=1 00:21:35.053 --rc geninfo_unexecuted_blocks=1 00:21:35.053 00:21:35.053 ' 00:21:35.053 23:13:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:35.053 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:35.053 --rc genhtml_branch_coverage=1 00:21:35.053 --rc genhtml_function_coverage=1 00:21:35.053 --rc genhtml_legend=1 00:21:35.053 --rc geninfo_all_blocks=1 00:21:35.053 --rc geninfo_unexecuted_blocks=1 00:21:35.053 00:21:35.053 ' 00:21:35.053 23:13:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:35.053 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:35.053 --rc genhtml_branch_coverage=1 00:21:35.053 --rc genhtml_function_coverage=1 00:21:35.053 --rc genhtml_legend=1 00:21:35.053 --rc geninfo_all_blocks=1 00:21:35.053 --rc geninfo_unexecuted_blocks=1 00:21:35.053 00:21:35.053 ' 00:21:35.053 23:13:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:35.053 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:35.053 --rc genhtml_branch_coverage=1 00:21:35.053 --rc genhtml_function_coverage=1 00:21:35.053 --rc genhtml_legend=1 00:21:35.053 --rc geninfo_all_blocks=1 00:21:35.053 --rc geninfo_unexecuted_blocks=1 00:21:35.053 00:21:35.053 ' 00:21:35.053 23:13:38 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:35.053 23:13:38 -- nvmf/common.sh@7 -- # uname -s 00:21:35.053 23:13:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:35.053 23:13:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:35.053 23:13:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:35.053 23:13:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:35.053 23:13:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:35.053 23:13:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:35.053 23:13:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:35.053 23:13:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:35.053 23:13:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:35.053 23:13:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:35.053 23:13:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:35.053 23:13:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:35.053 23:13:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:35.053 23:13:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:35.053 23:13:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:35.053 23:13:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:35.053 23:13:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:35.053 23:13:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:35.053 23:13:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:35.053 23:13:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:35.053 23:13:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:35.053 23:13:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:35.053 23:13:38 -- paths/export.sh@5 -- # export PATH 00:21:35.053 23:13:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:35.053 23:13:38 -- nvmf/common.sh@46 -- # : 0 00:21:35.053 23:13:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:35.053 23:13:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:35.053 23:13:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:35.053 23:13:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:35.054 23:13:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:35.054 23:13:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:35.054 23:13:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:35.054 23:13:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:35.054 23:13:38 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:21:35.054 23:13:38 -- fips/fips.sh@89 -- # check_openssl_version 00:21:35.054 23:13:38 -- fips/fips.sh@83 -- # local target=3.0.0 00:21:35.054 23:13:38 -- fips/fips.sh@85 -- # openssl version 00:21:35.054 23:13:38 -- fips/fips.sh@85 -- # awk '{print $2}' 00:21:35.054 23:13:38 -- fips/fips.sh@85 -- # ge 3.1.1 3.0.0 00:21:35.054 23:13:38 -- scripts/common.sh@375 -- # cmp_versions 3.1.1 '>=' 3.0.0 00:21:35.054 23:13:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:35.054 23:13:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:35.054 23:13:38 -- scripts/common.sh@335 -- # IFS=.-: 00:21:35.054 23:13:38 -- scripts/common.sh@335 -- # read -ra ver1 00:21:35.054 23:13:38 -- scripts/common.sh@336 -- # IFS=.-: 00:21:35.054 23:13:38 -- scripts/common.sh@336 -- # read -ra ver2 00:21:35.054 23:13:38 -- scripts/common.sh@337 -- # local 'op=>=' 00:21:35.054 23:13:38 -- scripts/common.sh@339 -- # ver1_l=3 00:21:35.054 23:13:38 -- scripts/common.sh@340 -- # ver2_l=3 00:21:35.054 23:13:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:35.054 23:13:38 -- scripts/common.sh@343 -- # case "$op" in 00:21:35.054 23:13:38 -- scripts/common.sh@347 -- # : 1 00:21:35.054 23:13:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:35.054 23:13:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:35.054 23:13:38 -- scripts/common.sh@364 -- # decimal 3 00:21:35.054 23:13:38 -- scripts/common.sh@352 -- # local d=3 00:21:35.054 23:13:38 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:21:35.054 23:13:38 -- scripts/common.sh@354 -- # echo 3 00:21:35.054 23:13:38 -- scripts/common.sh@364 -- # ver1[v]=3 00:21:35.054 23:13:38 -- scripts/common.sh@365 -- # decimal 3 00:21:35.054 23:13:38 -- scripts/common.sh@352 -- # local d=3 00:21:35.054 23:13:38 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:21:35.054 23:13:38 -- scripts/common.sh@354 -- # echo 3 00:21:35.054 23:13:38 -- scripts/common.sh@365 -- # ver2[v]=3 00:21:35.054 23:13:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:35.054 23:13:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:35.054 23:13:38 -- scripts/common.sh@363 -- # (( v++ )) 00:21:35.054 23:13:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:35.054 23:13:38 -- scripts/common.sh@364 -- # decimal 1 00:21:35.054 23:13:38 -- scripts/common.sh@352 -- # local d=1 00:21:35.054 23:13:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:35.054 23:13:38 -- scripts/common.sh@354 -- # echo 1 00:21:35.054 23:13:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:35.054 23:13:38 -- scripts/common.sh@365 -- # decimal 0 00:21:35.054 23:13:38 -- scripts/common.sh@352 -- # local d=0 00:21:35.054 23:13:38 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:21:35.054 23:13:38 -- scripts/common.sh@354 -- # echo 0 00:21:35.054 23:13:38 -- scripts/common.sh@365 -- # ver2[v]=0 00:21:35.054 23:13:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:35.054 23:13:38 -- scripts/common.sh@366 -- # return 0 00:21:35.054 23:13:38 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:21:35.054 23:13:38 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:21:35.054 23:13:38 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:21:35.054 23:13:38 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:21:35.054 23:13:38 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:21:35.054 23:13:38 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:21:35.054 23:13:38 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:21:35.054 23:13:38 -- fips/fips.sh@113 -- # build_openssl_config 00:21:35.054 23:13:38 -- fips/fips.sh@37 -- # cat 00:21:35.054 23:13:38 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:21:35.054 23:13:38 -- fips/fips.sh@58 -- # cat - 00:21:35.054 23:13:38 -- fips/fips.sh@114 -- # export OPENSSL_CONF=spdk_fips.conf 00:21:35.054 23:13:38 -- fips/fips.sh@114 -- # OPENSSL_CONF=spdk_fips.conf 00:21:35.054 23:13:38 -- fips/fips.sh@116 -- # mapfile -t providers 00:21:35.054 23:13:38 -- fips/fips.sh@116 -- # openssl list -providers 00:21:35.054 23:13:38 -- fips/fips.sh@116 -- # grep name 00:21:35.054 23:13:38 -- fips/fips.sh@120 -- # (( 2 != 2 )) 00:21:35.054 23:13:38 -- fips/fips.sh@120 -- # [[ name: openssl base provider != *base* ]] 00:21:35.054 23:13:38 -- fips/fips.sh@120 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:21:35.054 23:13:38 -- fips/fips.sh@127 -- # NOT openssl md5 /dev/fd/62 00:21:35.054 23:13:38 -- common/autotest_common.sh@650 -- # local es=0 00:21:35.054 23:13:38 -- fips/fips.sh@127 -- # : 00:21:35.054 23:13:38 -- common/autotest_common.sh@652 -- # valid_exec_arg openssl md5 /dev/fd/62 00:21:35.054 23:13:38 -- common/autotest_common.sh@638 -- # local arg=openssl 00:21:35.054 23:13:38 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:35.054 23:13:38 -- common/autotest_common.sh@642 -- # type -t openssl 00:21:35.054 23:13:38 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:35.054 23:13:38 -- common/autotest_common.sh@644 -- # type -P openssl 00:21:35.054 23:13:38 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:35.054 23:13:38 -- common/autotest_common.sh@644 -- # arg=/usr/bin/openssl 00:21:35.054 23:13:38 -- common/autotest_common.sh@644 -- # [[ -x /usr/bin/openssl ]] 00:21:35.054 23:13:38 -- common/autotest_common.sh@653 -- # openssl md5 /dev/fd/62 00:21:35.054 Error setting digest 00:21:35.054 40921A2C257F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:341:Global default library context, Algorithm (MD5 : 95), Properties () 00:21:35.054 40921A2C257F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:272: 00:21:35.054 23:13:38 -- common/autotest_common.sh@653 -- # es=1 00:21:35.054 23:13:38 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:21:35.054 23:13:38 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:21:35.054 23:13:38 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:21:35.054 23:13:38 -- fips/fips.sh@130 -- # nvmftestinit 00:21:35.054 23:13:38 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:35.054 23:13:38 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:35.054 23:13:38 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:35.054 23:13:38 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:35.054 23:13:38 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:35.054 23:13:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:35.054 23:13:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:35.054 23:13:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:35.054 23:13:38 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:35.054 23:13:38 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:35.054 23:13:38 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:35.054 23:13:38 -- common/autotest_common.sh@10 -- # set +x 00:21:37.589 23:13:40 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:37.589 23:13:40 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:37.589 23:13:40 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:37.589 23:13:40 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:37.589 23:13:40 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:37.589 23:13:40 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:37.589 23:13:40 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:37.589 23:13:40 -- nvmf/common.sh@294 -- # net_devs=() 00:21:37.589 23:13:40 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:37.589 23:13:40 -- nvmf/common.sh@295 -- # e810=() 00:21:37.589 23:13:40 -- nvmf/common.sh@295 -- # local -ga e810 00:21:37.589 23:13:40 -- nvmf/common.sh@296 -- # x722=() 00:21:37.589 23:13:40 -- nvmf/common.sh@296 -- # local -ga x722 00:21:37.589 23:13:40 -- nvmf/common.sh@297 -- # mlx=() 00:21:37.589 23:13:40 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:37.589 23:13:40 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:37.589 23:13:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:37.589 23:13:40 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:37.589 23:13:40 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:37.589 23:13:40 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:37.589 23:13:40 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:37.589 23:13:40 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:37.589 23:13:40 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:37.589 23:13:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:37.589 23:13:40 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:37.589 23:13:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:37.589 23:13:40 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:37.589 23:13:40 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:37.589 23:13:40 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:37.589 23:13:40 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:37.589 23:13:40 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:37.589 23:13:40 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:37.589 23:13:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:37.589 23:13:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:37.589 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:37.589 23:13:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:37.589 23:13:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:37.589 23:13:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:37.589 23:13:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:37.589 23:13:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:37.589 23:13:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:37.589 23:13:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:37.589 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:37.589 23:13:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:37.589 23:13:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:37.589 23:13:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:37.589 23:13:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:37.589 23:13:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:37.589 23:13:40 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:37.589 23:13:40 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:37.589 23:13:40 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:37.589 23:13:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:37.589 23:13:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:37.589 23:13:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:37.589 23:13:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:37.589 23:13:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:37.589 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:37.589 23:13:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:37.589 23:13:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:37.589 23:13:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:37.589 23:13:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:37.589 23:13:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:37.589 23:13:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:37.589 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:37.589 23:13:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:37.589 23:13:40 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:37.589 23:13:40 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:37.589 23:13:40 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:37.589 23:13:40 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:37.589 23:13:40 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:37.589 23:13:40 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:37.589 23:13:40 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:37.589 23:13:40 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:37.589 23:13:40 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:37.589 23:13:40 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:37.589 23:13:40 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:37.589 23:13:40 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:37.589 23:13:40 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:37.589 23:13:40 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:37.589 23:13:40 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:37.589 23:13:40 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:37.589 23:13:40 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:37.589 23:13:40 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:37.589 23:13:40 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:37.589 23:13:40 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:37.589 23:13:40 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:37.589 23:13:40 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:37.589 23:13:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:37.589 23:13:40 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:37.589 23:13:40 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:37.589 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:37.589 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.149 ms 00:21:37.589 00:21:37.589 --- 10.0.0.2 ping statistics --- 00:21:37.589 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:37.589 rtt min/avg/max/mdev = 0.149/0.149/0.149/0.000 ms 00:21:37.589 23:13:40 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:37.589 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:37.589 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.050 ms 00:21:37.589 00:21:37.589 --- 10.0.0.1 ping statistics --- 00:21:37.589 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:37.589 rtt min/avg/max/mdev = 0.050/0.050/0.050/0.000 ms 00:21:37.589 23:13:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:37.589 23:13:40 -- nvmf/common.sh@410 -- # return 0 00:21:37.589 23:13:40 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:37.589 23:13:40 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:37.589 23:13:40 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:37.589 23:13:40 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:37.589 23:13:40 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:37.589 23:13:40 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:37.589 23:13:40 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:37.589 23:13:40 -- fips/fips.sh@131 -- # nvmfappstart -m 0x2 00:21:37.589 23:13:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:37.589 23:13:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:37.589 23:13:40 -- common/autotest_common.sh@10 -- # set +x 00:21:37.589 23:13:40 -- nvmf/common.sh@469 -- # nvmfpid=2486177 00:21:37.589 23:13:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:21:37.589 23:13:40 -- nvmf/common.sh@470 -- # waitforlisten 2486177 00:21:37.589 23:13:40 -- common/autotest_common.sh@829 -- # '[' -z 2486177 ']' 00:21:37.589 23:13:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:37.589 23:13:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:37.589 23:13:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:37.589 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:37.589 23:13:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:37.589 23:13:40 -- common/autotest_common.sh@10 -- # set +x 00:21:37.589 [2024-11-28 23:13:40.968629] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:37.589 [2024-11-28 23:13:40.968711] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:37.589 EAL: No free 2048 kB hugepages reported on node 1 00:21:37.589 [2024-11-28 23:13:41.038245] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:37.590 [2024-11-28 23:13:41.125621] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:37.590 [2024-11-28 23:13:41.125786] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:37.590 [2024-11-28 23:13:41.125805] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:37.590 [2024-11-28 23:13:41.125820] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:37.590 [2024-11-28 23:13:41.125851] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:38.523 23:13:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:38.523 23:13:41 -- common/autotest_common.sh@862 -- # return 0 00:21:38.523 23:13:41 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:38.523 23:13:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:38.523 23:13:41 -- common/autotest_common.sh@10 -- # set +x 00:21:38.524 23:13:41 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:38.524 23:13:41 -- fips/fips.sh@133 -- # trap cleanup EXIT 00:21:38.524 23:13:41 -- fips/fips.sh@136 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:21:38.524 23:13:41 -- fips/fips.sh@137 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:38.524 23:13:41 -- fips/fips.sh@138 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:21:38.524 23:13:41 -- fips/fips.sh@139 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:38.524 23:13:41 -- fips/fips.sh@141 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:38.524 23:13:41 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:38.524 23:13:41 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:21:38.782 [2024-11-28 23:13:42.146288] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:38.782 [2024-11-28 23:13:42.162251] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:38.782 [2024-11-28 23:13:42.162510] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:38.782 malloc0 00:21:38.782 23:13:42 -- fips/fips.sh@144 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:21:38.782 23:13:42 -- fips/fips.sh@147 -- # bdevperf_pid=2486339 00:21:38.782 23:13:42 -- fips/fips.sh@145 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:21:38.782 23:13:42 -- fips/fips.sh@148 -- # waitforlisten 2486339 /var/tmp/bdevperf.sock 00:21:38.782 23:13:42 -- common/autotest_common.sh@829 -- # '[' -z 2486339 ']' 00:21:38.782 23:13:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:38.782 23:13:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:38.782 23:13:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:38.782 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:38.782 23:13:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:38.782 23:13:42 -- common/autotest_common.sh@10 -- # set +x 00:21:38.782 [2024-11-28 23:13:42.282586] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:38.782 [2024-11-28 23:13:42.282667] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2486339 ] 00:21:38.782 EAL: No free 2048 kB hugepages reported on node 1 00:21:38.782 [2024-11-28 23:13:42.340911] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:39.040 [2024-11-28 23:13:42.423311] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:39.606 23:13:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:39.606 23:13:43 -- common/autotest_common.sh@862 -- # return 0 00:21:39.606 23:13:43 -- fips/fips.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:39.864 [2024-11-28 23:13:43.427567] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:40.122 TLSTESTn1 00:21:40.122 23:13:43 -- fips/fips.sh@154 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:21:40.122 Running I/O for 10 seconds... 00:21:50.089 00:21:50.089 Latency(us) 00:21:50.089 [2024-11-28T22:13:53.695Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:50.089 [2024-11-28T22:13:53.695Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:21:50.089 Verification LBA range: start 0x0 length 0x2000 00:21:50.089 TLSTESTn1 : 10.01 4114.23 16.07 0.00 0.00 31071.33 5801.15 39224.51 00:21:50.089 [2024-11-28T22:13:53.695Z] =================================================================================================================== 00:21:50.089 [2024-11-28T22:13:53.695Z] Total : 4114.23 16.07 0.00 0.00 31071.33 5801.15 39224.51 00:21:50.089 0 00:21:50.089 23:13:53 -- fips/fips.sh@1 -- # cleanup 00:21:50.089 23:13:53 -- fips/fips.sh@15 -- # process_shm --id 0 00:21:50.089 23:13:53 -- common/autotest_common.sh@806 -- # type=--id 00:21:50.089 23:13:53 -- common/autotest_common.sh@807 -- # id=0 00:21:50.089 23:13:53 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:21:50.089 23:13:53 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:21:50.347 23:13:53 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:21:50.347 23:13:53 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:21:50.347 23:13:53 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:21:50.347 23:13:53 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:21:50.347 nvmf_trace.0 00:21:50.347 23:13:53 -- common/autotest_common.sh@821 -- # return 0 00:21:50.347 23:13:53 -- fips/fips.sh@16 -- # killprocess 2486339 00:21:50.347 23:13:53 -- common/autotest_common.sh@936 -- # '[' -z 2486339 ']' 00:21:50.347 23:13:53 -- common/autotest_common.sh@940 -- # kill -0 2486339 00:21:50.347 23:13:53 -- common/autotest_common.sh@941 -- # uname 00:21:50.347 23:13:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:50.347 23:13:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2486339 00:21:50.347 23:13:53 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:50.347 23:13:53 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:50.347 23:13:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2486339' 00:21:50.347 killing process with pid 2486339 00:21:50.347 23:13:53 -- common/autotest_common.sh@955 -- # kill 2486339 00:21:50.347 Received shutdown signal, test time was about 10.000000 seconds 00:21:50.347 00:21:50.347 Latency(us) 00:21:50.347 [2024-11-28T22:13:53.953Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:50.348 [2024-11-28T22:13:53.954Z] =================================================================================================================== 00:21:50.348 [2024-11-28T22:13:53.954Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:50.348 23:13:53 -- common/autotest_common.sh@960 -- # wait 2486339 00:21:50.606 23:13:54 -- fips/fips.sh@17 -- # nvmftestfini 00:21:50.606 23:13:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:50.606 23:13:54 -- nvmf/common.sh@116 -- # sync 00:21:50.606 23:13:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:50.606 23:13:54 -- nvmf/common.sh@119 -- # set +e 00:21:50.606 23:13:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:50.606 23:13:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:50.606 rmmod nvme_tcp 00:21:50.606 rmmod nvme_fabrics 00:21:50.606 rmmod nvme_keyring 00:21:50.606 23:13:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:50.606 23:13:54 -- nvmf/common.sh@123 -- # set -e 00:21:50.606 23:13:54 -- nvmf/common.sh@124 -- # return 0 00:21:50.606 23:13:54 -- nvmf/common.sh@477 -- # '[' -n 2486177 ']' 00:21:50.606 23:13:54 -- nvmf/common.sh@478 -- # killprocess 2486177 00:21:50.606 23:13:54 -- common/autotest_common.sh@936 -- # '[' -z 2486177 ']' 00:21:50.606 23:13:54 -- common/autotest_common.sh@940 -- # kill -0 2486177 00:21:50.606 23:13:54 -- common/autotest_common.sh@941 -- # uname 00:21:50.606 23:13:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:50.606 23:13:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2486177 00:21:50.606 23:13:54 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:50.606 23:13:54 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:50.606 23:13:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2486177' 00:21:50.606 killing process with pid 2486177 00:21:50.606 23:13:54 -- common/autotest_common.sh@955 -- # kill 2486177 00:21:50.606 23:13:54 -- common/autotest_common.sh@960 -- # wait 2486177 00:21:50.865 23:13:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:50.865 23:13:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:50.865 23:13:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:50.865 23:13:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:50.865 23:13:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:50.865 23:13:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:50.865 23:13:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:50.865 23:13:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:53.397 23:13:56 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:53.397 23:13:56 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:53.397 00:21:53.397 real 0m18.062s 00:21:53.397 user 0m20.490s 00:21:53.397 sys 0m6.806s 00:21:53.397 23:13:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:53.397 23:13:56 -- common/autotest_common.sh@10 -- # set +x 00:21:53.397 ************************************ 00:21:53.397 END TEST nvmf_fips 00:21:53.397 ************************************ 00:21:53.397 23:13:56 -- nvmf/nvmf.sh@63 -- # '[' 1 -eq 1 ']' 00:21:53.397 23:13:56 -- nvmf/nvmf.sh@64 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:21:53.397 23:13:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:53.397 23:13:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:53.397 23:13:56 -- common/autotest_common.sh@10 -- # set +x 00:21:53.397 ************************************ 00:21:53.397 START TEST nvmf_fuzz 00:21:53.397 ************************************ 00:21:53.397 23:13:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:21:53.397 * Looking for test storage... 00:21:53.397 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:53.397 23:13:56 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:53.397 23:13:56 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:53.397 23:13:56 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:53.397 23:13:56 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:53.397 23:13:56 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:53.397 23:13:56 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:53.397 23:13:56 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:53.397 23:13:56 -- scripts/common.sh@335 -- # IFS=.-: 00:21:53.397 23:13:56 -- scripts/common.sh@335 -- # read -ra ver1 00:21:53.397 23:13:56 -- scripts/common.sh@336 -- # IFS=.-: 00:21:53.397 23:13:56 -- scripts/common.sh@336 -- # read -ra ver2 00:21:53.397 23:13:56 -- scripts/common.sh@337 -- # local 'op=<' 00:21:53.397 23:13:56 -- scripts/common.sh@339 -- # ver1_l=2 00:21:53.397 23:13:56 -- scripts/common.sh@340 -- # ver2_l=1 00:21:53.397 23:13:56 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:53.397 23:13:56 -- scripts/common.sh@343 -- # case "$op" in 00:21:53.397 23:13:56 -- scripts/common.sh@344 -- # : 1 00:21:53.397 23:13:56 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:53.397 23:13:56 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:53.397 23:13:56 -- scripts/common.sh@364 -- # decimal 1 00:21:53.397 23:13:56 -- scripts/common.sh@352 -- # local d=1 00:21:53.397 23:13:56 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:53.397 23:13:56 -- scripts/common.sh@354 -- # echo 1 00:21:53.397 23:13:56 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:53.397 23:13:56 -- scripts/common.sh@365 -- # decimal 2 00:21:53.397 23:13:56 -- scripts/common.sh@352 -- # local d=2 00:21:53.397 23:13:56 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:53.397 23:13:56 -- scripts/common.sh@354 -- # echo 2 00:21:53.397 23:13:56 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:53.397 23:13:56 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:53.397 23:13:56 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:53.397 23:13:56 -- scripts/common.sh@367 -- # return 0 00:21:53.397 23:13:56 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:53.397 23:13:56 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:53.397 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:53.397 --rc genhtml_branch_coverage=1 00:21:53.397 --rc genhtml_function_coverage=1 00:21:53.397 --rc genhtml_legend=1 00:21:53.397 --rc geninfo_all_blocks=1 00:21:53.397 --rc geninfo_unexecuted_blocks=1 00:21:53.397 00:21:53.397 ' 00:21:53.397 23:13:56 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:53.397 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:53.397 --rc genhtml_branch_coverage=1 00:21:53.397 --rc genhtml_function_coverage=1 00:21:53.397 --rc genhtml_legend=1 00:21:53.397 --rc geninfo_all_blocks=1 00:21:53.397 --rc geninfo_unexecuted_blocks=1 00:21:53.397 00:21:53.397 ' 00:21:53.397 23:13:56 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:53.397 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:53.397 --rc genhtml_branch_coverage=1 00:21:53.397 --rc genhtml_function_coverage=1 00:21:53.397 --rc genhtml_legend=1 00:21:53.397 --rc geninfo_all_blocks=1 00:21:53.397 --rc geninfo_unexecuted_blocks=1 00:21:53.397 00:21:53.397 ' 00:21:53.397 23:13:56 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:53.397 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:53.397 --rc genhtml_branch_coverage=1 00:21:53.397 --rc genhtml_function_coverage=1 00:21:53.397 --rc genhtml_legend=1 00:21:53.397 --rc geninfo_all_blocks=1 00:21:53.397 --rc geninfo_unexecuted_blocks=1 00:21:53.397 00:21:53.397 ' 00:21:53.397 23:13:56 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:53.397 23:13:56 -- nvmf/common.sh@7 -- # uname -s 00:21:53.397 23:13:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:53.397 23:13:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:53.397 23:13:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:53.397 23:13:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:53.397 23:13:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:53.397 23:13:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:53.397 23:13:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:53.397 23:13:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:53.397 23:13:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:53.397 23:13:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:53.397 23:13:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:53.397 23:13:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:53.397 23:13:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:53.397 23:13:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:53.397 23:13:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:53.397 23:13:56 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:53.397 23:13:56 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:53.397 23:13:56 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:53.397 23:13:56 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:53.398 23:13:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:53.398 23:13:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:53.398 23:13:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:53.398 23:13:56 -- paths/export.sh@5 -- # export PATH 00:21:53.398 23:13:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:53.398 23:13:56 -- nvmf/common.sh@46 -- # : 0 00:21:53.398 23:13:56 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:53.398 23:13:56 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:53.398 23:13:56 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:53.398 23:13:56 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:53.398 23:13:56 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:53.398 23:13:56 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:53.398 23:13:56 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:53.398 23:13:56 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:53.398 23:13:56 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:21:53.398 23:13:56 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:53.398 23:13:56 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:53.398 23:13:56 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:53.398 23:13:56 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:53.398 23:13:56 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:53.398 23:13:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:53.398 23:13:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:53.398 23:13:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:53.398 23:13:56 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:53.398 23:13:56 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:53.398 23:13:56 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:53.398 23:13:56 -- common/autotest_common.sh@10 -- # set +x 00:21:55.302 23:13:58 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:55.302 23:13:58 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:55.302 23:13:58 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:55.302 23:13:58 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:55.302 23:13:58 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:55.302 23:13:58 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:55.302 23:13:58 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:55.302 23:13:58 -- nvmf/common.sh@294 -- # net_devs=() 00:21:55.302 23:13:58 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:55.302 23:13:58 -- nvmf/common.sh@295 -- # e810=() 00:21:55.302 23:13:58 -- nvmf/common.sh@295 -- # local -ga e810 00:21:55.302 23:13:58 -- nvmf/common.sh@296 -- # x722=() 00:21:55.302 23:13:58 -- nvmf/common.sh@296 -- # local -ga x722 00:21:55.302 23:13:58 -- nvmf/common.sh@297 -- # mlx=() 00:21:55.302 23:13:58 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:55.302 23:13:58 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:55.302 23:13:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:55.302 23:13:58 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:55.302 23:13:58 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:55.302 23:13:58 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:55.302 23:13:58 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:55.302 23:13:58 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:55.302 23:13:58 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:55.302 23:13:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:55.302 23:13:58 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:55.302 23:13:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:55.302 23:13:58 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:55.302 23:13:58 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:55.302 23:13:58 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:55.302 23:13:58 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:55.302 23:13:58 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:55.302 23:13:58 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:55.302 23:13:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:55.302 23:13:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:55.302 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:55.302 23:13:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:55.302 23:13:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:55.302 23:13:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:55.302 23:13:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:55.302 23:13:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:55.302 23:13:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:55.302 23:13:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:55.302 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:55.302 23:13:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:55.302 23:13:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:55.302 23:13:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:55.302 23:13:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:55.302 23:13:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:55.302 23:13:58 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:55.302 23:13:58 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:55.302 23:13:58 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:55.302 23:13:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:55.302 23:13:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:55.302 23:13:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:55.302 23:13:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:55.302 23:13:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:55.302 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:55.302 23:13:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:55.303 23:13:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:55.303 23:13:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:55.303 23:13:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:55.303 23:13:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:55.303 23:13:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:55.303 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:55.303 23:13:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:55.303 23:13:58 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:55.303 23:13:58 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:55.303 23:13:58 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:55.303 23:13:58 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:55.303 23:13:58 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:55.303 23:13:58 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:55.303 23:13:58 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:55.303 23:13:58 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:55.303 23:13:58 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:55.303 23:13:58 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:55.303 23:13:58 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:55.303 23:13:58 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:55.303 23:13:58 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:55.303 23:13:58 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:55.303 23:13:58 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:55.303 23:13:58 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:55.303 23:13:58 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:55.303 23:13:58 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:55.303 23:13:58 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:55.303 23:13:58 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:55.303 23:13:58 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:55.303 23:13:58 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:55.562 23:13:58 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:55.562 23:13:58 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:55.562 23:13:58 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:55.562 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:55.562 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.262 ms 00:21:55.562 00:21:55.562 --- 10.0.0.2 ping statistics --- 00:21:55.562 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:55.562 rtt min/avg/max/mdev = 0.262/0.262/0.262/0.000 ms 00:21:55.562 23:13:58 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:55.562 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:55.562 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.083 ms 00:21:55.562 00:21:55.562 --- 10.0.0.1 ping statistics --- 00:21:55.562 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:55.562 rtt min/avg/max/mdev = 0.083/0.083/0.083/0.000 ms 00:21:55.562 23:13:58 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:55.562 23:13:58 -- nvmf/common.sh@410 -- # return 0 00:21:55.562 23:13:58 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:55.562 23:13:58 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:55.562 23:13:58 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:55.562 23:13:58 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:55.562 23:13:58 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:55.562 23:13:58 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:55.562 23:13:58 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:55.562 23:13:58 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=2489779 00:21:55.562 23:13:58 -- target/fabrics_fuzz.sh@13 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:21:55.562 23:13:58 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:21:55.562 23:13:58 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 2489779 00:21:55.562 23:13:58 -- common/autotest_common.sh@829 -- # '[' -z 2489779 ']' 00:21:55.562 23:13:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:55.562 23:13:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:55.562 23:13:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:55.562 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:55.562 23:13:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:55.562 23:13:58 -- common/autotest_common.sh@10 -- # set +x 00:21:56.497 23:14:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:56.497 23:14:00 -- common/autotest_common.sh@862 -- # return 0 00:21:56.497 23:14:00 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:21:56.497 23:14:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:56.497 23:14:00 -- common/autotest_common.sh@10 -- # set +x 00:21:56.497 23:14:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:56.497 23:14:00 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:21:56.497 23:14:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:56.497 23:14:00 -- common/autotest_common.sh@10 -- # set +x 00:21:56.497 Malloc0 00:21:56.497 23:14:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:56.497 23:14:00 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:56.497 23:14:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:56.497 23:14:00 -- common/autotest_common.sh@10 -- # set +x 00:21:56.756 23:14:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:56.756 23:14:00 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:21:56.756 23:14:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:56.756 23:14:00 -- common/autotest_common.sh@10 -- # set +x 00:21:56.756 23:14:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:56.756 23:14:00 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:56.756 23:14:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:56.756 23:14:00 -- common/autotest_common.sh@10 -- # set +x 00:21:56.756 23:14:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:56.756 23:14:00 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' 00:21:56.756 23:14:00 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -t 30 -S 123456 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -N -a 00:22:28.872 Fuzzing completed. Shutting down the fuzz application 00:22:28.872 00:22:28.872 Dumping successful admin opcodes: 00:22:28.872 8, 9, 10, 24, 00:22:28.872 Dumping successful io opcodes: 00:22:28.872 0, 9, 00:22:28.872 NS: 0x200003aeff00 I/O qp, Total commands completed: 480855, total successful commands: 2778, random_seed: 1056784896 00:22:28.872 NS: 0x200003aeff00 admin qp, Total commands completed: 57392, total successful commands: 459, random_seed: 4250568256 00:22:28.872 23:14:30 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:22:28.872 Fuzzing completed. Shutting down the fuzz application 00:22:28.872 00:22:28.872 Dumping successful admin opcodes: 00:22:28.872 24, 00:22:28.872 Dumping successful io opcodes: 00:22:28.872 00:22:28.872 NS: 0x200003aeff00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 3185532178 00:22:28.872 NS: 0x200003aeff00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 3185636713 00:22:28.872 23:14:31 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:28.872 23:14:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:28.872 23:14:31 -- common/autotest_common.sh@10 -- # set +x 00:22:28.872 23:14:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:28.872 23:14:31 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:22:28.872 23:14:31 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:22:28.872 23:14:31 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:28.872 23:14:31 -- nvmf/common.sh@116 -- # sync 00:22:28.872 23:14:31 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:28.872 23:14:31 -- nvmf/common.sh@119 -- # set +e 00:22:28.872 23:14:31 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:28.872 23:14:31 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:28.872 rmmod nvme_tcp 00:22:28.872 rmmod nvme_fabrics 00:22:28.872 rmmod nvme_keyring 00:22:28.872 23:14:31 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:28.872 23:14:31 -- nvmf/common.sh@123 -- # set -e 00:22:28.872 23:14:31 -- nvmf/common.sh@124 -- # return 0 00:22:28.872 23:14:31 -- nvmf/common.sh@477 -- # '[' -n 2489779 ']' 00:22:28.872 23:14:31 -- nvmf/common.sh@478 -- # killprocess 2489779 00:22:28.872 23:14:31 -- common/autotest_common.sh@936 -- # '[' -z 2489779 ']' 00:22:28.872 23:14:31 -- common/autotest_common.sh@940 -- # kill -0 2489779 00:22:28.872 23:14:31 -- common/autotest_common.sh@941 -- # uname 00:22:28.872 23:14:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:28.872 23:14:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2489779 00:22:28.872 23:14:31 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:28.873 23:14:31 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:28.873 23:14:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2489779' 00:22:28.873 killing process with pid 2489779 00:22:28.873 23:14:31 -- common/autotest_common.sh@955 -- # kill 2489779 00:22:28.873 23:14:31 -- common/autotest_common.sh@960 -- # wait 2489779 00:22:28.873 23:14:32 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:28.873 23:14:32 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:28.873 23:14:32 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:28.873 23:14:32 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:28.873 23:14:32 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:28.873 23:14:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:28.873 23:14:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:28.873 23:14:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:30.775 23:14:34 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:30.775 23:14:34 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:22:30.775 00:22:30.775 real 0m37.844s 00:22:30.775 user 0m52.087s 00:22:30.775 sys 0m15.085s 00:22:30.775 23:14:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:30.775 23:14:34 -- common/autotest_common.sh@10 -- # set +x 00:22:30.776 ************************************ 00:22:30.776 END TEST nvmf_fuzz 00:22:30.776 ************************************ 00:22:30.776 23:14:34 -- nvmf/nvmf.sh@65 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:22:30.776 23:14:34 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:30.776 23:14:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:30.776 23:14:34 -- common/autotest_common.sh@10 -- # set +x 00:22:30.776 ************************************ 00:22:30.776 START TEST nvmf_multiconnection 00:22:30.776 ************************************ 00:22:30.776 23:14:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:22:30.776 * Looking for test storage... 00:22:30.776 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:22:30.776 23:14:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:30.776 23:14:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:30.776 23:14:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:31.034 23:14:34 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:31.034 23:14:34 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:31.034 23:14:34 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:31.034 23:14:34 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:31.034 23:14:34 -- scripts/common.sh@335 -- # IFS=.-: 00:22:31.034 23:14:34 -- scripts/common.sh@335 -- # read -ra ver1 00:22:31.034 23:14:34 -- scripts/common.sh@336 -- # IFS=.-: 00:22:31.034 23:14:34 -- scripts/common.sh@336 -- # read -ra ver2 00:22:31.034 23:14:34 -- scripts/common.sh@337 -- # local 'op=<' 00:22:31.034 23:14:34 -- scripts/common.sh@339 -- # ver1_l=2 00:22:31.034 23:14:34 -- scripts/common.sh@340 -- # ver2_l=1 00:22:31.034 23:14:34 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:31.034 23:14:34 -- scripts/common.sh@343 -- # case "$op" in 00:22:31.034 23:14:34 -- scripts/common.sh@344 -- # : 1 00:22:31.034 23:14:34 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:31.034 23:14:34 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:31.034 23:14:34 -- scripts/common.sh@364 -- # decimal 1 00:22:31.034 23:14:34 -- scripts/common.sh@352 -- # local d=1 00:22:31.034 23:14:34 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:31.034 23:14:34 -- scripts/common.sh@354 -- # echo 1 00:22:31.034 23:14:34 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:31.034 23:14:34 -- scripts/common.sh@365 -- # decimal 2 00:22:31.034 23:14:34 -- scripts/common.sh@352 -- # local d=2 00:22:31.034 23:14:34 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:31.034 23:14:34 -- scripts/common.sh@354 -- # echo 2 00:22:31.034 23:14:34 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:31.034 23:14:34 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:31.034 23:14:34 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:31.034 23:14:34 -- scripts/common.sh@367 -- # return 0 00:22:31.034 23:14:34 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:31.034 23:14:34 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:31.034 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:31.034 --rc genhtml_branch_coverage=1 00:22:31.035 --rc genhtml_function_coverage=1 00:22:31.035 --rc genhtml_legend=1 00:22:31.035 --rc geninfo_all_blocks=1 00:22:31.035 --rc geninfo_unexecuted_blocks=1 00:22:31.035 00:22:31.035 ' 00:22:31.035 23:14:34 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:31.035 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:31.035 --rc genhtml_branch_coverage=1 00:22:31.035 --rc genhtml_function_coverage=1 00:22:31.035 --rc genhtml_legend=1 00:22:31.035 --rc geninfo_all_blocks=1 00:22:31.035 --rc geninfo_unexecuted_blocks=1 00:22:31.035 00:22:31.035 ' 00:22:31.035 23:14:34 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:31.035 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:31.035 --rc genhtml_branch_coverage=1 00:22:31.035 --rc genhtml_function_coverage=1 00:22:31.035 --rc genhtml_legend=1 00:22:31.035 --rc geninfo_all_blocks=1 00:22:31.035 --rc geninfo_unexecuted_blocks=1 00:22:31.035 00:22:31.035 ' 00:22:31.035 23:14:34 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:31.035 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:31.035 --rc genhtml_branch_coverage=1 00:22:31.035 --rc genhtml_function_coverage=1 00:22:31.035 --rc genhtml_legend=1 00:22:31.035 --rc geninfo_all_blocks=1 00:22:31.035 --rc geninfo_unexecuted_blocks=1 00:22:31.035 00:22:31.035 ' 00:22:31.035 23:14:34 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:31.035 23:14:34 -- nvmf/common.sh@7 -- # uname -s 00:22:31.035 23:14:34 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:31.035 23:14:34 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:31.035 23:14:34 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:31.035 23:14:34 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:31.035 23:14:34 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:31.035 23:14:34 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:31.035 23:14:34 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:31.035 23:14:34 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:31.035 23:14:34 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:31.035 23:14:34 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:31.035 23:14:34 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:31.035 23:14:34 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:31.035 23:14:34 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:31.035 23:14:34 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:31.035 23:14:34 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:31.035 23:14:34 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:31.035 23:14:34 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:31.035 23:14:34 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:31.035 23:14:34 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:31.035 23:14:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:31.035 23:14:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:31.035 23:14:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:31.035 23:14:34 -- paths/export.sh@5 -- # export PATH 00:22:31.035 23:14:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:31.035 23:14:34 -- nvmf/common.sh@46 -- # : 0 00:22:31.035 23:14:34 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:31.035 23:14:34 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:31.035 23:14:34 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:31.035 23:14:34 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:31.035 23:14:34 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:31.035 23:14:34 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:31.035 23:14:34 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:31.035 23:14:34 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:31.035 23:14:34 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:31.035 23:14:34 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:31.035 23:14:34 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:22:31.035 23:14:34 -- target/multiconnection.sh@16 -- # nvmftestinit 00:22:31.035 23:14:34 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:31.035 23:14:34 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:31.035 23:14:34 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:31.035 23:14:34 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:31.035 23:14:34 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:31.035 23:14:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:31.035 23:14:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:31.035 23:14:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:31.035 23:14:34 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:31.035 23:14:34 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:31.035 23:14:34 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:31.035 23:14:34 -- common/autotest_common.sh@10 -- # set +x 00:22:32.948 23:14:36 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:32.948 23:14:36 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:32.948 23:14:36 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:32.948 23:14:36 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:32.948 23:14:36 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:32.948 23:14:36 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:32.948 23:14:36 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:32.948 23:14:36 -- nvmf/common.sh@294 -- # net_devs=() 00:22:32.948 23:14:36 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:32.948 23:14:36 -- nvmf/common.sh@295 -- # e810=() 00:22:32.948 23:14:36 -- nvmf/common.sh@295 -- # local -ga e810 00:22:32.948 23:14:36 -- nvmf/common.sh@296 -- # x722=() 00:22:32.948 23:14:36 -- nvmf/common.sh@296 -- # local -ga x722 00:22:32.948 23:14:36 -- nvmf/common.sh@297 -- # mlx=() 00:22:32.948 23:14:36 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:32.948 23:14:36 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:32.948 23:14:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:32.948 23:14:36 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:32.948 23:14:36 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:32.948 23:14:36 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:32.948 23:14:36 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:32.948 23:14:36 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:32.948 23:14:36 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:32.948 23:14:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:32.948 23:14:36 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:32.948 23:14:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:32.948 23:14:36 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:32.948 23:14:36 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:32.948 23:14:36 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:32.948 23:14:36 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:32.948 23:14:36 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:32.948 23:14:36 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:32.948 23:14:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:32.948 23:14:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:32.948 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:32.948 23:14:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:32.948 23:14:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:32.948 23:14:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:32.948 23:14:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:32.948 23:14:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:32.948 23:14:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:32.948 23:14:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:32.948 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:32.948 23:14:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:32.948 23:14:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:32.948 23:14:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:32.948 23:14:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:32.948 23:14:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:32.948 23:14:36 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:32.948 23:14:36 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:32.948 23:14:36 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:32.948 23:14:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:32.948 23:14:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:32.948 23:14:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:32.948 23:14:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:32.948 23:14:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:32.948 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:32.948 23:14:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:32.948 23:14:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:32.948 23:14:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:32.948 23:14:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:32.948 23:14:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:32.948 23:14:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:32.948 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:32.948 23:14:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:32.948 23:14:36 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:32.948 23:14:36 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:32.948 23:14:36 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:32.948 23:14:36 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:32.948 23:14:36 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:32.948 23:14:36 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:32.948 23:14:36 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:32.949 23:14:36 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:32.949 23:14:36 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:32.949 23:14:36 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:32.949 23:14:36 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:32.949 23:14:36 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:32.949 23:14:36 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:32.949 23:14:36 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:32.949 23:14:36 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:32.949 23:14:36 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:32.949 23:14:36 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:32.949 23:14:36 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:33.207 23:14:36 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:33.207 23:14:36 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:33.207 23:14:36 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:33.207 23:14:36 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:33.207 23:14:36 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:33.207 23:14:36 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:33.207 23:14:36 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:33.207 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:33.207 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.299 ms 00:22:33.207 00:22:33.207 --- 10.0.0.2 ping statistics --- 00:22:33.207 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:33.207 rtt min/avg/max/mdev = 0.299/0.299/0.299/0.000 ms 00:22:33.207 23:14:36 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:33.207 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:33.207 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.150 ms 00:22:33.207 00:22:33.207 --- 10.0.0.1 ping statistics --- 00:22:33.207 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:33.207 rtt min/avg/max/mdev = 0.150/0.150/0.150/0.000 ms 00:22:33.207 23:14:36 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:33.207 23:14:36 -- nvmf/common.sh@410 -- # return 0 00:22:33.207 23:14:36 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:33.207 23:14:36 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:33.207 23:14:36 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:33.207 23:14:36 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:33.207 23:14:36 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:33.207 23:14:36 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:33.207 23:14:36 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:33.207 23:14:36 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:22:33.207 23:14:36 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:33.207 23:14:36 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:33.207 23:14:36 -- common/autotest_common.sh@10 -- # set +x 00:22:33.207 23:14:36 -- nvmf/common.sh@469 -- # nvmfpid=2495656 00:22:33.208 23:14:36 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:33.208 23:14:36 -- nvmf/common.sh@470 -- # waitforlisten 2495656 00:22:33.208 23:14:36 -- common/autotest_common.sh@829 -- # '[' -z 2495656 ']' 00:22:33.208 23:14:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:33.208 23:14:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:33.208 23:14:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:33.208 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:33.208 23:14:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:33.208 23:14:36 -- common/autotest_common.sh@10 -- # set +x 00:22:33.208 [2024-11-28 23:14:36.748958] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:33.208 [2024-11-28 23:14:36.749056] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:33.208 EAL: No free 2048 kB hugepages reported on node 1 00:22:33.466 [2024-11-28 23:14:36.830337] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:33.466 [2024-11-28 23:14:36.929295] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:33.466 [2024-11-28 23:14:36.929466] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:33.466 [2024-11-28 23:14:36.929488] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:33.466 [2024-11-28 23:14:36.929503] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:33.466 [2024-11-28 23:14:36.929564] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:33.466 [2024-11-28 23:14:36.929597] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:33.466 [2024-11-28 23:14:36.929652] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:33.466 [2024-11-28 23:14:36.929656] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:34.399 23:14:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:34.399 23:14:37 -- common/autotest_common.sh@862 -- # return 0 00:22:34.399 23:14:37 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:34.399 23:14:37 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:34.399 23:14:37 -- common/autotest_common.sh@10 -- # set +x 00:22:34.399 23:14:37 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:34.399 23:14:37 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:34.399 23:14:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.399 23:14:37 -- common/autotest_common.sh@10 -- # set +x 00:22:34.399 [2024-11-28 23:14:37.774111] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:34.399 23:14:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.399 23:14:37 -- target/multiconnection.sh@21 -- # seq 1 11 00:22:34.399 23:14:37 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:34.399 23:14:37 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:34.399 23:14:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.399 23:14:37 -- common/autotest_common.sh@10 -- # set +x 00:22:34.399 Malloc1 00:22:34.399 23:14:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.399 23:14:37 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:22:34.399 23:14:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.399 23:14:37 -- common/autotest_common.sh@10 -- # set +x 00:22:34.399 23:14:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.399 23:14:37 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:22:34.399 23:14:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.399 23:14:37 -- common/autotest_common.sh@10 -- # set +x 00:22:34.399 23:14:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.399 23:14:37 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:34.399 23:14:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.399 23:14:37 -- common/autotest_common.sh@10 -- # set +x 00:22:34.399 [2024-11-28 23:14:37.829317] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:34.399 23:14:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.399 23:14:37 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:34.399 23:14:37 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:22:34.399 23:14:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.399 23:14:37 -- common/autotest_common.sh@10 -- # set +x 00:22:34.399 Malloc2 00:22:34.399 23:14:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.399 23:14:37 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:22:34.399 23:14:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.399 23:14:37 -- common/autotest_common.sh@10 -- # set +x 00:22:34.399 23:14:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.399 23:14:37 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:22:34.399 23:14:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.399 23:14:37 -- common/autotest_common.sh@10 -- # set +x 00:22:34.399 23:14:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.399 23:14:37 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:22:34.399 23:14:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.399 23:14:37 -- common/autotest_common.sh@10 -- # set +x 00:22:34.399 23:14:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.399 23:14:37 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:34.399 23:14:37 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:22:34.399 23:14:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.399 23:14:37 -- common/autotest_common.sh@10 -- # set +x 00:22:34.399 Malloc3 00:22:34.399 23:14:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.399 23:14:37 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:22:34.400 23:14:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.400 23:14:37 -- common/autotest_common.sh@10 -- # set +x 00:22:34.400 23:14:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.400 23:14:37 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:22:34.400 23:14:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.400 23:14:37 -- common/autotest_common.sh@10 -- # set +x 00:22:34.400 23:14:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.400 23:14:37 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:22:34.400 23:14:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.400 23:14:37 -- common/autotest_common.sh@10 -- # set +x 00:22:34.400 23:14:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.400 23:14:37 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:34.400 23:14:37 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:22:34.400 23:14:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.400 23:14:37 -- common/autotest_common.sh@10 -- # set +x 00:22:34.400 Malloc4 00:22:34.400 23:14:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.400 23:14:37 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:22:34.400 23:14:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.400 23:14:37 -- common/autotest_common.sh@10 -- # set +x 00:22:34.400 23:14:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.400 23:14:37 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:22:34.400 23:14:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.400 23:14:37 -- common/autotest_common.sh@10 -- # set +x 00:22:34.400 23:14:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.400 23:14:37 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:22:34.400 23:14:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.400 23:14:37 -- common/autotest_common.sh@10 -- # set +x 00:22:34.400 23:14:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.400 23:14:37 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:34.400 23:14:37 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:22:34.400 23:14:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.400 23:14:37 -- common/autotest_common.sh@10 -- # set +x 00:22:34.400 Malloc5 00:22:34.400 23:14:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.400 23:14:37 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:22:34.400 23:14:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.400 23:14:37 -- common/autotest_common.sh@10 -- # set +x 00:22:34.400 23:14:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.400 23:14:37 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:22:34.400 23:14:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.400 23:14:37 -- common/autotest_common.sh@10 -- # set +x 00:22:34.658 23:14:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.658 23:14:38 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t tcp -a 10.0.0.2 -s 4420 00:22:34.658 23:14:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.658 23:14:38 -- common/autotest_common.sh@10 -- # set +x 00:22:34.658 23:14:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.658 23:14:38 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:34.658 23:14:38 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:22:34.658 23:14:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.658 23:14:38 -- common/autotest_common.sh@10 -- # set +x 00:22:34.658 Malloc6 00:22:34.658 23:14:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.658 23:14:38 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:22:34.658 23:14:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.658 23:14:38 -- common/autotest_common.sh@10 -- # set +x 00:22:34.658 23:14:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.658 23:14:38 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:22:34.658 23:14:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.658 23:14:38 -- common/autotest_common.sh@10 -- # set +x 00:22:34.658 23:14:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.658 23:14:38 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t tcp -a 10.0.0.2 -s 4420 00:22:34.658 23:14:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.658 23:14:38 -- common/autotest_common.sh@10 -- # set +x 00:22:34.658 23:14:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.658 23:14:38 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:34.658 23:14:38 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:22:34.658 23:14:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.658 23:14:38 -- common/autotest_common.sh@10 -- # set +x 00:22:34.658 Malloc7 00:22:34.658 23:14:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.658 23:14:38 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:22:34.658 23:14:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.658 23:14:38 -- common/autotest_common.sh@10 -- # set +x 00:22:34.658 23:14:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.658 23:14:38 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:22:34.658 23:14:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.658 23:14:38 -- common/autotest_common.sh@10 -- # set +x 00:22:34.658 23:14:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.658 23:14:38 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t tcp -a 10.0.0.2 -s 4420 00:22:34.658 23:14:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.658 23:14:38 -- common/autotest_common.sh@10 -- # set +x 00:22:34.658 23:14:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.659 23:14:38 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:34.659 23:14:38 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:22:34.659 23:14:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.659 23:14:38 -- common/autotest_common.sh@10 -- # set +x 00:22:34.659 Malloc8 00:22:34.659 23:14:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.659 23:14:38 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:22:34.659 23:14:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.659 23:14:38 -- common/autotest_common.sh@10 -- # set +x 00:22:34.659 23:14:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.659 23:14:38 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:22:34.659 23:14:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.659 23:14:38 -- common/autotest_common.sh@10 -- # set +x 00:22:34.659 23:14:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.659 23:14:38 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t tcp -a 10.0.0.2 -s 4420 00:22:34.659 23:14:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.659 23:14:38 -- common/autotest_common.sh@10 -- # set +x 00:22:34.659 23:14:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.659 23:14:38 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:34.659 23:14:38 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:22:34.659 23:14:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.659 23:14:38 -- common/autotest_common.sh@10 -- # set +x 00:22:34.659 Malloc9 00:22:34.659 23:14:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.659 23:14:38 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:22:34.659 23:14:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.659 23:14:38 -- common/autotest_common.sh@10 -- # set +x 00:22:34.659 23:14:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.659 23:14:38 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:22:34.659 23:14:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.659 23:14:38 -- common/autotest_common.sh@10 -- # set +x 00:22:34.659 23:14:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.659 23:14:38 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t tcp -a 10.0.0.2 -s 4420 00:22:34.659 23:14:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.659 23:14:38 -- common/autotest_common.sh@10 -- # set +x 00:22:34.659 23:14:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.659 23:14:38 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:34.659 23:14:38 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:22:34.659 23:14:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.659 23:14:38 -- common/autotest_common.sh@10 -- # set +x 00:22:34.659 Malloc10 00:22:34.659 23:14:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.659 23:14:38 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:22:34.659 23:14:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.659 23:14:38 -- common/autotest_common.sh@10 -- # set +x 00:22:34.659 23:14:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.659 23:14:38 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:22:34.659 23:14:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.659 23:14:38 -- common/autotest_common.sh@10 -- # set +x 00:22:34.917 23:14:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.917 23:14:38 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t tcp -a 10.0.0.2 -s 4420 00:22:34.917 23:14:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.917 23:14:38 -- common/autotest_common.sh@10 -- # set +x 00:22:34.917 23:14:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.917 23:14:38 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:34.917 23:14:38 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:22:34.917 23:14:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.917 23:14:38 -- common/autotest_common.sh@10 -- # set +x 00:22:34.917 Malloc11 00:22:34.917 23:14:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.917 23:14:38 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:22:34.917 23:14:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.917 23:14:38 -- common/autotest_common.sh@10 -- # set +x 00:22:34.917 23:14:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.917 23:14:38 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:22:34.917 23:14:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.917 23:14:38 -- common/autotest_common.sh@10 -- # set +x 00:22:34.917 23:14:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.917 23:14:38 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t tcp -a 10.0.0.2 -s 4420 00:22:34.917 23:14:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.917 23:14:38 -- common/autotest_common.sh@10 -- # set +x 00:22:34.917 23:14:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.917 23:14:38 -- target/multiconnection.sh@28 -- # seq 1 11 00:22:34.917 23:14:38 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:34.917 23:14:38 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:22:35.482 23:14:38 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:22:35.483 23:14:38 -- common/autotest_common.sh@1187 -- # local i=0 00:22:35.483 23:14:38 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:35.483 23:14:38 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:35.483 23:14:38 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:37.381 23:14:40 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:37.381 23:14:40 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:37.381 23:14:40 -- common/autotest_common.sh@1196 -- # grep -c SPDK1 00:22:37.381 23:14:40 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:37.381 23:14:40 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:37.381 23:14:40 -- common/autotest_common.sh@1197 -- # return 0 00:22:37.381 23:14:40 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:37.381 23:14:40 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode2 -a 10.0.0.2 -s 4420 00:22:38.314 23:14:41 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:22:38.314 23:14:41 -- common/autotest_common.sh@1187 -- # local i=0 00:22:38.314 23:14:41 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:38.314 23:14:41 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:38.314 23:14:41 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:40.211 23:14:43 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:40.211 23:14:43 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:40.211 23:14:43 -- common/autotest_common.sh@1196 -- # grep -c SPDK2 00:22:40.211 23:14:43 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:40.211 23:14:43 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:40.211 23:14:43 -- common/autotest_common.sh@1197 -- # return 0 00:22:40.211 23:14:43 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:40.211 23:14:43 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode3 -a 10.0.0.2 -s 4420 00:22:40.775 23:14:44 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:22:40.775 23:14:44 -- common/autotest_common.sh@1187 -- # local i=0 00:22:40.775 23:14:44 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:40.775 23:14:44 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:40.775 23:14:44 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:42.671 23:14:46 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:42.671 23:14:46 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:42.671 23:14:46 -- common/autotest_common.sh@1196 -- # grep -c SPDK3 00:22:42.928 23:14:46 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:42.928 23:14:46 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:42.928 23:14:46 -- common/autotest_common.sh@1197 -- # return 0 00:22:42.928 23:14:46 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:42.928 23:14:46 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode4 -a 10.0.0.2 -s 4420 00:22:43.493 23:14:47 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:22:43.493 23:14:47 -- common/autotest_common.sh@1187 -- # local i=0 00:22:43.493 23:14:47 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:43.493 23:14:47 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:43.493 23:14:47 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:46.022 23:14:49 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:46.022 23:14:49 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:46.022 23:14:49 -- common/autotest_common.sh@1196 -- # grep -c SPDK4 00:22:46.022 23:14:49 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:46.022 23:14:49 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:46.022 23:14:49 -- common/autotest_common.sh@1197 -- # return 0 00:22:46.022 23:14:49 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:46.022 23:14:49 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode5 -a 10.0.0.2 -s 4420 00:22:46.280 23:14:49 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:22:46.280 23:14:49 -- common/autotest_common.sh@1187 -- # local i=0 00:22:46.280 23:14:49 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:46.280 23:14:49 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:46.280 23:14:49 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:48.178 23:14:51 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:48.178 23:14:51 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:48.178 23:14:51 -- common/autotest_common.sh@1196 -- # grep -c SPDK5 00:22:48.178 23:14:51 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:48.178 23:14:51 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:48.178 23:14:51 -- common/autotest_common.sh@1197 -- # return 0 00:22:48.178 23:14:51 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:48.178 23:14:51 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode6 -a 10.0.0.2 -s 4420 00:22:49.112 23:14:52 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:22:49.112 23:14:52 -- common/autotest_common.sh@1187 -- # local i=0 00:22:49.112 23:14:52 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:49.112 23:14:52 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:49.112 23:14:52 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:51.641 23:14:54 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:51.641 23:14:54 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:51.641 23:14:54 -- common/autotest_common.sh@1196 -- # grep -c SPDK6 00:22:51.641 23:14:54 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:51.641 23:14:54 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:51.641 23:14:54 -- common/autotest_common.sh@1197 -- # return 0 00:22:51.641 23:14:54 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:51.641 23:14:54 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode7 -a 10.0.0.2 -s 4420 00:22:51.900 23:14:55 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:22:51.900 23:14:55 -- common/autotest_common.sh@1187 -- # local i=0 00:22:51.900 23:14:55 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:51.900 23:14:55 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:51.900 23:14:55 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:54.426 23:14:57 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:54.426 23:14:57 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:54.426 23:14:57 -- common/autotest_common.sh@1196 -- # grep -c SPDK7 00:22:54.426 23:14:57 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:54.426 23:14:57 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:54.426 23:14:57 -- common/autotest_common.sh@1197 -- # return 0 00:22:54.426 23:14:57 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:54.426 23:14:57 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode8 -a 10.0.0.2 -s 4420 00:22:55.024 23:14:58 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:22:55.024 23:14:58 -- common/autotest_common.sh@1187 -- # local i=0 00:22:55.024 23:14:58 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:55.024 23:14:58 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:55.024 23:14:58 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:56.949 23:15:00 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:56.949 23:15:00 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:56.949 23:15:00 -- common/autotest_common.sh@1196 -- # grep -c SPDK8 00:22:56.949 23:15:00 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:56.949 23:15:00 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:56.949 23:15:00 -- common/autotest_common.sh@1197 -- # return 0 00:22:56.949 23:15:00 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:56.949 23:15:00 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode9 -a 10.0.0.2 -s 4420 00:22:57.889 23:15:01 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:22:57.889 23:15:01 -- common/autotest_common.sh@1187 -- # local i=0 00:22:57.889 23:15:01 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:57.889 23:15:01 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:57.889 23:15:01 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:59.787 23:15:03 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:59.787 23:15:03 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:59.787 23:15:03 -- common/autotest_common.sh@1196 -- # grep -c SPDK9 00:22:59.787 23:15:03 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:59.787 23:15:03 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:59.787 23:15:03 -- common/autotest_common.sh@1197 -- # return 0 00:22:59.787 23:15:03 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:59.787 23:15:03 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode10 -a 10.0.0.2 -s 4420 00:23:00.721 23:15:04 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:23:00.721 23:15:04 -- common/autotest_common.sh@1187 -- # local i=0 00:23:00.721 23:15:04 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:23:00.721 23:15:04 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:23:00.721 23:15:04 -- common/autotest_common.sh@1194 -- # sleep 2 00:23:02.626 23:15:06 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:23:02.626 23:15:06 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:23:02.626 23:15:06 -- common/autotest_common.sh@1196 -- # grep -c SPDK10 00:23:02.885 23:15:06 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:23:02.885 23:15:06 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:23:02.885 23:15:06 -- common/autotest_common.sh@1197 -- # return 0 00:23:02.885 23:15:06 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:02.885 23:15:06 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode11 -a 10.0.0.2 -s 4420 00:23:03.818 23:15:07 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:23:03.818 23:15:07 -- common/autotest_common.sh@1187 -- # local i=0 00:23:03.818 23:15:07 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:23:03.818 23:15:07 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:23:03.818 23:15:07 -- common/autotest_common.sh@1194 -- # sleep 2 00:23:05.716 23:15:09 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:23:05.716 23:15:09 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:23:05.716 23:15:09 -- common/autotest_common.sh@1196 -- # grep -c SPDK11 00:23:05.716 23:15:09 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:23:05.716 23:15:09 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:23:05.716 23:15:09 -- common/autotest_common.sh@1197 -- # return 0 00:23:05.716 23:15:09 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:23:05.716 [global] 00:23:05.716 thread=1 00:23:05.716 invalidate=1 00:23:05.716 rw=read 00:23:05.716 time_based=1 00:23:05.716 runtime=10 00:23:05.716 ioengine=libaio 00:23:05.716 direct=1 00:23:05.716 bs=262144 00:23:05.716 iodepth=64 00:23:05.716 norandommap=1 00:23:05.716 numjobs=1 00:23:05.716 00:23:05.716 [job0] 00:23:05.716 filename=/dev/nvme0n1 00:23:05.716 [job1] 00:23:05.716 filename=/dev/nvme10n1 00:23:05.716 [job2] 00:23:05.716 filename=/dev/nvme1n1 00:23:05.716 [job3] 00:23:05.716 filename=/dev/nvme2n1 00:23:05.716 [job4] 00:23:05.716 filename=/dev/nvme3n1 00:23:05.716 [job5] 00:23:05.716 filename=/dev/nvme4n1 00:23:05.716 [job6] 00:23:05.716 filename=/dev/nvme5n1 00:23:05.716 [job7] 00:23:05.716 filename=/dev/nvme6n1 00:23:05.716 [job8] 00:23:05.716 filename=/dev/nvme7n1 00:23:05.716 [job9] 00:23:05.716 filename=/dev/nvme8n1 00:23:05.716 [job10] 00:23:05.716 filename=/dev/nvme9n1 00:23:05.716 Could not set queue depth (nvme0n1) 00:23:05.716 Could not set queue depth (nvme10n1) 00:23:05.716 Could not set queue depth (nvme1n1) 00:23:05.716 Could not set queue depth (nvme2n1) 00:23:05.716 Could not set queue depth (nvme3n1) 00:23:05.716 Could not set queue depth (nvme4n1) 00:23:05.716 Could not set queue depth (nvme5n1) 00:23:05.716 Could not set queue depth (nvme6n1) 00:23:05.716 Could not set queue depth (nvme7n1) 00:23:05.716 Could not set queue depth (nvme8n1) 00:23:05.716 Could not set queue depth (nvme9n1) 00:23:05.974 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:05.974 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:05.974 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:05.974 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:05.974 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:05.974 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:05.974 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:05.974 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:05.974 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:05.974 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:05.974 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:05.974 fio-3.35 00:23:05.974 Starting 11 threads 00:23:18.186 00:23:18.186 job0: (groupid=0, jobs=1): err= 0: pid=2500787: Thu Nov 28 23:15:19 2024 00:23:18.186 read: IOPS=841, BW=210MiB/s (221MB/s)(2117MiB/10061msec) 00:23:18.186 slat (usec): min=9, max=168225, avg=890.98, stdev=4342.45 00:23:18.186 clat (usec): min=1932, max=385784, avg=75084.55, stdev=52921.59 00:23:18.186 lat (usec): min=1956, max=385826, avg=75975.53, stdev=53699.02 00:23:18.186 clat percentiles (msec): 00:23:18.186 | 1.00th=[ 5], 5.00th=[ 17], 10.00th=[ 23], 20.00th=[ 28], 00:23:18.186 | 30.00th=[ 31], 40.00th=[ 46], 50.00th=[ 67], 60.00th=[ 82], 00:23:18.186 | 70.00th=[ 97], 80.00th=[ 118], 90.00th=[ 153], 95.00th=[ 186], 00:23:18.186 | 99.00th=[ 215], 99.50th=[ 224], 99.90th=[ 236], 99.95th=[ 236], 00:23:18.186 | 99.99th=[ 384] 00:23:18.186 bw ( KiB/s): min=93696, max=544256, per=10.64%, avg=215191.00, stdev=126597.97, samples=20 00:23:18.186 iops : min= 366, max= 2126, avg=840.55, stdev=494.52, samples=20 00:23:18.186 lat (msec) : 2=0.01%, 4=0.61%, 10=1.42%, 20=5.95%, 50=34.33% 00:23:18.186 lat (msec) : 100=29.48%, 250=28.18%, 500=0.02% 00:23:18.186 cpu : usr=0.56%, sys=2.52%, ctx=1718, majf=0, minf=4097 00:23:18.186 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:23:18.186 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:18.186 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:18.186 issued rwts: total=8468,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:18.186 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:18.186 job1: (groupid=0, jobs=1): err= 0: pid=2500789: Thu Nov 28 23:15:19 2024 00:23:18.186 read: IOPS=646, BW=162MiB/s (170MB/s)(1632MiB/10092msec) 00:23:18.186 slat (usec): min=8, max=164267, avg=1013.58, stdev=5566.40 00:23:18.186 clat (msec): min=2, max=337, avg=97.87, stdev=59.08 00:23:18.186 lat (msec): min=2, max=344, avg=98.88, stdev=59.95 00:23:18.187 clat percentiles (msec): 00:23:18.187 | 1.00th=[ 8], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 29], 00:23:18.187 | 30.00th=[ 50], 40.00th=[ 85], 50.00th=[ 107], 60.00th=[ 120], 00:23:18.187 | 70.00th=[ 133], 80.00th=[ 148], 90.00th=[ 178], 95.00th=[ 199], 00:23:18.187 | 99.00th=[ 224], 99.50th=[ 230], 99.90th=[ 239], 99.95th=[ 309], 00:23:18.187 | 99.99th=[ 338] 00:23:18.187 bw ( KiB/s): min=94208, max=561152, per=8.18%, avg=165452.80, stdev=98466.15, samples=20 00:23:18.187 iops : min= 368, max= 2192, avg=646.30, stdev=384.63, samples=20 00:23:18.187 lat (msec) : 4=0.09%, 10=1.75%, 20=4.75%, 50=23.99%, 100=16.45% 00:23:18.187 lat (msec) : 250=52.87%, 500=0.09% 00:23:18.187 cpu : usr=0.17%, sys=2.08%, ctx=1564, majf=0, minf=4097 00:23:18.187 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:23:18.187 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:18.187 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:18.187 issued rwts: total=6527,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:18.187 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:18.187 job2: (groupid=0, jobs=1): err= 0: pid=2500790: Thu Nov 28 23:15:19 2024 00:23:18.187 read: IOPS=727, BW=182MiB/s (191MB/s)(1837MiB/10096msec) 00:23:18.187 slat (usec): min=8, max=130965, avg=1157.21, stdev=4140.22 00:23:18.187 clat (usec): min=1582, max=246559, avg=86708.52, stdev=36824.47 00:23:18.187 lat (usec): min=1622, max=246575, avg=87865.73, stdev=37245.14 00:23:18.187 clat percentiles (msec): 00:23:18.187 | 1.00th=[ 5], 5.00th=[ 29], 10.00th=[ 38], 20.00th=[ 54], 00:23:18.187 | 30.00th=[ 71], 40.00th=[ 81], 50.00th=[ 88], 60.00th=[ 97], 00:23:18.187 | 70.00th=[ 107], 80.00th=[ 114], 90.00th=[ 129], 95.00th=[ 140], 00:23:18.187 | 99.00th=[ 203], 99.50th=[ 215], 99.90th=[ 224], 99.95th=[ 226], 00:23:18.187 | 99.99th=[ 247] 00:23:18.187 bw ( KiB/s): min=128512, max=297984, per=9.22%, avg=186460.25, stdev=47701.24, samples=20 00:23:18.187 iops : min= 502, max= 1164, avg=728.35, stdev=186.34, samples=20 00:23:18.187 lat (msec) : 2=0.03%, 4=0.91%, 10=1.22%, 20=1.46%, 50=14.54% 00:23:18.187 lat (msec) : 100=44.47%, 250=37.38% 00:23:18.187 cpu : usr=0.44%, sys=2.36%, ctx=1370, majf=0, minf=4097 00:23:18.187 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:23:18.187 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:18.187 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:18.187 issued rwts: total=7347,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:18.187 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:18.187 job3: (groupid=0, jobs=1): err= 0: pid=2500791: Thu Nov 28 23:15:19 2024 00:23:18.187 read: IOPS=972, BW=243MiB/s (255MB/s)(2440MiB/10042msec) 00:23:18.187 slat (usec): min=10, max=78379, avg=899.72, stdev=3284.76 00:23:18.187 clat (msec): min=2, max=244, avg=64.89, stdev=40.69 00:23:18.187 lat (msec): min=2, max=261, avg=65.79, stdev=41.26 00:23:18.187 clat percentiles (msec): 00:23:18.187 | 1.00th=[ 20], 5.00th=[ 28], 10.00th=[ 29], 20.00th=[ 32], 00:23:18.187 | 30.00th=[ 35], 40.00th=[ 48], 50.00th=[ 54], 60.00th=[ 61], 00:23:18.187 | 70.00th=[ 74], 80.00th=[ 93], 90.00th=[ 115], 95.00th=[ 150], 00:23:18.187 | 99.00th=[ 211], 99.50th=[ 215], 99.90th=[ 228], 99.95th=[ 243], 00:23:18.187 | 99.99th=[ 245] 00:23:18.187 bw ( KiB/s): min=88576, max=528896, per=12.28%, avg=248284.25, stdev=125682.86, samples=20 00:23:18.187 iops : min= 346, max= 2066, avg=969.85, stdev=490.96, samples=20 00:23:18.187 lat (msec) : 4=0.06%, 10=0.18%, 20=0.82%, 50=42.27%, 100=40.41% 00:23:18.187 lat (msec) : 250=16.26% 00:23:18.187 cpu : usr=0.65%, sys=3.46%, ctx=1807, majf=0, minf=4097 00:23:18.187 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:23:18.187 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:18.187 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:18.187 issued rwts: total=9761,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:18.187 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:18.187 job4: (groupid=0, jobs=1): err= 0: pid=2500794: Thu Nov 28 23:15:19 2024 00:23:18.187 read: IOPS=651, BW=163MiB/s (171MB/s)(1643MiB/10092msec) 00:23:18.187 slat (usec): min=9, max=60784, avg=1490.65, stdev=4591.50 00:23:18.187 clat (msec): min=11, max=245, avg=96.69, stdev=50.27 00:23:18.187 lat (msec): min=11, max=251, avg=98.19, stdev=51.10 00:23:18.187 clat percentiles (msec): 00:23:18.187 | 1.00th=[ 29], 5.00th=[ 36], 10.00th=[ 40], 20.00th=[ 46], 00:23:18.187 | 30.00th=[ 57], 40.00th=[ 72], 50.00th=[ 89], 60.00th=[ 108], 00:23:18.187 | 70.00th=[ 126], 80.00th=[ 142], 90.00th=[ 174], 95.00th=[ 190], 00:23:18.187 | 99.00th=[ 213], 99.50th=[ 222], 99.90th=[ 230], 99.95th=[ 230], 00:23:18.187 | 99.99th=[ 245] 00:23:18.187 bw ( KiB/s): min=81408, max=312832, per=8.24%, avg=166656.00, stdev=81317.79, samples=20 00:23:18.187 iops : min= 318, max= 1222, avg=651.00, stdev=317.65, samples=20 00:23:18.187 lat (msec) : 20=0.18%, 50=24.89%, 100=31.54%, 250=43.39% 00:23:18.187 cpu : usr=0.49%, sys=2.31%, ctx=1176, majf=0, minf=4097 00:23:18.187 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:23:18.187 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:18.187 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:18.187 issued rwts: total=6573,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:18.187 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:18.187 job5: (groupid=0, jobs=1): err= 0: pid=2500795: Thu Nov 28 23:15:19 2024 00:23:18.187 read: IOPS=574, BW=144MiB/s (151MB/s)(1444MiB/10061msec) 00:23:18.187 slat (usec): min=9, max=97469, avg=1013.19, stdev=4529.62 00:23:18.187 clat (msec): min=2, max=304, avg=110.36, stdev=41.27 00:23:18.187 lat (msec): min=2, max=304, avg=111.37, stdev=41.92 00:23:18.187 clat percentiles (msec): 00:23:18.187 | 1.00th=[ 24], 5.00th=[ 53], 10.00th=[ 64], 20.00th=[ 78], 00:23:18.187 | 30.00th=[ 88], 40.00th=[ 99], 50.00th=[ 106], 60.00th=[ 115], 00:23:18.187 | 70.00th=[ 127], 80.00th=[ 140], 90.00th=[ 174], 95.00th=[ 190], 00:23:18.187 | 99.00th=[ 218], 99.50th=[ 220], 99.90th=[ 257], 99.95th=[ 300], 00:23:18.187 | 99.99th=[ 305] 00:23:18.187 bw ( KiB/s): min=80384, max=229376, per=7.23%, avg=146278.40, stdev=41467.21, samples=20 00:23:18.187 iops : min= 314, max= 896, avg=571.40, stdev=161.98, samples=20 00:23:18.187 lat (msec) : 4=0.05%, 10=0.35%, 20=0.33%, 50=3.79%, 100=38.19% 00:23:18.187 lat (msec) : 250=57.18%, 500=0.12% 00:23:18.187 cpu : usr=0.27%, sys=1.75%, ctx=1424, majf=0, minf=4097 00:23:18.187 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:23:18.187 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:18.187 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:18.187 issued rwts: total=5777,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:18.187 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:18.187 job6: (groupid=0, jobs=1): err= 0: pid=2500796: Thu Nov 28 23:15:19 2024 00:23:18.187 read: IOPS=777, BW=194MiB/s (204MB/s)(1945MiB/10011msec) 00:23:18.187 slat (usec): min=9, max=77116, avg=835.71, stdev=3940.88 00:23:18.187 clat (usec): min=790, max=278601, avg=81457.67, stdev=57989.01 00:23:18.187 lat (usec): min=809, max=286179, avg=82293.38, stdev=58776.16 00:23:18.187 clat percentiles (msec): 00:23:18.187 | 1.00th=[ 3], 5.00th=[ 11], 10.00th=[ 18], 20.00th=[ 31], 00:23:18.187 | 30.00th=[ 33], 40.00th=[ 48], 50.00th=[ 68], 60.00th=[ 92], 00:23:18.187 | 70.00th=[ 115], 80.00th=[ 138], 90.00th=[ 169], 95.00th=[ 188], 00:23:18.187 | 99.00th=[ 213], 99.50th=[ 218], 99.90th=[ 247], 99.95th=[ 266], 00:23:18.187 | 99.99th=[ 279] 00:23:18.187 bw ( KiB/s): min=71680, max=499712, per=9.77%, avg=197580.80, stdev=109531.84, samples=20 00:23:18.187 iops : min= 280, max= 1952, avg=771.80, stdev=427.86, samples=20 00:23:18.187 lat (usec) : 1000=0.12% 00:23:18.187 lat (msec) : 2=0.69%, 4=1.21%, 10=2.98%, 20=6.75%, 50=28.75% 00:23:18.187 lat (msec) : 100=22.97%, 250=36.47%, 500=0.06% 00:23:18.187 cpu : usr=0.37%, sys=1.97%, ctx=1698, majf=0, minf=4097 00:23:18.187 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:23:18.187 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:18.187 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:18.187 issued rwts: total=7781,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:18.187 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:18.187 job7: (groupid=0, jobs=1): err= 0: pid=2500797: Thu Nov 28 23:15:19 2024 00:23:18.187 read: IOPS=787, BW=197MiB/s (207MB/s)(1978MiB/10043msec) 00:23:18.187 slat (usec): min=13, max=84255, avg=1215.78, stdev=3558.28 00:23:18.187 clat (msec): min=2, max=214, avg=79.95, stdev=31.97 00:23:18.187 lat (msec): min=2, max=214, avg=81.16, stdev=32.41 00:23:18.187 clat percentiles (msec): 00:23:18.187 | 1.00th=[ 15], 5.00th=[ 30], 10.00th=[ 34], 20.00th=[ 55], 00:23:18.187 | 30.00th=[ 63], 40.00th=[ 71], 50.00th=[ 80], 60.00th=[ 87], 00:23:18.187 | 70.00th=[ 96], 80.00th=[ 107], 90.00th=[ 122], 95.00th=[ 136], 00:23:18.187 | 99.00th=[ 159], 99.50th=[ 171], 99.90th=[ 213], 99.95th=[ 215], 00:23:18.187 | 99.99th=[ 215] 00:23:18.187 bw ( KiB/s): min=121344, max=333312, per=9.94%, avg=200934.40, stdev=65484.29, samples=20 00:23:18.187 iops : min= 474, max= 1302, avg=784.90, stdev=255.80, samples=20 00:23:18.187 lat (msec) : 4=0.06%, 10=0.49%, 20=1.07%, 50=14.23%, 100=57.99% 00:23:18.187 lat (msec) : 250=26.15% 00:23:18.187 cpu : usr=0.56%, sys=2.85%, ctx=1465, majf=0, minf=4097 00:23:18.187 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:23:18.187 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:18.187 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:18.187 issued rwts: total=7912,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:18.187 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:18.187 job8: (groupid=0, jobs=1): err= 0: pid=2500798: Thu Nov 28 23:15:19 2024 00:23:18.187 read: IOPS=495, BW=124MiB/s (130MB/s)(1249MiB/10092msec) 00:23:18.187 slat (usec): min=14, max=73486, avg=1935.37, stdev=5254.34 00:23:18.187 clat (msec): min=40, max=264, avg=127.24, stdev=35.37 00:23:18.187 lat (msec): min=41, max=272, avg=129.18, stdev=35.99 00:23:18.187 clat percentiles (msec): 00:23:18.187 | 1.00th=[ 72], 5.00th=[ 79], 10.00th=[ 87], 20.00th=[ 99], 00:23:18.187 | 30.00th=[ 106], 40.00th=[ 114], 50.00th=[ 121], 60.00th=[ 131], 00:23:18.187 | 70.00th=[ 140], 80.00th=[ 157], 90.00th=[ 184], 95.00th=[ 199], 00:23:18.187 | 99.00th=[ 215], 99.50th=[ 222], 99.90th=[ 234], 99.95th=[ 259], 00:23:18.187 | 99.99th=[ 264] 00:23:18.188 bw ( KiB/s): min=75264, max=186880, per=6.25%, avg=126270.05, stdev=30468.73, samples=20 00:23:18.188 iops : min= 294, max= 730, avg=493.20, stdev=119.04, samples=20 00:23:18.188 lat (msec) : 50=0.24%, 100=21.84%, 250=77.86%, 500=0.06% 00:23:18.188 cpu : usr=0.38%, sys=1.82%, ctx=985, majf=0, minf=4097 00:23:18.188 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.7% 00:23:18.188 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:18.188 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:18.188 issued rwts: total=4996,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:18.188 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:18.188 job9: (groupid=0, jobs=1): err= 0: pid=2500799: Thu Nov 28 23:15:19 2024 00:23:18.188 read: IOPS=959, BW=240MiB/s (251MB/s)(2413MiB/10061msec) 00:23:18.188 slat (usec): min=8, max=103384, avg=907.71, stdev=3935.57 00:23:18.188 clat (msec): min=2, max=301, avg=65.76, stdev=43.02 00:23:18.188 lat (msec): min=2, max=301, avg=66.66, stdev=43.61 00:23:18.188 clat percentiles (msec): 00:23:18.188 | 1.00th=[ 4], 5.00th=[ 17], 10.00th=[ 27], 20.00th=[ 30], 00:23:18.188 | 30.00th=[ 33], 40.00th=[ 43], 50.00th=[ 56], 60.00th=[ 68], 00:23:18.188 | 70.00th=[ 83], 80.00th=[ 99], 90.00th=[ 130], 95.00th=[ 155], 00:23:18.188 | 99.00th=[ 192], 99.50th=[ 209], 99.90th=[ 228], 99.95th=[ 247], 00:23:18.188 | 99.99th=[ 300] 00:23:18.188 bw ( KiB/s): min=92672, max=416768, per=12.14%, avg=245478.40, stdev=95408.51, samples=20 00:23:18.188 iops : min= 362, max= 1628, avg=958.90, stdev=372.69, samples=20 00:23:18.188 lat (msec) : 4=1.15%, 10=1.41%, 20=3.15%, 50=38.75%, 100=36.20% 00:23:18.188 lat (msec) : 250=19.30%, 500=0.04% 00:23:18.188 cpu : usr=0.50%, sys=2.97%, ctx=1769, majf=0, minf=4097 00:23:18.188 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:23:18.188 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:18.188 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:18.188 issued rwts: total=9652,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:18.188 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:18.188 job10: (groupid=0, jobs=1): err= 0: pid=2500800: Thu Nov 28 23:15:19 2024 00:23:18.188 read: IOPS=489, BW=122MiB/s (128MB/s)(1236MiB/10090msec) 00:23:18.188 slat (usec): min=9, max=71852, avg=1622.23, stdev=5335.96 00:23:18.188 clat (msec): min=9, max=273, avg=128.95, stdev=43.50 00:23:18.188 lat (msec): min=9, max=273, avg=130.57, stdev=44.37 00:23:18.188 clat percentiles (msec): 00:23:18.188 | 1.00th=[ 20], 5.00th=[ 54], 10.00th=[ 77], 20.00th=[ 96], 00:23:18.188 | 30.00th=[ 108], 40.00th=[ 117], 50.00th=[ 128], 60.00th=[ 138], 00:23:18.188 | 70.00th=[ 153], 80.00th=[ 167], 90.00th=[ 190], 95.00th=[ 203], 00:23:18.188 | 99.00th=[ 218], 99.50th=[ 224], 99.90th=[ 241], 99.95th=[ 257], 00:23:18.188 | 99.99th=[ 275] 00:23:18.188 bw ( KiB/s): min=84992, max=226304, per=6.18%, avg=124902.40, stdev=36815.87, samples=20 00:23:18.188 iops : min= 332, max= 884, avg=487.90, stdev=143.81, samples=20 00:23:18.188 lat (msec) : 10=0.06%, 20=0.95%, 50=3.28%, 100=19.49%, 250=76.16% 00:23:18.188 lat (msec) : 500=0.06% 00:23:18.188 cpu : usr=0.32%, sys=1.69%, ctx=1164, majf=0, minf=3721 00:23:18.188 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.7% 00:23:18.188 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:18.188 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:18.188 issued rwts: total=4942,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:18.188 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:18.188 00:23:18.188 Run status group 0 (all jobs): 00:23:18.188 READ: bw=1974MiB/s (2070MB/s), 122MiB/s-243MiB/s (128MB/s-255MB/s), io=19.5GiB (20.9GB), run=10011-10096msec 00:23:18.188 00:23:18.188 Disk stats (read/write): 00:23:18.188 nvme0n1: ios=16745/0, merge=0/0, ticks=1240129/0, in_queue=1240129, util=97.37% 00:23:18.188 nvme10n1: ios=12880/0, merge=0/0, ticks=1237448/0, in_queue=1237448, util=97.61% 00:23:18.188 nvme1n1: ios=14537/0, merge=0/0, ticks=1236444/0, in_queue=1236444, util=97.85% 00:23:18.188 nvme2n1: ios=19292/0, merge=0/0, ticks=1238914/0, in_queue=1238914, util=97.97% 00:23:18.188 nvme3n1: ios=12976/0, merge=0/0, ticks=1230800/0, in_queue=1230800, util=98.06% 00:23:18.188 nvme4n1: ios=11347/0, merge=0/0, ticks=1245255/0, in_queue=1245255, util=98.37% 00:23:18.188 nvme5n1: ios=15224/0, merge=0/0, ticks=1245354/0, in_queue=1245354, util=98.51% 00:23:18.188 nvme6n1: ios=15592/0, merge=0/0, ticks=1237410/0, in_queue=1237410, util=98.62% 00:23:18.188 nvme7n1: ios=9836/0, merge=0/0, ticks=1229932/0, in_queue=1229932, util=99.00% 00:23:18.188 nvme8n1: ios=19118/0, merge=0/0, ticks=1237427/0, in_queue=1237427, util=99.14% 00:23:18.188 nvme9n1: ios=9726/0, merge=0/0, ticks=1235056/0, in_queue=1235056, util=99.28% 00:23:18.188 23:15:19 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:23:18.188 [global] 00:23:18.188 thread=1 00:23:18.188 invalidate=1 00:23:18.188 rw=randwrite 00:23:18.188 time_based=1 00:23:18.188 runtime=10 00:23:18.188 ioengine=libaio 00:23:18.188 direct=1 00:23:18.188 bs=262144 00:23:18.188 iodepth=64 00:23:18.188 norandommap=1 00:23:18.188 numjobs=1 00:23:18.188 00:23:18.188 [job0] 00:23:18.188 filename=/dev/nvme0n1 00:23:18.188 [job1] 00:23:18.188 filename=/dev/nvme10n1 00:23:18.188 [job2] 00:23:18.188 filename=/dev/nvme1n1 00:23:18.188 [job3] 00:23:18.188 filename=/dev/nvme2n1 00:23:18.188 [job4] 00:23:18.188 filename=/dev/nvme3n1 00:23:18.188 [job5] 00:23:18.188 filename=/dev/nvme4n1 00:23:18.188 [job6] 00:23:18.188 filename=/dev/nvme5n1 00:23:18.188 [job7] 00:23:18.188 filename=/dev/nvme6n1 00:23:18.188 [job8] 00:23:18.188 filename=/dev/nvme7n1 00:23:18.188 [job9] 00:23:18.188 filename=/dev/nvme8n1 00:23:18.188 [job10] 00:23:18.188 filename=/dev/nvme9n1 00:23:18.188 Could not set queue depth (nvme0n1) 00:23:18.188 Could not set queue depth (nvme10n1) 00:23:18.188 Could not set queue depth (nvme1n1) 00:23:18.188 Could not set queue depth (nvme2n1) 00:23:18.188 Could not set queue depth (nvme3n1) 00:23:18.188 Could not set queue depth (nvme4n1) 00:23:18.188 Could not set queue depth (nvme5n1) 00:23:18.188 Could not set queue depth (nvme6n1) 00:23:18.188 Could not set queue depth (nvme7n1) 00:23:18.188 Could not set queue depth (nvme8n1) 00:23:18.188 Could not set queue depth (nvme9n1) 00:23:18.188 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:18.188 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:18.188 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:18.188 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:18.188 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:18.188 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:18.188 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:18.188 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:18.188 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:18.188 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:18.188 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:18.188 fio-3.35 00:23:18.188 Starting 11 threads 00:23:28.169 00:23:28.169 job0: (groupid=0, jobs=1): err= 0: pid=2501843: Thu Nov 28 23:15:30 2024 00:23:28.169 write: IOPS=465, BW=116MiB/s (122MB/s)(1183MiB/10155msec); 0 zone resets 00:23:28.169 slat (usec): min=14, max=76233, avg=1687.24, stdev=4137.07 00:23:28.169 clat (usec): min=1273, max=351274, avg=135578.95, stdev=68226.13 00:23:28.169 lat (usec): min=1376, max=351320, avg=137266.19, stdev=69146.90 00:23:28.169 clat percentiles (msec): 00:23:28.169 | 1.00th=[ 9], 5.00th=[ 27], 10.00th=[ 59], 20.00th=[ 88], 00:23:28.169 | 30.00th=[ 99], 40.00th=[ 113], 50.00th=[ 125], 60.00th=[ 142], 00:23:28.169 | 70.00th=[ 153], 80.00th=[ 184], 90.00th=[ 239], 95.00th=[ 271], 00:23:28.169 | 99.00th=[ 326], 99.50th=[ 334], 99.90th=[ 351], 99.95th=[ 351], 00:23:28.169 | 99.99th=[ 351] 00:23:28.169 bw ( KiB/s): min=55296, max=181760, per=8.25%, avg=119477.00, stdev=38271.52, samples=20 00:23:28.169 iops : min= 216, max= 710, avg=466.60, stdev=149.44, samples=20 00:23:28.169 lat (msec) : 2=0.08%, 4=0.19%, 10=1.39%, 20=2.07%, 50=5.07% 00:23:28.169 lat (msec) : 100=23.50%, 250=59.81%, 500=7.88% 00:23:28.169 cpu : usr=1.59%, sys=1.37%, ctx=2134, majf=0, minf=1 00:23:28.169 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:23:28.169 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:28.169 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:28.169 issued rwts: total=0,4732,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:28.169 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:28.169 job1: (groupid=0, jobs=1): err= 0: pid=2501844: Thu Nov 28 23:15:30 2024 00:23:28.169 write: IOPS=459, BW=115MiB/s (121MB/s)(1167MiB/10151msec); 0 zone resets 00:23:28.169 slat (usec): min=15, max=72772, avg=1723.20, stdev=4483.43 00:23:28.169 clat (usec): min=1471, max=339387, avg=137410.91, stdev=78673.89 00:23:28.169 lat (usec): min=1787, max=347328, avg=139134.11, stdev=79749.59 00:23:28.169 clat percentiles (msec): 00:23:28.169 | 1.00th=[ 7], 5.00th=[ 20], 10.00th=[ 39], 20.00th=[ 73], 00:23:28.169 | 30.00th=[ 81], 40.00th=[ 103], 50.00th=[ 122], 60.00th=[ 161], 00:23:28.169 | 70.00th=[ 182], 80.00th=[ 224], 90.00th=[ 251], 95.00th=[ 268], 00:23:28.169 | 99.00th=[ 300], 99.50th=[ 317], 99.90th=[ 330], 99.95th=[ 334], 00:23:28.169 | 99.99th=[ 338] 00:23:28.169 bw ( KiB/s): min=55296, max=272896, per=8.14%, avg=117843.10, stdev=55835.27, samples=20 00:23:28.169 iops : min= 216, max= 1066, avg=460.20, stdev=218.12, samples=20 00:23:28.169 lat (msec) : 2=0.06%, 4=0.43%, 10=1.52%, 20=3.21%, 50=8.42% 00:23:28.169 lat (msec) : 100=25.20%, 250=50.85%, 500=10.31% 00:23:28.169 cpu : usr=1.41%, sys=1.52%, ctx=2194, majf=0, minf=1 00:23:28.169 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:23:28.169 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:28.169 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:28.169 issued rwts: total=0,4667,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:28.169 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:28.169 job2: (groupid=0, jobs=1): err= 0: pid=2501848: Thu Nov 28 23:15:30 2024 00:23:28.169 write: IOPS=564, BW=141MiB/s (148MB/s)(1422MiB/10079msec); 0 zone resets 00:23:28.169 slat (usec): min=19, max=62209, avg=1329.68, stdev=3304.68 00:23:28.169 clat (usec): min=804, max=271753, avg=111997.74, stdev=55327.36 00:23:28.169 lat (usec): min=837, max=271810, avg=113327.42, stdev=56015.14 00:23:28.169 clat percentiles (msec): 00:23:28.169 | 1.00th=[ 4], 5.00th=[ 21], 10.00th=[ 41], 20.00th=[ 77], 00:23:28.169 | 30.00th=[ 81], 40.00th=[ 84], 50.00th=[ 100], 60.00th=[ 123], 00:23:28.169 | 70.00th=[ 146], 80.00th=[ 165], 90.00th=[ 184], 95.00th=[ 207], 00:23:28.169 | 99.00th=[ 253], 99.50th=[ 266], 99.90th=[ 271], 99.95th=[ 271], 00:23:28.169 | 99.99th=[ 271] 00:23:28.169 bw ( KiB/s): min=73216, max=280576, per=9.94%, avg=143963.95, stdev=53345.66, samples=20 00:23:28.169 iops : min= 286, max= 1096, avg=562.30, stdev=208.39, samples=20 00:23:28.169 lat (usec) : 1000=0.07% 00:23:28.169 lat (msec) : 2=0.42%, 4=1.07%, 10=1.72%, 20=1.60%, 50=6.36% 00:23:28.169 lat (msec) : 100=39.35%, 250=48.35%, 500=1.05% 00:23:28.169 cpu : usr=1.65%, sys=1.75%, ctx=2739, majf=0, minf=1 00:23:28.169 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:23:28.169 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:28.169 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:28.169 issued rwts: total=0,5688,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:28.169 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:28.169 job3: (groupid=0, jobs=1): err= 0: pid=2501860: Thu Nov 28 23:15:30 2024 00:23:28.169 write: IOPS=500, BW=125MiB/s (131MB/s)(1263MiB/10081msec); 0 zone resets 00:23:28.169 slat (usec): min=15, max=155607, avg=1500.49, stdev=5281.65 00:23:28.169 clat (usec): min=1564, max=459379, avg=126175.54, stdev=75733.11 00:23:28.169 lat (usec): min=1655, max=459464, avg=127676.03, stdev=76663.40 00:23:28.169 clat percentiles (msec): 00:23:28.169 | 1.00th=[ 6], 5.00th=[ 14], 10.00th=[ 23], 20.00th=[ 45], 00:23:28.169 | 30.00th=[ 85], 40.00th=[ 97], 50.00th=[ 123], 60.00th=[ 150], 00:23:28.169 | 70.00th=[ 169], 80.00th=[ 188], 90.00th=[ 228], 95.00th=[ 268], 00:23:28.169 | 99.00th=[ 305], 99.50th=[ 317], 99.90th=[ 330], 99.95th=[ 330], 00:23:28.169 | 99.99th=[ 460] 00:23:28.170 bw ( KiB/s): min=72192, max=336032, per=8.82%, avg=127659.00, stdev=59945.91, samples=20 00:23:28.170 iops : min= 282, max= 1312, avg=498.55, stdev=234.02, samples=20 00:23:28.170 lat (msec) : 2=0.02%, 4=0.40%, 10=2.93%, 20=5.17%, 50=12.36% 00:23:28.170 lat (msec) : 100=23.47%, 250=48.53%, 500=7.13% 00:23:28.170 cpu : usr=1.59%, sys=1.40%, ctx=2629, majf=0, minf=1 00:23:28.170 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:23:28.170 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:28.170 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:28.170 issued rwts: total=0,5050,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:28.170 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:28.170 job4: (groupid=0, jobs=1): err= 0: pid=2501861: Thu Nov 28 23:15:30 2024 00:23:28.170 write: IOPS=381, BW=95.4MiB/s (100MB/s)(961MiB/10074msec); 0 zone resets 00:23:28.170 slat (usec): min=26, max=53754, avg=2250.58, stdev=5096.60 00:23:28.170 clat (usec): min=1065, max=329746, avg=165400.41, stdev=69289.96 00:23:28.170 lat (usec): min=1146, max=329817, avg=167650.99, stdev=70302.24 00:23:28.170 clat percentiles (msec): 00:23:28.170 | 1.00th=[ 17], 5.00th=[ 50], 10.00th=[ 73], 20.00th=[ 103], 00:23:28.170 | 30.00th=[ 131], 40.00th=[ 144], 50.00th=[ 167], 60.00th=[ 190], 00:23:28.170 | 70.00th=[ 209], 80.00th=[ 232], 90.00th=[ 255], 95.00th=[ 275], 00:23:28.170 | 99.00th=[ 305], 99.50th=[ 313], 99.90th=[ 330], 99.95th=[ 330], 00:23:28.170 | 99.99th=[ 330] 00:23:28.170 bw ( KiB/s): min=57344, max=179712, per=6.69%, avg=96784.80, stdev=31924.90, samples=20 00:23:28.170 iops : min= 224, max= 702, avg=378.05, stdev=124.71, samples=20 00:23:28.170 lat (msec) : 2=0.23%, 4=0.34%, 10=0.16%, 20=0.57%, 50=3.95% 00:23:28.170 lat (msec) : 100=14.10%, 250=68.44%, 500=12.20% 00:23:28.170 cpu : usr=1.27%, sys=1.21%, ctx=1578, majf=0, minf=1 00:23:28.170 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.4% 00:23:28.170 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:28.170 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:28.170 issued rwts: total=0,3844,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:28.170 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:28.170 job5: (groupid=0, jobs=1): err= 0: pid=2501864: Thu Nov 28 23:15:30 2024 00:23:28.170 write: IOPS=558, BW=140MiB/s (146MB/s)(1417MiB/10154msec); 0 zone resets 00:23:28.170 slat (usec): min=20, max=72868, avg=1400.31, stdev=3810.00 00:23:28.170 clat (usec): min=1549, max=353302, avg=113227.69, stdev=75957.84 00:23:28.170 lat (msec): min=2, max=353, avg=114.63, stdev=77.02 00:23:28.170 clat percentiles (msec): 00:23:28.170 | 1.00th=[ 8], 5.00th=[ 22], 10.00th=[ 34], 20.00th=[ 43], 00:23:28.170 | 30.00th=[ 63], 40.00th=[ 79], 50.00th=[ 99], 60.00th=[ 115], 00:23:28.170 | 70.00th=[ 127], 80.00th=[ 184], 90.00th=[ 236], 95.00th=[ 266], 00:23:28.170 | 99.00th=[ 313], 99.50th=[ 321], 99.90th=[ 355], 99.95th=[ 355], 00:23:28.170 | 99.99th=[ 355] 00:23:28.170 bw ( KiB/s): min=55296, max=338432, per=9.90%, avg=143392.20, stdev=78984.01, samples=20 00:23:28.170 iops : min= 216, max= 1322, avg=560.05, stdev=308.51, samples=20 00:23:28.170 lat (msec) : 2=0.02%, 4=0.32%, 10=1.29%, 20=2.61%, 50=20.10% 00:23:28.170 lat (msec) : 100=26.44%, 250=41.62%, 500=7.61% 00:23:28.170 cpu : usr=1.74%, sys=2.07%, ctx=2734, majf=0, minf=1 00:23:28.170 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:23:28.170 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:28.170 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:28.170 issued rwts: total=0,5666,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:28.170 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:28.170 job6: (groupid=0, jobs=1): err= 0: pid=2501865: Thu Nov 28 23:15:30 2024 00:23:28.170 write: IOPS=358, BW=89.6MiB/s (93.9MB/s)(910MiB/10151msec); 0 zone resets 00:23:28.170 slat (usec): min=14, max=88248, avg=2340.45, stdev=5427.40 00:23:28.170 clat (usec): min=1049, max=325596, avg=176146.24, stdev=76451.72 00:23:28.170 lat (usec): min=1135, max=325661, avg=178486.69, stdev=77551.26 00:23:28.170 clat percentiles (msec): 00:23:28.170 | 1.00th=[ 6], 5.00th=[ 18], 10.00th=[ 40], 20.00th=[ 117], 00:23:28.170 | 30.00th=[ 165], 40.00th=[ 178], 50.00th=[ 194], 60.00th=[ 207], 00:23:28.170 | 70.00th=[ 218], 80.00th=[ 239], 90.00th=[ 262], 95.00th=[ 275], 00:23:28.170 | 99.00th=[ 309], 99.50th=[ 317], 99.90th=[ 326], 99.95th=[ 326], 00:23:28.170 | 99.99th=[ 326] 00:23:28.170 bw ( KiB/s): min=57344, max=190464, per=6.32%, avg=91504.30, stdev=33922.48, samples=20 00:23:28.170 iops : min= 224, max= 744, avg=357.35, stdev=132.54, samples=20 00:23:28.170 lat (msec) : 2=0.19%, 4=0.38%, 10=1.68%, 20=3.55%, 50=6.65% 00:23:28.170 lat (msec) : 100=6.10%, 250=67.48%, 500=13.96% 00:23:28.170 cpu : usr=1.04%, sys=1.04%, ctx=1646, majf=0, minf=1 00:23:28.170 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.9%, >=64=98.3% 00:23:28.170 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:28.170 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:28.170 issued rwts: total=0,3638,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:28.170 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:28.170 job7: (groupid=0, jobs=1): err= 0: pid=2501866: Thu Nov 28 23:15:30 2024 00:23:28.170 write: IOPS=672, BW=168MiB/s (176MB/s)(1695MiB/10078msec); 0 zone resets 00:23:28.170 slat (usec): min=17, max=75911, avg=1087.09, stdev=3191.60 00:23:28.170 clat (usec): min=1041, max=293199, avg=93973.51, stdev=62019.46 00:23:28.170 lat (usec): min=1091, max=293262, avg=95060.60, stdev=62804.15 00:23:28.170 clat percentiles (msec): 00:23:28.170 | 1.00th=[ 10], 5.00th=[ 22], 10.00th=[ 35], 20.00th=[ 42], 00:23:28.170 | 30.00th=[ 45], 40.00th=[ 62], 50.00th=[ 80], 60.00th=[ 106], 00:23:28.170 | 70.00th=[ 117], 80.00th=[ 136], 90.00th=[ 192], 95.00th=[ 228], 00:23:28.170 | 99.00th=[ 271], 99.50th=[ 275], 99.90th=[ 288], 99.95th=[ 288], 00:23:28.170 | 99.99th=[ 292] 00:23:28.170 bw ( KiB/s): min=63488, max=386560, per=11.88%, avg=171935.95, stdev=85436.07, samples=20 00:23:28.170 iops : min= 248, max= 1510, avg=671.50, stdev=333.76, samples=20 00:23:28.170 lat (msec) : 2=0.06%, 4=0.19%, 10=0.86%, 20=3.33%, 50=31.63% 00:23:28.170 lat (msec) : 100=22.14%, 250=39.40%, 500=2.39% 00:23:28.170 cpu : usr=1.98%, sys=2.33%, ctx=3148, majf=0, minf=1 00:23:28.170 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:23:28.170 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:28.170 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:28.170 issued rwts: total=0,6781,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:28.170 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:28.170 job8: (groupid=0, jobs=1): err= 0: pid=2501868: Thu Nov 28 23:15:30 2024 00:23:28.170 write: IOPS=710, BW=178MiB/s (186MB/s)(1794MiB/10101msec); 0 zone resets 00:23:28.170 slat (usec): min=22, max=82171, avg=1095.23, stdev=3157.55 00:23:28.170 clat (usec): min=1109, max=337558, avg=88939.72, stdev=62500.80 00:23:28.170 lat (usec): min=1166, max=337601, avg=90034.95, stdev=63260.23 00:23:28.170 clat percentiles (msec): 00:23:28.170 | 1.00th=[ 8], 5.00th=[ 23], 10.00th=[ 39], 20.00th=[ 41], 00:23:28.170 | 30.00th=[ 43], 40.00th=[ 53], 50.00th=[ 74], 60.00th=[ 84], 00:23:28.170 | 70.00th=[ 112], 80.00th=[ 131], 90.00th=[ 171], 95.00th=[ 234], 00:23:28.170 | 99.00th=[ 288], 99.50th=[ 292], 99.90th=[ 305], 99.95th=[ 309], 00:23:28.170 | 99.99th=[ 338] 00:23:28.170 bw ( KiB/s): min=79360, max=419001, per=12.57%, avg=182045.20, stdev=100751.74, samples=20 00:23:28.170 iops : min= 310, max= 1636, avg=711.05, stdev=393.49, samples=20 00:23:28.170 lat (msec) : 2=0.10%, 4=0.32%, 10=1.27%, 20=2.55%, 50=34.64% 00:23:28.171 lat (msec) : 100=26.18%, 250=31.22%, 500=3.72% 00:23:28.171 cpu : usr=2.19%, sys=2.38%, ctx=3215, majf=0, minf=1 00:23:28.171 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:23:28.171 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:28.171 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:28.171 issued rwts: total=0,7176,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:28.171 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:28.171 job9: (groupid=0, jobs=1): err= 0: pid=2501869: Thu Nov 28 23:15:30 2024 00:23:28.171 write: IOPS=532, BW=133MiB/s (140MB/s)(1344MiB/10101msec); 0 zone resets 00:23:28.171 slat (usec): min=22, max=77108, avg=1476.15, stdev=3658.98 00:23:28.171 clat (usec): min=1453, max=330218, avg=118566.45, stdev=63707.70 00:23:28.171 lat (msec): min=2, max=330, avg=120.04, stdev=64.51 00:23:28.171 clat percentiles (msec): 00:23:28.171 | 1.00th=[ 12], 5.00th=[ 33], 10.00th=[ 46], 20.00th=[ 61], 00:23:28.171 | 30.00th=[ 79], 40.00th=[ 86], 50.00th=[ 111], 60.00th=[ 136], 00:23:28.171 | 70.00th=[ 146], 80.00th=[ 165], 90.00th=[ 220], 95.00th=[ 239], 00:23:28.171 | 99.00th=[ 271], 99.50th=[ 284], 99.90th=[ 305], 99.95th=[ 330], 00:23:28.171 | 99.99th=[ 330] 00:23:28.171 bw ( KiB/s): min=67584, max=256000, per=9.40%, avg=136024.10, stdev=51388.74, samples=20 00:23:28.171 iops : min= 264, max= 1000, avg=531.30, stdev=200.77, samples=20 00:23:28.171 lat (msec) : 2=0.04%, 4=0.11%, 10=0.67%, 20=1.71%, 50=8.55% 00:23:28.171 lat (msec) : 100=36.45%, 250=49.56%, 500=2.90% 00:23:28.171 cpu : usr=1.71%, sys=1.78%, ctx=2416, majf=0, minf=1 00:23:28.171 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:23:28.171 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:28.171 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:28.171 issued rwts: total=0,5377,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:28.171 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:28.171 job10: (groupid=0, jobs=1): err= 0: pid=2501870: Thu Nov 28 23:15:30 2024 00:23:28.171 write: IOPS=477, BW=119MiB/s (125MB/s)(1203MiB/10074msec); 0 zone resets 00:23:28.171 slat (usec): min=16, max=43085, avg=1841.83, stdev=4040.94 00:23:28.171 clat (usec): min=1503, max=313368, avg=132134.64, stdev=64540.07 00:23:28.171 lat (usec): min=1604, max=313431, avg=133976.47, stdev=65339.10 00:23:28.171 clat percentiles (msec): 00:23:28.171 | 1.00th=[ 8], 5.00th=[ 48], 10.00th=[ 77], 20.00th=[ 81], 00:23:28.171 | 30.00th=[ 84], 40.00th=[ 100], 50.00th=[ 118], 60.00th=[ 138], 00:23:28.171 | 70.00th=[ 157], 80.00th=[ 190], 90.00th=[ 232], 95.00th=[ 255], 00:23:28.171 | 99.00th=[ 296], 99.50th=[ 305], 99.90th=[ 313], 99.95th=[ 313], 00:23:28.171 | 99.99th=[ 313] 00:23:28.171 bw ( KiB/s): min=59392, max=200704, per=8.39%, avg=121540.20, stdev=49512.16, samples=20 00:23:28.171 iops : min= 232, max= 784, avg=474.75, stdev=193.42, samples=20 00:23:28.171 lat (msec) : 2=0.06%, 4=0.42%, 10=1.10%, 20=1.10%, 50=2.49% 00:23:28.171 lat (msec) : 100=35.17%, 250=53.44%, 500=6.21% 00:23:28.171 cpu : usr=1.38%, sys=1.49%, ctx=1737, majf=0, minf=1 00:23:28.171 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:23:28.171 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:28.171 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:28.171 issued rwts: total=0,4811,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:28.171 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:28.171 00:23:28.171 Run status group 0 (all jobs): 00:23:28.171 WRITE: bw=1414MiB/s (1483MB/s), 89.6MiB/s-178MiB/s (93.9MB/s-186MB/s), io=14.0GiB (15.1GB), run=10074-10155msec 00:23:28.171 00:23:28.171 Disk stats (read/write): 00:23:28.171 nvme0n1: ios=49/9285, merge=0/0, ticks=228/1212159, in_queue=1212387, util=97.58% 00:23:28.171 nvme10n1: ios=49/9149, merge=0/0, ticks=125/1212093, in_queue=1212218, util=98.27% 00:23:28.171 nvme1n1: ios=43/11176, merge=0/0, ticks=1336/1215303, in_queue=1216639, util=99.91% 00:23:28.171 nvme2n1: ios=45/9858, merge=0/0, ticks=3552/1165326, in_queue=1168878, util=99.99% 00:23:28.171 nvme3n1: ios=43/7435, merge=0/0, ticks=833/1213526, in_queue=1214359, util=99.92% 00:23:28.171 nvme4n1: ios=47/11141, merge=0/0, ticks=80/1211462, in_queue=1211542, util=98.57% 00:23:28.171 nvme5n1: ios=0/7058, merge=0/0, ticks=0/1207717, in_queue=1207717, util=98.27% 00:23:28.171 nvme6n1: ios=36/13320, merge=0/0, ticks=823/1219496, in_queue=1220319, util=100.00% 00:23:28.171 nvme7n1: ios=0/14158, merge=0/0, ticks=0/1215254, in_queue=1215254, util=98.81% 00:23:28.171 nvme8n1: ios=25/10561, merge=0/0, ticks=728/1214694, in_queue=1215422, util=100.00% 00:23:28.171 nvme9n1: ios=0/9376, merge=0/0, ticks=0/1212466, in_queue=1212466, util=99.04% 00:23:28.171 23:15:30 -- target/multiconnection.sh@36 -- # sync 00:23:28.171 23:15:30 -- target/multiconnection.sh@37 -- # seq 1 11 00:23:28.171 23:15:30 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:28.171 23:15:30 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:23:28.171 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:23:28.171 23:15:30 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:23:28.171 23:15:30 -- common/autotest_common.sh@1208 -- # local i=0 00:23:28.171 23:15:30 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:28.171 23:15:30 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK1 00:23:28.171 23:15:30 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:28.171 23:15:30 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK1 00:23:28.171 23:15:31 -- common/autotest_common.sh@1220 -- # return 0 00:23:28.171 23:15:31 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:28.171 23:15:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:28.171 23:15:31 -- common/autotest_common.sh@10 -- # set +x 00:23:28.171 23:15:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:28.171 23:15:31 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:28.171 23:15:31 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:23:28.171 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:23:28.171 23:15:31 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:23:28.171 23:15:31 -- common/autotest_common.sh@1208 -- # local i=0 00:23:28.171 23:15:31 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:28.171 23:15:31 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK2 00:23:28.171 23:15:31 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:28.171 23:15:31 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK2 00:23:28.171 23:15:31 -- common/autotest_common.sh@1220 -- # return 0 00:23:28.171 23:15:31 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:23:28.171 23:15:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:28.171 23:15:31 -- common/autotest_common.sh@10 -- # set +x 00:23:28.171 23:15:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:28.171 23:15:31 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:28.171 23:15:31 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:23:28.171 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:23:28.171 23:15:31 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:23:28.171 23:15:31 -- common/autotest_common.sh@1208 -- # local i=0 00:23:28.171 23:15:31 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:28.171 23:15:31 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK3 00:23:28.171 23:15:31 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:28.171 23:15:31 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK3 00:23:28.171 23:15:31 -- common/autotest_common.sh@1220 -- # return 0 00:23:28.171 23:15:31 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:23:28.171 23:15:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:28.171 23:15:31 -- common/autotest_common.sh@10 -- # set +x 00:23:28.171 23:15:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:28.171 23:15:31 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:28.171 23:15:31 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:23:28.430 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:23:28.430 23:15:31 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:23:28.430 23:15:31 -- common/autotest_common.sh@1208 -- # local i=0 00:23:28.430 23:15:31 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:28.430 23:15:31 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK4 00:23:28.430 23:15:31 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:28.430 23:15:31 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK4 00:23:28.430 23:15:31 -- common/autotest_common.sh@1220 -- # return 0 00:23:28.430 23:15:31 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:23:28.430 23:15:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:28.430 23:15:31 -- common/autotest_common.sh@10 -- # set +x 00:23:28.430 23:15:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:28.430 23:15:31 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:28.430 23:15:31 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:23:28.688 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:23:28.688 23:15:32 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:23:28.688 23:15:32 -- common/autotest_common.sh@1208 -- # local i=0 00:23:28.688 23:15:32 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:28.688 23:15:32 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK5 00:23:28.688 23:15:32 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:28.688 23:15:32 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK5 00:23:28.688 23:15:32 -- common/autotest_common.sh@1220 -- # return 0 00:23:28.688 23:15:32 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:23:28.688 23:15:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:28.688 23:15:32 -- common/autotest_common.sh@10 -- # set +x 00:23:28.688 23:15:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:28.688 23:15:32 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:28.688 23:15:32 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:23:28.948 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:23:28.948 23:15:32 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:23:28.948 23:15:32 -- common/autotest_common.sh@1208 -- # local i=0 00:23:28.948 23:15:32 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:28.948 23:15:32 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK6 00:23:28.948 23:15:32 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:28.948 23:15:32 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK6 00:23:28.948 23:15:32 -- common/autotest_common.sh@1220 -- # return 0 00:23:28.948 23:15:32 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:23:28.948 23:15:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:28.948 23:15:32 -- common/autotest_common.sh@10 -- # set +x 00:23:28.948 23:15:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:28.948 23:15:32 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:28.948 23:15:32 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:23:28.948 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:23:28.948 23:15:32 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:23:28.948 23:15:32 -- common/autotest_common.sh@1208 -- # local i=0 00:23:28.948 23:15:32 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:28.948 23:15:32 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK7 00:23:28.948 23:15:32 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:28.948 23:15:32 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK7 00:23:28.948 23:15:32 -- common/autotest_common.sh@1220 -- # return 0 00:23:28.948 23:15:32 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:23:28.948 23:15:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:28.948 23:15:32 -- common/autotest_common.sh@10 -- # set +x 00:23:28.948 23:15:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:28.948 23:15:32 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:28.948 23:15:32 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:23:29.516 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:23:29.516 23:15:32 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:23:29.516 23:15:32 -- common/autotest_common.sh@1208 -- # local i=0 00:23:29.516 23:15:32 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:29.516 23:15:32 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK8 00:23:29.516 23:15:32 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:29.516 23:15:32 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK8 00:23:29.516 23:15:32 -- common/autotest_common.sh@1220 -- # return 0 00:23:29.516 23:15:32 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:23:29.516 23:15:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:29.516 23:15:32 -- common/autotest_common.sh@10 -- # set +x 00:23:29.516 23:15:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:29.516 23:15:32 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:29.516 23:15:32 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:23:29.516 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:23:29.516 23:15:32 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:23:29.516 23:15:32 -- common/autotest_common.sh@1208 -- # local i=0 00:23:29.516 23:15:32 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:29.516 23:15:32 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK9 00:23:29.516 23:15:32 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:29.516 23:15:32 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK9 00:23:29.516 23:15:32 -- common/autotest_common.sh@1220 -- # return 0 00:23:29.516 23:15:32 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:23:29.516 23:15:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:29.516 23:15:32 -- common/autotest_common.sh@10 -- # set +x 00:23:29.516 23:15:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:29.516 23:15:32 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:29.516 23:15:32 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:23:29.516 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:23:29.516 23:15:33 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:23:29.516 23:15:33 -- common/autotest_common.sh@1208 -- # local i=0 00:23:29.516 23:15:33 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:29.516 23:15:33 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK10 00:23:29.516 23:15:33 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:29.516 23:15:33 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK10 00:23:29.516 23:15:33 -- common/autotest_common.sh@1220 -- # return 0 00:23:29.516 23:15:33 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:23:29.516 23:15:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:29.516 23:15:33 -- common/autotest_common.sh@10 -- # set +x 00:23:29.516 23:15:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:29.516 23:15:33 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:29.516 23:15:33 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:23:29.774 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:23:29.774 23:15:33 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:23:29.774 23:15:33 -- common/autotest_common.sh@1208 -- # local i=0 00:23:29.774 23:15:33 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:29.774 23:15:33 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK11 00:23:29.774 23:15:33 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:29.774 23:15:33 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK11 00:23:29.774 23:15:33 -- common/autotest_common.sh@1220 -- # return 0 00:23:29.774 23:15:33 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:23:29.774 23:15:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:29.774 23:15:33 -- common/autotest_common.sh@10 -- # set +x 00:23:29.774 23:15:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:29.774 23:15:33 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:23:29.774 23:15:33 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:23:29.774 23:15:33 -- target/multiconnection.sh@47 -- # nvmftestfini 00:23:29.774 23:15:33 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:29.774 23:15:33 -- nvmf/common.sh@116 -- # sync 00:23:29.774 23:15:33 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:29.774 23:15:33 -- nvmf/common.sh@119 -- # set +e 00:23:29.774 23:15:33 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:29.774 23:15:33 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:29.774 rmmod nvme_tcp 00:23:29.774 rmmod nvme_fabrics 00:23:29.774 rmmod nvme_keyring 00:23:29.774 23:15:33 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:29.774 23:15:33 -- nvmf/common.sh@123 -- # set -e 00:23:29.774 23:15:33 -- nvmf/common.sh@124 -- # return 0 00:23:29.774 23:15:33 -- nvmf/common.sh@477 -- # '[' -n 2495656 ']' 00:23:29.774 23:15:33 -- nvmf/common.sh@478 -- # killprocess 2495656 00:23:29.774 23:15:33 -- common/autotest_common.sh@936 -- # '[' -z 2495656 ']' 00:23:29.774 23:15:33 -- common/autotest_common.sh@940 -- # kill -0 2495656 00:23:29.774 23:15:33 -- common/autotest_common.sh@941 -- # uname 00:23:29.774 23:15:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:29.774 23:15:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2495656 00:23:29.774 23:15:33 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:29.774 23:15:33 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:29.774 23:15:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2495656' 00:23:29.774 killing process with pid 2495656 00:23:29.774 23:15:33 -- common/autotest_common.sh@955 -- # kill 2495656 00:23:29.774 23:15:33 -- common/autotest_common.sh@960 -- # wait 2495656 00:23:30.341 23:15:33 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:30.341 23:15:33 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:30.341 23:15:33 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:30.341 23:15:33 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:30.341 23:15:33 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:30.341 23:15:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:30.341 23:15:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:30.341 23:15:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:32.265 23:15:35 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:32.265 00:23:32.265 real 1m1.528s 00:23:32.265 user 3m28.238s 00:23:32.265 sys 0m25.369s 00:23:32.265 23:15:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:32.265 23:15:35 -- common/autotest_common.sh@10 -- # set +x 00:23:32.265 ************************************ 00:23:32.265 END TEST nvmf_multiconnection 00:23:32.265 ************************************ 00:23:32.265 23:15:35 -- nvmf/nvmf.sh@66 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:23:32.265 23:15:35 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:32.265 23:15:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:32.265 23:15:35 -- common/autotest_common.sh@10 -- # set +x 00:23:32.523 ************************************ 00:23:32.523 START TEST nvmf_initiator_timeout 00:23:32.523 ************************************ 00:23:32.523 23:15:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:23:32.523 * Looking for test storage... 00:23:32.523 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:23:32.523 23:15:35 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:32.523 23:15:35 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:32.523 23:15:35 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:32.523 23:15:36 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:32.523 23:15:36 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:32.523 23:15:36 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:32.523 23:15:36 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:32.523 23:15:36 -- scripts/common.sh@335 -- # IFS=.-: 00:23:32.523 23:15:36 -- scripts/common.sh@335 -- # read -ra ver1 00:23:32.523 23:15:36 -- scripts/common.sh@336 -- # IFS=.-: 00:23:32.523 23:15:36 -- scripts/common.sh@336 -- # read -ra ver2 00:23:32.523 23:15:36 -- scripts/common.sh@337 -- # local 'op=<' 00:23:32.523 23:15:36 -- scripts/common.sh@339 -- # ver1_l=2 00:23:32.523 23:15:36 -- scripts/common.sh@340 -- # ver2_l=1 00:23:32.523 23:15:36 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:32.523 23:15:36 -- scripts/common.sh@343 -- # case "$op" in 00:23:32.523 23:15:36 -- scripts/common.sh@344 -- # : 1 00:23:32.523 23:15:36 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:32.523 23:15:36 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:32.523 23:15:36 -- scripts/common.sh@364 -- # decimal 1 00:23:32.523 23:15:36 -- scripts/common.sh@352 -- # local d=1 00:23:32.523 23:15:36 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:32.523 23:15:36 -- scripts/common.sh@354 -- # echo 1 00:23:32.523 23:15:36 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:32.523 23:15:36 -- scripts/common.sh@365 -- # decimal 2 00:23:32.523 23:15:36 -- scripts/common.sh@352 -- # local d=2 00:23:32.523 23:15:36 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:32.523 23:15:36 -- scripts/common.sh@354 -- # echo 2 00:23:32.523 23:15:36 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:32.523 23:15:36 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:32.523 23:15:36 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:32.523 23:15:36 -- scripts/common.sh@367 -- # return 0 00:23:32.523 23:15:36 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:32.523 23:15:36 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:32.523 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:32.523 --rc genhtml_branch_coverage=1 00:23:32.523 --rc genhtml_function_coverage=1 00:23:32.523 --rc genhtml_legend=1 00:23:32.523 --rc geninfo_all_blocks=1 00:23:32.523 --rc geninfo_unexecuted_blocks=1 00:23:32.523 00:23:32.523 ' 00:23:32.523 23:15:36 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:32.523 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:32.523 --rc genhtml_branch_coverage=1 00:23:32.523 --rc genhtml_function_coverage=1 00:23:32.523 --rc genhtml_legend=1 00:23:32.523 --rc geninfo_all_blocks=1 00:23:32.523 --rc geninfo_unexecuted_blocks=1 00:23:32.523 00:23:32.523 ' 00:23:32.523 23:15:36 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:32.523 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:32.523 --rc genhtml_branch_coverage=1 00:23:32.523 --rc genhtml_function_coverage=1 00:23:32.523 --rc genhtml_legend=1 00:23:32.523 --rc geninfo_all_blocks=1 00:23:32.523 --rc geninfo_unexecuted_blocks=1 00:23:32.523 00:23:32.523 ' 00:23:32.523 23:15:36 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:32.523 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:32.523 --rc genhtml_branch_coverage=1 00:23:32.523 --rc genhtml_function_coverage=1 00:23:32.523 --rc genhtml_legend=1 00:23:32.523 --rc geninfo_all_blocks=1 00:23:32.523 --rc geninfo_unexecuted_blocks=1 00:23:32.523 00:23:32.523 ' 00:23:32.523 23:15:36 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:32.524 23:15:36 -- nvmf/common.sh@7 -- # uname -s 00:23:32.524 23:15:36 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:32.524 23:15:36 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:32.524 23:15:36 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:32.524 23:15:36 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:32.524 23:15:36 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:32.524 23:15:36 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:32.524 23:15:36 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:32.524 23:15:36 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:32.524 23:15:36 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:32.524 23:15:36 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:32.524 23:15:36 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:32.524 23:15:36 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:32.524 23:15:36 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:32.524 23:15:36 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:32.524 23:15:36 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:32.524 23:15:36 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:32.524 23:15:36 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:32.524 23:15:36 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:32.524 23:15:36 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:32.524 23:15:36 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:32.524 23:15:36 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:32.524 23:15:36 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:32.524 23:15:36 -- paths/export.sh@5 -- # export PATH 00:23:32.524 23:15:36 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:32.524 23:15:36 -- nvmf/common.sh@46 -- # : 0 00:23:32.524 23:15:36 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:32.524 23:15:36 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:32.524 23:15:36 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:32.524 23:15:36 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:32.524 23:15:36 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:32.524 23:15:36 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:32.524 23:15:36 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:32.524 23:15:36 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:32.524 23:15:36 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:23:32.524 23:15:36 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:23:32.524 23:15:36 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:23:32.524 23:15:36 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:32.524 23:15:36 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:32.524 23:15:36 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:32.524 23:15:36 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:32.524 23:15:36 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:32.524 23:15:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:32.524 23:15:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:32.524 23:15:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:32.524 23:15:36 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:32.524 23:15:36 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:32.524 23:15:36 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:32.524 23:15:36 -- common/autotest_common.sh@10 -- # set +x 00:23:34.425 23:15:38 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:34.425 23:15:38 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:34.425 23:15:38 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:34.425 23:15:38 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:34.425 23:15:38 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:34.425 23:15:38 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:34.425 23:15:38 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:34.425 23:15:38 -- nvmf/common.sh@294 -- # net_devs=() 00:23:34.425 23:15:38 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:34.425 23:15:38 -- nvmf/common.sh@295 -- # e810=() 00:23:34.425 23:15:38 -- nvmf/common.sh@295 -- # local -ga e810 00:23:34.425 23:15:38 -- nvmf/common.sh@296 -- # x722=() 00:23:34.425 23:15:38 -- nvmf/common.sh@296 -- # local -ga x722 00:23:34.425 23:15:38 -- nvmf/common.sh@297 -- # mlx=() 00:23:34.425 23:15:38 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:34.425 23:15:38 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:34.425 23:15:38 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:34.425 23:15:38 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:34.425 23:15:38 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:34.425 23:15:38 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:34.425 23:15:38 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:34.425 23:15:38 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:34.425 23:15:38 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:34.425 23:15:38 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:34.425 23:15:38 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:34.425 23:15:38 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:34.425 23:15:38 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:34.425 23:15:38 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:34.425 23:15:38 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:34.425 23:15:38 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:34.425 23:15:38 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:34.425 23:15:38 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:34.425 23:15:38 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:34.425 23:15:38 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:34.425 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:34.425 23:15:38 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:34.425 23:15:38 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:34.425 23:15:38 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:34.425 23:15:38 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:34.425 23:15:38 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:34.425 23:15:38 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:34.425 23:15:38 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:34.425 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:34.425 23:15:38 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:34.425 23:15:38 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:34.425 23:15:38 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:34.425 23:15:38 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:34.425 23:15:38 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:34.425 23:15:38 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:34.425 23:15:38 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:34.425 23:15:38 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:34.426 23:15:38 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:34.426 23:15:38 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:34.426 23:15:38 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:34.426 23:15:38 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:34.426 23:15:38 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:34.426 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:34.426 23:15:38 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:34.426 23:15:38 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:34.426 23:15:38 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:34.426 23:15:38 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:34.426 23:15:38 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:34.426 23:15:38 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:34.426 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:34.426 23:15:38 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:34.426 23:15:38 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:34.426 23:15:38 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:34.426 23:15:38 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:34.426 23:15:38 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:34.426 23:15:38 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:34.426 23:15:38 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:34.426 23:15:38 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:34.426 23:15:38 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:34.426 23:15:38 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:34.426 23:15:38 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:34.426 23:15:38 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:34.426 23:15:38 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:34.426 23:15:38 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:34.426 23:15:38 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:34.426 23:15:38 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:34.426 23:15:38 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:34.426 23:15:38 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:34.426 23:15:38 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:34.684 23:15:38 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:34.684 23:15:38 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:34.684 23:15:38 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:34.684 23:15:38 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:34.684 23:15:38 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:34.684 23:15:38 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:34.684 23:15:38 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:34.684 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:34.684 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.232 ms 00:23:34.684 00:23:34.684 --- 10.0.0.2 ping statistics --- 00:23:34.684 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:34.684 rtt min/avg/max/mdev = 0.232/0.232/0.232/0.000 ms 00:23:34.684 23:15:38 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:34.684 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:34.684 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.080 ms 00:23:34.684 00:23:34.684 --- 10.0.0.1 ping statistics --- 00:23:34.684 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:34.684 rtt min/avg/max/mdev = 0.080/0.080/0.080/0.000 ms 00:23:34.684 23:15:38 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:34.684 23:15:38 -- nvmf/common.sh@410 -- # return 0 00:23:34.684 23:15:38 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:34.684 23:15:38 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:34.684 23:15:38 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:34.684 23:15:38 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:34.684 23:15:38 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:34.684 23:15:38 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:34.684 23:15:38 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:34.684 23:15:38 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:23:34.684 23:15:38 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:34.684 23:15:38 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:34.684 23:15:38 -- common/autotest_common.sh@10 -- # set +x 00:23:34.684 23:15:38 -- nvmf/common.sh@469 -- # nvmfpid=2505386 00:23:34.684 23:15:38 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:34.684 23:15:38 -- nvmf/common.sh@470 -- # waitforlisten 2505386 00:23:34.684 23:15:38 -- common/autotest_common.sh@829 -- # '[' -z 2505386 ']' 00:23:34.684 23:15:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:34.684 23:15:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:34.684 23:15:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:34.684 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:34.684 23:15:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:34.684 23:15:38 -- common/autotest_common.sh@10 -- # set +x 00:23:34.684 [2024-11-28 23:15:38.214888] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:34.684 [2024-11-28 23:15:38.214969] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:34.684 EAL: No free 2048 kB hugepages reported on node 1 00:23:34.684 [2024-11-28 23:15:38.285019] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:34.943 [2024-11-28 23:15:38.379239] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:34.943 [2024-11-28 23:15:38.379414] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:34.943 [2024-11-28 23:15:38.379436] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:34.943 [2024-11-28 23:15:38.379451] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:34.943 [2024-11-28 23:15:38.379527] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:34.943 [2024-11-28 23:15:38.379608] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:34.943 [2024-11-28 23:15:38.379611] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:34.943 [2024-11-28 23:15:38.379556] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:35.877 23:15:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:35.877 23:15:39 -- common/autotest_common.sh@862 -- # return 0 00:23:35.877 23:15:39 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:35.877 23:15:39 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:35.877 23:15:39 -- common/autotest_common.sh@10 -- # set +x 00:23:35.877 23:15:39 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:35.877 23:15:39 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:23:35.877 23:15:39 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:23:35.877 23:15:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:35.877 23:15:39 -- common/autotest_common.sh@10 -- # set +x 00:23:35.877 Malloc0 00:23:35.877 23:15:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:35.877 23:15:39 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:23:35.877 23:15:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:35.877 23:15:39 -- common/autotest_common.sh@10 -- # set +x 00:23:35.877 Delay0 00:23:35.877 23:15:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:35.877 23:15:39 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:35.877 23:15:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:35.877 23:15:39 -- common/autotest_common.sh@10 -- # set +x 00:23:35.877 [2024-11-28 23:15:39.285540] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:35.877 23:15:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:35.877 23:15:39 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:23:35.877 23:15:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:35.877 23:15:39 -- common/autotest_common.sh@10 -- # set +x 00:23:35.877 23:15:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:35.877 23:15:39 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:23:35.877 23:15:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:35.877 23:15:39 -- common/autotest_common.sh@10 -- # set +x 00:23:35.877 23:15:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:35.877 23:15:39 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:35.877 23:15:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:35.877 23:15:39 -- common/autotest_common.sh@10 -- # set +x 00:23:35.877 [2024-11-28 23:15:39.313844] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:35.877 23:15:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:35.877 23:15:39 -- target/initiator_timeout.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:23:36.443 23:15:39 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:23:36.443 23:15:39 -- common/autotest_common.sh@1187 -- # local i=0 00:23:36.443 23:15:39 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:23:36.443 23:15:39 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:23:36.443 23:15:39 -- common/autotest_common.sh@1194 -- # sleep 2 00:23:38.340 23:15:41 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:23:38.340 23:15:41 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:23:38.340 23:15:41 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:23:38.600 23:15:41 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:23:38.600 23:15:41 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:23:38.600 23:15:41 -- common/autotest_common.sh@1197 -- # return 0 00:23:38.600 23:15:41 -- target/initiator_timeout.sh@35 -- # fio_pid=2505830 00:23:38.600 23:15:41 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:23:38.600 23:15:41 -- target/initiator_timeout.sh@37 -- # sleep 3 00:23:38.600 [global] 00:23:38.600 thread=1 00:23:38.600 invalidate=1 00:23:38.600 rw=write 00:23:38.600 time_based=1 00:23:38.600 runtime=60 00:23:38.600 ioengine=libaio 00:23:38.600 direct=1 00:23:38.600 bs=4096 00:23:38.600 iodepth=1 00:23:38.600 norandommap=0 00:23:38.600 numjobs=1 00:23:38.600 00:23:38.600 verify_dump=1 00:23:38.600 verify_backlog=512 00:23:38.600 verify_state_save=0 00:23:38.600 do_verify=1 00:23:38.600 verify=crc32c-intel 00:23:38.600 [job0] 00:23:38.600 filename=/dev/nvme0n1 00:23:38.600 Could not set queue depth (nvme0n1) 00:23:38.600 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:23:38.600 fio-3.35 00:23:38.600 Starting 1 thread 00:23:41.935 23:15:44 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:23:41.935 23:15:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:41.935 23:15:44 -- common/autotest_common.sh@10 -- # set +x 00:23:41.935 true 00:23:41.935 23:15:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:41.935 23:15:44 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:23:41.935 23:15:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:41.935 23:15:44 -- common/autotest_common.sh@10 -- # set +x 00:23:41.935 true 00:23:41.935 23:15:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:41.935 23:15:44 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:23:41.935 23:15:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:41.935 23:15:44 -- common/autotest_common.sh@10 -- # set +x 00:23:41.935 true 00:23:41.935 23:15:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:41.935 23:15:44 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:23:41.935 23:15:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:41.935 23:15:44 -- common/autotest_common.sh@10 -- # set +x 00:23:41.935 true 00:23:41.935 23:15:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:41.935 23:15:44 -- target/initiator_timeout.sh@45 -- # sleep 3 00:23:44.471 23:15:47 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:23:44.471 23:15:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:44.471 23:15:47 -- common/autotest_common.sh@10 -- # set +x 00:23:44.471 true 00:23:44.471 23:15:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:44.471 23:15:47 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:23:44.471 23:15:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:44.471 23:15:47 -- common/autotest_common.sh@10 -- # set +x 00:23:44.471 true 00:23:44.471 23:15:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:44.471 23:15:48 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:23:44.471 23:15:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:44.471 23:15:48 -- common/autotest_common.sh@10 -- # set +x 00:23:44.471 true 00:23:44.471 23:15:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:44.471 23:15:48 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:23:44.471 23:15:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:44.471 23:15:48 -- common/autotest_common.sh@10 -- # set +x 00:23:44.471 true 00:23:44.471 23:15:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:44.471 23:15:48 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:23:44.471 23:15:48 -- target/initiator_timeout.sh@54 -- # wait 2505830 00:24:40.673 00:24:40.674 job0: (groupid=0, jobs=1): err= 0: pid=2505905: Thu Nov 28 23:16:42 2024 00:24:40.674 read: IOPS=94, BW=380KiB/s (389kB/s)(22.3MiB/60032msec) 00:24:40.674 slat (usec): min=4, max=7669, avg=16.26, stdev=128.20 00:24:40.674 clat (usec): min=209, max=41257k, avg=10256.49, stdev=546376.83 00:24:40.674 lat (usec): min=214, max=41257k, avg=10272.75, stdev=546377.14 00:24:40.674 clat percentiles (usec): 00:24:40.674 | 1.00th=[ 223], 5.00th=[ 229], 10.00th=[ 233], 00:24:40.674 | 20.00th=[ 239], 30.00th=[ 245], 40.00th=[ 251], 00:24:40.674 | 50.00th=[ 265], 60.00th=[ 277], 70.00th=[ 289], 00:24:40.674 | 80.00th=[ 326], 90.00th=[ 445], 95.00th=[ 41157], 00:24:40.674 | 99.00th=[ 42206], 99.50th=[ 42206], 99.90th=[ 42206], 00:24:40.674 | 99.95th=[ 42206], 99.99th=[17112761] 00:24:40.674 write: IOPS=102, BW=409KiB/s (419kB/s)(24.0MiB/60032msec); 0 zone resets 00:24:40.674 slat (usec): min=5, max=23881, avg=17.15, stdev=304.63 00:24:40.674 clat (usec): min=166, max=453, avg=210.21, stdev=27.98 00:24:40.674 lat (usec): min=172, max=24261, avg=227.36, stdev=308.53 00:24:40.674 clat percentiles (usec): 00:24:40.674 | 1.00th=[ 182], 5.00th=[ 186], 10.00th=[ 190], 20.00th=[ 194], 00:24:40.674 | 30.00th=[ 196], 40.00th=[ 200], 50.00th=[ 202], 60.00th=[ 206], 00:24:40.674 | 70.00th=[ 210], 80.00th=[ 219], 90.00th=[ 239], 95.00th=[ 273], 00:24:40.674 | 99.00th=[ 318], 99.50th=[ 330], 99.90th=[ 383], 99.95th=[ 412], 00:24:40.674 | 99.99th=[ 453] 00:24:40.674 bw ( KiB/s): min= 4096, max= 8192, per=100.00%, avg=6144.00, stdev=1994.45, samples=8 00:24:40.674 iops : min= 1024, max= 2048, avg=1536.00, stdev=498.61, samples=8 00:24:40.674 lat (usec) : 250=67.22%, 500=28.82%, 750=0.73%, 1000=0.01% 00:24:40.674 lat (msec) : 50=3.21%, >=2000=0.01% 00:24:40.674 cpu : usr=0.15%, sys=0.28%, ctx=11853, majf=0, minf=1 00:24:40.674 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:24:40.674 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:40.674 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:40.674 issued rwts: total=5703,6144,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:40.674 latency : target=0, window=0, percentile=100.00%, depth=1 00:24:40.674 00:24:40.674 Run status group 0 (all jobs): 00:24:40.674 READ: bw=380KiB/s (389kB/s), 380KiB/s-380KiB/s (389kB/s-389kB/s), io=22.3MiB (23.4MB), run=60032-60032msec 00:24:40.674 WRITE: bw=409KiB/s (419kB/s), 409KiB/s-409KiB/s (419kB/s-419kB/s), io=24.0MiB (25.2MB), run=60032-60032msec 00:24:40.674 00:24:40.674 Disk stats (read/write): 00:24:40.674 nvme0n1: ios=5751/6144, merge=0/0, ticks=18345/1255, in_queue=19600, util=99.87% 00:24:40.674 23:16:42 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:24:40.674 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:24:40.674 23:16:42 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:24:40.674 23:16:42 -- common/autotest_common.sh@1208 -- # local i=0 00:24:40.674 23:16:42 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:24:40.674 23:16:42 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:24:40.674 23:16:42 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:24:40.674 23:16:42 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:24:40.674 23:16:42 -- common/autotest_common.sh@1220 -- # return 0 00:24:40.674 23:16:42 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:24:40.674 23:16:42 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:24:40.674 nvmf hotplug test: fio successful as expected 00:24:40.674 23:16:42 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:40.674 23:16:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:40.674 23:16:42 -- common/autotest_common.sh@10 -- # set +x 00:24:40.674 23:16:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:40.674 23:16:42 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:24:40.674 23:16:42 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:24:40.674 23:16:42 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:24:40.674 23:16:42 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:40.674 23:16:42 -- nvmf/common.sh@116 -- # sync 00:24:40.674 23:16:42 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:40.674 23:16:42 -- nvmf/common.sh@119 -- # set +e 00:24:40.674 23:16:42 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:40.674 23:16:42 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:40.674 rmmod nvme_tcp 00:24:40.674 rmmod nvme_fabrics 00:24:40.674 rmmod nvme_keyring 00:24:40.674 23:16:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:40.674 23:16:42 -- nvmf/common.sh@123 -- # set -e 00:24:40.674 23:16:42 -- nvmf/common.sh@124 -- # return 0 00:24:40.674 23:16:42 -- nvmf/common.sh@477 -- # '[' -n 2505386 ']' 00:24:40.674 23:16:42 -- nvmf/common.sh@478 -- # killprocess 2505386 00:24:40.674 23:16:42 -- common/autotest_common.sh@936 -- # '[' -z 2505386 ']' 00:24:40.674 23:16:42 -- common/autotest_common.sh@940 -- # kill -0 2505386 00:24:40.674 23:16:42 -- common/autotest_common.sh@941 -- # uname 00:24:40.674 23:16:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:40.674 23:16:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2505386 00:24:40.674 23:16:42 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:40.674 23:16:42 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:40.674 23:16:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2505386' 00:24:40.674 killing process with pid 2505386 00:24:40.674 23:16:42 -- common/autotest_common.sh@955 -- # kill 2505386 00:24:40.674 23:16:42 -- common/autotest_common.sh@960 -- # wait 2505386 00:24:40.674 23:16:42 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:40.674 23:16:42 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:40.674 23:16:42 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:40.674 23:16:42 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:40.674 23:16:42 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:40.674 23:16:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:40.674 23:16:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:40.674 23:16:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:41.612 23:16:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:41.612 00:24:41.612 real 1m8.978s 00:24:41.612 user 4m13.643s 00:24:41.612 sys 0m6.854s 00:24:41.612 23:16:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:24:41.612 23:16:44 -- common/autotest_common.sh@10 -- # set +x 00:24:41.612 ************************************ 00:24:41.612 END TEST nvmf_initiator_timeout 00:24:41.612 ************************************ 00:24:41.612 23:16:44 -- nvmf/nvmf.sh@69 -- # [[ phy == phy ]] 00:24:41.612 23:16:44 -- nvmf/nvmf.sh@70 -- # '[' tcp = tcp ']' 00:24:41.612 23:16:44 -- nvmf/nvmf.sh@71 -- # gather_supported_nvmf_pci_devs 00:24:41.612 23:16:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:41.612 23:16:44 -- common/autotest_common.sh@10 -- # set +x 00:24:43.514 23:16:46 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:43.514 23:16:46 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:43.514 23:16:46 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:43.514 23:16:46 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:43.514 23:16:46 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:43.514 23:16:46 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:43.514 23:16:46 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:43.514 23:16:46 -- nvmf/common.sh@294 -- # net_devs=() 00:24:43.514 23:16:46 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:43.514 23:16:46 -- nvmf/common.sh@295 -- # e810=() 00:24:43.514 23:16:46 -- nvmf/common.sh@295 -- # local -ga e810 00:24:43.514 23:16:46 -- nvmf/common.sh@296 -- # x722=() 00:24:43.514 23:16:46 -- nvmf/common.sh@296 -- # local -ga x722 00:24:43.514 23:16:46 -- nvmf/common.sh@297 -- # mlx=() 00:24:43.514 23:16:46 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:43.514 23:16:46 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:43.514 23:16:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:43.514 23:16:46 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:43.514 23:16:46 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:43.514 23:16:46 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:43.514 23:16:46 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:43.514 23:16:46 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:43.514 23:16:46 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:43.514 23:16:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:43.514 23:16:46 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:43.514 23:16:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:43.514 23:16:46 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:43.514 23:16:46 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:43.514 23:16:46 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:43.514 23:16:46 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:43.514 23:16:46 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:43.514 23:16:46 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:43.514 23:16:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:43.514 23:16:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:43.514 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:43.514 23:16:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:43.514 23:16:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:43.514 23:16:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:43.514 23:16:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:43.514 23:16:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:43.514 23:16:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:43.514 23:16:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:43.514 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:43.514 23:16:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:43.514 23:16:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:43.514 23:16:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:43.514 23:16:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:43.514 23:16:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:43.514 23:16:46 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:43.514 23:16:46 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:43.514 23:16:46 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:43.514 23:16:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:43.514 23:16:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:43.514 23:16:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:43.514 23:16:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:43.514 23:16:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:43.514 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:43.514 23:16:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:43.514 23:16:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:43.514 23:16:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:43.514 23:16:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:43.514 23:16:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:43.514 23:16:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:43.514 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:43.514 23:16:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:43.514 23:16:46 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:43.514 23:16:46 -- nvmf/nvmf.sh@72 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:43.514 23:16:46 -- nvmf/nvmf.sh@73 -- # (( 2 > 0 )) 00:24:43.514 23:16:46 -- nvmf/nvmf.sh@74 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:24:43.514 23:16:46 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:24:43.514 23:16:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:43.514 23:16:46 -- common/autotest_common.sh@10 -- # set +x 00:24:43.514 ************************************ 00:24:43.514 START TEST nvmf_perf_adq 00:24:43.514 ************************************ 00:24:43.514 23:16:46 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:24:43.514 * Looking for test storage... 00:24:43.514 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:24:43.514 23:16:47 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:24:43.514 23:16:47 -- common/autotest_common.sh@1690 -- # lcov --version 00:24:43.514 23:16:47 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:24:43.514 23:16:47 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:24:43.514 23:16:47 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:24:43.514 23:16:47 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:24:43.514 23:16:47 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:24:43.514 23:16:47 -- scripts/common.sh@335 -- # IFS=.-: 00:24:43.514 23:16:47 -- scripts/common.sh@335 -- # read -ra ver1 00:24:43.514 23:16:47 -- scripts/common.sh@336 -- # IFS=.-: 00:24:43.514 23:16:47 -- scripts/common.sh@336 -- # read -ra ver2 00:24:43.515 23:16:47 -- scripts/common.sh@337 -- # local 'op=<' 00:24:43.515 23:16:47 -- scripts/common.sh@339 -- # ver1_l=2 00:24:43.515 23:16:47 -- scripts/common.sh@340 -- # ver2_l=1 00:24:43.515 23:16:47 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:24:43.515 23:16:47 -- scripts/common.sh@343 -- # case "$op" in 00:24:43.515 23:16:47 -- scripts/common.sh@344 -- # : 1 00:24:43.515 23:16:47 -- scripts/common.sh@363 -- # (( v = 0 )) 00:24:43.515 23:16:47 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:24:43.515 23:16:47 -- scripts/common.sh@364 -- # decimal 1 00:24:43.515 23:16:47 -- scripts/common.sh@352 -- # local d=1 00:24:43.515 23:16:47 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:24:43.515 23:16:47 -- scripts/common.sh@354 -- # echo 1 00:24:43.515 23:16:47 -- scripts/common.sh@364 -- # ver1[v]=1 00:24:43.515 23:16:47 -- scripts/common.sh@365 -- # decimal 2 00:24:43.515 23:16:47 -- scripts/common.sh@352 -- # local d=2 00:24:43.515 23:16:47 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:24:43.515 23:16:47 -- scripts/common.sh@354 -- # echo 2 00:24:43.515 23:16:47 -- scripts/common.sh@365 -- # ver2[v]=2 00:24:43.515 23:16:47 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:24:43.515 23:16:47 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:24:43.515 23:16:47 -- scripts/common.sh@367 -- # return 0 00:24:43.515 23:16:47 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:24:43.515 23:16:47 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:24:43.515 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:43.515 --rc genhtml_branch_coverage=1 00:24:43.515 --rc genhtml_function_coverage=1 00:24:43.515 --rc genhtml_legend=1 00:24:43.515 --rc geninfo_all_blocks=1 00:24:43.515 --rc geninfo_unexecuted_blocks=1 00:24:43.515 00:24:43.515 ' 00:24:43.515 23:16:47 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:24:43.515 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:43.515 --rc genhtml_branch_coverage=1 00:24:43.515 --rc genhtml_function_coverage=1 00:24:43.515 --rc genhtml_legend=1 00:24:43.515 --rc geninfo_all_blocks=1 00:24:43.515 --rc geninfo_unexecuted_blocks=1 00:24:43.515 00:24:43.515 ' 00:24:43.515 23:16:47 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:24:43.515 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:43.515 --rc genhtml_branch_coverage=1 00:24:43.515 --rc genhtml_function_coverage=1 00:24:43.515 --rc genhtml_legend=1 00:24:43.515 --rc geninfo_all_blocks=1 00:24:43.515 --rc geninfo_unexecuted_blocks=1 00:24:43.515 00:24:43.515 ' 00:24:43.515 23:16:47 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:24:43.515 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:43.515 --rc genhtml_branch_coverage=1 00:24:43.515 --rc genhtml_function_coverage=1 00:24:43.515 --rc genhtml_legend=1 00:24:43.515 --rc geninfo_all_blocks=1 00:24:43.515 --rc geninfo_unexecuted_blocks=1 00:24:43.515 00:24:43.515 ' 00:24:43.515 23:16:47 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:43.515 23:16:47 -- nvmf/common.sh@7 -- # uname -s 00:24:43.515 23:16:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:43.515 23:16:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:43.515 23:16:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:43.515 23:16:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:43.515 23:16:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:43.515 23:16:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:43.515 23:16:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:43.515 23:16:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:43.515 23:16:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:43.515 23:16:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:43.515 23:16:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:24:43.515 23:16:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:24:43.515 23:16:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:43.515 23:16:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:43.515 23:16:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:43.515 23:16:47 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:43.515 23:16:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:43.515 23:16:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:43.515 23:16:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:43.515 23:16:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:43.515 23:16:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:43.515 23:16:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:43.515 23:16:47 -- paths/export.sh@5 -- # export PATH 00:24:43.515 23:16:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:43.515 23:16:47 -- nvmf/common.sh@46 -- # : 0 00:24:43.515 23:16:47 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:43.515 23:16:47 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:43.515 23:16:47 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:43.515 23:16:47 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:43.515 23:16:47 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:43.515 23:16:47 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:43.515 23:16:47 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:43.515 23:16:47 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:43.515 23:16:47 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:24:43.515 23:16:47 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:43.515 23:16:47 -- common/autotest_common.sh@10 -- # set +x 00:24:46.098 23:16:49 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:46.098 23:16:49 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:46.098 23:16:49 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:46.098 23:16:49 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:46.098 23:16:49 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:46.098 23:16:49 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:46.098 23:16:49 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:46.098 23:16:49 -- nvmf/common.sh@294 -- # net_devs=() 00:24:46.098 23:16:49 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:46.098 23:16:49 -- nvmf/common.sh@295 -- # e810=() 00:24:46.098 23:16:49 -- nvmf/common.sh@295 -- # local -ga e810 00:24:46.098 23:16:49 -- nvmf/common.sh@296 -- # x722=() 00:24:46.098 23:16:49 -- nvmf/common.sh@296 -- # local -ga x722 00:24:46.098 23:16:49 -- nvmf/common.sh@297 -- # mlx=() 00:24:46.098 23:16:49 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:46.098 23:16:49 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:46.098 23:16:49 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:46.098 23:16:49 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:46.098 23:16:49 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:46.098 23:16:49 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:46.098 23:16:49 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:46.098 23:16:49 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:46.098 23:16:49 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:46.099 23:16:49 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:46.099 23:16:49 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:46.099 23:16:49 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:46.099 23:16:49 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:46.099 23:16:49 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:46.099 23:16:49 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:46.099 23:16:49 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:46.099 23:16:49 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:46.099 23:16:49 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:46.099 23:16:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:46.099 23:16:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:46.099 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:46.099 23:16:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:46.099 23:16:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:46.099 23:16:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:46.099 23:16:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:46.099 23:16:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:46.099 23:16:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:46.099 23:16:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:46.099 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:46.099 23:16:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:46.099 23:16:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:46.099 23:16:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:46.099 23:16:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:46.099 23:16:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:46.099 23:16:49 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:46.099 23:16:49 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:46.099 23:16:49 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:46.099 23:16:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:46.099 23:16:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:46.099 23:16:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:46.099 23:16:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:46.099 23:16:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:46.099 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:46.099 23:16:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:46.099 23:16:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:46.099 23:16:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:46.099 23:16:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:46.099 23:16:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:46.099 23:16:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:46.099 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:46.099 23:16:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:46.099 23:16:49 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:46.099 23:16:49 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:46.099 23:16:49 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:24:46.099 23:16:49 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:24:46.099 23:16:49 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:24:46.099 23:16:49 -- target/perf_adq.sh@52 -- # rmmod ice 00:24:46.359 23:16:49 -- target/perf_adq.sh@53 -- # modprobe ice 00:24:48.890 23:16:52 -- target/perf_adq.sh@54 -- # sleep 5 00:24:54.302 23:16:57 -- target/perf_adq.sh@67 -- # nvmftestinit 00:24:54.303 23:16:57 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:54.303 23:16:57 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:54.303 23:16:57 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:54.303 23:16:57 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:54.303 23:16:57 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:54.303 23:16:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:54.303 23:16:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:54.303 23:16:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:54.303 23:16:57 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:54.303 23:16:57 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:54.303 23:16:57 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:54.303 23:16:57 -- common/autotest_common.sh@10 -- # set +x 00:24:54.303 23:16:57 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:54.303 23:16:57 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:54.303 23:16:57 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:54.303 23:16:57 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:54.303 23:16:57 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:54.303 23:16:57 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:54.303 23:16:57 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:54.303 23:16:57 -- nvmf/common.sh@294 -- # net_devs=() 00:24:54.303 23:16:57 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:54.303 23:16:57 -- nvmf/common.sh@295 -- # e810=() 00:24:54.303 23:16:57 -- nvmf/common.sh@295 -- # local -ga e810 00:24:54.303 23:16:57 -- nvmf/common.sh@296 -- # x722=() 00:24:54.303 23:16:57 -- nvmf/common.sh@296 -- # local -ga x722 00:24:54.303 23:16:57 -- nvmf/common.sh@297 -- # mlx=() 00:24:54.303 23:16:57 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:54.303 23:16:57 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:54.303 23:16:57 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:54.303 23:16:57 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:54.303 23:16:57 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:54.303 23:16:57 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:54.303 23:16:57 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:54.303 23:16:57 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:54.303 23:16:57 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:54.303 23:16:57 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:54.303 23:16:57 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:54.303 23:16:57 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:54.303 23:16:57 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:54.303 23:16:57 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:54.303 23:16:57 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:54.303 23:16:57 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:54.303 23:16:57 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:54.303 23:16:57 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:54.303 23:16:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:54.303 23:16:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:54.303 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:54.303 23:16:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:54.303 23:16:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:54.303 23:16:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:54.303 23:16:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:54.303 23:16:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:54.303 23:16:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:54.303 23:16:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:54.303 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:54.303 23:16:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:54.303 23:16:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:54.303 23:16:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:54.303 23:16:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:54.303 23:16:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:54.303 23:16:57 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:54.303 23:16:57 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:54.303 23:16:57 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:54.303 23:16:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:54.303 23:16:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:54.303 23:16:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:54.303 23:16:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:54.303 23:16:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:54.303 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:54.303 23:16:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:54.303 23:16:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:54.303 23:16:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:54.303 23:16:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:54.303 23:16:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:54.303 23:16:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:54.303 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:54.303 23:16:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:54.303 23:16:57 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:54.303 23:16:57 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:54.303 23:16:57 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:54.303 23:16:57 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:54.303 23:16:57 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:54.303 23:16:57 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:54.303 23:16:57 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:54.303 23:16:57 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:54.303 23:16:57 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:54.303 23:16:57 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:54.303 23:16:57 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:54.303 23:16:57 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:54.303 23:16:57 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:54.303 23:16:57 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:54.303 23:16:57 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:54.303 23:16:57 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:54.303 23:16:57 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:54.303 23:16:57 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:54.303 23:16:57 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:54.303 23:16:57 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:54.303 23:16:57 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:54.303 23:16:57 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:54.303 23:16:57 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:54.303 23:16:57 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:54.303 23:16:57 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:54.303 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:54.303 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.219 ms 00:24:54.303 00:24:54.303 --- 10.0.0.2 ping statistics --- 00:24:54.303 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:54.303 rtt min/avg/max/mdev = 0.219/0.219/0.219/0.000 ms 00:24:54.303 23:16:57 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:54.303 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:54.303 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.053 ms 00:24:54.303 00:24:54.303 --- 10.0.0.1 ping statistics --- 00:24:54.303 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:54.303 rtt min/avg/max/mdev = 0.053/0.053/0.053/0.000 ms 00:24:54.303 23:16:57 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:54.303 23:16:57 -- nvmf/common.sh@410 -- # return 0 00:24:54.303 23:16:57 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:54.303 23:16:57 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:54.303 23:16:57 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:54.303 23:16:57 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:54.303 23:16:57 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:54.303 23:16:57 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:54.303 23:16:57 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:54.303 23:16:57 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:24:54.303 23:16:57 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:54.303 23:16:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:54.303 23:16:57 -- common/autotest_common.sh@10 -- # set +x 00:24:54.303 23:16:57 -- nvmf/common.sh@469 -- # nvmfpid=2517835 00:24:54.303 23:16:57 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:24:54.303 23:16:57 -- nvmf/common.sh@470 -- # waitforlisten 2517835 00:24:54.303 23:16:57 -- common/autotest_common.sh@829 -- # '[' -z 2517835 ']' 00:24:54.303 23:16:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:54.303 23:16:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:54.304 23:16:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:54.304 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:54.304 23:16:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:54.304 23:16:57 -- common/autotest_common.sh@10 -- # set +x 00:24:54.304 [2024-11-28 23:16:57.605010] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:24:54.304 [2024-11-28 23:16:57.605081] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:54.304 EAL: No free 2048 kB hugepages reported on node 1 00:24:54.304 [2024-11-28 23:16:57.677136] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:54.304 [2024-11-28 23:16:57.773482] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:54.304 [2024-11-28 23:16:57.773637] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:54.304 [2024-11-28 23:16:57.773657] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:54.304 [2024-11-28 23:16:57.773672] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:54.304 [2024-11-28 23:16:57.773750] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:54.304 [2024-11-28 23:16:57.773803] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:54.304 [2024-11-28 23:16:57.773836] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:54.304 [2024-11-28 23:16:57.773839] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:54.304 23:16:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:54.304 23:16:57 -- common/autotest_common.sh@862 -- # return 0 00:24:54.304 23:16:57 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:54.304 23:16:57 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:54.304 23:16:57 -- common/autotest_common.sh@10 -- # set +x 00:24:54.304 23:16:57 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:54.304 23:16:57 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:24:54.304 23:16:57 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:24:54.304 23:16:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:54.304 23:16:57 -- common/autotest_common.sh@10 -- # set +x 00:24:54.304 23:16:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:54.304 23:16:57 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:24:54.304 23:16:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:54.304 23:16:57 -- common/autotest_common.sh@10 -- # set +x 00:24:54.562 23:16:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:54.562 23:16:57 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:24:54.562 23:16:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:54.562 23:16:57 -- common/autotest_common.sh@10 -- # set +x 00:24:54.562 [2024-11-28 23:16:57.998934] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:54.562 23:16:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:54.562 23:16:58 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:24:54.562 23:16:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:54.562 23:16:58 -- common/autotest_common.sh@10 -- # set +x 00:24:54.562 Malloc1 00:24:54.562 23:16:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:54.562 23:16:58 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:54.562 23:16:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:54.562 23:16:58 -- common/autotest_common.sh@10 -- # set +x 00:24:54.562 23:16:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:54.562 23:16:58 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:24:54.562 23:16:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:54.562 23:16:58 -- common/autotest_common.sh@10 -- # set +x 00:24:54.562 23:16:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:54.562 23:16:58 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:54.562 23:16:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:54.562 23:16:58 -- common/autotest_common.sh@10 -- # set +x 00:24:54.562 [2024-11-28 23:16:58.049744] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:54.562 23:16:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:54.562 23:16:58 -- target/perf_adq.sh@73 -- # perfpid=2517984 00:24:54.562 23:16:58 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:24:54.562 23:16:58 -- target/perf_adq.sh@74 -- # sleep 2 00:24:54.562 EAL: No free 2048 kB hugepages reported on node 1 00:24:56.463 23:17:00 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:24:56.463 23:17:00 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:24:56.463 23:17:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:56.463 23:17:00 -- target/perf_adq.sh@76 -- # wc -l 00:24:56.463 23:17:00 -- common/autotest_common.sh@10 -- # set +x 00:24:56.721 23:17:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:56.721 23:17:00 -- target/perf_adq.sh@76 -- # count=4 00:24:56.721 23:17:00 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:24:56.721 23:17:00 -- target/perf_adq.sh@81 -- # wait 2517984 00:25:04.827 Initializing NVMe Controllers 00:25:04.827 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:04.827 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:25:04.827 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:25:04.827 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:25:04.827 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:25:04.827 Initialization complete. Launching workers. 00:25:04.827 ======================================================== 00:25:04.827 Latency(us) 00:25:04.827 Device Information : IOPS MiB/s Average min max 00:25:04.827 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 10964.80 42.83 5837.41 1518.12 9995.92 00:25:04.827 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 11218.00 43.82 5706.38 1948.01 9755.52 00:25:04.827 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 11605.80 45.34 5515.11 1375.58 9272.92 00:25:04.827 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 11233.90 43.88 5698.83 1339.43 9389.39 00:25:04.827 ======================================================== 00:25:04.827 Total : 45022.49 175.87 5687.10 1339.43 9995.92 00:25:04.827 00:25:04.827 23:17:08 -- target/perf_adq.sh@82 -- # nvmftestfini 00:25:04.827 23:17:08 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:04.827 23:17:08 -- nvmf/common.sh@116 -- # sync 00:25:04.827 23:17:08 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:04.827 23:17:08 -- nvmf/common.sh@119 -- # set +e 00:25:04.827 23:17:08 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:04.827 23:17:08 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:04.827 rmmod nvme_tcp 00:25:04.827 rmmod nvme_fabrics 00:25:04.827 rmmod nvme_keyring 00:25:04.827 23:17:08 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:04.827 23:17:08 -- nvmf/common.sh@123 -- # set -e 00:25:04.827 23:17:08 -- nvmf/common.sh@124 -- # return 0 00:25:04.827 23:17:08 -- nvmf/common.sh@477 -- # '[' -n 2517835 ']' 00:25:04.827 23:17:08 -- nvmf/common.sh@478 -- # killprocess 2517835 00:25:04.827 23:17:08 -- common/autotest_common.sh@936 -- # '[' -z 2517835 ']' 00:25:04.827 23:17:08 -- common/autotest_common.sh@940 -- # kill -0 2517835 00:25:04.827 23:17:08 -- common/autotest_common.sh@941 -- # uname 00:25:04.827 23:17:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:04.827 23:17:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2517835 00:25:04.827 23:17:08 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:04.827 23:17:08 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:04.827 23:17:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2517835' 00:25:04.827 killing process with pid 2517835 00:25:04.827 23:17:08 -- common/autotest_common.sh@955 -- # kill 2517835 00:25:04.827 23:17:08 -- common/autotest_common.sh@960 -- # wait 2517835 00:25:05.086 23:17:08 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:05.086 23:17:08 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:05.086 23:17:08 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:05.087 23:17:08 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:05.087 23:17:08 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:05.087 23:17:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:05.087 23:17:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:05.087 23:17:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:06.992 23:17:10 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:06.992 23:17:10 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:25:06.992 23:17:10 -- target/perf_adq.sh@52 -- # rmmod ice 00:25:07.926 23:17:11 -- target/perf_adq.sh@53 -- # modprobe ice 00:25:10.457 23:17:13 -- target/perf_adq.sh@54 -- # sleep 5 00:25:15.724 23:17:18 -- target/perf_adq.sh@87 -- # nvmftestinit 00:25:15.724 23:17:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:15.724 23:17:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:15.724 23:17:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:15.724 23:17:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:15.724 23:17:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:15.724 23:17:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:15.724 23:17:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:15.724 23:17:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:15.724 23:17:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:15.724 23:17:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:15.724 23:17:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:15.724 23:17:18 -- common/autotest_common.sh@10 -- # set +x 00:25:15.724 23:17:18 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:15.724 23:17:18 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:15.724 23:17:18 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:15.724 23:17:18 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:15.724 23:17:18 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:15.724 23:17:18 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:15.724 23:17:18 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:15.724 23:17:18 -- nvmf/common.sh@294 -- # net_devs=() 00:25:15.724 23:17:18 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:15.724 23:17:18 -- nvmf/common.sh@295 -- # e810=() 00:25:15.724 23:17:18 -- nvmf/common.sh@295 -- # local -ga e810 00:25:15.724 23:17:18 -- nvmf/common.sh@296 -- # x722=() 00:25:15.724 23:17:18 -- nvmf/common.sh@296 -- # local -ga x722 00:25:15.724 23:17:18 -- nvmf/common.sh@297 -- # mlx=() 00:25:15.724 23:17:18 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:15.724 23:17:18 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:15.724 23:17:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:15.724 23:17:18 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:15.724 23:17:18 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:15.724 23:17:18 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:15.724 23:17:18 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:15.724 23:17:18 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:15.724 23:17:18 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:15.724 23:17:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:15.724 23:17:18 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:15.724 23:17:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:15.724 23:17:18 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:15.724 23:17:18 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:15.724 23:17:18 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:15.724 23:17:18 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:15.724 23:17:18 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:15.724 23:17:18 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:15.724 23:17:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:15.724 23:17:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:15.724 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:15.724 23:17:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:15.724 23:17:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:15.724 23:17:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:15.724 23:17:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:15.724 23:17:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:15.724 23:17:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:15.724 23:17:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:15.724 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:15.724 23:17:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:15.724 23:17:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:15.724 23:17:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:15.724 23:17:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:15.724 23:17:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:15.724 23:17:18 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:15.724 23:17:18 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:15.724 23:17:18 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:15.724 23:17:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:15.724 23:17:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:15.724 23:17:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:15.724 23:17:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:15.724 23:17:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:15.724 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:15.724 23:17:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:15.724 23:17:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:15.724 23:17:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:15.724 23:17:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:15.724 23:17:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:15.724 23:17:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:15.724 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:15.724 23:17:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:15.724 23:17:18 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:15.724 23:17:18 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:15.724 23:17:18 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:15.724 23:17:18 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:15.724 23:17:18 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:15.724 23:17:18 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:15.724 23:17:18 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:15.724 23:17:18 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:15.724 23:17:18 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:15.724 23:17:18 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:15.724 23:17:18 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:15.724 23:17:18 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:15.724 23:17:18 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:15.724 23:17:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:15.724 23:17:18 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:15.724 23:17:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:15.724 23:17:18 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:15.724 23:17:18 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:15.724 23:17:18 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:15.724 23:17:18 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:15.724 23:17:18 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:15.724 23:17:18 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:15.724 23:17:18 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:15.724 23:17:18 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:15.724 23:17:18 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:15.724 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:15.724 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.321 ms 00:25:15.724 00:25:15.724 --- 10.0.0.2 ping statistics --- 00:25:15.724 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:15.724 rtt min/avg/max/mdev = 0.321/0.321/0.321/0.000 ms 00:25:15.724 23:17:18 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:15.725 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:15.725 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.111 ms 00:25:15.725 00:25:15.725 --- 10.0.0.1 ping statistics --- 00:25:15.725 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:15.725 rtt min/avg/max/mdev = 0.111/0.111/0.111/0.000 ms 00:25:15.725 23:17:18 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:15.725 23:17:18 -- nvmf/common.sh@410 -- # return 0 00:25:15.725 23:17:18 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:15.725 23:17:18 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:15.725 23:17:18 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:15.725 23:17:18 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:15.725 23:17:18 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:15.725 23:17:18 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:15.725 23:17:18 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:15.725 23:17:18 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:25:15.725 23:17:18 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:25:15.725 23:17:18 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:25:15.725 23:17:18 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:25:15.725 net.core.busy_poll = 1 00:25:15.725 23:17:18 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:25:15.725 net.core.busy_read = 1 00:25:15.725 23:17:18 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:25:15.725 23:17:18 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:25:15.725 23:17:18 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:25:15.725 23:17:18 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:25:15.725 23:17:18 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:25:15.725 23:17:18 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:25:15.725 23:17:18 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:15.725 23:17:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:15.725 23:17:18 -- common/autotest_common.sh@10 -- # set +x 00:25:15.725 23:17:18 -- nvmf/common.sh@469 -- # nvmfpid=2520679 00:25:15.725 23:17:18 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:25:15.725 23:17:18 -- nvmf/common.sh@470 -- # waitforlisten 2520679 00:25:15.725 23:17:18 -- common/autotest_common.sh@829 -- # '[' -z 2520679 ']' 00:25:15.725 23:17:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:15.725 23:17:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:15.725 23:17:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:15.725 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:15.725 23:17:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:15.725 23:17:18 -- common/autotest_common.sh@10 -- # set +x 00:25:15.725 [2024-11-28 23:17:18.900296] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:15.725 [2024-11-28 23:17:18.900388] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:15.725 EAL: No free 2048 kB hugepages reported on node 1 00:25:15.725 [2024-11-28 23:17:18.965018] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:15.725 [2024-11-28 23:17:19.049063] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:15.725 [2024-11-28 23:17:19.049227] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:15.725 [2024-11-28 23:17:19.049244] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:15.725 [2024-11-28 23:17:19.049256] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:15.725 [2024-11-28 23:17:19.049310] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:15.725 [2024-11-28 23:17:19.049370] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:15.725 [2024-11-28 23:17:19.049436] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:15.725 [2024-11-28 23:17:19.049439] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:15.725 23:17:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:15.725 23:17:19 -- common/autotest_common.sh@862 -- # return 0 00:25:15.725 23:17:19 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:15.725 23:17:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:15.725 23:17:19 -- common/autotest_common.sh@10 -- # set +x 00:25:15.725 23:17:19 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:15.725 23:17:19 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:25:15.725 23:17:19 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:25:15.725 23:17:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:15.725 23:17:19 -- common/autotest_common.sh@10 -- # set +x 00:25:15.725 23:17:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:15.725 23:17:19 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:25:15.725 23:17:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:15.725 23:17:19 -- common/autotest_common.sh@10 -- # set +x 00:25:15.725 23:17:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:15.725 23:17:19 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:25:15.725 23:17:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:15.725 23:17:19 -- common/autotest_common.sh@10 -- # set +x 00:25:15.725 [2024-11-28 23:17:19.265299] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:15.725 23:17:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:15.725 23:17:19 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:25:15.725 23:17:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:15.725 23:17:19 -- common/autotest_common.sh@10 -- # set +x 00:25:15.725 Malloc1 00:25:15.725 23:17:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:15.725 23:17:19 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:15.725 23:17:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:15.725 23:17:19 -- common/autotest_common.sh@10 -- # set +x 00:25:15.725 23:17:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:15.725 23:17:19 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:25:15.725 23:17:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:15.725 23:17:19 -- common/autotest_common.sh@10 -- # set +x 00:25:15.725 23:17:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:15.725 23:17:19 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:15.725 23:17:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:15.725 23:17:19 -- common/autotest_common.sh@10 -- # set +x 00:25:15.725 [2024-11-28 23:17:19.317235] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:15.725 23:17:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:15.725 23:17:19 -- target/perf_adq.sh@94 -- # perfpid=2520731 00:25:15.725 23:17:19 -- target/perf_adq.sh@95 -- # sleep 2 00:25:15.725 23:17:19 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:25:15.983 EAL: No free 2048 kB hugepages reported on node 1 00:25:17.883 23:17:21 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:25:17.883 23:17:21 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:25:17.883 23:17:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:17.883 23:17:21 -- target/perf_adq.sh@97 -- # wc -l 00:25:17.883 23:17:21 -- common/autotest_common.sh@10 -- # set +x 00:25:17.883 23:17:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:17.883 23:17:21 -- target/perf_adq.sh@97 -- # count=2 00:25:17.883 23:17:21 -- target/perf_adq.sh@98 -- # [[ 2 -lt 2 ]] 00:25:17.883 23:17:21 -- target/perf_adq.sh@103 -- # wait 2520731 00:25:25.995 Initializing NVMe Controllers 00:25:25.995 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:25.995 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:25:25.995 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:25:25.995 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:25:25.995 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:25:25.995 Initialization complete. Launching workers. 00:25:25.995 ======================================================== 00:25:25.995 Latency(us) 00:25:25.995 Device Information : IOPS MiB/s Average min max 00:25:25.995 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 14435.94 56.39 4433.48 2104.90 6746.91 00:25:25.995 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 5138.61 20.07 12500.46 1696.46 58591.99 00:25:25.995 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 5229.01 20.43 12242.47 1829.20 59551.48 00:25:25.995 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 4722.52 18.45 13557.63 1053.04 59512.48 00:25:25.995 ======================================================== 00:25:25.995 Total : 29526.07 115.34 8679.73 1053.04 59551.48 00:25:25.995 00:25:25.995 23:17:29 -- target/perf_adq.sh@104 -- # nvmftestfini 00:25:25.995 23:17:29 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:25.995 23:17:29 -- nvmf/common.sh@116 -- # sync 00:25:25.995 23:17:29 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:25.995 23:17:29 -- nvmf/common.sh@119 -- # set +e 00:25:25.995 23:17:29 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:25.995 23:17:29 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:25.995 rmmod nvme_tcp 00:25:25.995 rmmod nvme_fabrics 00:25:25.995 rmmod nvme_keyring 00:25:25.995 23:17:29 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:25.995 23:17:29 -- nvmf/common.sh@123 -- # set -e 00:25:25.995 23:17:29 -- nvmf/common.sh@124 -- # return 0 00:25:25.995 23:17:29 -- nvmf/common.sh@477 -- # '[' -n 2520679 ']' 00:25:25.995 23:17:29 -- nvmf/common.sh@478 -- # killprocess 2520679 00:25:25.995 23:17:29 -- common/autotest_common.sh@936 -- # '[' -z 2520679 ']' 00:25:25.995 23:17:29 -- common/autotest_common.sh@940 -- # kill -0 2520679 00:25:25.995 23:17:29 -- common/autotest_common.sh@941 -- # uname 00:25:25.995 23:17:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:25.995 23:17:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2520679 00:25:26.254 23:17:29 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:26.254 23:17:29 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:26.254 23:17:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2520679' 00:25:26.254 killing process with pid 2520679 00:25:26.254 23:17:29 -- common/autotest_common.sh@955 -- # kill 2520679 00:25:26.254 23:17:29 -- common/autotest_common.sh@960 -- # wait 2520679 00:25:26.513 23:17:29 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:26.513 23:17:29 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:26.513 23:17:29 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:26.513 23:17:29 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:26.513 23:17:29 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:26.513 23:17:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:26.513 23:17:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:26.513 23:17:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:28.415 23:17:31 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:28.415 23:17:31 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:25:28.415 00:25:28.415 real 0m44.947s 00:25:28.415 user 2m40.209s 00:25:28.415 sys 0m9.211s 00:25:28.415 23:17:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:28.415 23:17:31 -- common/autotest_common.sh@10 -- # set +x 00:25:28.415 ************************************ 00:25:28.415 END TEST nvmf_perf_adq 00:25:28.415 ************************************ 00:25:28.415 23:17:31 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:25:28.415 23:17:31 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:28.415 23:17:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:28.415 23:17:31 -- common/autotest_common.sh@10 -- # set +x 00:25:28.415 ************************************ 00:25:28.415 START TEST nvmf_shutdown 00:25:28.415 ************************************ 00:25:28.415 23:17:31 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:25:28.415 * Looking for test storage... 00:25:28.415 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:25:28.415 23:17:31 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:28.415 23:17:31 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:28.415 23:17:31 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:28.674 23:17:32 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:28.674 23:17:32 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:28.674 23:17:32 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:28.674 23:17:32 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:28.674 23:17:32 -- scripts/common.sh@335 -- # IFS=.-: 00:25:28.674 23:17:32 -- scripts/common.sh@335 -- # read -ra ver1 00:25:28.674 23:17:32 -- scripts/common.sh@336 -- # IFS=.-: 00:25:28.674 23:17:32 -- scripts/common.sh@336 -- # read -ra ver2 00:25:28.674 23:17:32 -- scripts/common.sh@337 -- # local 'op=<' 00:25:28.674 23:17:32 -- scripts/common.sh@339 -- # ver1_l=2 00:25:28.674 23:17:32 -- scripts/common.sh@340 -- # ver2_l=1 00:25:28.674 23:17:32 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:28.674 23:17:32 -- scripts/common.sh@343 -- # case "$op" in 00:25:28.674 23:17:32 -- scripts/common.sh@344 -- # : 1 00:25:28.674 23:17:32 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:28.674 23:17:32 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:28.674 23:17:32 -- scripts/common.sh@364 -- # decimal 1 00:25:28.674 23:17:32 -- scripts/common.sh@352 -- # local d=1 00:25:28.674 23:17:32 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:28.674 23:17:32 -- scripts/common.sh@354 -- # echo 1 00:25:28.674 23:17:32 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:28.674 23:17:32 -- scripts/common.sh@365 -- # decimal 2 00:25:28.674 23:17:32 -- scripts/common.sh@352 -- # local d=2 00:25:28.674 23:17:32 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:28.674 23:17:32 -- scripts/common.sh@354 -- # echo 2 00:25:28.674 23:17:32 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:28.674 23:17:32 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:28.674 23:17:32 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:28.674 23:17:32 -- scripts/common.sh@367 -- # return 0 00:25:28.674 23:17:32 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:28.674 23:17:32 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:28.674 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:28.674 --rc genhtml_branch_coverage=1 00:25:28.674 --rc genhtml_function_coverage=1 00:25:28.674 --rc genhtml_legend=1 00:25:28.674 --rc geninfo_all_blocks=1 00:25:28.674 --rc geninfo_unexecuted_blocks=1 00:25:28.674 00:25:28.674 ' 00:25:28.674 23:17:32 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:28.674 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:28.674 --rc genhtml_branch_coverage=1 00:25:28.674 --rc genhtml_function_coverage=1 00:25:28.674 --rc genhtml_legend=1 00:25:28.674 --rc geninfo_all_blocks=1 00:25:28.674 --rc geninfo_unexecuted_blocks=1 00:25:28.674 00:25:28.674 ' 00:25:28.674 23:17:32 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:28.674 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:28.674 --rc genhtml_branch_coverage=1 00:25:28.674 --rc genhtml_function_coverage=1 00:25:28.674 --rc genhtml_legend=1 00:25:28.674 --rc geninfo_all_blocks=1 00:25:28.674 --rc geninfo_unexecuted_blocks=1 00:25:28.674 00:25:28.674 ' 00:25:28.674 23:17:32 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:28.674 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:28.674 --rc genhtml_branch_coverage=1 00:25:28.674 --rc genhtml_function_coverage=1 00:25:28.674 --rc genhtml_legend=1 00:25:28.674 --rc geninfo_all_blocks=1 00:25:28.674 --rc geninfo_unexecuted_blocks=1 00:25:28.674 00:25:28.674 ' 00:25:28.674 23:17:32 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:28.674 23:17:32 -- nvmf/common.sh@7 -- # uname -s 00:25:28.674 23:17:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:28.674 23:17:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:28.674 23:17:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:28.674 23:17:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:28.674 23:17:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:28.674 23:17:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:28.674 23:17:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:28.674 23:17:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:28.674 23:17:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:28.674 23:17:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:28.674 23:17:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:28.674 23:17:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:28.674 23:17:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:28.674 23:17:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:28.674 23:17:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:28.674 23:17:32 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:28.674 23:17:32 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:28.674 23:17:32 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:28.674 23:17:32 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:28.674 23:17:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:28.674 23:17:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:28.675 23:17:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:28.675 23:17:32 -- paths/export.sh@5 -- # export PATH 00:25:28.675 23:17:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:28.675 23:17:32 -- nvmf/common.sh@46 -- # : 0 00:25:28.675 23:17:32 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:28.675 23:17:32 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:28.675 23:17:32 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:28.675 23:17:32 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:28.675 23:17:32 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:28.675 23:17:32 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:28.675 23:17:32 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:28.675 23:17:32 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:28.675 23:17:32 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:28.675 23:17:32 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:28.675 23:17:32 -- target/shutdown.sh@146 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:25:28.675 23:17:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:25:28.675 23:17:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:28.675 23:17:32 -- common/autotest_common.sh@10 -- # set +x 00:25:28.675 ************************************ 00:25:28.675 START TEST nvmf_shutdown_tc1 00:25:28.675 ************************************ 00:25:28.675 23:17:32 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc1 00:25:28.675 23:17:32 -- target/shutdown.sh@74 -- # starttarget 00:25:28.675 23:17:32 -- target/shutdown.sh@15 -- # nvmftestinit 00:25:28.675 23:17:32 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:28.675 23:17:32 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:28.675 23:17:32 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:28.675 23:17:32 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:28.675 23:17:32 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:28.675 23:17:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:28.675 23:17:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:28.675 23:17:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:28.675 23:17:32 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:28.675 23:17:32 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:28.675 23:17:32 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:28.675 23:17:32 -- common/autotest_common.sh@10 -- # set +x 00:25:30.578 23:17:34 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:30.578 23:17:34 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:30.578 23:17:34 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:30.578 23:17:34 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:30.578 23:17:34 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:30.578 23:17:34 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:30.578 23:17:34 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:30.578 23:17:34 -- nvmf/common.sh@294 -- # net_devs=() 00:25:30.578 23:17:34 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:30.578 23:17:34 -- nvmf/common.sh@295 -- # e810=() 00:25:30.578 23:17:34 -- nvmf/common.sh@295 -- # local -ga e810 00:25:30.578 23:17:34 -- nvmf/common.sh@296 -- # x722=() 00:25:30.578 23:17:34 -- nvmf/common.sh@296 -- # local -ga x722 00:25:30.578 23:17:34 -- nvmf/common.sh@297 -- # mlx=() 00:25:30.578 23:17:34 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:30.578 23:17:34 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:30.578 23:17:34 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:30.578 23:17:34 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:30.578 23:17:34 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:30.578 23:17:34 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:30.578 23:17:34 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:30.578 23:17:34 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:30.578 23:17:34 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:30.578 23:17:34 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:30.578 23:17:34 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:30.578 23:17:34 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:30.578 23:17:34 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:30.578 23:17:34 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:30.578 23:17:34 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:30.578 23:17:34 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:30.578 23:17:34 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:30.578 23:17:34 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:30.578 23:17:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:30.578 23:17:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:30.578 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:30.578 23:17:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:30.578 23:17:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:30.578 23:17:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:30.578 23:17:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:30.578 23:17:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:30.578 23:17:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:30.578 23:17:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:30.578 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:30.578 23:17:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:30.578 23:17:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:30.578 23:17:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:30.578 23:17:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:30.578 23:17:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:30.578 23:17:34 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:30.578 23:17:34 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:30.578 23:17:34 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:30.578 23:17:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:30.578 23:17:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:30.578 23:17:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:30.578 23:17:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:30.578 23:17:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:30.578 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:30.578 23:17:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:30.578 23:17:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:30.578 23:17:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:30.578 23:17:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:30.578 23:17:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:30.578 23:17:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:30.578 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:30.578 23:17:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:30.578 23:17:34 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:30.578 23:17:34 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:30.578 23:17:34 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:30.578 23:17:34 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:30.578 23:17:34 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:30.578 23:17:34 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:30.578 23:17:34 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:30.578 23:17:34 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:30.578 23:17:34 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:30.578 23:17:34 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:30.579 23:17:34 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:30.579 23:17:34 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:30.579 23:17:34 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:30.579 23:17:34 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:30.579 23:17:34 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:30.579 23:17:34 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:30.579 23:17:34 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:30.836 23:17:34 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:30.836 23:17:34 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:30.836 23:17:34 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:30.836 23:17:34 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:30.836 23:17:34 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:30.836 23:17:34 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:30.836 23:17:34 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:30.836 23:17:34 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:30.836 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:30.836 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.319 ms 00:25:30.836 00:25:30.836 --- 10.0.0.2 ping statistics --- 00:25:30.836 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:30.836 rtt min/avg/max/mdev = 0.319/0.319/0.319/0.000 ms 00:25:30.836 23:17:34 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:30.836 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:30.836 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.088 ms 00:25:30.836 00:25:30.836 --- 10.0.0.1 ping statistics --- 00:25:30.836 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:30.836 rtt min/avg/max/mdev = 0.088/0.088/0.088/0.000 ms 00:25:30.836 23:17:34 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:30.836 23:17:34 -- nvmf/common.sh@410 -- # return 0 00:25:30.836 23:17:34 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:30.836 23:17:34 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:30.836 23:17:34 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:30.836 23:17:34 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:30.836 23:17:34 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:30.836 23:17:34 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:30.836 23:17:34 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:30.836 23:17:34 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:25:30.836 23:17:34 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:30.836 23:17:34 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:30.836 23:17:34 -- common/autotest_common.sh@10 -- # set +x 00:25:30.836 23:17:34 -- nvmf/common.sh@469 -- # nvmfpid=2524036 00:25:30.836 23:17:34 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:25:30.836 23:17:34 -- nvmf/common.sh@470 -- # waitforlisten 2524036 00:25:30.836 23:17:34 -- common/autotest_common.sh@829 -- # '[' -z 2524036 ']' 00:25:30.836 23:17:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:30.836 23:17:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:30.836 23:17:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:30.836 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:30.836 23:17:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:30.836 23:17:34 -- common/autotest_common.sh@10 -- # set +x 00:25:31.094 [2024-11-28 23:17:34.456100] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:31.094 [2024-11-28 23:17:34.456182] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:31.094 EAL: No free 2048 kB hugepages reported on node 1 00:25:31.094 [2024-11-28 23:17:34.524586] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:31.094 [2024-11-28 23:17:34.615178] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:31.094 [2024-11-28 23:17:34.615324] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:31.094 [2024-11-28 23:17:34.615342] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:31.094 [2024-11-28 23:17:34.615355] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:31.094 [2024-11-28 23:17:34.615435] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:31.094 [2024-11-28 23:17:34.615499] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:31.094 [2024-11-28 23:17:34.615531] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:31.094 [2024-11-28 23:17:34.615534] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:32.044 23:17:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:32.044 23:17:35 -- common/autotest_common.sh@862 -- # return 0 00:25:32.044 23:17:35 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:32.044 23:17:35 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:32.044 23:17:35 -- common/autotest_common.sh@10 -- # set +x 00:25:32.044 23:17:35 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:32.044 23:17:35 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:32.044 23:17:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:32.044 23:17:35 -- common/autotest_common.sh@10 -- # set +x 00:25:32.044 [2024-11-28 23:17:35.512235] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:32.044 23:17:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:32.044 23:17:35 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:25:32.044 23:17:35 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:25:32.044 23:17:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:32.044 23:17:35 -- common/autotest_common.sh@10 -- # set +x 00:25:32.044 23:17:35 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:32.044 23:17:35 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:32.044 23:17:35 -- target/shutdown.sh@28 -- # cat 00:25:32.044 23:17:35 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:32.044 23:17:35 -- target/shutdown.sh@28 -- # cat 00:25:32.044 23:17:35 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:32.044 23:17:35 -- target/shutdown.sh@28 -- # cat 00:25:32.044 23:17:35 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:32.044 23:17:35 -- target/shutdown.sh@28 -- # cat 00:25:32.044 23:17:35 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:32.044 23:17:35 -- target/shutdown.sh@28 -- # cat 00:25:32.044 23:17:35 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:32.044 23:17:35 -- target/shutdown.sh@28 -- # cat 00:25:32.044 23:17:35 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:32.044 23:17:35 -- target/shutdown.sh@28 -- # cat 00:25:32.044 23:17:35 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:32.044 23:17:35 -- target/shutdown.sh@28 -- # cat 00:25:32.044 23:17:35 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:32.044 23:17:35 -- target/shutdown.sh@28 -- # cat 00:25:32.044 23:17:35 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:32.044 23:17:35 -- target/shutdown.sh@28 -- # cat 00:25:32.044 23:17:35 -- target/shutdown.sh@35 -- # rpc_cmd 00:25:32.044 23:17:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:32.044 23:17:35 -- common/autotest_common.sh@10 -- # set +x 00:25:32.044 Malloc1 00:25:32.044 [2024-11-28 23:17:35.592441] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:32.044 Malloc2 00:25:32.307 Malloc3 00:25:32.307 Malloc4 00:25:32.307 Malloc5 00:25:32.307 Malloc6 00:25:32.307 Malloc7 00:25:32.307 Malloc8 00:25:32.567 Malloc9 00:25:32.567 Malloc10 00:25:32.567 23:17:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:32.567 23:17:36 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:25:32.567 23:17:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:32.567 23:17:36 -- common/autotest_common.sh@10 -- # set +x 00:25:32.567 23:17:36 -- target/shutdown.sh@78 -- # perfpid=2524233 00:25:32.567 23:17:36 -- target/shutdown.sh@79 -- # waitforlisten 2524233 /var/tmp/bdevperf.sock 00:25:32.567 23:17:36 -- common/autotest_common.sh@829 -- # '[' -z 2524233 ']' 00:25:32.567 23:17:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:32.567 23:17:36 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:32.567 23:17:36 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:25:32.567 23:17:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:32.567 23:17:36 -- nvmf/common.sh@520 -- # config=() 00:25:32.567 23:17:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:32.567 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:32.567 23:17:36 -- nvmf/common.sh@520 -- # local subsystem config 00:25:32.567 23:17:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:32.567 23:17:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:32.567 23:17:36 -- common/autotest_common.sh@10 -- # set +x 00:25:32.567 23:17:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:32.567 { 00:25:32.567 "params": { 00:25:32.567 "name": "Nvme$subsystem", 00:25:32.567 "trtype": "$TEST_TRANSPORT", 00:25:32.567 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:32.567 "adrfam": "ipv4", 00:25:32.567 "trsvcid": "$NVMF_PORT", 00:25:32.567 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:32.567 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:32.567 "hdgst": ${hdgst:-false}, 00:25:32.567 "ddgst": ${ddgst:-false} 00:25:32.567 }, 00:25:32.567 "method": "bdev_nvme_attach_controller" 00:25:32.567 } 00:25:32.567 EOF 00:25:32.567 )") 00:25:32.567 23:17:36 -- nvmf/common.sh@542 -- # cat 00:25:32.567 23:17:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:32.567 23:17:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:32.567 { 00:25:32.567 "params": { 00:25:32.567 "name": "Nvme$subsystem", 00:25:32.567 "trtype": "$TEST_TRANSPORT", 00:25:32.567 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:32.567 "adrfam": "ipv4", 00:25:32.567 "trsvcid": "$NVMF_PORT", 00:25:32.567 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:32.567 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:32.567 "hdgst": ${hdgst:-false}, 00:25:32.567 "ddgst": ${ddgst:-false} 00:25:32.567 }, 00:25:32.567 "method": "bdev_nvme_attach_controller" 00:25:32.567 } 00:25:32.567 EOF 00:25:32.567 )") 00:25:32.567 23:17:36 -- nvmf/common.sh@542 -- # cat 00:25:32.567 23:17:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:32.567 23:17:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:32.567 { 00:25:32.567 "params": { 00:25:32.567 "name": "Nvme$subsystem", 00:25:32.567 "trtype": "$TEST_TRANSPORT", 00:25:32.567 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:32.567 "adrfam": "ipv4", 00:25:32.567 "trsvcid": "$NVMF_PORT", 00:25:32.567 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:32.567 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:32.567 "hdgst": ${hdgst:-false}, 00:25:32.567 "ddgst": ${ddgst:-false} 00:25:32.567 }, 00:25:32.567 "method": "bdev_nvme_attach_controller" 00:25:32.567 } 00:25:32.567 EOF 00:25:32.567 )") 00:25:32.567 23:17:36 -- nvmf/common.sh@542 -- # cat 00:25:32.567 23:17:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:32.567 23:17:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:32.567 { 00:25:32.567 "params": { 00:25:32.567 "name": "Nvme$subsystem", 00:25:32.567 "trtype": "$TEST_TRANSPORT", 00:25:32.567 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:32.567 "adrfam": "ipv4", 00:25:32.567 "trsvcid": "$NVMF_PORT", 00:25:32.567 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:32.567 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:32.567 "hdgst": ${hdgst:-false}, 00:25:32.567 "ddgst": ${ddgst:-false} 00:25:32.567 }, 00:25:32.567 "method": "bdev_nvme_attach_controller" 00:25:32.567 } 00:25:32.567 EOF 00:25:32.567 )") 00:25:32.567 23:17:36 -- nvmf/common.sh@542 -- # cat 00:25:32.567 23:17:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:32.567 23:17:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:32.567 { 00:25:32.567 "params": { 00:25:32.567 "name": "Nvme$subsystem", 00:25:32.567 "trtype": "$TEST_TRANSPORT", 00:25:32.567 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:32.567 "adrfam": "ipv4", 00:25:32.567 "trsvcid": "$NVMF_PORT", 00:25:32.567 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:32.567 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:32.567 "hdgst": ${hdgst:-false}, 00:25:32.567 "ddgst": ${ddgst:-false} 00:25:32.567 }, 00:25:32.567 "method": "bdev_nvme_attach_controller" 00:25:32.567 } 00:25:32.567 EOF 00:25:32.567 )") 00:25:32.567 23:17:36 -- nvmf/common.sh@542 -- # cat 00:25:32.567 23:17:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:32.567 23:17:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:32.567 { 00:25:32.567 "params": { 00:25:32.567 "name": "Nvme$subsystem", 00:25:32.567 "trtype": "$TEST_TRANSPORT", 00:25:32.567 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:32.567 "adrfam": "ipv4", 00:25:32.567 "trsvcid": "$NVMF_PORT", 00:25:32.567 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:32.567 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:32.567 "hdgst": ${hdgst:-false}, 00:25:32.567 "ddgst": ${ddgst:-false} 00:25:32.567 }, 00:25:32.567 "method": "bdev_nvme_attach_controller" 00:25:32.567 } 00:25:32.567 EOF 00:25:32.567 )") 00:25:32.567 23:17:36 -- nvmf/common.sh@542 -- # cat 00:25:32.567 23:17:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:32.567 23:17:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:32.567 { 00:25:32.567 "params": { 00:25:32.567 "name": "Nvme$subsystem", 00:25:32.567 "trtype": "$TEST_TRANSPORT", 00:25:32.567 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:32.567 "adrfam": "ipv4", 00:25:32.567 "trsvcid": "$NVMF_PORT", 00:25:32.567 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:32.567 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:32.567 "hdgst": ${hdgst:-false}, 00:25:32.567 "ddgst": ${ddgst:-false} 00:25:32.567 }, 00:25:32.567 "method": "bdev_nvme_attach_controller" 00:25:32.567 } 00:25:32.567 EOF 00:25:32.567 )") 00:25:32.567 23:17:36 -- nvmf/common.sh@542 -- # cat 00:25:32.567 23:17:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:32.567 23:17:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:32.567 { 00:25:32.567 "params": { 00:25:32.567 "name": "Nvme$subsystem", 00:25:32.567 "trtype": "$TEST_TRANSPORT", 00:25:32.567 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:32.567 "adrfam": "ipv4", 00:25:32.567 "trsvcid": "$NVMF_PORT", 00:25:32.567 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:32.567 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:32.567 "hdgst": ${hdgst:-false}, 00:25:32.567 "ddgst": ${ddgst:-false} 00:25:32.567 }, 00:25:32.567 "method": "bdev_nvme_attach_controller" 00:25:32.567 } 00:25:32.567 EOF 00:25:32.567 )") 00:25:32.568 23:17:36 -- nvmf/common.sh@542 -- # cat 00:25:32.568 23:17:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:32.568 23:17:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:32.568 { 00:25:32.568 "params": { 00:25:32.568 "name": "Nvme$subsystem", 00:25:32.568 "trtype": "$TEST_TRANSPORT", 00:25:32.568 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:32.568 "adrfam": "ipv4", 00:25:32.568 "trsvcid": "$NVMF_PORT", 00:25:32.568 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:32.568 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:32.568 "hdgst": ${hdgst:-false}, 00:25:32.568 "ddgst": ${ddgst:-false} 00:25:32.568 }, 00:25:32.568 "method": "bdev_nvme_attach_controller" 00:25:32.568 } 00:25:32.568 EOF 00:25:32.568 )") 00:25:32.568 23:17:36 -- nvmf/common.sh@542 -- # cat 00:25:32.568 23:17:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:32.568 23:17:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:32.568 { 00:25:32.568 "params": { 00:25:32.568 "name": "Nvme$subsystem", 00:25:32.568 "trtype": "$TEST_TRANSPORT", 00:25:32.568 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:32.568 "adrfam": "ipv4", 00:25:32.568 "trsvcid": "$NVMF_PORT", 00:25:32.568 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:32.568 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:32.568 "hdgst": ${hdgst:-false}, 00:25:32.568 "ddgst": ${ddgst:-false} 00:25:32.568 }, 00:25:32.568 "method": "bdev_nvme_attach_controller" 00:25:32.568 } 00:25:32.568 EOF 00:25:32.568 )") 00:25:32.568 23:17:36 -- nvmf/common.sh@542 -- # cat 00:25:32.568 23:17:36 -- nvmf/common.sh@544 -- # jq . 00:25:32.568 23:17:36 -- nvmf/common.sh@545 -- # IFS=, 00:25:32.568 23:17:36 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:32.568 "params": { 00:25:32.568 "name": "Nvme1", 00:25:32.568 "trtype": "tcp", 00:25:32.568 "traddr": "10.0.0.2", 00:25:32.568 "adrfam": "ipv4", 00:25:32.568 "trsvcid": "4420", 00:25:32.568 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:32.568 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:32.568 "hdgst": false, 00:25:32.568 "ddgst": false 00:25:32.568 }, 00:25:32.568 "method": "bdev_nvme_attach_controller" 00:25:32.568 },{ 00:25:32.568 "params": { 00:25:32.568 "name": "Nvme2", 00:25:32.568 "trtype": "tcp", 00:25:32.568 "traddr": "10.0.0.2", 00:25:32.568 "adrfam": "ipv4", 00:25:32.568 "trsvcid": "4420", 00:25:32.568 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:32.568 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:32.568 "hdgst": false, 00:25:32.568 "ddgst": false 00:25:32.568 }, 00:25:32.568 "method": "bdev_nvme_attach_controller" 00:25:32.568 },{ 00:25:32.568 "params": { 00:25:32.568 "name": "Nvme3", 00:25:32.568 "trtype": "tcp", 00:25:32.568 "traddr": "10.0.0.2", 00:25:32.568 "adrfam": "ipv4", 00:25:32.568 "trsvcid": "4420", 00:25:32.568 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:32.568 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:32.568 "hdgst": false, 00:25:32.568 "ddgst": false 00:25:32.568 }, 00:25:32.568 "method": "bdev_nvme_attach_controller" 00:25:32.568 },{ 00:25:32.568 "params": { 00:25:32.568 "name": "Nvme4", 00:25:32.568 "trtype": "tcp", 00:25:32.568 "traddr": "10.0.0.2", 00:25:32.568 "adrfam": "ipv4", 00:25:32.568 "trsvcid": "4420", 00:25:32.568 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:32.568 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:32.568 "hdgst": false, 00:25:32.568 "ddgst": false 00:25:32.568 }, 00:25:32.568 "method": "bdev_nvme_attach_controller" 00:25:32.568 },{ 00:25:32.568 "params": { 00:25:32.568 "name": "Nvme5", 00:25:32.568 "trtype": "tcp", 00:25:32.568 "traddr": "10.0.0.2", 00:25:32.568 "adrfam": "ipv4", 00:25:32.568 "trsvcid": "4420", 00:25:32.568 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:32.568 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:32.568 "hdgst": false, 00:25:32.568 "ddgst": false 00:25:32.568 }, 00:25:32.568 "method": "bdev_nvme_attach_controller" 00:25:32.568 },{ 00:25:32.568 "params": { 00:25:32.568 "name": "Nvme6", 00:25:32.568 "trtype": "tcp", 00:25:32.568 "traddr": "10.0.0.2", 00:25:32.568 "adrfam": "ipv4", 00:25:32.568 "trsvcid": "4420", 00:25:32.568 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:32.568 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:32.568 "hdgst": false, 00:25:32.568 "ddgst": false 00:25:32.568 }, 00:25:32.568 "method": "bdev_nvme_attach_controller" 00:25:32.568 },{ 00:25:32.568 "params": { 00:25:32.568 "name": "Nvme7", 00:25:32.568 "trtype": "tcp", 00:25:32.568 "traddr": "10.0.0.2", 00:25:32.568 "adrfam": "ipv4", 00:25:32.568 "trsvcid": "4420", 00:25:32.568 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:32.568 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:32.568 "hdgst": false, 00:25:32.568 "ddgst": false 00:25:32.568 }, 00:25:32.568 "method": "bdev_nvme_attach_controller" 00:25:32.568 },{ 00:25:32.568 "params": { 00:25:32.568 "name": "Nvme8", 00:25:32.568 "trtype": "tcp", 00:25:32.568 "traddr": "10.0.0.2", 00:25:32.568 "adrfam": "ipv4", 00:25:32.568 "trsvcid": "4420", 00:25:32.568 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:32.568 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:32.568 "hdgst": false, 00:25:32.568 "ddgst": false 00:25:32.568 }, 00:25:32.568 "method": "bdev_nvme_attach_controller" 00:25:32.568 },{ 00:25:32.568 "params": { 00:25:32.568 "name": "Nvme9", 00:25:32.568 "trtype": "tcp", 00:25:32.568 "traddr": "10.0.0.2", 00:25:32.568 "adrfam": "ipv4", 00:25:32.568 "trsvcid": "4420", 00:25:32.568 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:32.568 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:32.568 "hdgst": false, 00:25:32.568 "ddgst": false 00:25:32.568 }, 00:25:32.568 "method": "bdev_nvme_attach_controller" 00:25:32.568 },{ 00:25:32.568 "params": { 00:25:32.568 "name": "Nvme10", 00:25:32.568 "trtype": "tcp", 00:25:32.568 "traddr": "10.0.0.2", 00:25:32.568 "adrfam": "ipv4", 00:25:32.568 "trsvcid": "4420", 00:25:32.568 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:32.568 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:32.568 "hdgst": false, 00:25:32.568 "ddgst": false 00:25:32.568 }, 00:25:32.568 "method": "bdev_nvme_attach_controller" 00:25:32.568 }' 00:25:32.568 [2024-11-28 23:17:36.084910] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:32.568 [2024-11-28 23:17:36.085003] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:25:32.568 EAL: No free 2048 kB hugepages reported on node 1 00:25:32.568 [2024-11-28 23:17:36.150175] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:32.827 [2024-11-28 23:17:36.235903] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:34.201 23:17:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:34.201 23:17:37 -- common/autotest_common.sh@862 -- # return 0 00:25:34.201 23:17:37 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:25:34.201 23:17:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:34.201 23:17:37 -- common/autotest_common.sh@10 -- # set +x 00:25:34.201 23:17:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:34.201 23:17:37 -- target/shutdown.sh@83 -- # kill -9 2524233 00:25:34.201 23:17:37 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:25:34.201 23:17:37 -- target/shutdown.sh@87 -- # sleep 1 00:25:35.577 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 2524233 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:25:35.577 23:17:38 -- target/shutdown.sh@88 -- # kill -0 2524036 00:25:35.577 23:17:38 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:25:35.577 23:17:38 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:35.577 23:17:38 -- nvmf/common.sh@520 -- # config=() 00:25:35.577 23:17:38 -- nvmf/common.sh@520 -- # local subsystem config 00:25:35.577 23:17:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:35.577 23:17:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:35.577 { 00:25:35.577 "params": { 00:25:35.577 "name": "Nvme$subsystem", 00:25:35.577 "trtype": "$TEST_TRANSPORT", 00:25:35.577 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:35.577 "adrfam": "ipv4", 00:25:35.577 "trsvcid": "$NVMF_PORT", 00:25:35.577 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:35.577 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:35.577 "hdgst": ${hdgst:-false}, 00:25:35.577 "ddgst": ${ddgst:-false} 00:25:35.577 }, 00:25:35.577 "method": "bdev_nvme_attach_controller" 00:25:35.577 } 00:25:35.577 EOF 00:25:35.577 )") 00:25:35.577 23:17:38 -- nvmf/common.sh@542 -- # cat 00:25:35.577 23:17:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:35.577 23:17:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:35.577 { 00:25:35.577 "params": { 00:25:35.577 "name": "Nvme$subsystem", 00:25:35.577 "trtype": "$TEST_TRANSPORT", 00:25:35.577 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:35.577 "adrfam": "ipv4", 00:25:35.577 "trsvcid": "$NVMF_PORT", 00:25:35.577 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:35.577 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:35.577 "hdgst": ${hdgst:-false}, 00:25:35.577 "ddgst": ${ddgst:-false} 00:25:35.577 }, 00:25:35.577 "method": "bdev_nvme_attach_controller" 00:25:35.577 } 00:25:35.577 EOF 00:25:35.577 )") 00:25:35.577 23:17:38 -- nvmf/common.sh@542 -- # cat 00:25:35.577 23:17:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:35.577 23:17:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:35.577 { 00:25:35.577 "params": { 00:25:35.577 "name": "Nvme$subsystem", 00:25:35.577 "trtype": "$TEST_TRANSPORT", 00:25:35.577 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:35.577 "adrfam": "ipv4", 00:25:35.577 "trsvcid": "$NVMF_PORT", 00:25:35.577 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:35.577 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:35.577 "hdgst": ${hdgst:-false}, 00:25:35.577 "ddgst": ${ddgst:-false} 00:25:35.577 }, 00:25:35.577 "method": "bdev_nvme_attach_controller" 00:25:35.577 } 00:25:35.577 EOF 00:25:35.577 )") 00:25:35.577 23:17:38 -- nvmf/common.sh@542 -- # cat 00:25:35.577 23:17:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:35.577 23:17:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:35.577 { 00:25:35.577 "params": { 00:25:35.577 "name": "Nvme$subsystem", 00:25:35.577 "trtype": "$TEST_TRANSPORT", 00:25:35.577 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:35.577 "adrfam": "ipv4", 00:25:35.577 "trsvcid": "$NVMF_PORT", 00:25:35.577 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:35.577 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:35.577 "hdgst": ${hdgst:-false}, 00:25:35.577 "ddgst": ${ddgst:-false} 00:25:35.577 }, 00:25:35.577 "method": "bdev_nvme_attach_controller" 00:25:35.577 } 00:25:35.577 EOF 00:25:35.577 )") 00:25:35.577 23:17:38 -- nvmf/common.sh@542 -- # cat 00:25:35.577 23:17:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:35.577 23:17:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:35.577 { 00:25:35.577 "params": { 00:25:35.577 "name": "Nvme$subsystem", 00:25:35.577 "trtype": "$TEST_TRANSPORT", 00:25:35.577 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:35.577 "adrfam": "ipv4", 00:25:35.577 "trsvcid": "$NVMF_PORT", 00:25:35.577 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:35.577 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:35.577 "hdgst": ${hdgst:-false}, 00:25:35.577 "ddgst": ${ddgst:-false} 00:25:35.577 }, 00:25:35.577 "method": "bdev_nvme_attach_controller" 00:25:35.577 } 00:25:35.577 EOF 00:25:35.577 )") 00:25:35.577 23:17:38 -- nvmf/common.sh@542 -- # cat 00:25:35.577 23:17:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:35.577 23:17:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:35.577 { 00:25:35.577 "params": { 00:25:35.577 "name": "Nvme$subsystem", 00:25:35.577 "trtype": "$TEST_TRANSPORT", 00:25:35.577 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:35.577 "adrfam": "ipv4", 00:25:35.577 "trsvcid": "$NVMF_PORT", 00:25:35.577 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:35.577 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:35.577 "hdgst": ${hdgst:-false}, 00:25:35.577 "ddgst": ${ddgst:-false} 00:25:35.577 }, 00:25:35.577 "method": "bdev_nvme_attach_controller" 00:25:35.577 } 00:25:35.577 EOF 00:25:35.577 )") 00:25:35.577 23:17:38 -- nvmf/common.sh@542 -- # cat 00:25:35.577 23:17:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:35.577 23:17:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:35.577 { 00:25:35.577 "params": { 00:25:35.577 "name": "Nvme$subsystem", 00:25:35.577 "trtype": "$TEST_TRANSPORT", 00:25:35.577 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:35.577 "adrfam": "ipv4", 00:25:35.577 "trsvcid": "$NVMF_PORT", 00:25:35.577 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:35.577 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:35.577 "hdgst": ${hdgst:-false}, 00:25:35.577 "ddgst": ${ddgst:-false} 00:25:35.577 }, 00:25:35.577 "method": "bdev_nvme_attach_controller" 00:25:35.577 } 00:25:35.577 EOF 00:25:35.577 )") 00:25:35.577 23:17:38 -- nvmf/common.sh@542 -- # cat 00:25:35.577 23:17:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:35.577 23:17:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:35.577 { 00:25:35.577 "params": { 00:25:35.577 "name": "Nvme$subsystem", 00:25:35.577 "trtype": "$TEST_TRANSPORT", 00:25:35.577 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:35.577 "adrfam": "ipv4", 00:25:35.577 "trsvcid": "$NVMF_PORT", 00:25:35.577 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:35.577 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:35.577 "hdgst": ${hdgst:-false}, 00:25:35.577 "ddgst": ${ddgst:-false} 00:25:35.577 }, 00:25:35.577 "method": "bdev_nvme_attach_controller" 00:25:35.577 } 00:25:35.577 EOF 00:25:35.577 )") 00:25:35.577 23:17:38 -- nvmf/common.sh@542 -- # cat 00:25:35.577 23:17:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:35.577 23:17:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:35.577 { 00:25:35.577 "params": { 00:25:35.577 "name": "Nvme$subsystem", 00:25:35.577 "trtype": "$TEST_TRANSPORT", 00:25:35.577 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:35.577 "adrfam": "ipv4", 00:25:35.577 "trsvcid": "$NVMF_PORT", 00:25:35.577 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:35.577 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:35.577 "hdgst": ${hdgst:-false}, 00:25:35.577 "ddgst": ${ddgst:-false} 00:25:35.577 }, 00:25:35.577 "method": "bdev_nvme_attach_controller" 00:25:35.577 } 00:25:35.577 EOF 00:25:35.577 )") 00:25:35.577 23:17:38 -- nvmf/common.sh@542 -- # cat 00:25:35.577 23:17:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:35.577 23:17:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:35.577 { 00:25:35.577 "params": { 00:25:35.577 "name": "Nvme$subsystem", 00:25:35.577 "trtype": "$TEST_TRANSPORT", 00:25:35.577 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:35.577 "adrfam": "ipv4", 00:25:35.577 "trsvcid": "$NVMF_PORT", 00:25:35.577 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:35.577 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:35.577 "hdgst": ${hdgst:-false}, 00:25:35.577 "ddgst": ${ddgst:-false} 00:25:35.577 }, 00:25:35.577 "method": "bdev_nvme_attach_controller" 00:25:35.577 } 00:25:35.577 EOF 00:25:35.577 )") 00:25:35.577 23:17:38 -- nvmf/common.sh@542 -- # cat 00:25:35.577 23:17:38 -- nvmf/common.sh@544 -- # jq . 00:25:35.577 23:17:38 -- nvmf/common.sh@545 -- # IFS=, 00:25:35.577 23:17:38 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:35.577 "params": { 00:25:35.577 "name": "Nvme1", 00:25:35.577 "trtype": "tcp", 00:25:35.577 "traddr": "10.0.0.2", 00:25:35.577 "adrfam": "ipv4", 00:25:35.577 "trsvcid": "4420", 00:25:35.577 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:35.577 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:35.577 "hdgst": false, 00:25:35.577 "ddgst": false 00:25:35.578 }, 00:25:35.578 "method": "bdev_nvme_attach_controller" 00:25:35.578 },{ 00:25:35.578 "params": { 00:25:35.578 "name": "Nvme2", 00:25:35.578 "trtype": "tcp", 00:25:35.578 "traddr": "10.0.0.2", 00:25:35.578 "adrfam": "ipv4", 00:25:35.578 "trsvcid": "4420", 00:25:35.578 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:35.578 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:35.578 "hdgst": false, 00:25:35.578 "ddgst": false 00:25:35.578 }, 00:25:35.578 "method": "bdev_nvme_attach_controller" 00:25:35.578 },{ 00:25:35.578 "params": { 00:25:35.578 "name": "Nvme3", 00:25:35.578 "trtype": "tcp", 00:25:35.578 "traddr": "10.0.0.2", 00:25:35.578 "adrfam": "ipv4", 00:25:35.578 "trsvcid": "4420", 00:25:35.578 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:35.578 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:35.578 "hdgst": false, 00:25:35.578 "ddgst": false 00:25:35.578 }, 00:25:35.578 "method": "bdev_nvme_attach_controller" 00:25:35.578 },{ 00:25:35.578 "params": { 00:25:35.578 "name": "Nvme4", 00:25:35.578 "trtype": "tcp", 00:25:35.578 "traddr": "10.0.0.2", 00:25:35.578 "adrfam": "ipv4", 00:25:35.578 "trsvcid": "4420", 00:25:35.578 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:35.578 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:35.578 "hdgst": false, 00:25:35.578 "ddgst": false 00:25:35.578 }, 00:25:35.578 "method": "bdev_nvme_attach_controller" 00:25:35.578 },{ 00:25:35.578 "params": { 00:25:35.578 "name": "Nvme5", 00:25:35.578 "trtype": "tcp", 00:25:35.578 "traddr": "10.0.0.2", 00:25:35.578 "adrfam": "ipv4", 00:25:35.578 "trsvcid": "4420", 00:25:35.578 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:35.578 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:35.578 "hdgst": false, 00:25:35.578 "ddgst": false 00:25:35.578 }, 00:25:35.578 "method": "bdev_nvme_attach_controller" 00:25:35.578 },{ 00:25:35.578 "params": { 00:25:35.578 "name": "Nvme6", 00:25:35.578 "trtype": "tcp", 00:25:35.578 "traddr": "10.0.0.2", 00:25:35.578 "adrfam": "ipv4", 00:25:35.578 "trsvcid": "4420", 00:25:35.578 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:35.578 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:35.578 "hdgst": false, 00:25:35.578 "ddgst": false 00:25:35.578 }, 00:25:35.578 "method": "bdev_nvme_attach_controller" 00:25:35.578 },{ 00:25:35.578 "params": { 00:25:35.578 "name": "Nvme7", 00:25:35.578 "trtype": "tcp", 00:25:35.578 "traddr": "10.0.0.2", 00:25:35.578 "adrfam": "ipv4", 00:25:35.578 "trsvcid": "4420", 00:25:35.578 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:35.578 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:35.578 "hdgst": false, 00:25:35.578 "ddgst": false 00:25:35.578 }, 00:25:35.578 "method": "bdev_nvme_attach_controller" 00:25:35.578 },{ 00:25:35.578 "params": { 00:25:35.578 "name": "Nvme8", 00:25:35.578 "trtype": "tcp", 00:25:35.578 "traddr": "10.0.0.2", 00:25:35.578 "adrfam": "ipv4", 00:25:35.578 "trsvcid": "4420", 00:25:35.578 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:35.578 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:35.578 "hdgst": false, 00:25:35.578 "ddgst": false 00:25:35.578 }, 00:25:35.578 "method": "bdev_nvme_attach_controller" 00:25:35.578 },{ 00:25:35.578 "params": { 00:25:35.578 "name": "Nvme9", 00:25:35.578 "trtype": "tcp", 00:25:35.578 "traddr": "10.0.0.2", 00:25:35.578 "adrfam": "ipv4", 00:25:35.578 "trsvcid": "4420", 00:25:35.578 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:35.578 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:35.578 "hdgst": false, 00:25:35.578 "ddgst": false 00:25:35.578 }, 00:25:35.578 "method": "bdev_nvme_attach_controller" 00:25:35.578 },{ 00:25:35.578 "params": { 00:25:35.578 "name": "Nvme10", 00:25:35.578 "trtype": "tcp", 00:25:35.578 "traddr": "10.0.0.2", 00:25:35.578 "adrfam": "ipv4", 00:25:35.578 "trsvcid": "4420", 00:25:35.578 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:35.578 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:35.578 "hdgst": false, 00:25:35.578 "ddgst": false 00:25:35.578 }, 00:25:35.578 "method": "bdev_nvme_attach_controller" 00:25:35.578 }' 00:25:35.578 [2024-11-28 23:17:38.846054] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:35.578 [2024-11-28 23:17:38.846140] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2524660 ] 00:25:35.578 EAL: No free 2048 kB hugepages reported on node 1 00:25:35.578 [2024-11-28 23:17:38.913031] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:35.578 [2024-11-28 23:17:39.000223] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:36.953 Running I/O for 1 seconds... 00:25:38.331 00:25:38.331 Latency(us) 00:25:38.331 [2024-11-28T22:17:41.937Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:38.331 [2024-11-28T22:17:41.937Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:38.331 Verification LBA range: start 0x0 length 0x400 00:25:38.331 Nvme1n1 : 1.09 366.53 22.91 0.00 0.00 170503.38 35729.26 164665.27 00:25:38.331 [2024-11-28T22:17:41.937Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:38.331 Verification LBA range: start 0x0 length 0x400 00:25:38.331 Nvme2n1 : 1.08 368.25 23.02 0.00 0.00 168430.33 36311.80 169325.61 00:25:38.331 [2024-11-28T22:17:41.937Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:38.331 Verification LBA range: start 0x0 length 0x400 00:25:38.331 Nvme3n1 : 1.10 394.09 24.63 0.00 0.00 157780.24 13981.01 125829.12 00:25:38.331 [2024-11-28T22:17:41.937Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:38.331 Verification LBA range: start 0x0 length 0x400 00:25:38.331 Nvme4n1 : 1.10 393.66 24.60 0.00 0.00 156896.58 12913.02 121168.78 00:25:38.331 [2024-11-28T22:17:41.937Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:38.331 Verification LBA range: start 0x0 length 0x400 00:25:38.331 Nvme5n1 : 1.07 375.27 23.45 0.00 0.00 161430.61 13398.47 145247.19 00:25:38.331 [2024-11-28T22:17:41.937Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:38.331 Verification LBA range: start 0x0 length 0x400 00:25:38.331 Nvme6n1 : 1.10 392.87 24.55 0.00 0.00 154938.89 13883.92 118061.89 00:25:38.331 [2024-11-28T22:17:41.937Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:38.331 Verification LBA range: start 0x0 length 0x400 00:25:38.331 Nvme7n1 : 1.11 392.01 24.50 0.00 0.00 154209.37 12815.93 120392.06 00:25:38.331 [2024-11-28T22:17:41.937Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:38.331 Verification LBA range: start 0x0 length 0x400 00:25:38.331 Nvme8n1 : 1.11 390.62 24.41 0.00 0.00 153546.07 14175.19 124275.67 00:25:38.331 [2024-11-28T22:17:41.937Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:38.331 Verification LBA range: start 0x0 length 0x400 00:25:38.331 Nvme9n1 : 1.12 389.18 24.32 0.00 0.00 154072.18 6310.87 128159.29 00:25:38.331 [2024-11-28T22:17:41.937Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:38.331 Verification LBA range: start 0x0 length 0x400 00:25:38.331 Nvme10n1 : 1.12 388.23 24.26 0.00 0.00 153548.11 4708.88 132042.90 00:25:38.331 [2024-11-28T22:17:41.937Z] =================================================================================================================== 00:25:38.331 [2024-11-28T22:17:41.937Z] Total : 3850.71 240.67 0.00 0.00 158327.91 4708.88 169325.61 00:25:38.331 23:17:41 -- target/shutdown.sh@93 -- # stoptarget 00:25:38.331 23:17:41 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:38.331 23:17:41 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:38.331 23:17:41 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:38.331 23:17:41 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:38.331 23:17:41 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:38.331 23:17:41 -- nvmf/common.sh@116 -- # sync 00:25:38.331 23:17:41 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:38.331 23:17:41 -- nvmf/common.sh@119 -- # set +e 00:25:38.331 23:17:41 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:38.331 23:17:41 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:38.331 rmmod nvme_tcp 00:25:38.331 rmmod nvme_fabrics 00:25:38.331 rmmod nvme_keyring 00:25:38.331 23:17:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:38.331 23:17:41 -- nvmf/common.sh@123 -- # set -e 00:25:38.331 23:17:41 -- nvmf/common.sh@124 -- # return 0 00:25:38.331 23:17:41 -- nvmf/common.sh@477 -- # '[' -n 2524036 ']' 00:25:38.331 23:17:41 -- nvmf/common.sh@478 -- # killprocess 2524036 00:25:38.331 23:17:41 -- common/autotest_common.sh@936 -- # '[' -z 2524036 ']' 00:25:38.591 23:17:41 -- common/autotest_common.sh@940 -- # kill -0 2524036 00:25:38.591 23:17:41 -- common/autotest_common.sh@941 -- # uname 00:25:38.591 23:17:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:38.591 23:17:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2524036 00:25:38.591 23:17:41 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:38.591 23:17:41 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:38.591 23:17:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2524036' 00:25:38.591 killing process with pid 2524036 00:25:38.591 23:17:41 -- common/autotest_common.sh@955 -- # kill 2524036 00:25:38.591 23:17:41 -- common/autotest_common.sh@960 -- # wait 2524036 00:25:39.159 23:17:42 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:39.159 23:17:42 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:39.159 23:17:42 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:39.159 23:17:42 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:39.159 23:17:42 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:39.159 23:17:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:39.159 23:17:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:39.159 23:17:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:41.071 23:17:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:41.071 00:25:41.071 real 0m12.424s 00:25:41.071 user 0m36.286s 00:25:41.071 sys 0m3.342s 00:25:41.071 23:17:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:41.071 23:17:44 -- common/autotest_common.sh@10 -- # set +x 00:25:41.071 ************************************ 00:25:41.071 END TEST nvmf_shutdown_tc1 00:25:41.071 ************************************ 00:25:41.071 23:17:44 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:25:41.071 23:17:44 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:25:41.071 23:17:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:41.071 23:17:44 -- common/autotest_common.sh@10 -- # set +x 00:25:41.071 ************************************ 00:25:41.071 START TEST nvmf_shutdown_tc2 00:25:41.071 ************************************ 00:25:41.071 23:17:44 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc2 00:25:41.071 23:17:44 -- target/shutdown.sh@98 -- # starttarget 00:25:41.071 23:17:44 -- target/shutdown.sh@15 -- # nvmftestinit 00:25:41.071 23:17:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:41.071 23:17:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:41.071 23:17:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:41.071 23:17:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:41.071 23:17:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:41.071 23:17:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:41.071 23:17:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:41.071 23:17:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:41.071 23:17:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:41.071 23:17:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:41.071 23:17:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:41.071 23:17:44 -- common/autotest_common.sh@10 -- # set +x 00:25:41.071 23:17:44 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:41.071 23:17:44 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:41.071 23:17:44 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:41.071 23:17:44 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:41.071 23:17:44 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:41.071 23:17:44 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:41.071 23:17:44 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:41.071 23:17:44 -- nvmf/common.sh@294 -- # net_devs=() 00:25:41.071 23:17:44 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:41.071 23:17:44 -- nvmf/common.sh@295 -- # e810=() 00:25:41.071 23:17:44 -- nvmf/common.sh@295 -- # local -ga e810 00:25:41.071 23:17:44 -- nvmf/common.sh@296 -- # x722=() 00:25:41.071 23:17:44 -- nvmf/common.sh@296 -- # local -ga x722 00:25:41.071 23:17:44 -- nvmf/common.sh@297 -- # mlx=() 00:25:41.071 23:17:44 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:41.071 23:17:44 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:41.071 23:17:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:41.071 23:17:44 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:41.071 23:17:44 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:41.072 23:17:44 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:41.072 23:17:44 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:41.072 23:17:44 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:41.072 23:17:44 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:41.072 23:17:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:41.072 23:17:44 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:41.072 23:17:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:41.072 23:17:44 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:41.072 23:17:44 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:41.072 23:17:44 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:41.072 23:17:44 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:41.072 23:17:44 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:41.072 23:17:44 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:41.072 23:17:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:41.072 23:17:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:41.072 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:41.072 23:17:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:41.072 23:17:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:41.072 23:17:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:41.072 23:17:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:41.072 23:17:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:41.072 23:17:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:41.072 23:17:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:41.072 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:41.072 23:17:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:41.072 23:17:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:41.072 23:17:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:41.072 23:17:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:41.072 23:17:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:41.072 23:17:44 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:41.072 23:17:44 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:41.072 23:17:44 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:41.072 23:17:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:41.072 23:17:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:41.072 23:17:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:41.072 23:17:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:41.072 23:17:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:41.072 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:41.072 23:17:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:41.072 23:17:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:41.072 23:17:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:41.072 23:17:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:41.072 23:17:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:41.072 23:17:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:41.072 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:41.072 23:17:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:41.072 23:17:44 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:41.072 23:17:44 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:41.072 23:17:44 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:41.072 23:17:44 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:41.072 23:17:44 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:41.072 23:17:44 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:41.072 23:17:44 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:41.072 23:17:44 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:41.072 23:17:44 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:41.072 23:17:44 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:41.072 23:17:44 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:41.072 23:17:44 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:41.072 23:17:44 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:41.072 23:17:44 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:41.072 23:17:44 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:41.072 23:17:44 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:41.072 23:17:44 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:41.072 23:17:44 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:41.072 23:17:44 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:41.072 23:17:44 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:41.072 23:17:44 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:41.072 23:17:44 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:41.331 23:17:44 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:41.331 23:17:44 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:41.331 23:17:44 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:41.331 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:41.331 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.209 ms 00:25:41.331 00:25:41.331 --- 10.0.0.2 ping statistics --- 00:25:41.331 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:41.331 rtt min/avg/max/mdev = 0.209/0.209/0.209/0.000 ms 00:25:41.331 23:17:44 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:41.331 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:41.331 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.071 ms 00:25:41.331 00:25:41.331 --- 10.0.0.1 ping statistics --- 00:25:41.331 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:41.331 rtt min/avg/max/mdev = 0.071/0.071/0.071/0.000 ms 00:25:41.331 23:17:44 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:41.331 23:17:44 -- nvmf/common.sh@410 -- # return 0 00:25:41.331 23:17:44 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:41.331 23:17:44 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:41.331 23:17:44 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:41.331 23:17:44 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:41.331 23:17:44 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:41.331 23:17:44 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:41.331 23:17:44 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:41.331 23:17:44 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:25:41.331 23:17:44 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:41.331 23:17:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:41.331 23:17:44 -- common/autotest_common.sh@10 -- # set +x 00:25:41.331 23:17:44 -- nvmf/common.sh@469 -- # nvmfpid=2525440 00:25:41.331 23:17:44 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:25:41.331 23:17:44 -- nvmf/common.sh@470 -- # waitforlisten 2525440 00:25:41.331 23:17:44 -- common/autotest_common.sh@829 -- # '[' -z 2525440 ']' 00:25:41.331 23:17:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:41.331 23:17:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:41.332 23:17:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:41.332 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:41.332 23:17:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:41.332 23:17:44 -- common/autotest_common.sh@10 -- # set +x 00:25:41.332 [2024-11-28 23:17:44.774847] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:41.332 [2024-11-28 23:17:44.774910] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:41.332 EAL: No free 2048 kB hugepages reported on node 1 00:25:41.332 [2024-11-28 23:17:44.842600] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:41.332 [2024-11-28 23:17:44.932962] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:41.332 [2024-11-28 23:17:44.933127] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:41.332 [2024-11-28 23:17:44.933147] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:41.332 [2024-11-28 23:17:44.933162] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:41.332 [2024-11-28 23:17:44.933255] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:41.332 [2024-11-28 23:17:44.933371] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:41.332 [2024-11-28 23:17:44.933438] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:41.332 [2024-11-28 23:17:44.933443] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:42.268 23:17:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:42.268 23:17:45 -- common/autotest_common.sh@862 -- # return 0 00:25:42.268 23:17:45 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:42.268 23:17:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:42.268 23:17:45 -- common/autotest_common.sh@10 -- # set +x 00:25:42.268 23:17:45 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:42.268 23:17:45 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:42.268 23:17:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:42.268 23:17:45 -- common/autotest_common.sh@10 -- # set +x 00:25:42.268 [2024-11-28 23:17:45.806198] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:42.268 23:17:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:42.268 23:17:45 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:25:42.268 23:17:45 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:25:42.268 23:17:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:42.268 23:17:45 -- common/autotest_common.sh@10 -- # set +x 00:25:42.268 23:17:45 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:42.268 23:17:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:42.268 23:17:45 -- target/shutdown.sh@28 -- # cat 00:25:42.268 23:17:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:42.268 23:17:45 -- target/shutdown.sh@28 -- # cat 00:25:42.268 23:17:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:42.268 23:17:45 -- target/shutdown.sh@28 -- # cat 00:25:42.268 23:17:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:42.268 23:17:45 -- target/shutdown.sh@28 -- # cat 00:25:42.268 23:17:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:42.268 23:17:45 -- target/shutdown.sh@28 -- # cat 00:25:42.268 23:17:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:42.268 23:17:45 -- target/shutdown.sh@28 -- # cat 00:25:42.268 23:17:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:42.268 23:17:45 -- target/shutdown.sh@28 -- # cat 00:25:42.268 23:17:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:42.268 23:17:45 -- target/shutdown.sh@28 -- # cat 00:25:42.268 23:17:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:42.268 23:17:45 -- target/shutdown.sh@28 -- # cat 00:25:42.268 23:17:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:42.268 23:17:45 -- target/shutdown.sh@28 -- # cat 00:25:42.268 23:17:45 -- target/shutdown.sh@35 -- # rpc_cmd 00:25:42.268 23:17:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:42.268 23:17:45 -- common/autotest_common.sh@10 -- # set +x 00:25:42.268 Malloc1 00:25:42.527 [2024-11-28 23:17:45.887466] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:42.527 Malloc2 00:25:42.527 Malloc3 00:25:42.527 Malloc4 00:25:42.527 Malloc5 00:25:42.527 Malloc6 00:25:42.786 Malloc7 00:25:42.786 Malloc8 00:25:42.786 Malloc9 00:25:42.786 Malloc10 00:25:42.786 23:17:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:42.786 23:17:46 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:25:42.786 23:17:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:42.786 23:17:46 -- common/autotest_common.sh@10 -- # set +x 00:25:42.786 23:17:46 -- target/shutdown.sh@102 -- # perfpid=2525638 00:25:42.786 23:17:46 -- target/shutdown.sh@103 -- # waitforlisten 2525638 /var/tmp/bdevperf.sock 00:25:42.786 23:17:46 -- common/autotest_common.sh@829 -- # '[' -z 2525638 ']' 00:25:42.786 23:17:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:42.786 23:17:46 -- target/shutdown.sh@101 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:42.786 23:17:46 -- target/shutdown.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:25:42.786 23:17:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:42.786 23:17:46 -- nvmf/common.sh@520 -- # config=() 00:25:42.786 23:17:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:42.786 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:42.786 23:17:46 -- nvmf/common.sh@520 -- # local subsystem config 00:25:42.786 23:17:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:42.786 23:17:46 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:42.786 23:17:46 -- common/autotest_common.sh@10 -- # set +x 00:25:42.786 23:17:46 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:42.786 { 00:25:42.786 "params": { 00:25:42.786 "name": "Nvme$subsystem", 00:25:42.786 "trtype": "$TEST_TRANSPORT", 00:25:42.786 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:42.786 "adrfam": "ipv4", 00:25:42.786 "trsvcid": "$NVMF_PORT", 00:25:42.786 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:42.786 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:42.786 "hdgst": ${hdgst:-false}, 00:25:42.786 "ddgst": ${ddgst:-false} 00:25:42.786 }, 00:25:42.786 "method": "bdev_nvme_attach_controller" 00:25:42.786 } 00:25:42.786 EOF 00:25:42.786 )") 00:25:42.786 23:17:46 -- nvmf/common.sh@542 -- # cat 00:25:42.786 23:17:46 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:42.786 23:17:46 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:42.786 { 00:25:42.786 "params": { 00:25:42.786 "name": "Nvme$subsystem", 00:25:42.786 "trtype": "$TEST_TRANSPORT", 00:25:42.786 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:42.786 "adrfam": "ipv4", 00:25:42.786 "trsvcid": "$NVMF_PORT", 00:25:42.786 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:42.786 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:42.786 "hdgst": ${hdgst:-false}, 00:25:42.786 "ddgst": ${ddgst:-false} 00:25:42.786 }, 00:25:42.786 "method": "bdev_nvme_attach_controller" 00:25:42.786 } 00:25:42.786 EOF 00:25:42.786 )") 00:25:42.786 23:17:46 -- nvmf/common.sh@542 -- # cat 00:25:42.786 23:17:46 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:42.786 23:17:46 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:42.786 { 00:25:42.786 "params": { 00:25:42.786 "name": "Nvme$subsystem", 00:25:42.786 "trtype": "$TEST_TRANSPORT", 00:25:42.786 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:42.786 "adrfam": "ipv4", 00:25:42.786 "trsvcid": "$NVMF_PORT", 00:25:42.786 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:42.786 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:42.786 "hdgst": ${hdgst:-false}, 00:25:42.786 "ddgst": ${ddgst:-false} 00:25:42.786 }, 00:25:42.786 "method": "bdev_nvme_attach_controller" 00:25:42.786 } 00:25:42.786 EOF 00:25:42.786 )") 00:25:42.786 23:17:46 -- nvmf/common.sh@542 -- # cat 00:25:42.786 23:17:46 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:42.786 23:17:46 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:42.786 { 00:25:42.786 "params": { 00:25:42.786 "name": "Nvme$subsystem", 00:25:42.786 "trtype": "$TEST_TRANSPORT", 00:25:42.786 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:42.786 "adrfam": "ipv4", 00:25:42.786 "trsvcid": "$NVMF_PORT", 00:25:42.786 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:42.786 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:42.787 "hdgst": ${hdgst:-false}, 00:25:42.787 "ddgst": ${ddgst:-false} 00:25:42.787 }, 00:25:42.787 "method": "bdev_nvme_attach_controller" 00:25:42.787 } 00:25:42.787 EOF 00:25:42.787 )") 00:25:42.787 23:17:46 -- nvmf/common.sh@542 -- # cat 00:25:42.787 23:17:46 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:42.787 23:17:46 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:42.787 { 00:25:42.787 "params": { 00:25:42.787 "name": "Nvme$subsystem", 00:25:42.787 "trtype": "$TEST_TRANSPORT", 00:25:42.787 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:42.787 "adrfam": "ipv4", 00:25:42.787 "trsvcid": "$NVMF_PORT", 00:25:42.787 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:42.787 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:42.787 "hdgst": ${hdgst:-false}, 00:25:42.787 "ddgst": ${ddgst:-false} 00:25:42.787 }, 00:25:42.787 "method": "bdev_nvme_attach_controller" 00:25:42.787 } 00:25:42.787 EOF 00:25:42.787 )") 00:25:42.787 23:17:46 -- nvmf/common.sh@542 -- # cat 00:25:42.787 23:17:46 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:42.787 23:17:46 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:42.787 { 00:25:42.787 "params": { 00:25:42.787 "name": "Nvme$subsystem", 00:25:42.787 "trtype": "$TEST_TRANSPORT", 00:25:42.787 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:42.787 "adrfam": "ipv4", 00:25:42.787 "trsvcid": "$NVMF_PORT", 00:25:42.787 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:42.787 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:42.787 "hdgst": ${hdgst:-false}, 00:25:42.787 "ddgst": ${ddgst:-false} 00:25:42.787 }, 00:25:42.787 "method": "bdev_nvme_attach_controller" 00:25:42.787 } 00:25:42.787 EOF 00:25:42.787 )") 00:25:42.787 23:17:46 -- nvmf/common.sh@542 -- # cat 00:25:42.787 23:17:46 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:42.787 23:17:46 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:42.787 { 00:25:42.787 "params": { 00:25:42.787 "name": "Nvme$subsystem", 00:25:42.787 "trtype": "$TEST_TRANSPORT", 00:25:42.787 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:42.787 "adrfam": "ipv4", 00:25:42.787 "trsvcid": "$NVMF_PORT", 00:25:42.787 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:42.787 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:42.787 "hdgst": ${hdgst:-false}, 00:25:42.787 "ddgst": ${ddgst:-false} 00:25:42.787 }, 00:25:42.787 "method": "bdev_nvme_attach_controller" 00:25:42.787 } 00:25:42.787 EOF 00:25:42.787 )") 00:25:42.787 23:17:46 -- nvmf/common.sh@542 -- # cat 00:25:42.787 23:17:46 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:42.787 23:17:46 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:42.787 { 00:25:42.787 "params": { 00:25:42.787 "name": "Nvme$subsystem", 00:25:42.787 "trtype": "$TEST_TRANSPORT", 00:25:42.787 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:42.787 "adrfam": "ipv4", 00:25:42.787 "trsvcid": "$NVMF_PORT", 00:25:42.787 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:42.787 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:42.787 "hdgst": ${hdgst:-false}, 00:25:42.787 "ddgst": ${ddgst:-false} 00:25:42.787 }, 00:25:42.787 "method": "bdev_nvme_attach_controller" 00:25:42.787 } 00:25:42.787 EOF 00:25:42.787 )") 00:25:42.787 23:17:46 -- nvmf/common.sh@542 -- # cat 00:25:42.787 23:17:46 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:42.787 23:17:46 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:42.787 { 00:25:42.787 "params": { 00:25:42.787 "name": "Nvme$subsystem", 00:25:42.787 "trtype": "$TEST_TRANSPORT", 00:25:42.787 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:42.787 "adrfam": "ipv4", 00:25:42.787 "trsvcid": "$NVMF_PORT", 00:25:42.787 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:42.787 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:42.787 "hdgst": ${hdgst:-false}, 00:25:42.787 "ddgst": ${ddgst:-false} 00:25:42.787 }, 00:25:42.787 "method": "bdev_nvme_attach_controller" 00:25:42.787 } 00:25:42.787 EOF 00:25:42.787 )") 00:25:42.787 23:17:46 -- nvmf/common.sh@542 -- # cat 00:25:42.787 23:17:46 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:42.787 23:17:46 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:42.787 { 00:25:42.787 "params": { 00:25:42.787 "name": "Nvme$subsystem", 00:25:42.787 "trtype": "$TEST_TRANSPORT", 00:25:42.787 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:42.787 "adrfam": "ipv4", 00:25:42.787 "trsvcid": "$NVMF_PORT", 00:25:42.787 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:42.787 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:42.787 "hdgst": ${hdgst:-false}, 00:25:42.787 "ddgst": ${ddgst:-false} 00:25:42.787 }, 00:25:42.787 "method": "bdev_nvme_attach_controller" 00:25:42.787 } 00:25:42.787 EOF 00:25:42.787 )") 00:25:42.787 23:17:46 -- nvmf/common.sh@542 -- # cat 00:25:42.787 23:17:46 -- nvmf/common.sh@544 -- # jq . 00:25:42.787 23:17:46 -- nvmf/common.sh@545 -- # IFS=, 00:25:42.787 23:17:46 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:42.787 "params": { 00:25:42.787 "name": "Nvme1", 00:25:42.787 "trtype": "tcp", 00:25:42.787 "traddr": "10.0.0.2", 00:25:42.787 "adrfam": "ipv4", 00:25:42.787 "trsvcid": "4420", 00:25:42.787 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:42.787 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:42.787 "hdgst": false, 00:25:42.787 "ddgst": false 00:25:42.787 }, 00:25:42.787 "method": "bdev_nvme_attach_controller" 00:25:42.787 },{ 00:25:42.787 "params": { 00:25:42.787 "name": "Nvme2", 00:25:42.787 "trtype": "tcp", 00:25:42.787 "traddr": "10.0.0.2", 00:25:42.787 "adrfam": "ipv4", 00:25:42.787 "trsvcid": "4420", 00:25:42.787 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:42.787 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:42.787 "hdgst": false, 00:25:42.787 "ddgst": false 00:25:42.787 }, 00:25:42.787 "method": "bdev_nvme_attach_controller" 00:25:42.787 },{ 00:25:42.787 "params": { 00:25:42.787 "name": "Nvme3", 00:25:42.787 "trtype": "tcp", 00:25:42.787 "traddr": "10.0.0.2", 00:25:42.787 "adrfam": "ipv4", 00:25:42.787 "trsvcid": "4420", 00:25:42.787 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:42.787 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:42.787 "hdgst": false, 00:25:42.787 "ddgst": false 00:25:42.787 }, 00:25:42.787 "method": "bdev_nvme_attach_controller" 00:25:42.787 },{ 00:25:42.787 "params": { 00:25:42.787 "name": "Nvme4", 00:25:42.787 "trtype": "tcp", 00:25:42.787 "traddr": "10.0.0.2", 00:25:42.787 "adrfam": "ipv4", 00:25:42.787 "trsvcid": "4420", 00:25:42.787 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:42.787 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:42.787 "hdgst": false, 00:25:42.787 "ddgst": false 00:25:42.787 }, 00:25:42.787 "method": "bdev_nvme_attach_controller" 00:25:42.787 },{ 00:25:42.787 "params": { 00:25:42.787 "name": "Nvme5", 00:25:42.787 "trtype": "tcp", 00:25:42.787 "traddr": "10.0.0.2", 00:25:42.787 "adrfam": "ipv4", 00:25:42.787 "trsvcid": "4420", 00:25:42.787 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:42.787 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:42.787 "hdgst": false, 00:25:42.787 "ddgst": false 00:25:42.787 }, 00:25:42.787 "method": "bdev_nvme_attach_controller" 00:25:42.787 },{ 00:25:42.787 "params": { 00:25:42.787 "name": "Nvme6", 00:25:42.787 "trtype": "tcp", 00:25:42.787 "traddr": "10.0.0.2", 00:25:42.787 "adrfam": "ipv4", 00:25:42.787 "trsvcid": "4420", 00:25:42.787 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:42.787 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:42.787 "hdgst": false, 00:25:42.787 "ddgst": false 00:25:42.787 }, 00:25:42.787 "method": "bdev_nvme_attach_controller" 00:25:42.787 },{ 00:25:42.787 "params": { 00:25:42.787 "name": "Nvme7", 00:25:42.787 "trtype": "tcp", 00:25:42.787 "traddr": "10.0.0.2", 00:25:42.787 "adrfam": "ipv4", 00:25:42.787 "trsvcid": "4420", 00:25:42.787 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:42.787 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:42.787 "hdgst": false, 00:25:42.787 "ddgst": false 00:25:42.787 }, 00:25:42.787 "method": "bdev_nvme_attach_controller" 00:25:42.787 },{ 00:25:42.787 "params": { 00:25:42.787 "name": "Nvme8", 00:25:42.787 "trtype": "tcp", 00:25:42.787 "traddr": "10.0.0.2", 00:25:42.787 "adrfam": "ipv4", 00:25:42.787 "trsvcid": "4420", 00:25:42.787 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:42.787 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:42.787 "hdgst": false, 00:25:42.787 "ddgst": false 00:25:42.787 }, 00:25:42.787 "method": "bdev_nvme_attach_controller" 00:25:42.787 },{ 00:25:42.787 "params": { 00:25:42.787 "name": "Nvme9", 00:25:42.787 "trtype": "tcp", 00:25:42.787 "traddr": "10.0.0.2", 00:25:42.787 "adrfam": "ipv4", 00:25:42.787 "trsvcid": "4420", 00:25:42.787 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:42.787 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:42.787 "hdgst": false, 00:25:42.787 "ddgst": false 00:25:42.787 }, 00:25:42.787 "method": "bdev_nvme_attach_controller" 00:25:42.787 },{ 00:25:42.787 "params": { 00:25:42.787 "name": "Nvme10", 00:25:42.787 "trtype": "tcp", 00:25:42.787 "traddr": "10.0.0.2", 00:25:42.787 "adrfam": "ipv4", 00:25:42.787 "trsvcid": "4420", 00:25:42.787 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:42.788 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:42.788 "hdgst": false, 00:25:42.788 "ddgst": false 00:25:42.788 }, 00:25:42.788 "method": "bdev_nvme_attach_controller" 00:25:42.788 }' 00:25:42.788 [2024-11-28 23:17:46.389798] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:42.788 [2024-11-28 23:17:46.389886] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2525638 ] 00:25:43.046 EAL: No free 2048 kB hugepages reported on node 1 00:25:43.046 [2024-11-28 23:17:46.454504] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:43.046 [2024-11-28 23:17:46.539895] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:44.947 Running I/O for 10 seconds... 00:25:44.947 23:17:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:44.947 23:17:48 -- common/autotest_common.sh@862 -- # return 0 00:25:44.947 23:17:48 -- target/shutdown.sh@104 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:25:44.947 23:17:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.947 23:17:48 -- common/autotest_common.sh@10 -- # set +x 00:25:44.947 23:17:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.947 23:17:48 -- target/shutdown.sh@106 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:25:44.947 23:17:48 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:25:44.947 23:17:48 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:25:44.947 23:17:48 -- target/shutdown.sh@57 -- # local ret=1 00:25:44.947 23:17:48 -- target/shutdown.sh@58 -- # local i 00:25:44.947 23:17:48 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:25:44.947 23:17:48 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:44.947 23:17:48 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:44.947 23:17:48 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:44.947 23:17:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.947 23:17:48 -- common/autotest_common.sh@10 -- # set +x 00:25:44.947 23:17:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.947 23:17:48 -- target/shutdown.sh@60 -- # read_io_count=42 00:25:44.947 23:17:48 -- target/shutdown.sh@63 -- # '[' 42 -ge 100 ']' 00:25:44.947 23:17:48 -- target/shutdown.sh@67 -- # sleep 0.25 00:25:44.947 23:17:48 -- target/shutdown.sh@59 -- # (( i-- )) 00:25:44.947 23:17:48 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:44.947 23:17:48 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:44.947 23:17:48 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:44.947 23:17:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.947 23:17:48 -- common/autotest_common.sh@10 -- # set +x 00:25:45.206 23:17:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:45.206 23:17:48 -- target/shutdown.sh@60 -- # read_io_count=167 00:25:45.206 23:17:48 -- target/shutdown.sh@63 -- # '[' 167 -ge 100 ']' 00:25:45.206 23:17:48 -- target/shutdown.sh@64 -- # ret=0 00:25:45.206 23:17:48 -- target/shutdown.sh@65 -- # break 00:25:45.206 23:17:48 -- target/shutdown.sh@69 -- # return 0 00:25:45.206 23:17:48 -- target/shutdown.sh@109 -- # killprocess 2525638 00:25:45.206 23:17:48 -- common/autotest_common.sh@936 -- # '[' -z 2525638 ']' 00:25:45.206 23:17:48 -- common/autotest_common.sh@940 -- # kill -0 2525638 00:25:45.206 23:17:48 -- common/autotest_common.sh@941 -- # uname 00:25:45.206 23:17:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:45.206 23:17:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2525638 00:25:45.206 23:17:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:45.206 23:17:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:45.206 23:17:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2525638' 00:25:45.206 killing process with pid 2525638 00:25:45.206 23:17:48 -- common/autotest_common.sh@955 -- # kill 2525638 00:25:45.206 23:17:48 -- common/autotest_common.sh@960 -- # wait 2525638 00:25:45.206 Received shutdown signal, test time was about 0.587332 seconds 00:25:45.206 00:25:45.206 Latency(us) 00:25:45.206 [2024-11-28T22:17:48.812Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:45.206 [2024-11-28T22:17:48.812Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:45.206 Verification LBA range: start 0x0 length 0x400 00:25:45.206 Nvme1n1 : 0.57 401.51 25.09 0.00 0.00 153036.57 26214.40 119615.34 00:25:45.206 [2024-11-28T22:17:48.812Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:45.206 Verification LBA range: start 0x0 length 0x400 00:25:45.206 Nvme2n1 : 0.57 400.58 25.04 0.00 0.00 151301.08 20388.98 118061.89 00:25:45.206 [2024-11-28T22:17:48.812Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:45.206 Verification LBA range: start 0x0 length 0x400 00:25:45.206 Nvme3n1 : 0.57 399.21 24.95 0.00 0.00 149589.86 25826.04 117285.17 00:25:45.206 [2024-11-28T22:17:48.812Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:45.206 Verification LBA range: start 0x0 length 0x400 00:25:45.206 Nvme4n1 : 0.57 398.29 24.89 0.00 0.00 147914.62 26408.58 118838.61 00:25:45.206 [2024-11-28T22:17:48.812Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:45.206 Verification LBA range: start 0x0 length 0x400 00:25:45.206 Nvme5n1 : 0.58 396.02 24.75 0.00 0.00 146341.59 28156.21 118838.61 00:25:45.206 [2024-11-28T22:17:48.812Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:45.206 Verification LBA range: start 0x0 length 0x400 00:25:45.206 Nvme6n1 : 0.58 395.12 24.69 0.00 0.00 144892.05 27379.48 119615.34 00:25:45.206 [2024-11-28T22:17:48.812Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:45.206 Verification LBA range: start 0x0 length 0x400 00:25:45.206 Nvme7n1 : 0.58 393.87 24.62 0.00 0.00 143296.87 27185.30 120392.06 00:25:45.206 [2024-11-28T22:17:48.812Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:45.206 Verification LBA range: start 0x0 length 0x400 00:25:45.206 Nvme8n1 : 0.58 391.81 24.49 0.00 0.00 142082.39 27379.48 124275.67 00:25:45.206 [2024-11-28T22:17:48.812Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:45.206 Verification LBA range: start 0x0 length 0x400 00:25:45.206 Nvme9n1 : 0.58 390.16 24.38 0.00 0.00 141125.96 24855.13 125829.12 00:25:45.206 [2024-11-28T22:17:48.812Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:45.206 Verification LBA range: start 0x0 length 0x400 00:25:45.207 Nvme10n1 : 0.59 393.85 24.62 0.00 0.00 137993.16 23204.60 125052.40 00:25:45.207 [2024-11-28T22:17:48.813Z] =================================================================================================================== 00:25:45.207 [2024-11-28T22:17:48.813Z] Total : 3960.41 247.53 0.00 0.00 145747.21 20388.98 125829.12 00:25:45.465 23:17:48 -- target/shutdown.sh@112 -- # sleep 1 00:25:46.400 23:17:49 -- target/shutdown.sh@113 -- # kill -0 2525440 00:25:46.400 23:17:49 -- target/shutdown.sh@115 -- # stoptarget 00:25:46.400 23:17:49 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:46.400 23:17:49 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:46.400 23:17:49 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:46.400 23:17:49 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:46.400 23:17:49 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:46.400 23:17:49 -- nvmf/common.sh@116 -- # sync 00:25:46.400 23:17:49 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:46.400 23:17:49 -- nvmf/common.sh@119 -- # set +e 00:25:46.400 23:17:49 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:46.400 23:17:49 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:46.400 rmmod nvme_tcp 00:25:46.400 rmmod nvme_fabrics 00:25:46.400 rmmod nvme_keyring 00:25:46.400 23:17:49 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:46.400 23:17:49 -- nvmf/common.sh@123 -- # set -e 00:25:46.400 23:17:49 -- nvmf/common.sh@124 -- # return 0 00:25:46.400 23:17:49 -- nvmf/common.sh@477 -- # '[' -n 2525440 ']' 00:25:46.400 23:17:49 -- nvmf/common.sh@478 -- # killprocess 2525440 00:25:46.400 23:17:49 -- common/autotest_common.sh@936 -- # '[' -z 2525440 ']' 00:25:46.400 23:17:49 -- common/autotest_common.sh@940 -- # kill -0 2525440 00:25:46.400 23:17:49 -- common/autotest_common.sh@941 -- # uname 00:25:46.400 23:17:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:46.400 23:17:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2525440 00:25:46.658 23:17:50 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:46.658 23:17:50 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:46.658 23:17:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2525440' 00:25:46.658 killing process with pid 2525440 00:25:46.658 23:17:50 -- common/autotest_common.sh@955 -- # kill 2525440 00:25:46.658 23:17:50 -- common/autotest_common.sh@960 -- # wait 2525440 00:25:46.917 23:17:50 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:46.917 23:17:50 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:46.917 23:17:50 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:46.917 23:17:50 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:46.917 23:17:50 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:46.917 23:17:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:46.917 23:17:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:46.917 23:17:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:49.462 23:17:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:49.462 00:25:49.462 real 0m7.995s 00:25:49.462 user 0m24.763s 00:25:49.462 sys 0m1.432s 00:25:49.462 23:17:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:49.462 23:17:52 -- common/autotest_common.sh@10 -- # set +x 00:25:49.462 ************************************ 00:25:49.462 END TEST nvmf_shutdown_tc2 00:25:49.462 ************************************ 00:25:49.462 23:17:52 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:25:49.462 23:17:52 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:25:49.462 23:17:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:49.462 23:17:52 -- common/autotest_common.sh@10 -- # set +x 00:25:49.462 ************************************ 00:25:49.462 START TEST nvmf_shutdown_tc3 00:25:49.462 ************************************ 00:25:49.462 23:17:52 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc3 00:25:49.462 23:17:52 -- target/shutdown.sh@120 -- # starttarget 00:25:49.462 23:17:52 -- target/shutdown.sh@15 -- # nvmftestinit 00:25:49.462 23:17:52 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:49.462 23:17:52 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:49.462 23:17:52 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:49.462 23:17:52 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:49.462 23:17:52 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:49.462 23:17:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:49.462 23:17:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:49.462 23:17:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:49.462 23:17:52 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:49.462 23:17:52 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:49.462 23:17:52 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:49.462 23:17:52 -- common/autotest_common.sh@10 -- # set +x 00:25:49.462 23:17:52 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:49.462 23:17:52 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:49.462 23:17:52 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:49.462 23:17:52 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:49.462 23:17:52 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:49.462 23:17:52 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:49.462 23:17:52 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:49.462 23:17:52 -- nvmf/common.sh@294 -- # net_devs=() 00:25:49.462 23:17:52 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:49.462 23:17:52 -- nvmf/common.sh@295 -- # e810=() 00:25:49.462 23:17:52 -- nvmf/common.sh@295 -- # local -ga e810 00:25:49.462 23:17:52 -- nvmf/common.sh@296 -- # x722=() 00:25:49.462 23:17:52 -- nvmf/common.sh@296 -- # local -ga x722 00:25:49.462 23:17:52 -- nvmf/common.sh@297 -- # mlx=() 00:25:49.462 23:17:52 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:49.462 23:17:52 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:49.462 23:17:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:49.462 23:17:52 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:49.462 23:17:52 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:49.462 23:17:52 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:49.462 23:17:52 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:49.462 23:17:52 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:49.462 23:17:52 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:49.462 23:17:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:49.462 23:17:52 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:49.462 23:17:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:49.462 23:17:52 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:49.462 23:17:52 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:49.462 23:17:52 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:49.462 23:17:52 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:49.462 23:17:52 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:49.462 23:17:52 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:49.462 23:17:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:49.462 23:17:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:49.462 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:49.462 23:17:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:49.462 23:17:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:49.462 23:17:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:49.462 23:17:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:49.462 23:17:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:49.462 23:17:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:49.462 23:17:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:49.462 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:49.462 23:17:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:49.462 23:17:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:49.462 23:17:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:49.462 23:17:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:49.462 23:17:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:49.462 23:17:52 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:49.462 23:17:52 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:49.462 23:17:52 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:49.462 23:17:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:49.462 23:17:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:49.462 23:17:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:49.462 23:17:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:49.462 23:17:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:49.462 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:49.462 23:17:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:49.462 23:17:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:49.462 23:17:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:49.462 23:17:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:49.462 23:17:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:49.462 23:17:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:49.462 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:49.462 23:17:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:49.462 23:17:52 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:49.462 23:17:52 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:49.462 23:17:52 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:49.462 23:17:52 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:49.462 23:17:52 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:49.462 23:17:52 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:49.462 23:17:52 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:49.462 23:17:52 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:49.462 23:17:52 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:49.462 23:17:52 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:49.462 23:17:52 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:49.462 23:17:52 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:49.462 23:17:52 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:49.462 23:17:52 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:49.462 23:17:52 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:49.462 23:17:52 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:49.462 23:17:52 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:49.462 23:17:52 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:49.462 23:17:52 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:49.462 23:17:52 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:49.462 23:17:52 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:49.462 23:17:52 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:49.462 23:17:52 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:49.462 23:17:52 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:49.462 23:17:52 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:49.462 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:49.462 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.234 ms 00:25:49.462 00:25:49.462 --- 10.0.0.2 ping statistics --- 00:25:49.462 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:49.462 rtt min/avg/max/mdev = 0.234/0.234/0.234/0.000 ms 00:25:49.462 23:17:52 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:49.462 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:49.462 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.080 ms 00:25:49.462 00:25:49.462 --- 10.0.0.1 ping statistics --- 00:25:49.462 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:49.462 rtt min/avg/max/mdev = 0.080/0.080/0.080/0.000 ms 00:25:49.462 23:17:52 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:49.462 23:17:52 -- nvmf/common.sh@410 -- # return 0 00:25:49.462 23:17:52 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:49.462 23:17:52 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:49.462 23:17:52 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:49.462 23:17:52 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:49.463 23:17:52 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:49.463 23:17:52 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:49.463 23:17:52 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:49.463 23:17:52 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:25:49.463 23:17:52 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:49.463 23:17:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:49.463 23:17:52 -- common/autotest_common.sh@10 -- # set +x 00:25:49.463 23:17:52 -- nvmf/common.sh@469 -- # nvmfpid=2526559 00:25:49.463 23:17:52 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:25:49.463 23:17:52 -- nvmf/common.sh@470 -- # waitforlisten 2526559 00:25:49.463 23:17:52 -- common/autotest_common.sh@829 -- # '[' -z 2526559 ']' 00:25:49.463 23:17:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:49.463 23:17:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:49.463 23:17:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:49.463 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:49.463 23:17:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:49.463 23:17:52 -- common/autotest_common.sh@10 -- # set +x 00:25:49.463 [2024-11-28 23:17:52.796007] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:49.463 [2024-11-28 23:17:52.796073] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:49.463 EAL: No free 2048 kB hugepages reported on node 1 00:25:49.463 [2024-11-28 23:17:52.861652] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:49.463 [2024-11-28 23:17:52.949581] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:49.463 [2024-11-28 23:17:52.949737] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:49.463 [2024-11-28 23:17:52.949754] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:49.463 [2024-11-28 23:17:52.949766] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:49.463 [2024-11-28 23:17:52.951416] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:49.463 [2024-11-28 23:17:52.951486] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:49.463 [2024-11-28 23:17:52.951549] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:49.463 [2024-11-28 23:17:52.951553] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:50.395 23:17:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:50.395 23:17:53 -- common/autotest_common.sh@862 -- # return 0 00:25:50.396 23:17:53 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:50.396 23:17:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:50.396 23:17:53 -- common/autotest_common.sh@10 -- # set +x 00:25:50.396 23:17:53 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:50.396 23:17:53 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:50.396 23:17:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:50.396 23:17:53 -- common/autotest_common.sh@10 -- # set +x 00:25:50.396 [2024-11-28 23:17:53.796075] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:50.396 23:17:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:50.396 23:17:53 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:25:50.396 23:17:53 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:25:50.396 23:17:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:50.396 23:17:53 -- common/autotest_common.sh@10 -- # set +x 00:25:50.396 23:17:53 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:50.396 23:17:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:50.396 23:17:53 -- target/shutdown.sh@28 -- # cat 00:25:50.396 23:17:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:50.396 23:17:53 -- target/shutdown.sh@28 -- # cat 00:25:50.396 23:17:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:50.396 23:17:53 -- target/shutdown.sh@28 -- # cat 00:25:50.396 23:17:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:50.396 23:17:53 -- target/shutdown.sh@28 -- # cat 00:25:50.396 23:17:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:50.396 23:17:53 -- target/shutdown.sh@28 -- # cat 00:25:50.396 23:17:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:50.396 23:17:53 -- target/shutdown.sh@28 -- # cat 00:25:50.396 23:17:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:50.396 23:17:53 -- target/shutdown.sh@28 -- # cat 00:25:50.396 23:17:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:50.396 23:17:53 -- target/shutdown.sh@28 -- # cat 00:25:50.396 23:17:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:50.396 23:17:53 -- target/shutdown.sh@28 -- # cat 00:25:50.396 23:17:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:50.396 23:17:53 -- target/shutdown.sh@28 -- # cat 00:25:50.396 23:17:53 -- target/shutdown.sh@35 -- # rpc_cmd 00:25:50.396 23:17:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:50.396 23:17:53 -- common/autotest_common.sh@10 -- # set +x 00:25:50.396 Malloc1 00:25:50.396 [2024-11-28 23:17:53.871708] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:50.396 Malloc2 00:25:50.396 Malloc3 00:25:50.396 Malloc4 00:25:50.654 Malloc5 00:25:50.654 Malloc6 00:25:50.654 Malloc7 00:25:50.654 Malloc8 00:25:50.654 Malloc9 00:25:50.913 Malloc10 00:25:50.913 23:17:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:50.913 23:17:54 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:25:50.913 23:17:54 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:50.913 23:17:54 -- common/autotest_common.sh@10 -- # set +x 00:25:50.913 23:17:54 -- target/shutdown.sh@124 -- # perfpid=2526755 00:25:50.913 23:17:54 -- target/shutdown.sh@125 -- # waitforlisten 2526755 /var/tmp/bdevperf.sock 00:25:50.913 23:17:54 -- common/autotest_common.sh@829 -- # '[' -z 2526755 ']' 00:25:50.913 23:17:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:50.913 23:17:54 -- target/shutdown.sh@123 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:25:50.913 23:17:54 -- target/shutdown.sh@123 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:50.913 23:17:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:50.913 23:17:54 -- nvmf/common.sh@520 -- # config=() 00:25:50.913 23:17:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:50.914 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:50.914 23:17:54 -- nvmf/common.sh@520 -- # local subsystem config 00:25:50.914 23:17:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:50.914 23:17:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:50.914 23:17:54 -- common/autotest_common.sh@10 -- # set +x 00:25:50.914 23:17:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:50.914 { 00:25:50.914 "params": { 00:25:50.914 "name": "Nvme$subsystem", 00:25:50.914 "trtype": "$TEST_TRANSPORT", 00:25:50.914 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:50.914 "adrfam": "ipv4", 00:25:50.914 "trsvcid": "$NVMF_PORT", 00:25:50.914 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:50.914 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:50.914 "hdgst": ${hdgst:-false}, 00:25:50.914 "ddgst": ${ddgst:-false} 00:25:50.914 }, 00:25:50.914 "method": "bdev_nvme_attach_controller" 00:25:50.914 } 00:25:50.914 EOF 00:25:50.914 )") 00:25:50.914 23:17:54 -- nvmf/common.sh@542 -- # cat 00:25:50.914 23:17:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:50.914 23:17:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:50.914 { 00:25:50.914 "params": { 00:25:50.914 "name": "Nvme$subsystem", 00:25:50.914 "trtype": "$TEST_TRANSPORT", 00:25:50.914 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:50.914 "adrfam": "ipv4", 00:25:50.914 "trsvcid": "$NVMF_PORT", 00:25:50.914 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:50.914 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:50.914 "hdgst": ${hdgst:-false}, 00:25:50.914 "ddgst": ${ddgst:-false} 00:25:50.914 }, 00:25:50.914 "method": "bdev_nvme_attach_controller" 00:25:50.914 } 00:25:50.914 EOF 00:25:50.914 )") 00:25:50.914 23:17:54 -- nvmf/common.sh@542 -- # cat 00:25:50.914 23:17:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:50.914 23:17:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:50.914 { 00:25:50.914 "params": { 00:25:50.914 "name": "Nvme$subsystem", 00:25:50.914 "trtype": "$TEST_TRANSPORT", 00:25:50.914 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:50.914 "adrfam": "ipv4", 00:25:50.914 "trsvcid": "$NVMF_PORT", 00:25:50.914 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:50.914 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:50.914 "hdgst": ${hdgst:-false}, 00:25:50.914 "ddgst": ${ddgst:-false} 00:25:50.914 }, 00:25:50.914 "method": "bdev_nvme_attach_controller" 00:25:50.914 } 00:25:50.914 EOF 00:25:50.914 )") 00:25:50.914 23:17:54 -- nvmf/common.sh@542 -- # cat 00:25:50.914 23:17:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:50.914 23:17:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:50.914 { 00:25:50.914 "params": { 00:25:50.914 "name": "Nvme$subsystem", 00:25:50.914 "trtype": "$TEST_TRANSPORT", 00:25:50.914 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:50.914 "adrfam": "ipv4", 00:25:50.914 "trsvcid": "$NVMF_PORT", 00:25:50.914 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:50.914 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:50.914 "hdgst": ${hdgst:-false}, 00:25:50.914 "ddgst": ${ddgst:-false} 00:25:50.914 }, 00:25:50.914 "method": "bdev_nvme_attach_controller" 00:25:50.914 } 00:25:50.914 EOF 00:25:50.914 )") 00:25:50.914 23:17:54 -- nvmf/common.sh@542 -- # cat 00:25:50.914 23:17:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:50.914 23:17:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:50.914 { 00:25:50.914 "params": { 00:25:50.914 "name": "Nvme$subsystem", 00:25:50.914 "trtype": "$TEST_TRANSPORT", 00:25:50.914 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:50.914 "adrfam": "ipv4", 00:25:50.914 "trsvcid": "$NVMF_PORT", 00:25:50.914 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:50.914 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:50.914 "hdgst": ${hdgst:-false}, 00:25:50.914 "ddgst": ${ddgst:-false} 00:25:50.914 }, 00:25:50.914 "method": "bdev_nvme_attach_controller" 00:25:50.914 } 00:25:50.914 EOF 00:25:50.914 )") 00:25:50.914 23:17:54 -- nvmf/common.sh@542 -- # cat 00:25:50.914 23:17:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:50.914 23:17:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:50.914 { 00:25:50.914 "params": { 00:25:50.914 "name": "Nvme$subsystem", 00:25:50.914 "trtype": "$TEST_TRANSPORT", 00:25:50.914 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:50.914 "adrfam": "ipv4", 00:25:50.914 "trsvcid": "$NVMF_PORT", 00:25:50.914 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:50.914 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:50.914 "hdgst": ${hdgst:-false}, 00:25:50.914 "ddgst": ${ddgst:-false} 00:25:50.914 }, 00:25:50.914 "method": "bdev_nvme_attach_controller" 00:25:50.914 } 00:25:50.914 EOF 00:25:50.914 )") 00:25:50.914 23:17:54 -- nvmf/common.sh@542 -- # cat 00:25:50.914 23:17:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:50.914 23:17:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:50.914 { 00:25:50.914 "params": { 00:25:50.914 "name": "Nvme$subsystem", 00:25:50.914 "trtype": "$TEST_TRANSPORT", 00:25:50.914 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:50.914 "adrfam": "ipv4", 00:25:50.914 "trsvcid": "$NVMF_PORT", 00:25:50.914 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:50.914 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:50.914 "hdgst": ${hdgst:-false}, 00:25:50.914 "ddgst": ${ddgst:-false} 00:25:50.914 }, 00:25:50.914 "method": "bdev_nvme_attach_controller" 00:25:50.914 } 00:25:50.914 EOF 00:25:50.914 )") 00:25:50.914 23:17:54 -- nvmf/common.sh@542 -- # cat 00:25:50.914 23:17:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:50.914 23:17:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:50.914 { 00:25:50.914 "params": { 00:25:50.914 "name": "Nvme$subsystem", 00:25:50.914 "trtype": "$TEST_TRANSPORT", 00:25:50.914 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:50.914 "adrfam": "ipv4", 00:25:50.914 "trsvcid": "$NVMF_PORT", 00:25:50.914 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:50.914 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:50.914 "hdgst": ${hdgst:-false}, 00:25:50.914 "ddgst": ${ddgst:-false} 00:25:50.914 }, 00:25:50.914 "method": "bdev_nvme_attach_controller" 00:25:50.914 } 00:25:50.914 EOF 00:25:50.914 )") 00:25:50.914 23:17:54 -- nvmf/common.sh@542 -- # cat 00:25:50.914 23:17:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:50.914 23:17:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:50.914 { 00:25:50.914 "params": { 00:25:50.914 "name": "Nvme$subsystem", 00:25:50.914 "trtype": "$TEST_TRANSPORT", 00:25:50.914 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:50.914 "adrfam": "ipv4", 00:25:50.914 "trsvcid": "$NVMF_PORT", 00:25:50.914 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:50.914 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:50.914 "hdgst": ${hdgst:-false}, 00:25:50.914 "ddgst": ${ddgst:-false} 00:25:50.914 }, 00:25:50.914 "method": "bdev_nvme_attach_controller" 00:25:50.914 } 00:25:50.914 EOF 00:25:50.914 )") 00:25:50.914 23:17:54 -- nvmf/common.sh@542 -- # cat 00:25:50.914 23:17:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:50.914 23:17:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:50.914 { 00:25:50.914 "params": { 00:25:50.914 "name": "Nvme$subsystem", 00:25:50.914 "trtype": "$TEST_TRANSPORT", 00:25:50.914 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:50.914 "adrfam": "ipv4", 00:25:50.914 "trsvcid": "$NVMF_PORT", 00:25:50.914 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:50.914 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:50.914 "hdgst": ${hdgst:-false}, 00:25:50.914 "ddgst": ${ddgst:-false} 00:25:50.914 }, 00:25:50.914 "method": "bdev_nvme_attach_controller" 00:25:50.914 } 00:25:50.914 EOF 00:25:50.914 )") 00:25:50.914 23:17:54 -- nvmf/common.sh@542 -- # cat 00:25:50.914 23:17:54 -- nvmf/common.sh@544 -- # jq . 00:25:50.914 23:17:54 -- nvmf/common.sh@545 -- # IFS=, 00:25:50.914 23:17:54 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:50.914 "params": { 00:25:50.914 "name": "Nvme1", 00:25:50.914 "trtype": "tcp", 00:25:50.914 "traddr": "10.0.0.2", 00:25:50.914 "adrfam": "ipv4", 00:25:50.914 "trsvcid": "4420", 00:25:50.914 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:50.914 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:50.914 "hdgst": false, 00:25:50.914 "ddgst": false 00:25:50.914 }, 00:25:50.914 "method": "bdev_nvme_attach_controller" 00:25:50.914 },{ 00:25:50.914 "params": { 00:25:50.914 "name": "Nvme2", 00:25:50.914 "trtype": "tcp", 00:25:50.914 "traddr": "10.0.0.2", 00:25:50.914 "adrfam": "ipv4", 00:25:50.914 "trsvcid": "4420", 00:25:50.914 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:50.914 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:50.914 "hdgst": false, 00:25:50.914 "ddgst": false 00:25:50.914 }, 00:25:50.914 "method": "bdev_nvme_attach_controller" 00:25:50.914 },{ 00:25:50.914 "params": { 00:25:50.914 "name": "Nvme3", 00:25:50.914 "trtype": "tcp", 00:25:50.914 "traddr": "10.0.0.2", 00:25:50.915 "adrfam": "ipv4", 00:25:50.915 "trsvcid": "4420", 00:25:50.915 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:50.915 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:50.915 "hdgst": false, 00:25:50.915 "ddgst": false 00:25:50.915 }, 00:25:50.915 "method": "bdev_nvme_attach_controller" 00:25:50.915 },{ 00:25:50.915 "params": { 00:25:50.915 "name": "Nvme4", 00:25:50.915 "trtype": "tcp", 00:25:50.915 "traddr": "10.0.0.2", 00:25:50.915 "adrfam": "ipv4", 00:25:50.915 "trsvcid": "4420", 00:25:50.915 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:50.915 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:50.915 "hdgst": false, 00:25:50.915 "ddgst": false 00:25:50.915 }, 00:25:50.915 "method": "bdev_nvme_attach_controller" 00:25:50.915 },{ 00:25:50.915 "params": { 00:25:50.915 "name": "Nvme5", 00:25:50.915 "trtype": "tcp", 00:25:50.915 "traddr": "10.0.0.2", 00:25:50.915 "adrfam": "ipv4", 00:25:50.915 "trsvcid": "4420", 00:25:50.915 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:50.915 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:50.915 "hdgst": false, 00:25:50.915 "ddgst": false 00:25:50.915 }, 00:25:50.915 "method": "bdev_nvme_attach_controller" 00:25:50.915 },{ 00:25:50.915 "params": { 00:25:50.915 "name": "Nvme6", 00:25:50.915 "trtype": "tcp", 00:25:50.915 "traddr": "10.0.0.2", 00:25:50.915 "adrfam": "ipv4", 00:25:50.915 "trsvcid": "4420", 00:25:50.915 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:50.915 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:50.915 "hdgst": false, 00:25:50.915 "ddgst": false 00:25:50.915 }, 00:25:50.915 "method": "bdev_nvme_attach_controller" 00:25:50.915 },{ 00:25:50.915 "params": { 00:25:50.915 "name": "Nvme7", 00:25:50.915 "trtype": "tcp", 00:25:50.915 "traddr": "10.0.0.2", 00:25:50.915 "adrfam": "ipv4", 00:25:50.915 "trsvcid": "4420", 00:25:50.915 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:50.915 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:50.915 "hdgst": false, 00:25:50.915 "ddgst": false 00:25:50.915 }, 00:25:50.915 "method": "bdev_nvme_attach_controller" 00:25:50.915 },{ 00:25:50.915 "params": { 00:25:50.915 "name": "Nvme8", 00:25:50.915 "trtype": "tcp", 00:25:50.915 "traddr": "10.0.0.2", 00:25:50.915 "adrfam": "ipv4", 00:25:50.915 "trsvcid": "4420", 00:25:50.915 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:50.915 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:50.915 "hdgst": false, 00:25:50.915 "ddgst": false 00:25:50.915 }, 00:25:50.915 "method": "bdev_nvme_attach_controller" 00:25:50.915 },{ 00:25:50.915 "params": { 00:25:50.915 "name": "Nvme9", 00:25:50.915 "trtype": "tcp", 00:25:50.915 "traddr": "10.0.0.2", 00:25:50.915 "adrfam": "ipv4", 00:25:50.915 "trsvcid": "4420", 00:25:50.915 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:50.915 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:50.915 "hdgst": false, 00:25:50.915 "ddgst": false 00:25:50.915 }, 00:25:50.915 "method": "bdev_nvme_attach_controller" 00:25:50.915 },{ 00:25:50.915 "params": { 00:25:50.915 "name": "Nvme10", 00:25:50.915 "trtype": "tcp", 00:25:50.915 "traddr": "10.0.0.2", 00:25:50.915 "adrfam": "ipv4", 00:25:50.915 "trsvcid": "4420", 00:25:50.915 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:50.915 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:50.915 "hdgst": false, 00:25:50.915 "ddgst": false 00:25:50.915 }, 00:25:50.915 "method": "bdev_nvme_attach_controller" 00:25:50.915 }' 00:25:50.915 [2024-11-28 23:17:54.389229] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:50.915 [2024-11-28 23:17:54.389313] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2526755 ] 00:25:50.915 EAL: No free 2048 kB hugepages reported on node 1 00:25:50.915 [2024-11-28 23:17:54.452762] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:51.174 [2024-11-28 23:17:54.539590] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:53.072 Running I/O for 10 seconds... 00:25:53.331 23:17:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:53.331 23:17:56 -- common/autotest_common.sh@862 -- # return 0 00:25:53.331 23:17:56 -- target/shutdown.sh@126 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:25:53.331 23:17:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:53.331 23:17:56 -- common/autotest_common.sh@10 -- # set +x 00:25:53.331 23:17:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:53.331 23:17:56 -- target/shutdown.sh@129 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:53.331 23:17:56 -- target/shutdown.sh@131 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:25:53.331 23:17:56 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:25:53.331 23:17:56 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:25:53.331 23:17:56 -- target/shutdown.sh@57 -- # local ret=1 00:25:53.331 23:17:56 -- target/shutdown.sh@58 -- # local i 00:25:53.331 23:17:56 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:25:53.331 23:17:56 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:53.331 23:17:56 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:53.331 23:17:56 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:53.331 23:17:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:53.331 23:17:56 -- common/autotest_common.sh@10 -- # set +x 00:25:53.331 23:17:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:53.331 23:17:56 -- target/shutdown.sh@60 -- # read_io_count=254 00:25:53.331 23:17:56 -- target/shutdown.sh@63 -- # '[' 254 -ge 100 ']' 00:25:53.331 23:17:56 -- target/shutdown.sh@64 -- # ret=0 00:25:53.331 23:17:56 -- target/shutdown.sh@65 -- # break 00:25:53.331 23:17:56 -- target/shutdown.sh@69 -- # return 0 00:25:53.331 23:17:56 -- target/shutdown.sh@134 -- # killprocess 2526559 00:25:53.331 23:17:56 -- common/autotest_common.sh@936 -- # '[' -z 2526559 ']' 00:25:53.331 23:17:56 -- common/autotest_common.sh@940 -- # kill -0 2526559 00:25:53.331 23:17:56 -- common/autotest_common.sh@941 -- # uname 00:25:53.331 23:17:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:53.331 23:17:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2526559 00:25:53.602 23:17:56 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:53.602 23:17:56 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:53.602 23:17:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2526559' 00:25:53.602 killing process with pid 2526559 00:25:53.602 23:17:56 -- common/autotest_common.sh@955 -- # kill 2526559 00:25:53.602 23:17:56 -- common/autotest_common.sh@960 -- # wait 2526559 00:25:53.602 [2024-11-28 23:17:56.968255] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968372] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968408] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968423] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968435] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968447] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968459] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968471] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968483] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968495] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968507] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968519] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968541] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968554] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968566] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968578] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968589] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968601] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968613] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968625] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968637] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968648] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968659] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968671] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968690] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968702] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968728] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968739] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968751] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968763] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968775] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968786] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968797] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968809] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968820] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968832] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968843] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968854] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968866] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968881] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968893] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968904] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968915] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968927] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968939] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968951] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968963] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968974] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968986] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.968997] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.969008] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.969019] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.969031] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.969042] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.969053] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.969065] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.969076] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.969088] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.969099] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.969110] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.969122] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.969133] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.969144] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe90 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.970503] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.970538] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.970554] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.970573] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.970586] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.970599] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.970611] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.970623] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.970636] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.970648] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.970660] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.970672] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.970689] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.970702] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.602 [2024-11-28 23:17:56.970729] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.970742] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.970754] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.970766] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.970778] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.970790] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.970802] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.970813] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.970825] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.970838] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.970850] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.970862] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.970874] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.970886] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.970897] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.970909] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.970929] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.970942] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.970953] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.970966] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.970978] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.970989] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.971001] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.971013] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.971025] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.971037] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.971049] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.971061] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.971072] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.971084] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.971096] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.971108] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.971120] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.971132] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.971145] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.971157] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.971168] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.971180] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.971191] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.971203] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.971215] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.971227] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.971239] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.971254] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.971267] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.971279] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.971291] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.971304] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.971315] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a425e0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.973720] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:53.603 [2024-11-28 23:17:56.973763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.603 [2024-11-28 23:17:56.973782] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:53.603 [2024-11-28 23:17:56.973796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.603 [2024-11-28 23:17:56.973811] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:53.603 [2024-11-28 23:17:56.973826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.603 [2024-11-28 23:17:56.973840] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:53.603 [2024-11-28 23:17:56.973854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.603 [2024-11-28 23:17:56.973868] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aa6b0 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.973938] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:53.603 [2024-11-28 23:17:56.973963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.603 [2024-11-28 23:17:56.973991] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:53.603 [2024-11-28 23:17:56.974009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.603 [2024-11-28 23:17:56.974023] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:53.603 [2024-11-28 23:17:56.974037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.603 [2024-11-28 23:17:56.974051] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:53.603 [2024-11-28 23:17:56.974065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.603 [2024-11-28 23:17:56.974078] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b6fc50 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.974896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.603 [2024-11-28 23:17:56.974925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.603 [2024-11-28 23:17:56.974973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.603 [2024-11-28 23:17:56.974991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.603 [2024-11-28 23:17:56.975008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.603 [2024-11-28 23:17:56.975022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.603 [2024-11-28 23:17:56.975038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.603 [2024-11-28 23:17:56.975052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.603 [2024-11-28 23:17:56.975068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.603 [2024-11-28 23:17:56.975082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.603 [2024-11-28 23:17:56.975099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.603 [2024-11-28 23:17:56.975112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.603 [2024-11-28 23:17:56.975128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.603 [2024-11-28 23:17:56.975142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.603 [2024-11-28 23:17:56.975158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.603 [2024-11-28 23:17:56.975172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.603 [2024-11-28 23:17:56.975203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.603 [2024-11-28 23:17:56.975217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.603 [2024-11-28 23:17:56.975233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.603 [2024-11-28 23:17:56.975247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.603 [2024-11-28 23:17:56.975262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.603 [2024-11-28 23:17:56.975276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.603 [2024-11-28 23:17:56.975291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.603 [2024-11-28 23:17:56.975305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.603 [2024-11-28 23:17:56.975321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.603 [2024-11-28 23:17:56.975334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.603 [2024-11-28 23:17:56.975350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.603 [2024-11-28 23:17:56.975368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.603 [2024-11-28 23:17:56.975414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.603 [2024-11-28 23:17:56.975431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.603 [2024-11-28 23:17:56.975447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.603 [2024-11-28 23:17:56.975461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.603 [2024-11-28 23:17:56.975479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.603 [2024-11-28 23:17:56.975493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.603 [2024-11-28 23:17:56.975509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.603 [2024-11-28 23:17:56.975524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.603 [2024-11-28 23:17:56.975541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.603 [2024-11-28 23:17:56.975555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.603 [2024-11-28 23:17:56.975572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.603 [2024-11-28 23:17:56.975587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.603 [2024-11-28 23:17:56.975604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.603 [2024-11-28 23:17:56.975618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.603 [2024-11-28 23:17:56.975634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.603 [2024-11-28 23:17:56.975649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.603 [2024-11-28 23:17:56.975665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.603 [2024-11-28 23:17:56.975680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.603 [2024-11-28 23:17:56.975680] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.975703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.603 [2024-11-28 23:17:56.975710] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.975718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.603 [2024-11-28 23:17:56.975724] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.975735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:38656 len:12[2024-11-28 23:17:56.975737] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.603 the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.975756] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with [2024-11-28 23:17:56.975756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:53.603 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.603 [2024-11-28 23:17:56.975786] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.975792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.603 [2024-11-28 23:17:56.975799] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.975808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.603 [2024-11-28 23:17:56.975811] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.975824] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.603 [2024-11-28 23:17:56.975825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.604 [2024-11-28 23:17:56.975851] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.975856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.604 [2024-11-28 23:17:56.975864] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.975874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:38912 len:12[2024-11-28 23:17:56.975876] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.604 the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.975890] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with [2024-11-28 23:17:56.975891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:53.604 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.604 [2024-11-28 23:17:56.975904] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.975909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.604 [2024-11-28 23:17:56.975917] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.975924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.604 [2024-11-28 23:17:56.975929] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.975942] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with [2024-11-28 23:17:56.975941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:39552 len:12the state(5) to be set 00:25:53.604 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.604 [2024-11-28 23:17:56.975956] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.975959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.604 [2024-11-28 23:17:56.975969] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.975975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.604 [2024-11-28 23:17:56.975984] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.975991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.604 [2024-11-28 23:17:56.975997] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.976007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:39936 len:12[2024-11-28 23:17:56.976009] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.604 the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.976023] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.976024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.604 [2024-11-28 23:17:56.976035] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.976042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.604 [2024-11-28 23:17:56.976048] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.976058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.604 [2024-11-28 23:17:56.976060] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.976073] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.976075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.604 [2024-11-28 23:17:56.976085] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.976090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.604 [2024-11-28 23:17:56.976098] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.976107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.604 [2024-11-28 23:17:56.976111] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.976122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-28 23:17:56.976123] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.604 the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.976138] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.976140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.604 [2024-11-28 23:17:56.976151] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.976156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-28 23:17:56.976164] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.604 the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.976178] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.976182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.604 [2024-11-28 23:17:56.976191] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.976198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.604 [2024-11-28 23:17:56.976203] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.976216] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.976221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.604 [2024-11-28 23:17:56.976228] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.976237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.604 [2024-11-28 23:17:56.976241] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.976253] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with [2024-11-28 23:17:56.976253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:42112 len:12the state(5) to be set 00:25:53.604 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.604 [2024-11-28 23:17:56.976267] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.976270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.604 [2024-11-28 23:17:56.976280] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.976286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.604 [2024-11-28 23:17:56.976292] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.976300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.604 [2024-11-28 23:17:56.976306] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.976318] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with [2024-11-28 23:17:56.976317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:42368 len:12the state(5) to be set 00:25:53.604 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.604 [2024-11-28 23:17:56.976332] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.976334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.604 [2024-11-28 23:17:56.976345] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.976366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.604 [2024-11-28 23:17:56.976381] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.976385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.604 [2024-11-28 23:17:56.976400] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.976409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.604 [2024-11-28 23:17:56.976414] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.976450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.604 [2024-11-28 23:17:56.976453] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.976466] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.976467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.604 [2024-11-28 23:17:56.976478] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.976482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.604 [2024-11-28 23:17:56.976491] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.976499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.604 [2024-11-28 23:17:56.976504] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.976514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-28 23:17:56.976516] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.604 the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.976529] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.976532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.604 [2024-11-28 23:17:56.976541] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.976546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.604 [2024-11-28 23:17:56.976554] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.976562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.604 [2024-11-28 23:17:56.976566] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.976577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-28 23:17:56.976578] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.604 the state(5) to be set 00:25:53.604 [2024-11-28 23:17:56.976593] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40340 is same with [2024-11-28 23:17:56.976596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:43264 len:1the state(5) to be set 00:25:53.604 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.604 [2024-11-28 23:17:56.976612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.604 [2024-11-28 23:17:56.976627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.604 [2024-11-28 23:17:56.976642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.604 [2024-11-28 23:17:56.976658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.604 [2024-11-28 23:17:56.976673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.604 [2024-11-28 23:17:56.976689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.604 [2024-11-28 23:17:56.976702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.604 [2024-11-28 23:17:56.976718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.604 [2024-11-28 23:17:56.976732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.604 [2024-11-28 23:17:56.976763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.604 [2024-11-28 23:17:56.976776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.604 [2024-11-28 23:17:56.976793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.604 [2024-11-28 23:17:56.976806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.604 [2024-11-28 23:17:56.976821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.604 [2024-11-28 23:17:56.976835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.604 [2024-11-28 23:17:56.976849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.604 [2024-11-28 23:17:56.976863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.604 [2024-11-28 23:17:56.976878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.604 [2024-11-28 23:17:56.976892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.604 [2024-11-28 23:17:56.976907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.604 [2024-11-28 23:17:56.976921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.604 [2024-11-28 23:17:56.976936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.604 [2024-11-28 23:17:56.976950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.604 [2024-11-28 23:17:56.976965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.604 [2024-11-28 23:17:56.976982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.604 [2024-11-28 23:17:56.976998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.604 [2024-11-28 23:17:56.977012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.604 [2024-11-28 23:17:56.977027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.604 [2024-11-28 23:17:56.977041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.604 [2024-11-28 23:17:56.977056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.604 [2024-11-28 23:17:56.977070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.605 [2024-11-28 23:17:56.977085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.605 [2024-11-28 23:17:56.977099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.605 [2024-11-28 23:17:56.977192] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1a1c010 was disconnected and freed. reset controller. 00:25:53.605 [2024-11-28 23:17:56.978689] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.978721] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.978736] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.978749] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.978761] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.978772] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.978785] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.978800] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.978813] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.978824] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.978837] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.978849] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.978861] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.978873] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.978885] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.978897] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.978910] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.978928] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.978941] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.978954] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.978966] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.978978] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.979004] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.979016] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.979028] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.979039] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.979051] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.979063] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.979074] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.979086] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.979098] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.979124] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.979137] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.979150] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.979163] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.979175] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.979193] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.979218] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.979233] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.979246] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.979259] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.979279] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.979299] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.979312] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.979329] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.979342] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.979354] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.979365] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.979387] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.979413] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.979426] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.979438] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.979450] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.979463] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.979474] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.979486] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.979498] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.979510] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.979521] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.979533] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.979544] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.979556] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.979568] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407f0 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.980569] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:53.605 [2024-11-28 23:17:56.980606] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:53.605 [2024-11-28 23:17:56.980640] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aa6b0 (9): Bad file descriptor 00:25:53.605 [2024-11-28 23:17:56.980653] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.980699] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.980714] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.980727] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.980740] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.980766] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.980780] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.980792] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.980804] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.980816] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.980829] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.980841] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.980853] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.980865] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.980877] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.980890] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.980903] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.980915] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.980927] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.980940] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.980952] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.980964] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.980976] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.980988] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.981001] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.981014] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.981027] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.981039] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.981051] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.981063] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.981076] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.981088] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.981104] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.981117] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.981130] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.981144] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.981167] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.981191] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.981212] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.981226] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.981238] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.981250] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.981262] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.981275] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.981287] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.981300] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.981312] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.981325] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.605 [2024-11-28 23:17:56.981337] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.981350] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.981363] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.981387] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.981410] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.981424] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.981436] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.981448] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.981460] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.981473] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.981485] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.981497] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.981514] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.981527] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.981539] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c80 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.982316] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:53.606 [2024-11-28 23:17:56.982482] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.982514] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.982534] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.982548] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.982561] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.982574] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.982586] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.982599] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.982612] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.982624] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.982636] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.982648] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.982661] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.982677] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.982708] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.982732] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.982755] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.982778] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.982801] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.982824] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.982846] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.982868] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.982889] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.982908] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.982922] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.982935] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.982948] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.982962] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.982974] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.982986] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.982998] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.983011] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.983024] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.983037] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.983049] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.983061] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.983073] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.983085] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.983097] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.983116] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.983139] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.983161] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.983185] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.983207] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.983229] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with [2024-11-28 23:17:56.983229] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:53.606 the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.983254] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.983268] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.983280] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.983292] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.983304] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.983320] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.983333] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.983346] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.983358] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.983370] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.983391] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40fe0 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.984369] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a41490 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.984416] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a41490 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.984432] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a41490 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.984445] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a41490 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.984457] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a41490 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.984470] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a41490 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.984483] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a41490 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.984482] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:53.606 [2024-11-28 23:17:56.984495] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a41490 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.984508] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a41490 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.984509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.606 [2024-11-28 23:17:56.984520] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a41490 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.984526] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:53.606 [2024-11-28 23:17:56.984533] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a41490 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.984541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.606 [2024-11-28 23:17:56.984546] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a41490 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.984556] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:53.606 [2024-11-28 23:17:56.984559] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a41490 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.984571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.606 [2024-11-28 23:17:56.984579] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a41490 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.984585] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:53.606 [2024-11-28 23:17:56.984598] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a41490 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.984600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.606 [2024-11-28 23:17:56.984611] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a41490 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.984614] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b71100 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.984624] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a41490 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.984636] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a41490 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.984649] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a41490 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.984662] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a41490 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.984660] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:53.606 [2024-11-28 23:17:56.984674] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a41490 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.984689] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a41490 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.984690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.606 [2024-11-28 23:17:56.984701] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a41490 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.984706] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:53.606 [2024-11-28 23:17:56.984720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.606 [2024-11-28 23:17:56.984734] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:53.606 [2024-11-28 23:17:56.984747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.606 [2024-11-28 23:17:56.984761] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:53.606 [2024-11-28 23:17:56.984775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.606 [2024-11-28 23:17:56.984788] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b4bc80 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.984854] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:53.606 [2024-11-28 23:17:56.984884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.606 [2024-11-28 23:17:56.984907] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:53.606 [2024-11-28 23:17:56.984922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.606 [2024-11-28 23:17:56.984936] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:53.606 [2024-11-28 23:17:56.984956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.606 [2024-11-28 23:17:56.984971] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:53.606 [2024-11-28 23:17:56.984984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.606 [2024-11-28 23:17:56.984998] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19cca30 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.985045] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:53.606 [2024-11-28 23:17:56.985066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.606 [2024-11-28 23:17:56.985082] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:53.606 [2024-11-28 23:17:56.985096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.606 [2024-11-28 23:17:56.985110] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:53.606 [2024-11-28 23:17:56.985125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.606 [2024-11-28 23:17:56.985139] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:53.606 [2024-11-28 23:17:56.985152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.606 [2024-11-28 23:17:56.985165] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b7d30 is same with the state(5) to be set 00:25:53.606 [2024-11-28 23:17:56.985193] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b6fc50 (9): Bad file descriptor 00:25:53.606 [2024-11-28 23:17:56.985703] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:53.607 [2024-11-28 23:17:56.986525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.986551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.986576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.986593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.986611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.986625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.986642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.986656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.986672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.986692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.986708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.986729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.986747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.986762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.986779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.986793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.986809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.986824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.986840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.986869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.986886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.986899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.986915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.986929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.986946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.986960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.986976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.986990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.987006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.987020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.987036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.987050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.987065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.987079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.987095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.987109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.987130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.987144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.987160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.987174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.987189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.987203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.987218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.987231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.987247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.987260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.987276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.987304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.987322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.987337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.987353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.987367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.987388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.987414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.987433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.987447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.987464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.987478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.987496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.987511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.987527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.987546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.987563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.987579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.987595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.987610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.987626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.987641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.987657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.987682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.987698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.987705] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a41dd0 is same with [2024-11-28 23:17:56.987714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:53.607 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.987736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.987750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.987767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.987782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.987798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.987812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.987829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.987844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.987861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.987881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.987910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.987931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.987949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.987968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.987986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.987992] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with [2024-11-28 23:17:56.988001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:53.607 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.988021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:42880 len:1[2024-11-28 23:17:56.988021] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 the state(5) to be set 00:25:53.607 [2024-11-28 23:17:56.988038] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with [2024-11-28 23:17:56.988038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:53.607 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.988053] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.607 [2024-11-28 23:17:56.988058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.988065] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.607 [2024-11-28 23:17:56.988073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.988078] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.607 [2024-11-28 23:17:56.988090] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.607 [2024-11-28 23:17:56.988090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.988102] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.607 [2024-11-28 23:17:56.988107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.988115] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.607 [2024-11-28 23:17:56.988123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.988128] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.607 [2024-11-28 23:17:56.988138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.988141] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.607 [2024-11-28 23:17:56.988154] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.607 [2024-11-28 23:17:56.988156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.988166] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.607 [2024-11-28 23:17:56.988171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.988179] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.607 [2024-11-28 23:17:56.988191] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.607 [2024-11-28 23:17:56.988192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.988204] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.607 [2024-11-28 23:17:56.988208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.988217] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.607 [2024-11-28 23:17:56.988225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.988229] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.607 [2024-11-28 23:17:56.988240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-28 23:17:56.988242] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 the state(5) to be set 00:25:53.607 [2024-11-28 23:17:56.988256] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.607 [2024-11-28 23:17:56.988259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.607 [2024-11-28 23:17:56.988269] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.607 [2024-11-28 23:17:56.988274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.607 [2024-11-28 23:17:56.988281] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.608 [2024-11-28 23:17:56.988291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.608 [2024-11-28 23:17:56.988294] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.608 [2024-11-28 23:17:56.988306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-28 23:17:56.988307] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.608 the state(5) to be set 00:25:53.608 [2024-11-28 23:17:56.988321] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.608 [2024-11-28 23:17:56.988324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.608 [2024-11-28 23:17:56.988333] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.608 [2024-11-28 23:17:56.988339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.608 [2024-11-28 23:17:56.988346] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.608 [2024-11-28 23:17:56.988356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:44160 len:1[2024-11-28 23:17:56.988358] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.608 the state(5) to be set 00:25:53.608 [2024-11-28 23:17:56.988384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.608 [2024-11-28 23:17:56.988387] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.608 [2024-11-28 23:17:56.988408] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with [2024-11-28 23:17:56.988408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:44288 len:1the state(5) to be set 00:25:53.608 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.608 [2024-11-28 23:17:56.988424] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.608 [2024-11-28 23:17:56.988427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.608 [2024-11-28 23:17:56.988437] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.608 [2024-11-28 23:17:56.988445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.608 [2024-11-28 23:17:56.988449] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.608 [2024-11-28 23:17:56.988460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-28 23:17:56.988462] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.608 the state(5) to be set 00:25:53.608 [2024-11-28 23:17:56.988476] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.608 [2024-11-28 23:17:56.988480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.608 [2024-11-28 23:17:56.988488] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.608 [2024-11-28 23:17:56.988495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.608 [2024-11-28 23:17:56.988501] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.608 [2024-11-28 23:17:56.988513] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with [2024-11-28 23:17:56.988512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:44672 len:12the state(5) to be set 00:25:53.608 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.608 [2024-11-28 23:17:56.988527] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.608 [2024-11-28 23:17:56.988530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.608 [2024-11-28 23:17:56.988539] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.608 [2024-11-28 23:17:56.988548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.608 [2024-11-28 23:17:56.988551] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.608 [2024-11-28 23:17:56.988562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-28 23:17:56.988564] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.608 the state(5) to be set 00:25:53.608 [2024-11-28 23:17:56.988578] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.608 [2024-11-28 23:17:56.988581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.608 [2024-11-28 23:17:56.988589] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.608 [2024-11-28 23:17:56.988600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-28 23:17:56.988601] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.608 the state(5) to be set 00:25:53.608 [2024-11-28 23:17:56.988616] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.608 [2024-11-28 23:17:56.988621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.608 [2024-11-28 23:17:56.988628] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.608 [2024-11-28 23:17:56.988636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.608 [2024-11-28 23:17:56.988640] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.608 [2024-11-28 23:17:56.988652] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.608 [2024-11-28 23:17:56.988653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.608 [2024-11-28 23:17:56.988664] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.608 [2024-11-28 23:17:56.988668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.608 [2024-11-28 23:17:56.988683] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.608 [2024-11-28 23:17:56.988688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.608 [2024-11-28 23:17:56.988696] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.608 [2024-11-28 23:17:56.988716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.608 [2024-11-28 23:17:56.988722] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.608 [2024-11-28 23:17:56.988732] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b0e0 is same [2024-11-28 23:17:56.988734] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with with the state(5) to be set 00:25:53.608 the state(5) to be set 00:25:53.608 [2024-11-28 23:17:56.988747] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.608 [2024-11-28 23:17:56.988758] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.608 [2024-11-28 23:17:56.988769] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.608 [2024-11-28 23:17:56.988780] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.608 [2024-11-28 23:17:56.988791] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.608 [2024-11-28 23:17:56.988802] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.608 [2024-11-28 23:17:56.988805] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1b2b0e0 was disconnected and freed. reset controller. 00:25:53.608 [2024-11-28 23:17:56.988813] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.608 [2024-11-28 23:17:56.988827] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.608 [2024-11-28 23:17:56.988839] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42130 is same with the state(5) to be set 00:25:53.608 [2024-11-28 23:17:56.988889] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:53.608 [2024-11-28 23:17:56.988946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.608 [2024-11-28 23:17:56.988967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.608 [2024-11-28 23:17:56.988988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.608 [2024-11-28 23:17:56.989004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.608 [2024-11-28 23:17:56.989020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.608 [2024-11-28 23:17:56.989035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.608 [2024-11-28 23:17:56.989051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.608 [2024-11-28 23:17:56.989065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.608 [2024-11-28 23:17:56.989081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.608 [2024-11-28 23:17:56.989095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.608 [2024-11-28 23:17:56.989110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.608 [2024-11-28 23:17:56.989124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.608 [2024-11-28 23:17:56.989140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.608 [2024-11-28 23:17:56.989154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.608 [2024-11-28 23:17:56.989170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.608 [2024-11-28 23:17:56.989184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.608 [2024-11-28 23:17:56.989200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.608 [2024-11-28 23:17:56.989213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.608 [2024-11-28 23:17:56.989229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.608 [2024-11-28 23:17:56.989243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.608 [2024-11-28 23:17:56.989259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.608 [2024-11-28 23:17:56.989273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.608 [2024-11-28 23:17:56.989293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.608 [2024-11-28 23:17:56.989309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.608 [2024-11-28 23:17:56.989325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.608 [2024-11-28 23:17:56.989339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.608 [2024-11-28 23:17:56.989355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.608 [2024-11-28 23:17:56.989369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.608 [2024-11-28 23:17:56.989391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.608 [2024-11-28 23:17:56.989418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.608 [2024-11-28 23:17:56.989434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.608 [2024-11-28 23:17:56.989448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.608 [2024-11-28 23:17:56.989464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.608 [2024-11-28 23:17:56.989478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.608 [2024-11-28 23:17:56.989494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.608 [2024-11-28 23:17:56.989508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.608 [2024-11-28 23:17:56.989525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.608 [2024-11-28 23:17:56.989539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.608 [2024-11-28 23:17:56.989555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.608 [2024-11-28 23:17:56.989569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.608 [2024-11-28 23:17:56.989585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.608 [2024-11-28 23:17:56.989598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.608 [2024-11-28 23:17:56.989614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.608 [2024-11-28 23:17:56.989628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.608 [2024-11-28 23:17:56.989643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.608 [2024-11-28 23:17:56.989658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.608 [2024-11-28 23:17:56.989673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.608 [2024-11-28 23:17:56.989701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.608 [2024-11-28 23:17:56.989716] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a1ddd0 is same with the state(5) to be set 00:25:53.608 [2024-11-28 23:17:56.989783] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1a1ddd0 was disconnected and freed. reset controller. 00:25:53.609 [2024-11-28 23:17:56.993013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.609 [2024-11-28 23:17:56.993039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.993061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.609 [2024-11-28 23:17:56.993077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.993093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.609 [2024-11-28 23:17:56.993109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.993125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.609 [2024-11-28 23:17:56.993139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.993155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.609 [2024-11-28 23:17:56.993169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.993187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.609 [2024-11-28 23:17:56.993201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.993216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.609 [2024-11-28 23:17:56.993231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.993247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.609 [2024-11-28 23:17:56.993261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.993277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.609 [2024-11-28 23:17:56.993290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.993315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.609 [2024-11-28 23:17:56.993329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.993344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.609 [2024-11-28 23:17:56.993358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.993401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.609 [2024-11-28 23:17:56.993419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.993435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.609 [2024-11-28 23:17:56.993450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.993465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.609 [2024-11-28 23:17:56.993479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.993495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.609 [2024-11-28 23:17:56.993509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.993525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.609 [2024-11-28 23:17:56.993539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.993554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.609 [2024-11-28 23:17:56.993569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.993585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.609 [2024-11-28 23:17:56.993599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.993615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.609 [2024-11-28 23:17:56.993630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.993645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.609 [2024-11-28 23:17:56.993659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.993675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.609 [2024-11-28 23:17:56.993695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.993710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.609 [2024-11-28 23:17:56.993724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.993740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.609 [2024-11-28 23:17:56.993754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.993770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.609 [2024-11-28 23:17:56.993788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.993804] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a1f3b0 is same with the state(5) to be set 00:25:53.609 [2024-11-28 23:17:56.993872] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1a1f3b0 was disconnected and freed. reset controller. 00:25:53.609 [2024-11-28 23:17:56.993963] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:25:53.609 [2024-11-28 23:17:56.993991] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:25:53.609 [2024-11-28 23:17:56.994051] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b60700 (9): Bad file descriptor 00:25:53.609 [2024-11-28 23:17:56.994078] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b4bc80 (9): Bad file descriptor 00:25:53.609 [2024-11-28 23:17:56.994099] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aa6b0 (9): Bad file descriptor 00:25:53.609 [2024-11-28 23:17:56.994120] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:53.609 [2024-11-28 23:17:56.995178] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:25:53.609 [2024-11-28 23:17:56.995239] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ff070 (9): Bad file descriptor 00:25:53.609 [2024-11-28 23:17:56.995281] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:25:53.609 [2024-11-28 23:17:56.995298] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:25:53.609 [2024-11-28 23:17:56.995315] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:53.609 [2024-11-28 23:17:56.995344] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b71100 (9): Bad file descriptor 00:25:53.609 [2024-11-28 23:17:56.995417] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:53.609 [2024-11-28 23:17:56.995439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.995455] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:53.609 [2024-11-28 23:17:56.995470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.995483] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:53.609 [2024-11-28 23:17:56.995498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.995513] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:53.609 [2024-11-28 23:17:56.995527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.995540] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5b660 is same with the state(5) to be set 00:25:53.609 [2024-11-28 23:17:56.995570] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19cca30 (9): Bad file descriptor 00:25:53.609 [2024-11-28 23:17:56.995604] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19b7d30 (9): Bad file descriptor 00:25:53.609 [2024-11-28 23:17:56.995663] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:53.609 [2024-11-28 23:17:56.995703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.995724] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:53.609 [2024-11-28 23:17:56.995739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.995753] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:53.609 [2024-11-28 23:17:56.995767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.995781] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:53.609 [2024-11-28 23:17:56.995795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.995808] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a01650 is same with the state(5) to be set 00:25:53.609 [2024-11-28 23:17:56.996493] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:53.609 [2024-11-28 23:17:56.996642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:53.609 [2024-11-28 23:17:56.996754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:53.609 [2024-11-28 23:17:56.996780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b4bc80 with addr=10.0.0.2, port=4420 00:25:53.609 [2024-11-28 23:17:56.996797] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b4bc80 is same with the state(5) to be set 00:25:53.609 [2024-11-28 23:17:56.996924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:53.609 [2024-11-28 23:17:56.997013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:53.609 [2024-11-28 23:17:56.997039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b60700 with addr=10.0.0.2, port=4420 00:25:53.609 [2024-11-28 23:17:56.997055] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b60700 is same with the state(5) to be set 00:25:53.609 [2024-11-28 23:17:56.997419] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:53.609 [2024-11-28 23:17:56.997494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.609 [2024-11-28 23:17:56.997517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.997540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.609 [2024-11-28 23:17:56.997556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.997574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.609 [2024-11-28 23:17:56.997588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.997604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.609 [2024-11-28 23:17:56.997618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.997635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.609 [2024-11-28 23:17:56.997649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.997671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.609 [2024-11-28 23:17:56.997690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.997706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.609 [2024-11-28 23:17:56.997721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.997737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.609 [2024-11-28 23:17:56.997751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.997768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.609 [2024-11-28 23:17:56.997782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.997799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.609 [2024-11-28 23:17:56.997813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.997829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.609 [2024-11-28 23:17:56.997843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.997859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.609 [2024-11-28 23:17:56.997873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.997889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.609 [2024-11-28 23:17:56.997904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.997920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.609 [2024-11-28 23:17:56.997934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.997951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.609 [2024-11-28 23:17:56.997966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.997983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.609 [2024-11-28 23:17:56.997997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.998013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.609 [2024-11-28 23:17:56.998027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.998043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.609 [2024-11-28 23:17:56.998062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.609 [2024-11-28 23:17:56.998079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.610 [2024-11-28 23:17:56.998094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.610 [2024-11-28 23:17:56.998110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.610 [2024-11-28 23:17:56.998124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.610 [2024-11-28 23:17:56.998140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.610 [2024-11-28 23:17:56.998155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.610 [2024-11-28 23:17:56.998171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.610 [2024-11-28 23:17:56.998185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.610 [2024-11-28 23:17:56.998201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.610 [2024-11-28 23:17:56.998215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.610 [2024-11-28 23:17:56.998232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.610 [2024-11-28 23:17:56.998247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.610 [2024-11-28 23:17:56.998262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.610 [2024-11-28 23:17:56.998277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.610 [2024-11-28 23:17:56.998293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.610 [2024-11-28 23:17:56.998308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.610 [2024-11-28 23:17:56.998324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.610 [2024-11-28 23:17:56.998338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.610 [2024-11-28 23:17:56.998354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.610 [2024-11-28 23:17:56.998370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.610 [2024-11-28 23:17:56.998387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.610 [2024-11-28 23:17:56.998423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.610 [2024-11-28 23:17:56.998441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.610 [2024-11-28 23:17:56.998456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.610 [2024-11-28 23:17:56.998477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.610 [2024-11-28 23:17:56.998493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.610 [2024-11-28 23:17:56.998509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.610 [2024-11-28 23:17:56.998524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.610 [2024-11-28 23:17:56.998540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.610 [2024-11-28 23:17:56.998555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.610 [2024-11-28 23:17:56.998571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.610 [2024-11-28 23:17:56.998585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.610 [2024-11-28 23:17:56.998602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.610 [2024-11-28 23:17:56.998616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.610 [2024-11-28 23:17:56.998633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.610 [2024-11-28 23:17:56.998647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.610 [2024-11-28 23:17:56.998663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.610 [2024-11-28 23:17:56.998686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.610 [2024-11-28 23:17:56.998702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.610 [2024-11-28 23:17:56.998717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.610 [2024-11-28 23:17:56.998733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.610 [2024-11-28 23:17:56.998748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.610 [2024-11-28 23:17:56.998763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.610 [2024-11-28 23:17:56.998778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.610 [2024-11-28 23:17:56.998794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.610 [2024-11-28 23:17:56.998809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.610 [2024-11-28 23:17:56.998826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.610 [2024-11-28 23:17:56.998840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.610 [2024-11-28 23:17:56.998857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.610 [2024-11-28 23:17:56.998876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.610 [2024-11-28 23:17:56.998893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.610 [2024-11-28 23:17:56.998907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.610 [2024-11-28 23:17:56.998923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.610 [2024-11-28 23:17:56.998937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.610 [2024-11-28 23:17:56.998953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.610 [2024-11-28 23:17:56.998968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.610 [2024-11-28 23:17:56.998984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.610 [2024-11-28 23:17:56.998998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.610 [2024-11-28 23:17:56.999015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.610 [2024-11-28 23:17:56.999030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.610 [2024-11-28 23:17:56.999046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.610 [2024-11-28 23:17:56.999060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.610 [2024-11-28 23:17:56.999076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.610 [2024-11-28 23:17:56.999090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.610 [2024-11-28 23:17:56.999106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.610 [2024-11-28 23:17:56.999120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.610 [2024-11-28 23:17:56.999136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.610 [2024-11-28 23:17:56.999151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.610 [2024-11-28 23:17:56.999166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.610 [2024-11-28 23:17:56.999181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.610 [2024-11-28 23:17:56.999199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.610 [2024-11-28 23:17:56.999213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.610 [2024-11-28 23:17:56.999230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.610 [2024-11-28 23:17:56.999244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.610 [2024-11-28 23:17:56.999264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.610 [2024-11-28 23:17:56.999279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.610 [2024-11-28 23:17:56.999296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.610 [2024-11-28 23:17:56.999311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.610 [2024-11-28 23:17:56.999327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.610 [2024-11-28 23:17:56.999342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.610 [2024-11-28 23:17:56.999358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.610 [2024-11-28 23:17:56.999384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.610 [2024-11-28 23:17:56.999407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.610 [2024-11-28 23:17:56.999423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.610 [2024-11-28 23:17:56.999439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.610 [2024-11-28 23:17:56.999454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.610 [2024-11-28 23:17:56.999470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.610 [2024-11-28 23:17:56.999484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.610 [2024-11-28 23:17:56.999500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.610 [2024-11-28 23:17:56.999514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.610 [2024-11-28 23:17:56.999530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.610 [2024-11-28 23:17:56.999545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.610 [2024-11-28 23:17:56.999560] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a21f70 is same with the state(5) to be set 00:25:53.610 [2024-11-28 23:17:57.001209] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:25:53.610 [2024-11-28 23:17:57.001365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:53.610 [2024-11-28 23:17:57.001481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:53.610 [2024-11-28 23:17:57.001509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ff070 with addr=10.0.0.2, port=4420 00:25:53.610 [2024-11-28 23:17:57.001527] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ff070 is same with the state(5) to be set 00:25:53.610 [2024-11-28 23:17:57.001550] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b4bc80 (9): Bad file descriptor 00:25:53.610 [2024-11-28 23:17:57.001572] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b60700 (9): Bad file descriptor 00:25:53.610 [2024-11-28 23:17:57.001805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:53.610 [2024-11-28 23:17:57.001906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:53.610 [2024-11-28 23:17:57.001934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b6fc50 with addr=10.0.0.2, port=4420 00:25:53.610 [2024-11-28 23:17:57.001951] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b6fc50 is same with the state(5) to be set 00:25:53.610 [2024-11-28 23:17:57.001971] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ff070 (9): Bad file descriptor 00:25:53.610 [2024-11-28 23:17:57.001990] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:25:53.610 [2024-11-28 23:17:57.002003] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:25:53.610 [2024-11-28 23:17:57.002020] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:25:53.610 [2024-11-28 23:17:57.002042] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:25:53.610 [2024-11-28 23:17:57.002058] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:25:53.610 [2024-11-28 23:17:57.002072] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:25:53.610 [2024-11-28 23:17:57.002401] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:53.610 [2024-11-28 23:17:57.002425] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:53.610 [2024-11-28 23:17:57.002444] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b6fc50 (9): Bad file descriptor 00:25:53.610 [2024-11-28 23:17:57.002461] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:25:53.610 [2024-11-28 23:17:57.002474] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:25:53.610 [2024-11-28 23:17:57.002488] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:25:53.610 [2024-11-28 23:17:57.002547] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:53.610 [2024-11-28 23:17:57.002568] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:25:53.610 [2024-11-28 23:17:57.002582] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:25:53.610 [2024-11-28 23:17:57.002596] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:25:53.611 [2024-11-28 23:17:57.002653] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:53.611 [2024-11-28 23:17:57.004073] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:53.611 [2024-11-28 23:17:57.004220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:53.611 [2024-11-28 23:17:57.004310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:53.611 [2024-11-28 23:17:57.004337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aa6b0 with addr=10.0.0.2, port=4420 00:25:53.611 [2024-11-28 23:17:57.004353] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aa6b0 is same with the state(5) to be set 00:25:53.611 [2024-11-28 23:17:57.004414] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aa6b0 (9): Bad file descriptor 00:25:53.611 [2024-11-28 23:17:57.004466] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:25:53.611 [2024-11-28 23:17:57.004483] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:25:53.611 [2024-11-28 23:17:57.004497] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:53.611 [2024-11-28 23:17:57.004552] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:53.611 [2024-11-28 23:17:57.005226] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b5b660 (9): Bad file descriptor 00:25:53.611 [2024-11-28 23:17:57.005288] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1a01650 (9): Bad file descriptor 00:25:53.611 [2024-11-28 23:17:57.005459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.005487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.005515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.005531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.005548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.005563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.005580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.005594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.005611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.005625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.005641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.005655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.005681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.005695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.005711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.005725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.005741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.005755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.005771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.005786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.005802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.005816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.005832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.005852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.005871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.005885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.005901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.005916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.005932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.005946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.005962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.005977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.005993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.006008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.006024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.006038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.006055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.006069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.006085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.006100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.006117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.006131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.006147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.006162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.006178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.006192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.006208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.006222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.006243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.006258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.006274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.006288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.006305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.006319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.006336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.006350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.006366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.006384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.006413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.006431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.006448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.006462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.006479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.006494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.006511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.006525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.006542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.006556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.006572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.006587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.006603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.006618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.006634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.006653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.006670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.006693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.006710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.006723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.006739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.006754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.006770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.006784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.006800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.006815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.006831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.006845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.006861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.006875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.006891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.006906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.006921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.006935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.006951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.006965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.006981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.006996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.007012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.007027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.007047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.007062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.007078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.007093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.007109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.007123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.007139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.007153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.007169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.007184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.007201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.007215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.007231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.007245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.007261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.007275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.611 [2024-11-28 23:17:57.007292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.611 [2024-11-28 23:17:57.007306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.007322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.007337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.007353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.007367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.007384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.007416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.007434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.007452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.007469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.007484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.007500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.007514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.007529] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b27950 is same with the state(5) to be set 00:25:53.612 [2024-11-28 23:17:57.008760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.008784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.008804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.008820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.008836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.008851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.008868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.008882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.008898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.008911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.008928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.008943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.008959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.008974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.008989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.009004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.009019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.009034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.009050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.009069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.009086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.009102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.009118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.009133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.009149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.009163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.009179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.009193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.009209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.009223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.009239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.009254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.009271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.009285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.009302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.009316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.009335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.009350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.009367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.009381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.009403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.009419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.009436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.009451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.009471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.009486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.009503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.009517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.009534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.009549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.009565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.009580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.009596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.009611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.009627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.009642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.009658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.009672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.009689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.009708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.009724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.009738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.009754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.009767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.009783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.009797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.009814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.009828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.009844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.009863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.009881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.009895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.009912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.009926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.009943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.009957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.009973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.009987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.010003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.010021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.010037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.010051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.010067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.010081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.010097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.010111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.010127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.010141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.010156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.010170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.010186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.010202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.010218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.010232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.010252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.010267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.010283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.010297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.010313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.010328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.010344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.010358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.010374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.010389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.010413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.010428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.010444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.010462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.010478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.010492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.010508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.612 [2024-11-28 23:17:57.010522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.612 [2024-11-28 23:17:57.010538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.010552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.010568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.010582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.010598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.010612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.010628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.010646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.010663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.010677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.010693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.010708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.010724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.010739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.010756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.010770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.010786] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b28ef0 is same with the state(5) to be set 00:25:53.613 [2024-11-28 23:17:57.012002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.012026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.012046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.012062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.012078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.012092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.012108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.012122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.012138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.012152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.012168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.012182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.012198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.012213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.012229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.012247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.012265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.012279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.012296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.012310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.012326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.012340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.012357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.012371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.012387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.012410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.012427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.012442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.012458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.012472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.012489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.012503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.012520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.012534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.012549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.012564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.012580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.012594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.012610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.012625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.012646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.012661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.012677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.012691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.012707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.012722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.012738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.012752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.012767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.012781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.012797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.012811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.012827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.012842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.012858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.012872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.012889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.012903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.012919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.012933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.012948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.012963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.012979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.012993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.013010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.013032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.013050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.013064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.013079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.013093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.013108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.013123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.013140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.013154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.013170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.013184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.013200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.013214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.013230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.013244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.013260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.013274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.013290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.013304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.013320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.013334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.013350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.013364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.013380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.013400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.013418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.013437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.013454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.013468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.013484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.013498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.013514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.013528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.613 [2024-11-28 23:17:57.013544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.613 [2024-11-28 23:17:57.013559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.013575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.013589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.013605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.013619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.013636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.013650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.013666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.013680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.013696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.013710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.013727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.013741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.013756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.013770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.013786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.013803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.013821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.013835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.013851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.013865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.013881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.013896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.013912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.013926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.013942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.013956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.013971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.013986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.014001] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b29d30 is same with the state(5) to be set 00:25:53.614 [2024-11-28 23:17:57.015220] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:25:53.614 [2024-11-28 23:17:57.015250] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:25:53.614 [2024-11-28 23:17:57.015268] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:25:53.614 [2024-11-28 23:17:57.015450] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:25:53.614 [2024-11-28 23:17:57.015479] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:25:53.614 [2024-11-28 23:17:57.015696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:53.614 [2024-11-28 23:17:57.015807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:53.614 [2024-11-28 23:17:57.015833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19b7d30 with addr=10.0.0.2, port=4420 00:25:53.614 [2024-11-28 23:17:57.015850] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b7d30 is same with the state(5) to be set 00:25:53.614 [2024-11-28 23:17:57.015948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:53.614 [2024-11-28 23:17:57.016042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:53.614 [2024-11-28 23:17:57.016066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b71100 with addr=10.0.0.2, port=4420 00:25:53.614 [2024-11-28 23:17:57.016083] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b71100 is same with the state(5) to be set 00:25:53.614 [2024-11-28 23:17:57.016170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:53.614 [2024-11-28 23:17:57.016265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:53.614 [2024-11-28 23:17:57.016297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19cca30 with addr=10.0.0.2, port=4420 00:25:53.614 [2024-11-28 23:17:57.016314] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19cca30 is same with the state(5) to be set 00:25:53.614 [2024-11-28 23:17:57.017141] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:25:53.614 [2024-11-28 23:17:57.017169] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:25:53.614 [2024-11-28 23:17:57.017188] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:53.614 [2024-11-28 23:17:57.017317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:53.614 [2024-11-28 23:17:57.017429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:53.614 [2024-11-28 23:17:57.017458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b60700 with addr=10.0.0.2, port=4420 00:25:53.614 [2024-11-28 23:17:57.017474] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b60700 is same with the state(5) to be set 00:25:53.614 [2024-11-28 23:17:57.017572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:53.614 [2024-11-28 23:17:57.017675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:53.614 [2024-11-28 23:17:57.017701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b4bc80 with addr=10.0.0.2, port=4420 00:25:53.614 [2024-11-28 23:17:57.017717] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b4bc80 is same with the state(5) to be set 00:25:53.614 [2024-11-28 23:17:57.017742] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19b7d30 (9): Bad file descriptor 00:25:53.614 [2024-11-28 23:17:57.017762] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b71100 (9): Bad file descriptor 00:25:53.614 [2024-11-28 23:17:57.017781] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19cca30 (9): Bad file descriptor 00:25:53.614 [2024-11-28 23:17:57.017871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.017896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.017920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.017936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.017954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.017968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.017985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.017999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.018015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.018029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.018045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.018060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.018082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.018097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.018113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.018128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.018144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.018158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.018173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.018187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.018204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.018218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.018235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.018248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.018264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.018278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.018294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.018308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.018324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.018338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.018353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.018367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.018383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.018404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.018422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.018436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.018453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.018471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.018488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.018503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.018518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.018533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.018549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.018563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.018579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.018593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.018609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.018623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.018638] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a1c8a0 is same with the state(5) to be set 00:25:53.614 [2024-11-28 23:17:57.019701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.019726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.019751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.019766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.019783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.019797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.019813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.019827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.019843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.019857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.019873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.019887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.019903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.019922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.019939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.019953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.019970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.019984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.020000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.020014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.020030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.020045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.020061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.020075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.020091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.614 [2024-11-28 23:17:57.020106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.614 [2024-11-28 23:17:57.020122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.020136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.020154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.020168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.020184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.020198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.020214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.020229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.020245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.020259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.020275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.020290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.020310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.020324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.020340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.020354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.020371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.020385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.020422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.020439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.020455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.020470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.020486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.020500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.020517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.020531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.020547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.020561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.020577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.020592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.020608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.020622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.020638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.020653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.020669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.020683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.020699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.020722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.020739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.020754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.020770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.020785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.020801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.020815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.020832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.020846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.020863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.020877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.020893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.020906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.020923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.020937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.020953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.020967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.020983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.020997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.021013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.021027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.021054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.021068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.021084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.021098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.021118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.021133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.021149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.021164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.021180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.021195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.021211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.021225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.021241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.021255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.021271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.021285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.021301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.021316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.021332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.021346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.021362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.021376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.021402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.021419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.021435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.021449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.021466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.021480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.021496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.021515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.021532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.021546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.021562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.021576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.021592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.021606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.021622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.021636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.021652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.021666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.021682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.021696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.021712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:53.615 [2024-11-28 23:17:57.021726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.615 [2024-11-28 23:17:57.021742] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a20990 is same with the state(5) to be set 00:25:53.615 [2024-11-28 23:17:57.023284] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:25:53.615 task offset: 40320 on job bdev=Nvme1n1 fails 00:25:53.615 00:25:53.615 Latency(us) 00:25:53.615 [2024-11-28T22:17:57.221Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:53.615 [2024-11-28T22:17:57.221Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:53.615 [2024-11-28T22:17:57.221Z] Job: Nvme1n1 ended in about 0.81 seconds with error 00:25:53.615 Verification LBA range: start 0x0 length 0x400 00:25:53.615 Nvme1n1 : 0.81 359.51 22.47 79.07 0.00 145015.00 17087.91 147577.36 00:25:53.615 [2024-11-28T22:17:57.221Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:53.615 [2024-11-28T22:17:57.221Z] Job: Nvme2n1 ended in about 0.84 seconds with error 00:25:53.615 Verification LBA range: start 0x0 length 0x400 00:25:53.615 Nvme2n1 : 0.84 346.85 21.68 76.28 0.00 148989.14 71458.51 118061.89 00:25:53.615 [2024-11-28T22:17:57.221Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:53.615 [2024-11-28T22:17:57.221Z] Job: Nvme3n1 ended in about 0.84 seconds with error 00:25:53.615 Verification LBA range: start 0x0 length 0x400 00:25:53.615 Nvme3n1 : 0.84 345.52 21.60 75.99 0.00 148186.16 66798.17 117285.17 00:25:53.615 [2024-11-28T22:17:57.221Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:53.615 [2024-11-28T22:17:57.221Z] Job: Nvme4n1 ended in about 0.85 seconds with error 00:25:53.615 Verification LBA range: start 0x0 length 0x400 00:25:53.615 Nvme4n1 : 0.85 344.21 21.51 75.70 0.00 147379.90 62526.20 116508.44 00:25:53.615 [2024-11-28T22:17:57.221Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:53.615 [2024-11-28T22:17:57.221Z] Job: Nvme5n1 ended in about 0.82 seconds with error 00:25:53.615 Verification LBA range: start 0x0 length 0x400 00:25:53.615 Nvme5n1 : 0.82 353.89 22.12 77.83 0.00 141883.22 17670.45 118061.89 00:25:53.615 [2024-11-28T22:17:57.221Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:53.615 [2024-11-28T22:17:57.221Z] Job: Nvme6n1 ended in about 0.85 seconds with error 00:25:53.615 Verification LBA range: start 0x0 length 0x400 00:25:53.615 Nvme6n1 : 0.85 342.40 21.40 28.24 0.00 159067.93 38447.79 118838.61 00:25:53.615 [2024-11-28T22:17:57.221Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:53.615 [2024-11-28T22:17:57.221Z] Job: Nvme7n1 ended in about 0.82 seconds with error 00:25:53.615 Verification LBA range: start 0x0 length 0x400 00:25:53.615 Nvme7n1 : 0.82 353.47 22.09 29.15 0.00 156056.43 8058.50 122722.23 00:25:53.615 [2024-11-28T22:17:57.221Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:53.615 [2024-11-28T22:17:57.221Z] Job: Nvme8n1 ended in about 0.83 seconds with error 00:25:53.615 Verification LBA range: start 0x0 length 0x400 00:25:53.615 Nvme8n1 : 0.83 352.53 22.03 29.07 0.00 155468.65 3907.89 124275.67 00:25:53.615 [2024-11-28T22:17:57.221Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:53.615 [2024-11-28T22:17:57.222Z] Job: Nvme9n1 ended in about 0.85 seconds with error 00:25:53.616 Verification LBA range: start 0x0 length 0x400 00:25:53.616 Nvme9n1 : 0.85 294.21 18.39 75.02 0.00 160108.49 100197.26 123498.95 00:25:53.616 [2024-11-28T22:17:57.222Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:53.616 [2024-11-28T22:17:57.222Z] Job: Nvme10n1 ended in about 0.83 seconds with error 00:25:53.616 Verification LBA range: start 0x0 length 0x400 00:25:53.616 Nvme10n1 : 0.83 302.04 18.88 77.01 0.00 154196.15 81167.55 124275.67 00:25:53.616 [2024-11-28T22:17:57.222Z] =================================================================================================================== 00:25:53.616 [2024-11-28T22:17:57.222Z] Total : 3394.65 212.17 623.38 0.00 151316.04 3907.89 147577.36 00:25:53.616 [2024-11-28 23:17:57.048678] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:25:53.616 [2024-11-28 23:17:57.048770] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:25:53.616 [2024-11-28 23:17:57.049063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:53.616 [2024-11-28 23:17:57.049178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:53.616 [2024-11-28 23:17:57.049206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ff070 with addr=10.0.0.2, port=4420 00:25:53.616 [2024-11-28 23:17:57.049226] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ff070 is same with the state(5) to be set 00:25:53.616 [2024-11-28 23:17:57.049313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:53.616 [2024-11-28 23:17:57.049418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:53.616 [2024-11-28 23:17:57.049447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b6fc50 with addr=10.0.0.2, port=4420 00:25:53.616 [2024-11-28 23:17:57.049465] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b6fc50 is same with the state(5) to be set 00:25:53.616 [2024-11-28 23:17:57.049553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:53.616 [2024-11-28 23:17:57.049638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:53.616 [2024-11-28 23:17:57.049664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aa6b0 with addr=10.0.0.2, port=4420 00:25:53.616 [2024-11-28 23:17:57.049681] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aa6b0 is same with the state(5) to be set 00:25:53.616 [2024-11-28 23:17:57.049707] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b60700 (9): Bad file descriptor 00:25:53.616 [2024-11-28 23:17:57.049730] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b4bc80 (9): Bad file descriptor 00:25:53.616 [2024-11-28 23:17:57.049759] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:25:53.616 [2024-11-28 23:17:57.049775] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:25:53.616 [2024-11-28 23:17:57.049792] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:25:53.616 [2024-11-28 23:17:57.049819] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:25:53.616 [2024-11-28 23:17:57.049835] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:25:53.616 [2024-11-28 23:17:57.049849] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:25:53.616 [2024-11-28 23:17:57.049868] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:25:53.616 [2024-11-28 23:17:57.049883] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:25:53.616 [2024-11-28 23:17:57.049897] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:25:53.616 [2024-11-28 23:17:57.050064] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:53.616 [2024-11-28 23:17:57.050090] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:53.616 [2024-11-28 23:17:57.050104] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:53.616 [2024-11-28 23:17:57.050231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:53.616 [2024-11-28 23:17:57.050323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:53.616 [2024-11-28 23:17:57.050350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b5b660 with addr=10.0.0.2, port=4420 00:25:53.616 [2024-11-28 23:17:57.050367] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5b660 is same with the state(5) to be set 00:25:53.616 [2024-11-28 23:17:57.050463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:53.616 [2024-11-28 23:17:57.050560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:53.616 [2024-11-28 23:17:57.050588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1a01650 with addr=10.0.0.2, port=4420 00:25:53.616 [2024-11-28 23:17:57.050605] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a01650 is same with the state(5) to be set 00:25:53.616 [2024-11-28 23:17:57.050625] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ff070 (9): Bad file descriptor 00:25:53.616 [2024-11-28 23:17:57.050645] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b6fc50 (9): Bad file descriptor 00:25:53.616 [2024-11-28 23:17:57.050664] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aa6b0 (9): Bad file descriptor 00:25:53.616 [2024-11-28 23:17:57.050681] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:25:53.616 [2024-11-28 23:17:57.050695] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:25:53.616 [2024-11-28 23:17:57.050709] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:25:53.616 [2024-11-28 23:17:57.050729] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:25:53.616 [2024-11-28 23:17:57.050745] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:25:53.616 [2024-11-28 23:17:57.050759] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:25:53.616 [2024-11-28 23:17:57.050809] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:53.616 [2024-11-28 23:17:57.050834] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:53.616 [2024-11-28 23:17:57.050860] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:53.616 [2024-11-28 23:17:57.050880] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:53.616 [2024-11-28 23:17:57.050899] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:53.616 [2024-11-28 23:17:57.051490] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:53.616 [2024-11-28 23:17:57.051515] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:53.616 [2024-11-28 23:17:57.051545] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b5b660 (9): Bad file descriptor 00:25:53.616 [2024-11-28 23:17:57.051567] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1a01650 (9): Bad file descriptor 00:25:53.616 [2024-11-28 23:17:57.051585] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:25:53.616 [2024-11-28 23:17:57.051598] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:25:53.616 [2024-11-28 23:17:57.051612] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:25:53.616 [2024-11-28 23:17:57.051630] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:25:53.616 [2024-11-28 23:17:57.051646] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:25:53.616 [2024-11-28 23:17:57.051660] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:25:53.616 [2024-11-28 23:17:57.051677] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:25:53.616 [2024-11-28 23:17:57.051692] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:25:53.616 [2024-11-28 23:17:57.051705] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:53.616 [2024-11-28 23:17:57.051770] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:25:53.616 [2024-11-28 23:17:57.051794] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:25:53.616 [2024-11-28 23:17:57.051813] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:25:53.616 [2024-11-28 23:17:57.051829] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:53.616 [2024-11-28 23:17:57.051843] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:53.616 [2024-11-28 23:17:57.051854] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:53.616 [2024-11-28 23:17:57.051887] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:25:53.616 [2024-11-28 23:17:57.051904] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:25:53.616 [2024-11-28 23:17:57.051918] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:25:53.616 [2024-11-28 23:17:57.051935] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:25:53.616 [2024-11-28 23:17:57.051949] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:25:53.616 [2024-11-28 23:17:57.051963] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:25:53.616 [2024-11-28 23:17:57.052018] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:53.616 [2024-11-28 23:17:57.052038] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:53.616 [2024-11-28 23:17:57.052125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:53.616 [2024-11-28 23:17:57.052219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:53.616 [2024-11-28 23:17:57.052244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19cca30 with addr=10.0.0.2, port=4420 00:25:53.616 [2024-11-28 23:17:57.052262] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19cca30 is same with the state(5) to be set 00:25:53.616 [2024-11-28 23:17:57.052339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:53.616 [2024-11-28 23:17:57.052443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:53.616 [2024-11-28 23:17:57.052470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b71100 with addr=10.0.0.2, port=4420 00:25:53.616 [2024-11-28 23:17:57.052487] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b71100 is same with the state(5) to be set 00:25:53.616 [2024-11-28 23:17:57.052561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:53.616 [2024-11-28 23:17:57.052638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:53.616 [2024-11-28 23:17:57.052665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19b7d30 with addr=10.0.0.2, port=4420 00:25:53.616 [2024-11-28 23:17:57.052686] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b7d30 is same with the state(5) to be set 00:25:53.616 [2024-11-28 23:17:57.052731] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19cca30 (9): Bad file descriptor 00:25:53.616 [2024-11-28 23:17:57.052758] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b71100 (9): Bad file descriptor 00:25:53.616 [2024-11-28 23:17:57.052777] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19b7d30 (9): Bad file descriptor 00:25:53.616 [2024-11-28 23:17:57.052816] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:25:53.616 [2024-11-28 23:17:57.052835] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:25:53.616 [2024-11-28 23:17:57.052849] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:25:53.616 [2024-11-28 23:17:57.052866] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:25:53.616 [2024-11-28 23:17:57.052882] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:25:53.616 [2024-11-28 23:17:57.052895] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:25:53.616 [2024-11-28 23:17:57.052911] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:25:53.616 [2024-11-28 23:17:57.052925] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:25:53.616 [2024-11-28 23:17:57.052938] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:25:53.616 [2024-11-28 23:17:57.052975] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:53.616 [2024-11-28 23:17:57.052993] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:53.616 [2024-11-28 23:17:57.053005] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:54.220 23:17:57 -- target/shutdown.sh@135 -- # nvmfpid= 00:25:54.220 23:17:57 -- target/shutdown.sh@138 -- # sleep 1 00:25:55.217 23:17:58 -- target/shutdown.sh@141 -- # kill -9 2526755 00:25:55.217 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 141: kill: (2526755) - No such process 00:25:55.217 23:17:58 -- target/shutdown.sh@141 -- # true 00:25:55.217 23:17:58 -- target/shutdown.sh@143 -- # stoptarget 00:25:55.217 23:17:58 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:55.217 23:17:58 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:55.217 23:17:58 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:55.217 23:17:58 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:55.217 23:17:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:55.217 23:17:58 -- nvmf/common.sh@116 -- # sync 00:25:55.217 23:17:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:55.217 23:17:58 -- nvmf/common.sh@119 -- # set +e 00:25:55.217 23:17:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:55.217 23:17:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:55.217 rmmod nvme_tcp 00:25:55.217 rmmod nvme_fabrics 00:25:55.217 rmmod nvme_keyring 00:25:55.217 23:17:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:55.217 23:17:58 -- nvmf/common.sh@123 -- # set -e 00:25:55.217 23:17:58 -- nvmf/common.sh@124 -- # return 0 00:25:55.217 23:17:58 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:25:55.217 23:17:58 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:55.217 23:17:58 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:55.217 23:17:58 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:55.217 23:17:58 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:55.217 23:17:58 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:55.217 23:17:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:55.217 23:17:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:55.217 23:17:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:57.121 23:18:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:57.121 00:25:57.121 real 0m8.022s 00:25:57.121 user 0m21.173s 00:25:57.121 sys 0m1.425s 00:25:57.121 23:18:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:57.121 23:18:00 -- common/autotest_common.sh@10 -- # set +x 00:25:57.121 ************************************ 00:25:57.121 END TEST nvmf_shutdown_tc3 00:25:57.121 ************************************ 00:25:57.121 23:18:00 -- target/shutdown.sh@150 -- # trap - SIGINT SIGTERM EXIT 00:25:57.121 00:25:57.121 real 0m28.676s 00:25:57.121 user 1m22.365s 00:25:57.121 sys 0m6.315s 00:25:57.121 23:18:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:57.121 23:18:00 -- common/autotest_common.sh@10 -- # set +x 00:25:57.121 ************************************ 00:25:57.121 END TEST nvmf_shutdown 00:25:57.121 ************************************ 00:25:57.121 23:18:00 -- nvmf/nvmf.sh@86 -- # timing_exit target 00:25:57.121 23:18:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:57.121 23:18:00 -- common/autotest_common.sh@10 -- # set +x 00:25:57.121 23:18:00 -- nvmf/nvmf.sh@88 -- # timing_enter host 00:25:57.121 23:18:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:57.121 23:18:00 -- common/autotest_common.sh@10 -- # set +x 00:25:57.121 23:18:00 -- nvmf/nvmf.sh@90 -- # [[ 0 -eq 0 ]] 00:25:57.121 23:18:00 -- nvmf/nvmf.sh@91 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:25:57.121 23:18:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:57.121 23:18:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:57.121 23:18:00 -- common/autotest_common.sh@10 -- # set +x 00:25:57.121 ************************************ 00:25:57.121 START TEST nvmf_multicontroller 00:25:57.121 ************************************ 00:25:57.121 23:18:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:25:57.121 * Looking for test storage... 00:25:57.121 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:57.121 23:18:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:57.121 23:18:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:57.121 23:18:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:57.382 23:18:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:57.382 23:18:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:57.382 23:18:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:57.382 23:18:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:57.382 23:18:00 -- scripts/common.sh@335 -- # IFS=.-: 00:25:57.382 23:18:00 -- scripts/common.sh@335 -- # read -ra ver1 00:25:57.382 23:18:00 -- scripts/common.sh@336 -- # IFS=.-: 00:25:57.382 23:18:00 -- scripts/common.sh@336 -- # read -ra ver2 00:25:57.382 23:18:00 -- scripts/common.sh@337 -- # local 'op=<' 00:25:57.382 23:18:00 -- scripts/common.sh@339 -- # ver1_l=2 00:25:57.382 23:18:00 -- scripts/common.sh@340 -- # ver2_l=1 00:25:57.382 23:18:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:57.382 23:18:00 -- scripts/common.sh@343 -- # case "$op" in 00:25:57.382 23:18:00 -- scripts/common.sh@344 -- # : 1 00:25:57.382 23:18:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:57.382 23:18:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:57.382 23:18:00 -- scripts/common.sh@364 -- # decimal 1 00:25:57.382 23:18:00 -- scripts/common.sh@352 -- # local d=1 00:25:57.382 23:18:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:57.382 23:18:00 -- scripts/common.sh@354 -- # echo 1 00:25:57.382 23:18:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:57.382 23:18:00 -- scripts/common.sh@365 -- # decimal 2 00:25:57.382 23:18:00 -- scripts/common.sh@352 -- # local d=2 00:25:57.382 23:18:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:57.382 23:18:00 -- scripts/common.sh@354 -- # echo 2 00:25:57.382 23:18:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:57.382 23:18:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:57.382 23:18:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:57.382 23:18:00 -- scripts/common.sh@367 -- # return 0 00:25:57.382 23:18:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:57.382 23:18:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:57.382 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:57.382 --rc genhtml_branch_coverage=1 00:25:57.382 --rc genhtml_function_coverage=1 00:25:57.382 --rc genhtml_legend=1 00:25:57.382 --rc geninfo_all_blocks=1 00:25:57.382 --rc geninfo_unexecuted_blocks=1 00:25:57.382 00:25:57.382 ' 00:25:57.382 23:18:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:57.382 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:57.382 --rc genhtml_branch_coverage=1 00:25:57.382 --rc genhtml_function_coverage=1 00:25:57.382 --rc genhtml_legend=1 00:25:57.382 --rc geninfo_all_blocks=1 00:25:57.382 --rc geninfo_unexecuted_blocks=1 00:25:57.382 00:25:57.382 ' 00:25:57.382 23:18:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:57.382 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:57.382 --rc genhtml_branch_coverage=1 00:25:57.382 --rc genhtml_function_coverage=1 00:25:57.382 --rc genhtml_legend=1 00:25:57.382 --rc geninfo_all_blocks=1 00:25:57.382 --rc geninfo_unexecuted_blocks=1 00:25:57.382 00:25:57.382 ' 00:25:57.382 23:18:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:57.382 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:57.382 --rc genhtml_branch_coverage=1 00:25:57.382 --rc genhtml_function_coverage=1 00:25:57.382 --rc genhtml_legend=1 00:25:57.382 --rc geninfo_all_blocks=1 00:25:57.382 --rc geninfo_unexecuted_blocks=1 00:25:57.382 00:25:57.382 ' 00:25:57.382 23:18:00 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:57.382 23:18:00 -- nvmf/common.sh@7 -- # uname -s 00:25:57.382 23:18:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:57.382 23:18:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:57.382 23:18:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:57.382 23:18:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:57.382 23:18:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:57.382 23:18:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:57.382 23:18:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:57.382 23:18:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:57.382 23:18:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:57.382 23:18:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:57.382 23:18:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:57.382 23:18:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:57.382 23:18:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:57.382 23:18:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:57.382 23:18:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:57.382 23:18:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:57.382 23:18:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:57.382 23:18:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:57.382 23:18:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:57.382 23:18:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:57.382 23:18:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:57.382 23:18:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:57.382 23:18:00 -- paths/export.sh@5 -- # export PATH 00:25:57.383 23:18:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:57.383 23:18:00 -- nvmf/common.sh@46 -- # : 0 00:25:57.383 23:18:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:57.383 23:18:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:57.383 23:18:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:57.383 23:18:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:57.383 23:18:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:57.383 23:18:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:57.383 23:18:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:57.383 23:18:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:57.383 23:18:00 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:57.383 23:18:00 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:57.383 23:18:00 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:25:57.383 23:18:00 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:25:57.383 23:18:00 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:25:57.383 23:18:00 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:25:57.383 23:18:00 -- host/multicontroller.sh@23 -- # nvmftestinit 00:25:57.383 23:18:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:57.383 23:18:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:57.383 23:18:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:57.383 23:18:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:57.383 23:18:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:57.383 23:18:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:57.383 23:18:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:57.383 23:18:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:57.383 23:18:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:57.383 23:18:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:57.383 23:18:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:57.383 23:18:00 -- common/autotest_common.sh@10 -- # set +x 00:25:59.288 23:18:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:59.288 23:18:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:59.288 23:18:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:59.288 23:18:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:59.288 23:18:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:59.288 23:18:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:59.288 23:18:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:59.288 23:18:02 -- nvmf/common.sh@294 -- # net_devs=() 00:25:59.288 23:18:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:59.288 23:18:02 -- nvmf/common.sh@295 -- # e810=() 00:25:59.288 23:18:02 -- nvmf/common.sh@295 -- # local -ga e810 00:25:59.288 23:18:02 -- nvmf/common.sh@296 -- # x722=() 00:25:59.288 23:18:02 -- nvmf/common.sh@296 -- # local -ga x722 00:25:59.288 23:18:02 -- nvmf/common.sh@297 -- # mlx=() 00:25:59.288 23:18:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:59.288 23:18:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:59.288 23:18:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:59.288 23:18:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:59.288 23:18:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:59.288 23:18:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:59.288 23:18:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:59.288 23:18:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:59.288 23:18:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:59.288 23:18:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:59.288 23:18:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:59.288 23:18:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:59.288 23:18:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:59.288 23:18:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:59.288 23:18:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:59.288 23:18:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:59.288 23:18:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:59.288 23:18:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:59.288 23:18:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:59.288 23:18:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:59.288 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:59.288 23:18:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:59.288 23:18:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:59.288 23:18:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:59.288 23:18:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:59.288 23:18:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:59.288 23:18:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:59.288 23:18:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:59.288 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:59.288 23:18:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:59.288 23:18:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:59.288 23:18:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:59.288 23:18:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:59.288 23:18:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:59.288 23:18:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:59.288 23:18:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:59.288 23:18:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:59.288 23:18:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:59.288 23:18:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:59.288 23:18:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:59.288 23:18:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:59.288 23:18:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:59.288 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:59.288 23:18:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:59.288 23:18:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:59.288 23:18:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:59.288 23:18:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:59.288 23:18:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:59.288 23:18:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:59.288 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:59.288 23:18:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:59.288 23:18:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:59.288 23:18:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:59.288 23:18:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:59.288 23:18:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:59.288 23:18:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:59.288 23:18:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:59.288 23:18:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:59.288 23:18:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:59.288 23:18:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:59.288 23:18:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:59.288 23:18:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:59.288 23:18:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:59.288 23:18:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:59.288 23:18:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:59.288 23:18:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:59.288 23:18:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:59.288 23:18:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:59.288 23:18:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:59.548 23:18:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:59.548 23:18:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:59.548 23:18:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:59.548 23:18:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:59.548 23:18:02 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:59.548 23:18:02 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:59.548 23:18:02 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:59.548 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:59.548 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.228 ms 00:25:59.548 00:25:59.548 --- 10.0.0.2 ping statistics --- 00:25:59.548 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:59.548 rtt min/avg/max/mdev = 0.228/0.228/0.228/0.000 ms 00:25:59.548 23:18:02 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:59.549 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:59.549 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.104 ms 00:25:59.549 00:25:59.549 --- 10.0.0.1 ping statistics --- 00:25:59.549 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:59.549 rtt min/avg/max/mdev = 0.104/0.104/0.104/0.000 ms 00:25:59.549 23:18:02 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:59.549 23:18:02 -- nvmf/common.sh@410 -- # return 0 00:25:59.549 23:18:02 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:59.549 23:18:02 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:59.549 23:18:02 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:59.549 23:18:02 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:59.549 23:18:02 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:59.549 23:18:02 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:59.549 23:18:02 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:59.549 23:18:03 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:25:59.549 23:18:03 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:59.549 23:18:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:59.549 23:18:03 -- common/autotest_common.sh@10 -- # set +x 00:25:59.549 23:18:03 -- nvmf/common.sh@469 -- # nvmfpid=2529425 00:25:59.549 23:18:03 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:25:59.549 23:18:03 -- nvmf/common.sh@470 -- # waitforlisten 2529425 00:25:59.549 23:18:03 -- common/autotest_common.sh@829 -- # '[' -z 2529425 ']' 00:25:59.549 23:18:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:59.549 23:18:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:59.549 23:18:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:59.549 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:59.549 23:18:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:59.549 23:18:03 -- common/autotest_common.sh@10 -- # set +x 00:25:59.549 [2024-11-28 23:18:03.071466] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:59.549 [2024-11-28 23:18:03.071558] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:59.549 EAL: No free 2048 kB hugepages reported on node 1 00:25:59.549 [2024-11-28 23:18:03.143184] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:25:59.808 [2024-11-28 23:18:03.233206] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:59.808 [2024-11-28 23:18:03.233413] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:59.808 [2024-11-28 23:18:03.233444] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:59.808 [2024-11-28 23:18:03.233476] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:59.808 [2024-11-28 23:18:03.233544] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:59.808 [2024-11-28 23:18:03.233635] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:59.808 [2024-11-28 23:18:03.233638] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:00.746 23:18:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:00.746 23:18:04 -- common/autotest_common.sh@862 -- # return 0 00:26:00.746 23:18:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:00.746 23:18:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:00.746 23:18:04 -- common/autotest_common.sh@10 -- # set +x 00:26:00.746 23:18:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:00.746 23:18:04 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:00.746 23:18:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.746 23:18:04 -- common/autotest_common.sh@10 -- # set +x 00:26:00.746 [2024-11-28 23:18:04.054940] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:00.746 23:18:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.746 23:18:04 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:26:00.746 23:18:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.746 23:18:04 -- common/autotest_common.sh@10 -- # set +x 00:26:00.746 Malloc0 00:26:00.746 23:18:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.746 23:18:04 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:00.746 23:18:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.746 23:18:04 -- common/autotest_common.sh@10 -- # set +x 00:26:00.746 23:18:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.746 23:18:04 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:26:00.746 23:18:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.746 23:18:04 -- common/autotest_common.sh@10 -- # set +x 00:26:00.746 23:18:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.746 23:18:04 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:00.746 23:18:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.746 23:18:04 -- common/autotest_common.sh@10 -- # set +x 00:26:00.746 [2024-11-28 23:18:04.117059] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:00.746 23:18:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.746 23:18:04 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:26:00.746 23:18:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.746 23:18:04 -- common/autotest_common.sh@10 -- # set +x 00:26:00.746 [2024-11-28 23:18:04.124955] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:26:00.746 23:18:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.746 23:18:04 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:26:00.746 23:18:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.746 23:18:04 -- common/autotest_common.sh@10 -- # set +x 00:26:00.746 Malloc1 00:26:00.746 23:18:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.746 23:18:04 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:26:00.746 23:18:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.746 23:18:04 -- common/autotest_common.sh@10 -- # set +x 00:26:00.746 23:18:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.746 23:18:04 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:26:00.746 23:18:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.746 23:18:04 -- common/autotest_common.sh@10 -- # set +x 00:26:00.746 23:18:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.746 23:18:04 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:26:00.746 23:18:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.746 23:18:04 -- common/autotest_common.sh@10 -- # set +x 00:26:00.746 23:18:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.746 23:18:04 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:26:00.746 23:18:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.746 23:18:04 -- common/autotest_common.sh@10 -- # set +x 00:26:00.746 23:18:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.746 23:18:04 -- host/multicontroller.sh@44 -- # bdevperf_pid=2529584 00:26:00.746 23:18:04 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:26:00.746 23:18:04 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:00.746 23:18:04 -- host/multicontroller.sh@47 -- # waitforlisten 2529584 /var/tmp/bdevperf.sock 00:26:00.746 23:18:04 -- common/autotest_common.sh@829 -- # '[' -z 2529584 ']' 00:26:00.746 23:18:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:26:00.746 23:18:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:00.746 23:18:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:26:00.746 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:26:00.746 23:18:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:00.746 23:18:04 -- common/autotest_common.sh@10 -- # set +x 00:26:01.701 23:18:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:01.701 23:18:05 -- common/autotest_common.sh@862 -- # return 0 00:26:01.701 23:18:05 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:26:01.701 23:18:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:01.701 23:18:05 -- common/autotest_common.sh@10 -- # set +x 00:26:01.965 NVMe0n1 00:26:01.965 23:18:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:01.965 23:18:05 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:01.965 23:18:05 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:26:01.965 23:18:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:01.965 23:18:05 -- common/autotest_common.sh@10 -- # set +x 00:26:01.965 23:18:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:01.965 1 00:26:01.965 23:18:05 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:26:01.965 23:18:05 -- common/autotest_common.sh@650 -- # local es=0 00:26:01.965 23:18:05 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:26:01.965 23:18:05 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:01.965 23:18:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:01.965 23:18:05 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:01.965 23:18:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:01.965 23:18:05 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:26:01.965 23:18:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:01.965 23:18:05 -- common/autotest_common.sh@10 -- # set +x 00:26:01.965 request: 00:26:01.965 { 00:26:01.965 "name": "NVMe0", 00:26:01.965 "trtype": "tcp", 00:26:01.965 "traddr": "10.0.0.2", 00:26:01.965 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:26:01.965 "hostaddr": "10.0.0.2", 00:26:01.965 "hostsvcid": "60000", 00:26:01.965 "adrfam": "ipv4", 00:26:01.965 "trsvcid": "4420", 00:26:01.965 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:26:01.965 "method": "bdev_nvme_attach_controller", 00:26:01.965 "req_id": 1 00:26:01.965 } 00:26:01.965 Got JSON-RPC error response 00:26:01.965 response: 00:26:01.965 { 00:26:01.965 "code": -114, 00:26:01.965 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:26:01.965 } 00:26:01.965 23:18:05 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:01.965 23:18:05 -- common/autotest_common.sh@653 -- # es=1 00:26:01.965 23:18:05 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:01.965 23:18:05 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:01.965 23:18:05 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:01.965 23:18:05 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:26:01.965 23:18:05 -- common/autotest_common.sh@650 -- # local es=0 00:26:01.965 23:18:05 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:26:01.965 23:18:05 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:01.965 23:18:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:01.965 23:18:05 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:01.965 23:18:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:01.965 23:18:05 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:26:01.965 23:18:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:01.965 23:18:05 -- common/autotest_common.sh@10 -- # set +x 00:26:01.965 request: 00:26:01.965 { 00:26:01.965 "name": "NVMe0", 00:26:01.965 "trtype": "tcp", 00:26:01.965 "traddr": "10.0.0.2", 00:26:01.965 "hostaddr": "10.0.0.2", 00:26:01.965 "hostsvcid": "60000", 00:26:01.965 "adrfam": "ipv4", 00:26:01.965 "trsvcid": "4420", 00:26:01.965 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:26:01.965 "method": "bdev_nvme_attach_controller", 00:26:01.965 "req_id": 1 00:26:01.965 } 00:26:01.965 Got JSON-RPC error response 00:26:01.965 response: 00:26:01.965 { 00:26:01.965 "code": -114, 00:26:01.965 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:26:01.965 } 00:26:01.965 23:18:05 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:01.965 23:18:05 -- common/autotest_common.sh@653 -- # es=1 00:26:01.965 23:18:05 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:01.965 23:18:05 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:01.965 23:18:05 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:01.966 23:18:05 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:26:01.966 23:18:05 -- common/autotest_common.sh@650 -- # local es=0 00:26:01.966 23:18:05 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:26:01.966 23:18:05 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:01.966 23:18:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:01.966 23:18:05 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:01.966 23:18:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:01.966 23:18:05 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:26:01.966 23:18:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:01.966 23:18:05 -- common/autotest_common.sh@10 -- # set +x 00:26:01.966 request: 00:26:01.966 { 00:26:01.966 "name": "NVMe0", 00:26:01.966 "trtype": "tcp", 00:26:01.966 "traddr": "10.0.0.2", 00:26:01.966 "hostaddr": "10.0.0.2", 00:26:01.966 "hostsvcid": "60000", 00:26:01.966 "adrfam": "ipv4", 00:26:01.966 "trsvcid": "4420", 00:26:01.966 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:26:01.966 "multipath": "disable", 00:26:01.966 "method": "bdev_nvme_attach_controller", 00:26:01.966 "req_id": 1 00:26:01.966 } 00:26:01.966 Got JSON-RPC error response 00:26:01.966 response: 00:26:01.966 { 00:26:01.966 "code": -114, 00:26:01.966 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:26:01.966 } 00:26:01.966 23:18:05 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:01.966 23:18:05 -- common/autotest_common.sh@653 -- # es=1 00:26:01.966 23:18:05 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:01.966 23:18:05 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:01.966 23:18:05 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:01.966 23:18:05 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:26:01.966 23:18:05 -- common/autotest_common.sh@650 -- # local es=0 00:26:01.966 23:18:05 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:26:01.966 23:18:05 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:01.966 23:18:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:01.966 23:18:05 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:01.966 23:18:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:01.966 23:18:05 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:26:01.966 23:18:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:01.966 23:18:05 -- common/autotest_common.sh@10 -- # set +x 00:26:01.966 request: 00:26:01.966 { 00:26:01.966 "name": "NVMe0", 00:26:01.966 "trtype": "tcp", 00:26:01.966 "traddr": "10.0.0.2", 00:26:01.966 "hostaddr": "10.0.0.2", 00:26:01.966 "hostsvcid": "60000", 00:26:01.966 "adrfam": "ipv4", 00:26:01.966 "trsvcid": "4420", 00:26:01.966 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:26:01.966 "multipath": "failover", 00:26:01.966 "method": "bdev_nvme_attach_controller", 00:26:01.966 "req_id": 1 00:26:01.966 } 00:26:01.966 Got JSON-RPC error response 00:26:01.966 response: 00:26:01.966 { 00:26:01.966 "code": -114, 00:26:01.966 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:26:01.966 } 00:26:01.966 23:18:05 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:01.966 23:18:05 -- common/autotest_common.sh@653 -- # es=1 00:26:01.966 23:18:05 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:01.966 23:18:05 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:01.966 23:18:05 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:01.966 23:18:05 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:01.966 23:18:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:01.966 23:18:05 -- common/autotest_common.sh@10 -- # set +x 00:26:02.224 00:26:02.224 23:18:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:02.224 23:18:05 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:02.224 23:18:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:02.224 23:18:05 -- common/autotest_common.sh@10 -- # set +x 00:26:02.224 23:18:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:02.224 23:18:05 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:26:02.224 23:18:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:02.224 23:18:05 -- common/autotest_common.sh@10 -- # set +x 00:26:02.483 00:26:02.483 23:18:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:02.483 23:18:05 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:02.483 23:18:05 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:26:02.483 23:18:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:02.483 23:18:05 -- common/autotest_common.sh@10 -- # set +x 00:26:02.483 23:18:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:02.483 23:18:05 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:26:02.483 23:18:05 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:26:03.419 0 00:26:03.419 23:18:06 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:26:03.419 23:18:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:03.419 23:18:06 -- common/autotest_common.sh@10 -- # set +x 00:26:03.419 23:18:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:03.419 23:18:07 -- host/multicontroller.sh@100 -- # killprocess 2529584 00:26:03.419 23:18:07 -- common/autotest_common.sh@936 -- # '[' -z 2529584 ']' 00:26:03.419 23:18:07 -- common/autotest_common.sh@940 -- # kill -0 2529584 00:26:03.419 23:18:07 -- common/autotest_common.sh@941 -- # uname 00:26:03.419 23:18:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:03.419 23:18:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2529584 00:26:03.679 23:18:07 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:03.679 23:18:07 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:03.679 23:18:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2529584' 00:26:03.679 killing process with pid 2529584 00:26:03.679 23:18:07 -- common/autotest_common.sh@955 -- # kill 2529584 00:26:03.679 23:18:07 -- common/autotest_common.sh@960 -- # wait 2529584 00:26:03.679 23:18:07 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:03.679 23:18:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:03.679 23:18:07 -- common/autotest_common.sh@10 -- # set +x 00:26:03.679 23:18:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:03.679 23:18:07 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:26:03.679 23:18:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:03.679 23:18:07 -- common/autotest_common.sh@10 -- # set +x 00:26:03.679 23:18:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:03.679 23:18:07 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:26:03.679 23:18:07 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:26:03.679 23:18:07 -- common/autotest_common.sh@1607 -- # read -r file 00:26:03.679 23:18:07 -- common/autotest_common.sh@1606 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:26:03.679 23:18:07 -- common/autotest_common.sh@1606 -- # sort -u 00:26:03.679 23:18:07 -- common/autotest_common.sh@1608 -- # cat 00:26:03.679 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:26:03.679 [2024-11-28 23:18:04.222309] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:03.679 [2024-11-28 23:18:04.222422] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2529584 ] 00:26:03.679 EAL: No free 2048 kB hugepages reported on node 1 00:26:03.679 [2024-11-28 23:18:04.285944] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:03.679 [2024-11-28 23:18:04.371269] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:03.679 [2024-11-28 23:18:05.841445] bdev.c:4553:bdev_name_add: *ERROR*: Bdev name b331a4be-6f82-4c04-83da-caba38776c92 already exists 00:26:03.679 [2024-11-28 23:18:05.841488] bdev.c:7603:bdev_register: *ERROR*: Unable to add uuid:b331a4be-6f82-4c04-83da-caba38776c92 alias for bdev NVMe1n1 00:26:03.679 [2024-11-28 23:18:05.841506] bdev_nvme.c:4236:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:26:03.679 Running I/O for 1 seconds... 00:26:03.679 00:26:03.679 Latency(us) 00:26:03.679 [2024-11-28T22:18:07.285Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:03.679 [2024-11-28T22:18:07.285Z] Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:26:03.679 NVMe0n1 : 1.01 19898.98 77.73 0.00 0.00 6415.65 2233.08 11650.84 00:26:03.679 [2024-11-28T22:18:07.285Z] =================================================================================================================== 00:26:03.679 [2024-11-28T22:18:07.285Z] Total : 19898.98 77.73 0.00 0.00 6415.65 2233.08 11650.84 00:26:03.679 Received shutdown signal, test time was about 1.000000 seconds 00:26:03.679 00:26:03.679 Latency(us) 00:26:03.679 [2024-11-28T22:18:07.285Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:03.679 [2024-11-28T22:18:07.285Z] =================================================================================================================== 00:26:03.679 [2024-11-28T22:18:07.285Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:03.679 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:26:03.939 23:18:07 -- common/autotest_common.sh@1613 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:26:03.939 23:18:07 -- common/autotest_common.sh@1607 -- # read -r file 00:26:03.939 23:18:07 -- host/multicontroller.sh@108 -- # nvmftestfini 00:26:03.939 23:18:07 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:03.939 23:18:07 -- nvmf/common.sh@116 -- # sync 00:26:03.939 23:18:07 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:03.939 23:18:07 -- nvmf/common.sh@119 -- # set +e 00:26:03.939 23:18:07 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:03.939 23:18:07 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:03.939 rmmod nvme_tcp 00:26:03.939 rmmod nvme_fabrics 00:26:03.939 rmmod nvme_keyring 00:26:03.939 23:18:07 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:03.939 23:18:07 -- nvmf/common.sh@123 -- # set -e 00:26:03.939 23:18:07 -- nvmf/common.sh@124 -- # return 0 00:26:03.939 23:18:07 -- nvmf/common.sh@477 -- # '[' -n 2529425 ']' 00:26:03.939 23:18:07 -- nvmf/common.sh@478 -- # killprocess 2529425 00:26:03.939 23:18:07 -- common/autotest_common.sh@936 -- # '[' -z 2529425 ']' 00:26:03.939 23:18:07 -- common/autotest_common.sh@940 -- # kill -0 2529425 00:26:03.939 23:18:07 -- common/autotest_common.sh@941 -- # uname 00:26:03.939 23:18:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:03.939 23:18:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2529425 00:26:03.939 23:18:07 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:03.939 23:18:07 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:03.939 23:18:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2529425' 00:26:03.939 killing process with pid 2529425 00:26:03.939 23:18:07 -- common/autotest_common.sh@955 -- # kill 2529425 00:26:03.939 23:18:07 -- common/autotest_common.sh@960 -- # wait 2529425 00:26:04.197 23:18:07 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:04.197 23:18:07 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:04.197 23:18:07 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:04.197 23:18:07 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:04.197 23:18:07 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:04.197 23:18:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:04.197 23:18:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:04.197 23:18:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:06.100 23:18:09 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:06.100 00:26:06.100 real 0m9.026s 00:26:06.100 user 0m17.428s 00:26:06.100 sys 0m2.466s 00:26:06.100 23:18:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:06.100 23:18:09 -- common/autotest_common.sh@10 -- # set +x 00:26:06.100 ************************************ 00:26:06.100 END TEST nvmf_multicontroller 00:26:06.100 ************************************ 00:26:06.359 23:18:09 -- nvmf/nvmf.sh@92 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:26:06.359 23:18:09 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:06.359 23:18:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:06.359 23:18:09 -- common/autotest_common.sh@10 -- # set +x 00:26:06.359 ************************************ 00:26:06.359 START TEST nvmf_aer 00:26:06.359 ************************************ 00:26:06.359 23:18:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:26:06.359 * Looking for test storage... 00:26:06.359 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:06.359 23:18:09 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:06.359 23:18:09 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:06.359 23:18:09 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:06.359 23:18:09 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:06.359 23:18:09 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:06.359 23:18:09 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:06.359 23:18:09 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:06.359 23:18:09 -- scripts/common.sh@335 -- # IFS=.-: 00:26:06.359 23:18:09 -- scripts/common.sh@335 -- # read -ra ver1 00:26:06.359 23:18:09 -- scripts/common.sh@336 -- # IFS=.-: 00:26:06.359 23:18:09 -- scripts/common.sh@336 -- # read -ra ver2 00:26:06.359 23:18:09 -- scripts/common.sh@337 -- # local 'op=<' 00:26:06.359 23:18:09 -- scripts/common.sh@339 -- # ver1_l=2 00:26:06.359 23:18:09 -- scripts/common.sh@340 -- # ver2_l=1 00:26:06.359 23:18:09 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:06.359 23:18:09 -- scripts/common.sh@343 -- # case "$op" in 00:26:06.359 23:18:09 -- scripts/common.sh@344 -- # : 1 00:26:06.359 23:18:09 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:06.359 23:18:09 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:06.359 23:18:09 -- scripts/common.sh@364 -- # decimal 1 00:26:06.359 23:18:09 -- scripts/common.sh@352 -- # local d=1 00:26:06.359 23:18:09 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:06.359 23:18:09 -- scripts/common.sh@354 -- # echo 1 00:26:06.359 23:18:09 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:06.359 23:18:09 -- scripts/common.sh@365 -- # decimal 2 00:26:06.359 23:18:09 -- scripts/common.sh@352 -- # local d=2 00:26:06.359 23:18:09 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:06.359 23:18:09 -- scripts/common.sh@354 -- # echo 2 00:26:06.359 23:18:09 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:06.359 23:18:09 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:06.359 23:18:09 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:06.359 23:18:09 -- scripts/common.sh@367 -- # return 0 00:26:06.359 23:18:09 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:06.359 23:18:09 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:06.359 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:06.359 --rc genhtml_branch_coverage=1 00:26:06.359 --rc genhtml_function_coverage=1 00:26:06.359 --rc genhtml_legend=1 00:26:06.359 --rc geninfo_all_blocks=1 00:26:06.359 --rc geninfo_unexecuted_blocks=1 00:26:06.359 00:26:06.359 ' 00:26:06.359 23:18:09 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:06.359 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:06.359 --rc genhtml_branch_coverage=1 00:26:06.359 --rc genhtml_function_coverage=1 00:26:06.359 --rc genhtml_legend=1 00:26:06.359 --rc geninfo_all_blocks=1 00:26:06.359 --rc geninfo_unexecuted_blocks=1 00:26:06.359 00:26:06.359 ' 00:26:06.359 23:18:09 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:06.359 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:06.359 --rc genhtml_branch_coverage=1 00:26:06.359 --rc genhtml_function_coverage=1 00:26:06.359 --rc genhtml_legend=1 00:26:06.359 --rc geninfo_all_blocks=1 00:26:06.359 --rc geninfo_unexecuted_blocks=1 00:26:06.359 00:26:06.359 ' 00:26:06.359 23:18:09 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:06.359 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:06.359 --rc genhtml_branch_coverage=1 00:26:06.359 --rc genhtml_function_coverage=1 00:26:06.359 --rc genhtml_legend=1 00:26:06.359 --rc geninfo_all_blocks=1 00:26:06.359 --rc geninfo_unexecuted_blocks=1 00:26:06.359 00:26:06.359 ' 00:26:06.359 23:18:09 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:06.359 23:18:09 -- nvmf/common.sh@7 -- # uname -s 00:26:06.359 23:18:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:06.359 23:18:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:06.359 23:18:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:06.359 23:18:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:06.359 23:18:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:06.359 23:18:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:06.359 23:18:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:06.359 23:18:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:06.359 23:18:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:06.359 23:18:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:06.359 23:18:09 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:06.359 23:18:09 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:06.359 23:18:09 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:06.359 23:18:09 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:06.359 23:18:09 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:06.359 23:18:09 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:06.359 23:18:09 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:06.359 23:18:09 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:06.359 23:18:09 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:06.359 23:18:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:06.359 23:18:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:06.359 23:18:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:06.359 23:18:09 -- paths/export.sh@5 -- # export PATH 00:26:06.359 23:18:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:06.359 23:18:09 -- nvmf/common.sh@46 -- # : 0 00:26:06.359 23:18:09 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:06.359 23:18:09 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:06.359 23:18:09 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:06.359 23:18:09 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:06.359 23:18:09 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:06.359 23:18:09 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:06.359 23:18:09 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:06.359 23:18:09 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:06.359 23:18:09 -- host/aer.sh@11 -- # nvmftestinit 00:26:06.359 23:18:09 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:06.359 23:18:09 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:06.359 23:18:09 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:06.359 23:18:09 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:06.359 23:18:09 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:06.359 23:18:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:06.359 23:18:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:06.359 23:18:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:06.359 23:18:09 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:06.359 23:18:09 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:06.359 23:18:09 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:06.359 23:18:09 -- common/autotest_common.sh@10 -- # set +x 00:26:08.893 23:18:11 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:08.893 23:18:11 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:08.893 23:18:11 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:08.893 23:18:11 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:08.893 23:18:11 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:08.893 23:18:11 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:08.893 23:18:11 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:08.893 23:18:11 -- nvmf/common.sh@294 -- # net_devs=() 00:26:08.893 23:18:11 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:08.893 23:18:11 -- nvmf/common.sh@295 -- # e810=() 00:26:08.893 23:18:11 -- nvmf/common.sh@295 -- # local -ga e810 00:26:08.893 23:18:11 -- nvmf/common.sh@296 -- # x722=() 00:26:08.893 23:18:11 -- nvmf/common.sh@296 -- # local -ga x722 00:26:08.893 23:18:11 -- nvmf/common.sh@297 -- # mlx=() 00:26:08.893 23:18:11 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:08.893 23:18:11 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:08.893 23:18:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:08.893 23:18:11 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:08.893 23:18:11 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:08.893 23:18:11 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:08.893 23:18:11 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:08.894 23:18:11 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:08.894 23:18:11 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:08.894 23:18:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:08.894 23:18:11 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:08.894 23:18:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:08.894 23:18:11 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:08.894 23:18:11 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:08.894 23:18:11 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:08.894 23:18:11 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:08.894 23:18:11 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:08.894 23:18:11 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:08.894 23:18:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:08.894 23:18:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:08.894 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:08.894 23:18:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:08.894 23:18:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:08.894 23:18:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:08.894 23:18:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:08.894 23:18:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:08.894 23:18:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:08.894 23:18:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:08.894 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:08.894 23:18:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:08.894 23:18:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:08.894 23:18:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:08.894 23:18:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:08.894 23:18:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:08.894 23:18:11 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:08.894 23:18:11 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:08.894 23:18:11 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:08.894 23:18:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:08.894 23:18:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:08.894 23:18:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:08.894 23:18:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:08.894 23:18:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:08.894 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:08.894 23:18:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:08.894 23:18:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:08.894 23:18:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:08.894 23:18:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:08.894 23:18:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:08.894 23:18:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:08.894 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:08.894 23:18:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:08.894 23:18:11 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:08.894 23:18:11 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:08.894 23:18:11 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:08.894 23:18:11 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:08.894 23:18:11 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:08.894 23:18:11 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:08.894 23:18:11 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:08.894 23:18:11 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:08.894 23:18:11 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:08.894 23:18:11 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:08.894 23:18:11 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:08.894 23:18:11 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:08.894 23:18:11 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:08.894 23:18:11 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:08.894 23:18:11 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:08.894 23:18:11 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:08.894 23:18:11 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:08.894 23:18:11 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:08.894 23:18:11 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:08.894 23:18:11 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:08.894 23:18:11 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:08.894 23:18:11 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:08.894 23:18:12 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:08.894 23:18:12 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:08.894 23:18:12 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:08.894 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:08.894 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.267 ms 00:26:08.894 00:26:08.894 --- 10.0.0.2 ping statistics --- 00:26:08.894 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:08.894 rtt min/avg/max/mdev = 0.267/0.267/0.267/0.000 ms 00:26:08.894 23:18:12 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:08.894 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:08.894 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.146 ms 00:26:08.894 00:26:08.894 --- 10.0.0.1 ping statistics --- 00:26:08.894 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:08.894 rtt min/avg/max/mdev = 0.146/0.146/0.146/0.000 ms 00:26:08.894 23:18:12 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:08.894 23:18:12 -- nvmf/common.sh@410 -- # return 0 00:26:08.894 23:18:12 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:08.894 23:18:12 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:08.894 23:18:12 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:08.894 23:18:12 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:08.894 23:18:12 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:08.894 23:18:12 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:08.894 23:18:12 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:08.894 23:18:12 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:26:08.894 23:18:12 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:08.894 23:18:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:08.894 23:18:12 -- common/autotest_common.sh@10 -- # set +x 00:26:08.894 23:18:12 -- nvmf/common.sh@469 -- # nvmfpid=2532465 00:26:08.894 23:18:12 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:26:08.894 23:18:12 -- nvmf/common.sh@470 -- # waitforlisten 2532465 00:26:08.894 23:18:12 -- common/autotest_common.sh@829 -- # '[' -z 2532465 ']' 00:26:08.894 23:18:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:08.894 23:18:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:08.894 23:18:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:08.894 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:08.894 23:18:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:08.894 23:18:12 -- common/autotest_common.sh@10 -- # set +x 00:26:08.894 [2024-11-28 23:18:12.098278] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:08.894 [2024-11-28 23:18:12.098360] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:08.894 EAL: No free 2048 kB hugepages reported on node 1 00:26:08.894 [2024-11-28 23:18:12.168956] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:08.894 [2024-11-28 23:18:12.256953] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:08.894 [2024-11-28 23:18:12.257099] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:08.894 [2024-11-28 23:18:12.257116] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:08.895 [2024-11-28 23:18:12.257128] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:08.895 [2024-11-28 23:18:12.257192] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:08.895 [2024-11-28 23:18:12.257224] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:08.895 [2024-11-28 23:18:12.257294] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:08.895 [2024-11-28 23:18:12.257296] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:09.829 23:18:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:09.829 23:18:13 -- common/autotest_common.sh@862 -- # return 0 00:26:09.829 23:18:13 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:09.829 23:18:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:09.829 23:18:13 -- common/autotest_common.sh@10 -- # set +x 00:26:09.829 23:18:13 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:09.829 23:18:13 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:09.829 23:18:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:09.829 23:18:13 -- common/autotest_common.sh@10 -- # set +x 00:26:09.829 [2024-11-28 23:18:13.109050] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:09.829 23:18:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:09.829 23:18:13 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:26:09.829 23:18:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:09.829 23:18:13 -- common/autotest_common.sh@10 -- # set +x 00:26:09.829 Malloc0 00:26:09.829 23:18:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:09.829 23:18:13 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:26:09.829 23:18:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:09.829 23:18:13 -- common/autotest_common.sh@10 -- # set +x 00:26:09.829 23:18:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:09.829 23:18:13 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:26:09.830 23:18:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:09.830 23:18:13 -- common/autotest_common.sh@10 -- # set +x 00:26:09.830 23:18:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:09.830 23:18:13 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:09.830 23:18:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:09.830 23:18:13 -- common/autotest_common.sh@10 -- # set +x 00:26:09.830 [2024-11-28 23:18:13.161627] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:09.830 23:18:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:09.830 23:18:13 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:26:09.830 23:18:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:09.830 23:18:13 -- common/autotest_common.sh@10 -- # set +x 00:26:09.830 [2024-11-28 23:18:13.169323] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:26:09.830 [ 00:26:09.830 { 00:26:09.830 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:26:09.830 "subtype": "Discovery", 00:26:09.830 "listen_addresses": [], 00:26:09.830 "allow_any_host": true, 00:26:09.830 "hosts": [] 00:26:09.830 }, 00:26:09.830 { 00:26:09.830 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:26:09.830 "subtype": "NVMe", 00:26:09.830 "listen_addresses": [ 00:26:09.830 { 00:26:09.830 "transport": "TCP", 00:26:09.830 "trtype": "TCP", 00:26:09.830 "adrfam": "IPv4", 00:26:09.830 "traddr": "10.0.0.2", 00:26:09.830 "trsvcid": "4420" 00:26:09.830 } 00:26:09.830 ], 00:26:09.830 "allow_any_host": true, 00:26:09.830 "hosts": [], 00:26:09.830 "serial_number": "SPDK00000000000001", 00:26:09.830 "model_number": "SPDK bdev Controller", 00:26:09.830 "max_namespaces": 2, 00:26:09.830 "min_cntlid": 1, 00:26:09.830 "max_cntlid": 65519, 00:26:09.830 "namespaces": [ 00:26:09.830 { 00:26:09.830 "nsid": 1, 00:26:09.830 "bdev_name": "Malloc0", 00:26:09.830 "name": "Malloc0", 00:26:09.830 "nguid": "292036E315664BC8BED1945A38C67E12", 00:26:09.830 "uuid": "292036e3-1566-4bc8-bed1-945a38c67e12" 00:26:09.830 } 00:26:09.830 ] 00:26:09.830 } 00:26:09.830 ] 00:26:09.830 23:18:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:09.830 23:18:13 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:26:09.830 23:18:13 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:26:09.830 23:18:13 -- host/aer.sh@33 -- # aerpid=2532634 00:26:09.830 23:18:13 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:26:09.830 23:18:13 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:26:09.830 23:18:13 -- common/autotest_common.sh@1254 -- # local i=0 00:26:09.830 23:18:13 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:26:09.830 23:18:13 -- common/autotest_common.sh@1256 -- # '[' 0 -lt 200 ']' 00:26:09.830 23:18:13 -- common/autotest_common.sh@1257 -- # i=1 00:26:09.830 23:18:13 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:26:09.830 EAL: No free 2048 kB hugepages reported on node 1 00:26:09.830 23:18:13 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:26:09.830 23:18:13 -- common/autotest_common.sh@1256 -- # '[' 1 -lt 200 ']' 00:26:09.830 23:18:13 -- common/autotest_common.sh@1257 -- # i=2 00:26:09.830 23:18:13 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:26:09.830 23:18:13 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:26:09.830 23:18:13 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:26:09.830 23:18:13 -- common/autotest_common.sh@1265 -- # return 0 00:26:09.830 23:18:13 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:26:09.830 23:18:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:09.830 23:18:13 -- common/autotest_common.sh@10 -- # set +x 00:26:09.830 Malloc1 00:26:09.830 23:18:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:09.830 23:18:13 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:26:09.830 23:18:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:09.830 23:18:13 -- common/autotest_common.sh@10 -- # set +x 00:26:10.089 23:18:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.089 23:18:13 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:26:10.089 23:18:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.089 23:18:13 -- common/autotest_common.sh@10 -- # set +x 00:26:10.089 [ 00:26:10.089 { 00:26:10.089 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:26:10.089 "subtype": "Discovery", 00:26:10.089 "listen_addresses": [], 00:26:10.089 "allow_any_host": true, 00:26:10.089 "hosts": [] 00:26:10.089 }, 00:26:10.089 { 00:26:10.089 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:26:10.089 "subtype": "NVMe", 00:26:10.089 "listen_addresses": [ 00:26:10.089 { 00:26:10.089 "transport": "TCP", 00:26:10.089 "trtype": "TCP", 00:26:10.089 "adrfam": "IPv4", 00:26:10.089 "traddr": "10.0.0.2", 00:26:10.089 "trsvcid": "4420" 00:26:10.089 } 00:26:10.089 ], 00:26:10.089 "allow_any_host": true, 00:26:10.089 "hosts": [], 00:26:10.089 "serial_number": "SPDK00000000000001", 00:26:10.089 "model_number": "SPDK bdev Controller", 00:26:10.089 "max_namespaces": 2, 00:26:10.089 "min_cntlid": 1, 00:26:10.089 "max_cntlid": 65519, 00:26:10.089 "namespaces": [ 00:26:10.089 { 00:26:10.089 "nsid": 1, 00:26:10.089 "bdev_name": "Malloc0", 00:26:10.089 "name": "Malloc0", 00:26:10.089 "nguid": "292036E315664BC8BED1945A38C67E12", 00:26:10.089 "uuid": "292036e3-1566-4bc8-bed1-945a38c67e12" 00:26:10.089 }, 00:26:10.089 { 00:26:10.089 "nsid": 2, 00:26:10.089 "bdev_name": "Malloc1", 00:26:10.089 "name": "Malloc1", 00:26:10.089 "nguid": "0A26839711944921BF9DAA94602FAB64", 00:26:10.089 "uuid": "0a268397-1194-4921-bf9d-aa94602fab64" 00:26:10.089 } 00:26:10.089 ] 00:26:10.089 } 00:26:10.089 ] 00:26:10.089 23:18:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.089 23:18:13 -- host/aer.sh@43 -- # wait 2532634 00:26:10.089 Asynchronous Event Request test 00:26:10.089 Attaching to 10.0.0.2 00:26:10.089 Attached to 10.0.0.2 00:26:10.089 Registering asynchronous event callbacks... 00:26:10.089 Starting namespace attribute notice tests for all controllers... 00:26:10.089 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:26:10.089 aer_cb - Changed Namespace 00:26:10.089 Cleaning up... 00:26:10.089 23:18:13 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:26:10.089 23:18:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.089 23:18:13 -- common/autotest_common.sh@10 -- # set +x 00:26:10.089 23:18:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.089 23:18:13 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:26:10.089 23:18:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.089 23:18:13 -- common/autotest_common.sh@10 -- # set +x 00:26:10.089 23:18:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.089 23:18:13 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:10.089 23:18:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.089 23:18:13 -- common/autotest_common.sh@10 -- # set +x 00:26:10.089 23:18:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.089 23:18:13 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:26:10.089 23:18:13 -- host/aer.sh@51 -- # nvmftestfini 00:26:10.089 23:18:13 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:10.089 23:18:13 -- nvmf/common.sh@116 -- # sync 00:26:10.089 23:18:13 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:10.089 23:18:13 -- nvmf/common.sh@119 -- # set +e 00:26:10.089 23:18:13 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:10.089 23:18:13 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:10.089 rmmod nvme_tcp 00:26:10.089 rmmod nvme_fabrics 00:26:10.089 rmmod nvme_keyring 00:26:10.089 23:18:13 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:10.089 23:18:13 -- nvmf/common.sh@123 -- # set -e 00:26:10.089 23:18:13 -- nvmf/common.sh@124 -- # return 0 00:26:10.089 23:18:13 -- nvmf/common.sh@477 -- # '[' -n 2532465 ']' 00:26:10.089 23:18:13 -- nvmf/common.sh@478 -- # killprocess 2532465 00:26:10.089 23:18:13 -- common/autotest_common.sh@936 -- # '[' -z 2532465 ']' 00:26:10.089 23:18:13 -- common/autotest_common.sh@940 -- # kill -0 2532465 00:26:10.089 23:18:13 -- common/autotest_common.sh@941 -- # uname 00:26:10.089 23:18:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:10.089 23:18:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2532465 00:26:10.089 23:18:13 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:10.089 23:18:13 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:10.089 23:18:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2532465' 00:26:10.089 killing process with pid 2532465 00:26:10.089 23:18:13 -- common/autotest_common.sh@955 -- # kill 2532465 00:26:10.089 [2024-11-28 23:18:13.627798] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:26:10.089 23:18:13 -- common/autotest_common.sh@960 -- # wait 2532465 00:26:10.349 23:18:13 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:10.349 23:18:13 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:10.349 23:18:13 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:10.349 23:18:13 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:10.349 23:18:13 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:10.349 23:18:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:10.349 23:18:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:10.349 23:18:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:12.882 23:18:15 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:12.882 00:26:12.882 real 0m6.169s 00:26:12.882 user 0m7.329s 00:26:12.882 sys 0m1.970s 00:26:12.882 23:18:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:12.882 23:18:15 -- common/autotest_common.sh@10 -- # set +x 00:26:12.882 ************************************ 00:26:12.882 END TEST nvmf_aer 00:26:12.882 ************************************ 00:26:12.882 23:18:15 -- nvmf/nvmf.sh@93 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:26:12.882 23:18:15 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:12.882 23:18:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:12.882 23:18:15 -- common/autotest_common.sh@10 -- # set +x 00:26:12.882 ************************************ 00:26:12.882 START TEST nvmf_async_init 00:26:12.882 ************************************ 00:26:12.882 23:18:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:26:12.882 * Looking for test storage... 00:26:12.882 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:12.882 23:18:15 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:12.882 23:18:15 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:12.882 23:18:15 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:12.882 23:18:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:12.882 23:18:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:12.882 23:18:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:12.882 23:18:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:12.882 23:18:16 -- scripts/common.sh@335 -- # IFS=.-: 00:26:12.882 23:18:16 -- scripts/common.sh@335 -- # read -ra ver1 00:26:12.882 23:18:16 -- scripts/common.sh@336 -- # IFS=.-: 00:26:12.882 23:18:16 -- scripts/common.sh@336 -- # read -ra ver2 00:26:12.882 23:18:16 -- scripts/common.sh@337 -- # local 'op=<' 00:26:12.882 23:18:16 -- scripts/common.sh@339 -- # ver1_l=2 00:26:12.882 23:18:16 -- scripts/common.sh@340 -- # ver2_l=1 00:26:12.882 23:18:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:12.882 23:18:16 -- scripts/common.sh@343 -- # case "$op" in 00:26:12.882 23:18:16 -- scripts/common.sh@344 -- # : 1 00:26:12.882 23:18:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:12.882 23:18:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:12.882 23:18:16 -- scripts/common.sh@364 -- # decimal 1 00:26:12.882 23:18:16 -- scripts/common.sh@352 -- # local d=1 00:26:12.882 23:18:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:12.882 23:18:16 -- scripts/common.sh@354 -- # echo 1 00:26:12.882 23:18:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:12.882 23:18:16 -- scripts/common.sh@365 -- # decimal 2 00:26:12.882 23:18:16 -- scripts/common.sh@352 -- # local d=2 00:26:12.882 23:18:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:12.882 23:18:16 -- scripts/common.sh@354 -- # echo 2 00:26:12.882 23:18:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:12.883 23:18:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:12.883 23:18:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:12.883 23:18:16 -- scripts/common.sh@367 -- # return 0 00:26:12.883 23:18:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:12.883 23:18:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:12.883 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:12.883 --rc genhtml_branch_coverage=1 00:26:12.883 --rc genhtml_function_coverage=1 00:26:12.883 --rc genhtml_legend=1 00:26:12.883 --rc geninfo_all_blocks=1 00:26:12.883 --rc geninfo_unexecuted_blocks=1 00:26:12.883 00:26:12.883 ' 00:26:12.883 23:18:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:12.883 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:12.883 --rc genhtml_branch_coverage=1 00:26:12.883 --rc genhtml_function_coverage=1 00:26:12.883 --rc genhtml_legend=1 00:26:12.883 --rc geninfo_all_blocks=1 00:26:12.883 --rc geninfo_unexecuted_blocks=1 00:26:12.883 00:26:12.883 ' 00:26:12.883 23:18:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:12.883 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:12.883 --rc genhtml_branch_coverage=1 00:26:12.883 --rc genhtml_function_coverage=1 00:26:12.883 --rc genhtml_legend=1 00:26:12.883 --rc geninfo_all_blocks=1 00:26:12.883 --rc geninfo_unexecuted_blocks=1 00:26:12.883 00:26:12.883 ' 00:26:12.883 23:18:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:12.883 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:12.883 --rc genhtml_branch_coverage=1 00:26:12.883 --rc genhtml_function_coverage=1 00:26:12.883 --rc genhtml_legend=1 00:26:12.883 --rc geninfo_all_blocks=1 00:26:12.883 --rc geninfo_unexecuted_blocks=1 00:26:12.883 00:26:12.883 ' 00:26:12.883 23:18:16 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:12.883 23:18:16 -- nvmf/common.sh@7 -- # uname -s 00:26:12.883 23:18:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:12.883 23:18:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:12.883 23:18:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:12.883 23:18:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:12.883 23:18:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:12.883 23:18:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:12.883 23:18:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:12.883 23:18:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:12.883 23:18:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:12.883 23:18:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:12.883 23:18:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:12.883 23:18:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:12.883 23:18:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:12.883 23:18:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:12.883 23:18:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:12.883 23:18:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:12.883 23:18:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:12.883 23:18:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:12.883 23:18:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:12.883 23:18:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:12.883 23:18:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:12.883 23:18:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:12.883 23:18:16 -- paths/export.sh@5 -- # export PATH 00:26:12.883 23:18:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:12.883 23:18:16 -- nvmf/common.sh@46 -- # : 0 00:26:12.883 23:18:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:12.883 23:18:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:12.883 23:18:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:12.883 23:18:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:12.883 23:18:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:12.883 23:18:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:12.883 23:18:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:12.883 23:18:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:12.883 23:18:16 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:26:12.883 23:18:16 -- host/async_init.sh@14 -- # null_block_size=512 00:26:12.883 23:18:16 -- host/async_init.sh@15 -- # null_bdev=null0 00:26:12.883 23:18:16 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:26:12.883 23:18:16 -- host/async_init.sh@20 -- # uuidgen 00:26:12.883 23:18:16 -- host/async_init.sh@20 -- # tr -d - 00:26:12.883 23:18:16 -- host/async_init.sh@20 -- # nguid=ecabc9ea2455407995c000774110d1b8 00:26:12.883 23:18:16 -- host/async_init.sh@22 -- # nvmftestinit 00:26:12.883 23:18:16 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:12.883 23:18:16 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:12.883 23:18:16 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:12.883 23:18:16 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:12.883 23:18:16 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:12.883 23:18:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:12.883 23:18:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:12.883 23:18:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:12.883 23:18:16 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:12.883 23:18:16 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:12.883 23:18:16 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:12.883 23:18:16 -- common/autotest_common.sh@10 -- # set +x 00:26:14.785 23:18:18 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:14.785 23:18:18 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:14.785 23:18:18 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:14.785 23:18:18 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:14.785 23:18:18 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:14.785 23:18:18 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:14.785 23:18:18 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:14.785 23:18:18 -- nvmf/common.sh@294 -- # net_devs=() 00:26:14.785 23:18:18 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:14.785 23:18:18 -- nvmf/common.sh@295 -- # e810=() 00:26:14.785 23:18:18 -- nvmf/common.sh@295 -- # local -ga e810 00:26:14.785 23:18:18 -- nvmf/common.sh@296 -- # x722=() 00:26:14.785 23:18:18 -- nvmf/common.sh@296 -- # local -ga x722 00:26:14.785 23:18:18 -- nvmf/common.sh@297 -- # mlx=() 00:26:14.785 23:18:18 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:14.785 23:18:18 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:14.785 23:18:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:14.785 23:18:18 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:14.785 23:18:18 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:14.785 23:18:18 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:14.785 23:18:18 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:14.785 23:18:18 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:14.785 23:18:18 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:14.785 23:18:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:14.785 23:18:18 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:14.785 23:18:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:14.785 23:18:18 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:14.785 23:18:18 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:14.785 23:18:18 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:14.785 23:18:18 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:14.785 23:18:18 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:14.785 23:18:18 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:14.785 23:18:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:14.785 23:18:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:14.785 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:14.785 23:18:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:14.785 23:18:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:14.785 23:18:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:14.785 23:18:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:14.785 23:18:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:14.785 23:18:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:14.785 23:18:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:14.785 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:14.785 23:18:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:14.785 23:18:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:14.785 23:18:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:14.785 23:18:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:14.785 23:18:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:14.785 23:18:18 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:14.785 23:18:18 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:14.785 23:18:18 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:14.785 23:18:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:14.785 23:18:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:14.785 23:18:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:14.785 23:18:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:14.785 23:18:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:14.785 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:14.785 23:18:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:14.785 23:18:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:14.785 23:18:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:14.785 23:18:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:14.785 23:18:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:14.785 23:18:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:14.785 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:14.785 23:18:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:14.785 23:18:18 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:14.785 23:18:18 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:14.785 23:18:18 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:14.785 23:18:18 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:14.785 23:18:18 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:14.785 23:18:18 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:14.785 23:18:18 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:14.785 23:18:18 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:14.785 23:18:18 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:14.785 23:18:18 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:14.785 23:18:18 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:14.785 23:18:18 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:14.785 23:18:18 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:14.785 23:18:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:14.785 23:18:18 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:14.785 23:18:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:14.785 23:18:18 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:14.785 23:18:18 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:14.785 23:18:18 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:14.785 23:18:18 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:14.785 23:18:18 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:14.785 23:18:18 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:14.785 23:18:18 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:14.785 23:18:18 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:14.785 23:18:18 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:14.785 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:14.785 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.161 ms 00:26:14.785 00:26:14.785 --- 10.0.0.2 ping statistics --- 00:26:14.785 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:14.785 rtt min/avg/max/mdev = 0.161/0.161/0.161/0.000 ms 00:26:14.785 23:18:18 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:14.785 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:14.785 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.079 ms 00:26:14.785 00:26:14.785 --- 10.0.0.1 ping statistics --- 00:26:14.785 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:14.785 rtt min/avg/max/mdev = 0.079/0.079/0.079/0.000 ms 00:26:14.785 23:18:18 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:14.785 23:18:18 -- nvmf/common.sh@410 -- # return 0 00:26:14.785 23:18:18 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:14.785 23:18:18 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:14.785 23:18:18 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:14.785 23:18:18 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:14.785 23:18:18 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:14.785 23:18:18 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:14.785 23:18:18 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:14.785 23:18:18 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:26:14.785 23:18:18 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:14.785 23:18:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:14.785 23:18:18 -- common/autotest_common.sh@10 -- # set +x 00:26:14.785 23:18:18 -- nvmf/common.sh@469 -- # nvmfpid=2534605 00:26:14.785 23:18:18 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:26:14.785 23:18:18 -- nvmf/common.sh@470 -- # waitforlisten 2534605 00:26:14.785 23:18:18 -- common/autotest_common.sh@829 -- # '[' -z 2534605 ']' 00:26:14.785 23:18:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:14.785 23:18:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:14.785 23:18:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:14.785 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:14.785 23:18:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:14.785 23:18:18 -- common/autotest_common.sh@10 -- # set +x 00:26:14.785 [2024-11-28 23:18:18.341830] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:14.785 [2024-11-28 23:18:18.341917] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:14.785 EAL: No free 2048 kB hugepages reported on node 1 00:26:15.044 [2024-11-28 23:18:18.410006] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:15.044 [2024-11-28 23:18:18.494818] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:15.044 [2024-11-28 23:18:18.494978] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:15.044 [2024-11-28 23:18:18.494996] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:15.044 [2024-11-28 23:18:18.495009] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:15.044 [2024-11-28 23:18:18.495038] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:15.978 23:18:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:15.978 23:18:19 -- common/autotest_common.sh@862 -- # return 0 00:26:15.978 23:18:19 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:15.978 23:18:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:15.978 23:18:19 -- common/autotest_common.sh@10 -- # set +x 00:26:15.978 23:18:19 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:15.978 23:18:19 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:26:15.978 23:18:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:15.978 23:18:19 -- common/autotest_common.sh@10 -- # set +x 00:26:15.978 [2024-11-28 23:18:19.349229] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:15.978 23:18:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:15.978 23:18:19 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:26:15.978 23:18:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:15.978 23:18:19 -- common/autotest_common.sh@10 -- # set +x 00:26:15.978 null0 00:26:15.978 23:18:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:15.978 23:18:19 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:26:15.978 23:18:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:15.978 23:18:19 -- common/autotest_common.sh@10 -- # set +x 00:26:15.978 23:18:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:15.978 23:18:19 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:26:15.978 23:18:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:15.978 23:18:19 -- common/autotest_common.sh@10 -- # set +x 00:26:15.978 23:18:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:15.978 23:18:19 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g ecabc9ea2455407995c000774110d1b8 00:26:15.978 23:18:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:15.978 23:18:19 -- common/autotest_common.sh@10 -- # set +x 00:26:15.978 23:18:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:15.978 23:18:19 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:26:15.978 23:18:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:15.978 23:18:19 -- common/autotest_common.sh@10 -- # set +x 00:26:15.978 [2024-11-28 23:18:19.389518] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:15.978 23:18:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:15.978 23:18:19 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:26:15.978 23:18:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:15.978 23:18:19 -- common/autotest_common.sh@10 -- # set +x 00:26:16.237 nvme0n1 00:26:16.237 23:18:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.237 23:18:19 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:26:16.237 23:18:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.237 23:18:19 -- common/autotest_common.sh@10 -- # set +x 00:26:16.237 [ 00:26:16.237 { 00:26:16.237 "name": "nvme0n1", 00:26:16.237 "aliases": [ 00:26:16.237 "ecabc9ea-2455-4079-95c0-00774110d1b8" 00:26:16.237 ], 00:26:16.237 "product_name": "NVMe disk", 00:26:16.237 "block_size": 512, 00:26:16.237 "num_blocks": 2097152, 00:26:16.237 "uuid": "ecabc9ea-2455-4079-95c0-00774110d1b8", 00:26:16.237 "assigned_rate_limits": { 00:26:16.237 "rw_ios_per_sec": 0, 00:26:16.237 "rw_mbytes_per_sec": 0, 00:26:16.237 "r_mbytes_per_sec": 0, 00:26:16.237 "w_mbytes_per_sec": 0 00:26:16.237 }, 00:26:16.237 "claimed": false, 00:26:16.237 "zoned": false, 00:26:16.237 "supported_io_types": { 00:26:16.237 "read": true, 00:26:16.237 "write": true, 00:26:16.237 "unmap": false, 00:26:16.237 "write_zeroes": true, 00:26:16.237 "flush": true, 00:26:16.237 "reset": true, 00:26:16.237 "compare": true, 00:26:16.237 "compare_and_write": true, 00:26:16.237 "abort": true, 00:26:16.237 "nvme_admin": true, 00:26:16.237 "nvme_io": true 00:26:16.237 }, 00:26:16.237 "driver_specific": { 00:26:16.237 "nvme": [ 00:26:16.237 { 00:26:16.237 "trid": { 00:26:16.237 "trtype": "TCP", 00:26:16.237 "adrfam": "IPv4", 00:26:16.237 "traddr": "10.0.0.2", 00:26:16.237 "trsvcid": "4420", 00:26:16.237 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:26:16.237 }, 00:26:16.237 "ctrlr_data": { 00:26:16.237 "cntlid": 1, 00:26:16.237 "vendor_id": "0x8086", 00:26:16.237 "model_number": "SPDK bdev Controller", 00:26:16.237 "serial_number": "00000000000000000000", 00:26:16.237 "firmware_revision": "24.01.1", 00:26:16.237 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:26:16.237 "oacs": { 00:26:16.237 "security": 0, 00:26:16.237 "format": 0, 00:26:16.237 "firmware": 0, 00:26:16.237 "ns_manage": 0 00:26:16.237 }, 00:26:16.237 "multi_ctrlr": true, 00:26:16.237 "ana_reporting": false 00:26:16.237 }, 00:26:16.237 "vs": { 00:26:16.237 "nvme_version": "1.3" 00:26:16.237 }, 00:26:16.237 "ns_data": { 00:26:16.237 "id": 1, 00:26:16.237 "can_share": true 00:26:16.237 } 00:26:16.237 } 00:26:16.237 ], 00:26:16.237 "mp_policy": "active_passive" 00:26:16.237 } 00:26:16.237 } 00:26:16.237 ] 00:26:16.237 23:18:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.237 23:18:19 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:26:16.237 23:18:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.237 23:18:19 -- common/autotest_common.sh@10 -- # set +x 00:26:16.237 [2024-11-28 23:18:19.642218] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:16.237 [2024-11-28 23:18:19.642309] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x16c93f0 (9): Bad file descriptor 00:26:16.237 [2024-11-28 23:18:19.784542] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:26:16.237 23:18:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.237 23:18:19 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:26:16.237 23:18:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.237 23:18:19 -- common/autotest_common.sh@10 -- # set +x 00:26:16.237 [ 00:26:16.237 { 00:26:16.237 "name": "nvme0n1", 00:26:16.237 "aliases": [ 00:26:16.237 "ecabc9ea-2455-4079-95c0-00774110d1b8" 00:26:16.237 ], 00:26:16.237 "product_name": "NVMe disk", 00:26:16.237 "block_size": 512, 00:26:16.237 "num_blocks": 2097152, 00:26:16.237 "uuid": "ecabc9ea-2455-4079-95c0-00774110d1b8", 00:26:16.237 "assigned_rate_limits": { 00:26:16.237 "rw_ios_per_sec": 0, 00:26:16.237 "rw_mbytes_per_sec": 0, 00:26:16.237 "r_mbytes_per_sec": 0, 00:26:16.237 "w_mbytes_per_sec": 0 00:26:16.237 }, 00:26:16.237 "claimed": false, 00:26:16.237 "zoned": false, 00:26:16.237 "supported_io_types": { 00:26:16.237 "read": true, 00:26:16.237 "write": true, 00:26:16.237 "unmap": false, 00:26:16.237 "write_zeroes": true, 00:26:16.237 "flush": true, 00:26:16.237 "reset": true, 00:26:16.237 "compare": true, 00:26:16.237 "compare_and_write": true, 00:26:16.237 "abort": true, 00:26:16.237 "nvme_admin": true, 00:26:16.237 "nvme_io": true 00:26:16.237 }, 00:26:16.237 "driver_specific": { 00:26:16.237 "nvme": [ 00:26:16.237 { 00:26:16.237 "trid": { 00:26:16.237 "trtype": "TCP", 00:26:16.237 "adrfam": "IPv4", 00:26:16.237 "traddr": "10.0.0.2", 00:26:16.237 "trsvcid": "4420", 00:26:16.237 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:26:16.237 }, 00:26:16.237 "ctrlr_data": { 00:26:16.237 "cntlid": 2, 00:26:16.237 "vendor_id": "0x8086", 00:26:16.237 "model_number": "SPDK bdev Controller", 00:26:16.237 "serial_number": "00000000000000000000", 00:26:16.237 "firmware_revision": "24.01.1", 00:26:16.237 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:26:16.237 "oacs": { 00:26:16.237 "security": 0, 00:26:16.237 "format": 0, 00:26:16.237 "firmware": 0, 00:26:16.237 "ns_manage": 0 00:26:16.237 }, 00:26:16.237 "multi_ctrlr": true, 00:26:16.237 "ana_reporting": false 00:26:16.237 }, 00:26:16.237 "vs": { 00:26:16.237 "nvme_version": "1.3" 00:26:16.237 }, 00:26:16.237 "ns_data": { 00:26:16.237 "id": 1, 00:26:16.237 "can_share": true 00:26:16.237 } 00:26:16.237 } 00:26:16.237 ], 00:26:16.238 "mp_policy": "active_passive" 00:26:16.238 } 00:26:16.238 } 00:26:16.238 ] 00:26:16.238 23:18:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.238 23:18:19 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:26:16.238 23:18:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.238 23:18:19 -- common/autotest_common.sh@10 -- # set +x 00:26:16.238 23:18:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.238 23:18:19 -- host/async_init.sh@53 -- # mktemp 00:26:16.238 23:18:19 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.Wrkz5GpZW3 00:26:16.238 23:18:19 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:26:16.238 23:18:19 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.Wrkz5GpZW3 00:26:16.238 23:18:19 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:26:16.238 23:18:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.238 23:18:19 -- common/autotest_common.sh@10 -- # set +x 00:26:16.238 23:18:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.238 23:18:19 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:26:16.238 23:18:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.238 23:18:19 -- common/autotest_common.sh@10 -- # set +x 00:26:16.238 [2024-11-28 23:18:19.834862] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:26:16.238 [2024-11-28 23:18:19.834999] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:26:16.238 23:18:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.238 23:18:19 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.Wrkz5GpZW3 00:26:16.238 23:18:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.238 23:18:19 -- common/autotest_common.sh@10 -- # set +x 00:26:16.496 23:18:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.496 23:18:19 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.Wrkz5GpZW3 00:26:16.496 23:18:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.496 23:18:19 -- common/autotest_common.sh@10 -- # set +x 00:26:16.496 [2024-11-28 23:18:19.850895] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:26:16.496 nvme0n1 00:26:16.496 23:18:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.496 23:18:19 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:26:16.496 23:18:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.496 23:18:19 -- common/autotest_common.sh@10 -- # set +x 00:26:16.496 [ 00:26:16.496 { 00:26:16.496 "name": "nvme0n1", 00:26:16.496 "aliases": [ 00:26:16.496 "ecabc9ea-2455-4079-95c0-00774110d1b8" 00:26:16.496 ], 00:26:16.496 "product_name": "NVMe disk", 00:26:16.496 "block_size": 512, 00:26:16.496 "num_blocks": 2097152, 00:26:16.496 "uuid": "ecabc9ea-2455-4079-95c0-00774110d1b8", 00:26:16.496 "assigned_rate_limits": { 00:26:16.496 "rw_ios_per_sec": 0, 00:26:16.496 "rw_mbytes_per_sec": 0, 00:26:16.496 "r_mbytes_per_sec": 0, 00:26:16.496 "w_mbytes_per_sec": 0 00:26:16.496 }, 00:26:16.496 "claimed": false, 00:26:16.496 "zoned": false, 00:26:16.496 "supported_io_types": { 00:26:16.496 "read": true, 00:26:16.496 "write": true, 00:26:16.496 "unmap": false, 00:26:16.496 "write_zeroes": true, 00:26:16.496 "flush": true, 00:26:16.496 "reset": true, 00:26:16.496 "compare": true, 00:26:16.496 "compare_and_write": true, 00:26:16.496 "abort": true, 00:26:16.496 "nvme_admin": true, 00:26:16.496 "nvme_io": true 00:26:16.496 }, 00:26:16.496 "driver_specific": { 00:26:16.496 "nvme": [ 00:26:16.496 { 00:26:16.496 "trid": { 00:26:16.496 "trtype": "TCP", 00:26:16.496 "adrfam": "IPv4", 00:26:16.496 "traddr": "10.0.0.2", 00:26:16.496 "trsvcid": "4421", 00:26:16.496 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:26:16.496 }, 00:26:16.496 "ctrlr_data": { 00:26:16.496 "cntlid": 3, 00:26:16.496 "vendor_id": "0x8086", 00:26:16.496 "model_number": "SPDK bdev Controller", 00:26:16.496 "serial_number": "00000000000000000000", 00:26:16.496 "firmware_revision": "24.01.1", 00:26:16.496 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:26:16.496 "oacs": { 00:26:16.496 "security": 0, 00:26:16.496 "format": 0, 00:26:16.496 "firmware": 0, 00:26:16.496 "ns_manage": 0 00:26:16.496 }, 00:26:16.496 "multi_ctrlr": true, 00:26:16.496 "ana_reporting": false 00:26:16.496 }, 00:26:16.496 "vs": { 00:26:16.496 "nvme_version": "1.3" 00:26:16.496 }, 00:26:16.496 "ns_data": { 00:26:16.496 "id": 1, 00:26:16.496 "can_share": true 00:26:16.496 } 00:26:16.496 } 00:26:16.496 ], 00:26:16.496 "mp_policy": "active_passive" 00:26:16.496 } 00:26:16.496 } 00:26:16.496 ] 00:26:16.496 23:18:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.496 23:18:19 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:26:16.496 23:18:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.496 23:18:19 -- common/autotest_common.sh@10 -- # set +x 00:26:16.496 23:18:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.496 23:18:19 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.Wrkz5GpZW3 00:26:16.496 23:18:19 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:26:16.496 23:18:19 -- host/async_init.sh@78 -- # nvmftestfini 00:26:16.496 23:18:19 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:16.497 23:18:19 -- nvmf/common.sh@116 -- # sync 00:26:16.497 23:18:19 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:16.497 23:18:19 -- nvmf/common.sh@119 -- # set +e 00:26:16.497 23:18:19 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:16.497 23:18:19 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:16.497 rmmod nvme_tcp 00:26:16.497 rmmod nvme_fabrics 00:26:16.497 rmmod nvme_keyring 00:26:16.497 23:18:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:16.497 23:18:20 -- nvmf/common.sh@123 -- # set -e 00:26:16.497 23:18:20 -- nvmf/common.sh@124 -- # return 0 00:26:16.497 23:18:20 -- nvmf/common.sh@477 -- # '[' -n 2534605 ']' 00:26:16.497 23:18:20 -- nvmf/common.sh@478 -- # killprocess 2534605 00:26:16.497 23:18:20 -- common/autotest_common.sh@936 -- # '[' -z 2534605 ']' 00:26:16.497 23:18:20 -- common/autotest_common.sh@940 -- # kill -0 2534605 00:26:16.497 23:18:20 -- common/autotest_common.sh@941 -- # uname 00:26:16.497 23:18:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:16.497 23:18:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2534605 00:26:16.497 23:18:20 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:16.497 23:18:20 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:16.497 23:18:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2534605' 00:26:16.497 killing process with pid 2534605 00:26:16.497 23:18:20 -- common/autotest_common.sh@955 -- # kill 2534605 00:26:16.497 23:18:20 -- common/autotest_common.sh@960 -- # wait 2534605 00:26:16.755 23:18:20 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:16.755 23:18:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:16.755 23:18:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:16.755 23:18:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:16.755 23:18:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:16.755 23:18:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:16.755 23:18:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:16.755 23:18:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:19.292 23:18:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:19.292 00:26:19.292 real 0m6.360s 00:26:19.292 user 0m3.025s 00:26:19.292 sys 0m1.925s 00:26:19.292 23:18:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:19.292 23:18:22 -- common/autotest_common.sh@10 -- # set +x 00:26:19.292 ************************************ 00:26:19.292 END TEST nvmf_async_init 00:26:19.292 ************************************ 00:26:19.292 23:18:22 -- nvmf/nvmf.sh@94 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:26:19.292 23:18:22 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:19.292 23:18:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:19.292 23:18:22 -- common/autotest_common.sh@10 -- # set +x 00:26:19.292 ************************************ 00:26:19.292 START TEST dma 00:26:19.292 ************************************ 00:26:19.292 23:18:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:26:19.292 * Looking for test storage... 00:26:19.292 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:19.292 23:18:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:19.292 23:18:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:19.292 23:18:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:19.292 23:18:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:19.292 23:18:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:19.292 23:18:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:19.292 23:18:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:19.292 23:18:22 -- scripts/common.sh@335 -- # IFS=.-: 00:26:19.292 23:18:22 -- scripts/common.sh@335 -- # read -ra ver1 00:26:19.292 23:18:22 -- scripts/common.sh@336 -- # IFS=.-: 00:26:19.292 23:18:22 -- scripts/common.sh@336 -- # read -ra ver2 00:26:19.292 23:18:22 -- scripts/common.sh@337 -- # local 'op=<' 00:26:19.292 23:18:22 -- scripts/common.sh@339 -- # ver1_l=2 00:26:19.292 23:18:22 -- scripts/common.sh@340 -- # ver2_l=1 00:26:19.292 23:18:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:19.292 23:18:22 -- scripts/common.sh@343 -- # case "$op" in 00:26:19.292 23:18:22 -- scripts/common.sh@344 -- # : 1 00:26:19.292 23:18:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:19.292 23:18:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:19.292 23:18:22 -- scripts/common.sh@364 -- # decimal 1 00:26:19.292 23:18:22 -- scripts/common.sh@352 -- # local d=1 00:26:19.292 23:18:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:19.292 23:18:22 -- scripts/common.sh@354 -- # echo 1 00:26:19.292 23:18:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:19.292 23:18:22 -- scripts/common.sh@365 -- # decimal 2 00:26:19.292 23:18:22 -- scripts/common.sh@352 -- # local d=2 00:26:19.292 23:18:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:19.292 23:18:22 -- scripts/common.sh@354 -- # echo 2 00:26:19.292 23:18:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:19.292 23:18:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:19.292 23:18:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:19.292 23:18:22 -- scripts/common.sh@367 -- # return 0 00:26:19.292 23:18:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:19.292 23:18:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:19.292 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:19.292 --rc genhtml_branch_coverage=1 00:26:19.292 --rc genhtml_function_coverage=1 00:26:19.292 --rc genhtml_legend=1 00:26:19.292 --rc geninfo_all_blocks=1 00:26:19.292 --rc geninfo_unexecuted_blocks=1 00:26:19.292 00:26:19.292 ' 00:26:19.292 23:18:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:19.292 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:19.292 --rc genhtml_branch_coverage=1 00:26:19.292 --rc genhtml_function_coverage=1 00:26:19.292 --rc genhtml_legend=1 00:26:19.292 --rc geninfo_all_blocks=1 00:26:19.292 --rc geninfo_unexecuted_blocks=1 00:26:19.292 00:26:19.292 ' 00:26:19.292 23:18:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:19.292 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:19.293 --rc genhtml_branch_coverage=1 00:26:19.293 --rc genhtml_function_coverage=1 00:26:19.293 --rc genhtml_legend=1 00:26:19.293 --rc geninfo_all_blocks=1 00:26:19.293 --rc geninfo_unexecuted_blocks=1 00:26:19.293 00:26:19.293 ' 00:26:19.293 23:18:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:19.293 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:19.293 --rc genhtml_branch_coverage=1 00:26:19.293 --rc genhtml_function_coverage=1 00:26:19.293 --rc genhtml_legend=1 00:26:19.293 --rc geninfo_all_blocks=1 00:26:19.293 --rc geninfo_unexecuted_blocks=1 00:26:19.293 00:26:19.293 ' 00:26:19.293 23:18:22 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:19.293 23:18:22 -- nvmf/common.sh@7 -- # uname -s 00:26:19.293 23:18:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:19.293 23:18:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:19.293 23:18:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:19.293 23:18:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:19.293 23:18:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:19.293 23:18:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:19.293 23:18:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:19.293 23:18:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:19.293 23:18:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:19.293 23:18:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:19.293 23:18:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:19.293 23:18:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:19.293 23:18:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:19.293 23:18:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:19.293 23:18:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:19.293 23:18:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:19.293 23:18:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:19.293 23:18:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:19.293 23:18:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:19.293 23:18:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:19.293 23:18:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:19.293 23:18:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:19.293 23:18:22 -- paths/export.sh@5 -- # export PATH 00:26:19.293 23:18:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:19.293 23:18:22 -- nvmf/common.sh@46 -- # : 0 00:26:19.293 23:18:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:19.293 23:18:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:19.293 23:18:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:19.293 23:18:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:19.293 23:18:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:19.293 23:18:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:19.293 23:18:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:19.293 23:18:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:19.293 23:18:22 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:26:19.293 23:18:22 -- host/dma.sh@13 -- # exit 0 00:26:19.293 00:26:19.293 real 0m0.155s 00:26:19.293 user 0m0.103s 00:26:19.293 sys 0m0.061s 00:26:19.293 23:18:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:19.293 23:18:22 -- common/autotest_common.sh@10 -- # set +x 00:26:19.293 ************************************ 00:26:19.293 END TEST dma 00:26:19.293 ************************************ 00:26:19.293 23:18:22 -- nvmf/nvmf.sh@97 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:26:19.293 23:18:22 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:19.293 23:18:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:19.293 23:18:22 -- common/autotest_common.sh@10 -- # set +x 00:26:19.293 ************************************ 00:26:19.293 START TEST nvmf_identify 00:26:19.293 ************************************ 00:26:19.293 23:18:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:26:19.293 * Looking for test storage... 00:26:19.293 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:19.293 23:18:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:19.293 23:18:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:19.293 23:18:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:19.293 23:18:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:19.293 23:18:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:19.293 23:18:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:19.293 23:18:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:19.293 23:18:22 -- scripts/common.sh@335 -- # IFS=.-: 00:26:19.293 23:18:22 -- scripts/common.sh@335 -- # read -ra ver1 00:26:19.293 23:18:22 -- scripts/common.sh@336 -- # IFS=.-: 00:26:19.293 23:18:22 -- scripts/common.sh@336 -- # read -ra ver2 00:26:19.293 23:18:22 -- scripts/common.sh@337 -- # local 'op=<' 00:26:19.293 23:18:22 -- scripts/common.sh@339 -- # ver1_l=2 00:26:19.293 23:18:22 -- scripts/common.sh@340 -- # ver2_l=1 00:26:19.293 23:18:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:19.293 23:18:22 -- scripts/common.sh@343 -- # case "$op" in 00:26:19.293 23:18:22 -- scripts/common.sh@344 -- # : 1 00:26:19.293 23:18:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:19.293 23:18:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:19.293 23:18:22 -- scripts/common.sh@364 -- # decimal 1 00:26:19.293 23:18:22 -- scripts/common.sh@352 -- # local d=1 00:26:19.293 23:18:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:19.293 23:18:22 -- scripts/common.sh@354 -- # echo 1 00:26:19.293 23:18:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:19.293 23:18:22 -- scripts/common.sh@365 -- # decimal 2 00:26:19.293 23:18:22 -- scripts/common.sh@352 -- # local d=2 00:26:19.293 23:18:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:19.293 23:18:22 -- scripts/common.sh@354 -- # echo 2 00:26:19.293 23:18:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:19.293 23:18:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:19.293 23:18:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:19.293 23:18:22 -- scripts/common.sh@367 -- # return 0 00:26:19.293 23:18:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:19.293 23:18:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:19.293 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:19.293 --rc genhtml_branch_coverage=1 00:26:19.293 --rc genhtml_function_coverage=1 00:26:19.293 --rc genhtml_legend=1 00:26:19.293 --rc geninfo_all_blocks=1 00:26:19.293 --rc geninfo_unexecuted_blocks=1 00:26:19.293 00:26:19.293 ' 00:26:19.293 23:18:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:19.293 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:19.293 --rc genhtml_branch_coverage=1 00:26:19.293 --rc genhtml_function_coverage=1 00:26:19.293 --rc genhtml_legend=1 00:26:19.293 --rc geninfo_all_blocks=1 00:26:19.293 --rc geninfo_unexecuted_blocks=1 00:26:19.293 00:26:19.293 ' 00:26:19.293 23:18:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:19.293 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:19.293 --rc genhtml_branch_coverage=1 00:26:19.293 --rc genhtml_function_coverage=1 00:26:19.293 --rc genhtml_legend=1 00:26:19.293 --rc geninfo_all_blocks=1 00:26:19.293 --rc geninfo_unexecuted_blocks=1 00:26:19.293 00:26:19.293 ' 00:26:19.293 23:18:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:19.293 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:19.293 --rc genhtml_branch_coverage=1 00:26:19.293 --rc genhtml_function_coverage=1 00:26:19.293 --rc genhtml_legend=1 00:26:19.293 --rc geninfo_all_blocks=1 00:26:19.293 --rc geninfo_unexecuted_blocks=1 00:26:19.293 00:26:19.293 ' 00:26:19.293 23:18:22 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:19.293 23:18:22 -- nvmf/common.sh@7 -- # uname -s 00:26:19.293 23:18:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:19.293 23:18:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:19.293 23:18:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:19.293 23:18:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:19.293 23:18:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:19.293 23:18:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:19.293 23:18:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:19.293 23:18:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:19.293 23:18:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:19.293 23:18:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:19.293 23:18:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:19.293 23:18:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:19.293 23:18:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:19.294 23:18:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:19.294 23:18:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:19.294 23:18:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:19.294 23:18:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:19.294 23:18:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:19.294 23:18:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:19.294 23:18:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:19.294 23:18:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:19.294 23:18:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:19.294 23:18:22 -- paths/export.sh@5 -- # export PATH 00:26:19.294 23:18:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:19.294 23:18:22 -- nvmf/common.sh@46 -- # : 0 00:26:19.294 23:18:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:19.294 23:18:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:19.294 23:18:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:19.294 23:18:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:19.294 23:18:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:19.294 23:18:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:19.294 23:18:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:19.294 23:18:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:19.294 23:18:22 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:26:19.294 23:18:22 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:26:19.294 23:18:22 -- host/identify.sh@14 -- # nvmftestinit 00:26:19.294 23:18:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:19.294 23:18:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:19.294 23:18:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:19.294 23:18:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:19.294 23:18:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:19.294 23:18:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:19.294 23:18:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:19.294 23:18:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:19.294 23:18:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:19.294 23:18:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:19.294 23:18:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:19.294 23:18:22 -- common/autotest_common.sh@10 -- # set +x 00:26:21.198 23:18:24 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:21.198 23:18:24 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:21.198 23:18:24 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:21.198 23:18:24 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:21.198 23:18:24 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:21.198 23:18:24 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:21.198 23:18:24 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:21.198 23:18:24 -- nvmf/common.sh@294 -- # net_devs=() 00:26:21.198 23:18:24 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:21.198 23:18:24 -- nvmf/common.sh@295 -- # e810=() 00:26:21.198 23:18:24 -- nvmf/common.sh@295 -- # local -ga e810 00:26:21.198 23:18:24 -- nvmf/common.sh@296 -- # x722=() 00:26:21.198 23:18:24 -- nvmf/common.sh@296 -- # local -ga x722 00:26:21.198 23:18:24 -- nvmf/common.sh@297 -- # mlx=() 00:26:21.198 23:18:24 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:21.198 23:18:24 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:21.198 23:18:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:21.198 23:18:24 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:21.198 23:18:24 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:21.198 23:18:24 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:21.198 23:18:24 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:21.198 23:18:24 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:21.198 23:18:24 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:21.198 23:18:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:21.198 23:18:24 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:21.198 23:18:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:21.198 23:18:24 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:21.198 23:18:24 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:21.198 23:18:24 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:21.198 23:18:24 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:21.198 23:18:24 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:21.198 23:18:24 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:21.198 23:18:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:21.198 23:18:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:21.198 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:21.198 23:18:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:21.198 23:18:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:21.198 23:18:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:21.198 23:18:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:21.198 23:18:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:21.198 23:18:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:21.198 23:18:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:21.198 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:21.198 23:18:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:21.198 23:18:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:21.198 23:18:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:21.198 23:18:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:21.198 23:18:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:21.198 23:18:24 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:21.198 23:18:24 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:21.198 23:18:24 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:21.198 23:18:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:21.198 23:18:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:21.198 23:18:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:21.198 23:18:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:21.198 23:18:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:21.198 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:21.198 23:18:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:21.198 23:18:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:21.198 23:18:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:21.198 23:18:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:21.198 23:18:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:21.198 23:18:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:21.198 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:21.198 23:18:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:21.198 23:18:24 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:21.198 23:18:24 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:21.198 23:18:24 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:21.198 23:18:24 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:21.198 23:18:24 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:21.198 23:18:24 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:21.198 23:18:24 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:21.198 23:18:24 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:21.198 23:18:24 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:21.198 23:18:24 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:21.198 23:18:24 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:21.198 23:18:24 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:21.198 23:18:24 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:21.198 23:18:24 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:21.198 23:18:24 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:21.198 23:18:24 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:21.198 23:18:24 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:21.198 23:18:24 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:21.198 23:18:24 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:21.458 23:18:24 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:21.458 23:18:24 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:21.458 23:18:24 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:21.458 23:18:24 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:21.458 23:18:24 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:21.458 23:18:24 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:21.458 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:21.458 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.231 ms 00:26:21.458 00:26:21.458 --- 10.0.0.2 ping statistics --- 00:26:21.458 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:21.458 rtt min/avg/max/mdev = 0.231/0.231/0.231/0.000 ms 00:26:21.458 23:18:24 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:21.458 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:21.458 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.140 ms 00:26:21.458 00:26:21.458 --- 10.0.0.1 ping statistics --- 00:26:21.458 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:21.458 rtt min/avg/max/mdev = 0.140/0.140/0.140/0.000 ms 00:26:21.458 23:18:24 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:21.458 23:18:24 -- nvmf/common.sh@410 -- # return 0 00:26:21.458 23:18:24 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:21.458 23:18:24 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:21.458 23:18:24 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:21.458 23:18:24 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:21.458 23:18:24 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:21.458 23:18:24 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:21.458 23:18:24 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:21.458 23:18:24 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:26:21.458 23:18:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:21.458 23:18:24 -- common/autotest_common.sh@10 -- # set +x 00:26:21.458 23:18:24 -- host/identify.sh@19 -- # nvmfpid=2536871 00:26:21.458 23:18:24 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:26:21.458 23:18:24 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:21.458 23:18:24 -- host/identify.sh@23 -- # waitforlisten 2536871 00:26:21.458 23:18:24 -- common/autotest_common.sh@829 -- # '[' -z 2536871 ']' 00:26:21.458 23:18:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:21.458 23:18:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:21.458 23:18:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:21.458 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:21.458 23:18:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:21.458 23:18:24 -- common/autotest_common.sh@10 -- # set +x 00:26:21.458 [2024-11-28 23:18:24.938627] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:21.458 [2024-11-28 23:18:24.938727] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:21.458 EAL: No free 2048 kB hugepages reported on node 1 00:26:21.458 [2024-11-28 23:18:25.005501] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:21.715 [2024-11-28 23:18:25.092143] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:21.715 [2024-11-28 23:18:25.092294] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:21.715 [2024-11-28 23:18:25.092311] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:21.715 [2024-11-28 23:18:25.092324] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:21.715 [2024-11-28 23:18:25.092419] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:21.715 [2024-11-28 23:18:25.092514] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:21.715 [2024-11-28 23:18:25.092582] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:21.715 [2024-11-28 23:18:25.092579] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:22.649 23:18:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:22.649 23:18:25 -- common/autotest_common.sh@862 -- # return 0 00:26:22.649 23:18:25 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:22.649 23:18:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.649 23:18:25 -- common/autotest_common.sh@10 -- # set +x 00:26:22.649 [2024-11-28 23:18:25.951185] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:22.649 23:18:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.649 23:18:25 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:26:22.649 23:18:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:22.649 23:18:25 -- common/autotest_common.sh@10 -- # set +x 00:26:22.649 23:18:25 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:26:22.649 23:18:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.649 23:18:25 -- common/autotest_common.sh@10 -- # set +x 00:26:22.649 Malloc0 00:26:22.649 23:18:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.649 23:18:26 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:22.649 23:18:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.649 23:18:26 -- common/autotest_common.sh@10 -- # set +x 00:26:22.649 23:18:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.649 23:18:26 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:26:22.649 23:18:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.649 23:18:26 -- common/autotest_common.sh@10 -- # set +x 00:26:22.649 23:18:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.649 23:18:26 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:22.649 23:18:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.649 23:18:26 -- common/autotest_common.sh@10 -- # set +x 00:26:22.649 [2024-11-28 23:18:26.032704] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:22.649 23:18:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.649 23:18:26 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:26:22.649 23:18:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.649 23:18:26 -- common/autotest_common.sh@10 -- # set +x 00:26:22.649 23:18:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.649 23:18:26 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:26:22.649 23:18:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.649 23:18:26 -- common/autotest_common.sh@10 -- # set +x 00:26:22.649 [2024-11-28 23:18:26.048432] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:26:22.649 [ 00:26:22.649 { 00:26:22.649 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:26:22.649 "subtype": "Discovery", 00:26:22.649 "listen_addresses": [ 00:26:22.649 { 00:26:22.649 "transport": "TCP", 00:26:22.649 "trtype": "TCP", 00:26:22.649 "adrfam": "IPv4", 00:26:22.649 "traddr": "10.0.0.2", 00:26:22.649 "trsvcid": "4420" 00:26:22.649 } 00:26:22.649 ], 00:26:22.649 "allow_any_host": true, 00:26:22.649 "hosts": [] 00:26:22.649 }, 00:26:22.649 { 00:26:22.649 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:26:22.649 "subtype": "NVMe", 00:26:22.649 "listen_addresses": [ 00:26:22.649 { 00:26:22.649 "transport": "TCP", 00:26:22.649 "trtype": "TCP", 00:26:22.649 "adrfam": "IPv4", 00:26:22.649 "traddr": "10.0.0.2", 00:26:22.649 "trsvcid": "4420" 00:26:22.649 } 00:26:22.649 ], 00:26:22.649 "allow_any_host": true, 00:26:22.649 "hosts": [], 00:26:22.649 "serial_number": "SPDK00000000000001", 00:26:22.649 "model_number": "SPDK bdev Controller", 00:26:22.649 "max_namespaces": 32, 00:26:22.649 "min_cntlid": 1, 00:26:22.649 "max_cntlid": 65519, 00:26:22.649 "namespaces": [ 00:26:22.649 { 00:26:22.649 "nsid": 1, 00:26:22.649 "bdev_name": "Malloc0", 00:26:22.649 "name": "Malloc0", 00:26:22.649 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:26:22.649 "eui64": "ABCDEF0123456789", 00:26:22.649 "uuid": "9df92431-a9cd-48c9-ab7f-59791eb9ca9c" 00:26:22.649 } 00:26:22.649 ] 00:26:22.649 } 00:26:22.649 ] 00:26:22.649 23:18:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.649 23:18:26 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:26:22.650 [2024-11-28 23:18:26.074276] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:22.650 [2024-11-28 23:18:26.074318] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2537027 ] 00:26:22.650 EAL: No free 2048 kB hugepages reported on node 1 00:26:22.650 [2024-11-28 23:18:26.107783] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:26:22.650 [2024-11-28 23:18:26.107837] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:26:22.650 [2024-11-28 23:18:26.107847] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:26:22.650 [2024-11-28 23:18:26.107863] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:26:22.650 [2024-11-28 23:18:26.107876] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:26:22.650 [2024-11-28 23:18:26.111446] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:26:22.650 [2024-11-28 23:18:26.111505] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x6ff420 0 00:26:22.650 [2024-11-28 23:18:26.126410] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:26:22.650 [2024-11-28 23:18:26.126441] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:26:22.650 [2024-11-28 23:18:26.126450] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:26:22.650 [2024-11-28 23:18:26.126456] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:26:22.650 [2024-11-28 23:18:26.126505] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.650 [2024-11-28 23:18:26.126517] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.650 [2024-11-28 23:18:26.126524] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x6ff420) 00:26:22.650 [2024-11-28 23:18:26.126541] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:26:22.650 [2024-11-28 23:18:26.126568] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x764b00, cid 0, qid 0 00:26:22.650 [2024-11-28 23:18:26.133406] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:22.650 [2024-11-28 23:18:26.133425] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:22.650 [2024-11-28 23:18:26.133446] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:22.650 [2024-11-28 23:18:26.133455] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x764b00) on tqpair=0x6ff420 00:26:22.650 [2024-11-28 23:18:26.133475] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:26:22.650 [2024-11-28 23:18:26.133486] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:26:22.650 [2024-11-28 23:18:26.133496] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:26:22.650 [2024-11-28 23:18:26.133513] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.650 [2024-11-28 23:18:26.133522] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.650 [2024-11-28 23:18:26.133529] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x6ff420) 00:26:22.650 [2024-11-28 23:18:26.133540] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.650 [2024-11-28 23:18:26.133563] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x764b00, cid 0, qid 0 00:26:22.650 [2024-11-28 23:18:26.133729] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:22.650 [2024-11-28 23:18:26.133759] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:22.650 [2024-11-28 23:18:26.133766] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:22.650 [2024-11-28 23:18:26.133773] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x764b00) on tqpair=0x6ff420 00:26:22.650 [2024-11-28 23:18:26.133782] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:26:22.650 [2024-11-28 23:18:26.133796] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:26:22.650 [2024-11-28 23:18:26.133809] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.650 [2024-11-28 23:18:26.133817] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.650 [2024-11-28 23:18:26.133824] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x6ff420) 00:26:22.650 [2024-11-28 23:18:26.133834] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.650 [2024-11-28 23:18:26.133856] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x764b00, cid 0, qid 0 00:26:22.650 [2024-11-28 23:18:26.133957] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:22.650 [2024-11-28 23:18:26.133969] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:22.650 [2024-11-28 23:18:26.133976] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:22.650 [2024-11-28 23:18:26.133983] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x764b00) on tqpair=0x6ff420 00:26:22.650 [2024-11-28 23:18:26.133991] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:26:22.650 [2024-11-28 23:18:26.134006] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:26:22.650 [2024-11-28 23:18:26.134018] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.650 [2024-11-28 23:18:26.134026] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.650 [2024-11-28 23:18:26.134032] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x6ff420) 00:26:22.650 [2024-11-28 23:18:26.134043] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.650 [2024-11-28 23:18:26.134063] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x764b00, cid 0, qid 0 00:26:22.650 [2024-11-28 23:18:26.134158] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:22.650 [2024-11-28 23:18:26.134170] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:22.650 [2024-11-28 23:18:26.134181] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:22.650 [2024-11-28 23:18:26.134188] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x764b00) on tqpair=0x6ff420 00:26:22.650 [2024-11-28 23:18:26.134198] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:26:22.650 [2024-11-28 23:18:26.134215] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.650 [2024-11-28 23:18:26.134224] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.650 [2024-11-28 23:18:26.134230] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x6ff420) 00:26:22.650 [2024-11-28 23:18:26.134241] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.650 [2024-11-28 23:18:26.134262] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x764b00, cid 0, qid 0 00:26:22.650 [2024-11-28 23:18:26.134349] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:22.650 [2024-11-28 23:18:26.134364] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:22.650 [2024-11-28 23:18:26.134371] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:22.650 [2024-11-28 23:18:26.134377] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x764b00) on tqpair=0x6ff420 00:26:22.650 [2024-11-28 23:18:26.134386] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:26:22.650 [2024-11-28 23:18:26.134403] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:26:22.650 [2024-11-28 23:18:26.134418] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:26:22.650 [2024-11-28 23:18:26.134538] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:26:22.650 [2024-11-28 23:18:26.134546] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:26:22.650 [2024-11-28 23:18:26.134560] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.650 [2024-11-28 23:18:26.134568] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.650 [2024-11-28 23:18:26.134574] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x6ff420) 00:26:22.650 [2024-11-28 23:18:26.134584] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.650 [2024-11-28 23:18:26.134620] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x764b00, cid 0, qid 0 00:26:22.650 [2024-11-28 23:18:26.134813] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:22.650 [2024-11-28 23:18:26.134828] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:22.650 [2024-11-28 23:18:26.134835] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:22.650 [2024-11-28 23:18:26.134842] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x764b00) on tqpair=0x6ff420 00:26:22.650 [2024-11-28 23:18:26.134850] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:26:22.651 [2024-11-28 23:18:26.134867] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.651 [2024-11-28 23:18:26.134876] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.651 [2024-11-28 23:18:26.134883] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x6ff420) 00:26:22.651 [2024-11-28 23:18:26.134894] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.651 [2024-11-28 23:18:26.134914] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x764b00, cid 0, qid 0 00:26:22.651 [2024-11-28 23:18:26.135002] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:22.651 [2024-11-28 23:18:26.135016] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:22.651 [2024-11-28 23:18:26.135023] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:22.651 [2024-11-28 23:18:26.135030] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x764b00) on tqpair=0x6ff420 00:26:22.651 [2024-11-28 23:18:26.135038] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:26:22.651 [2024-11-28 23:18:26.135047] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:26:22.651 [2024-11-28 23:18:26.135060] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:26:22.651 [2024-11-28 23:18:26.135075] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:26:22.651 [2024-11-28 23:18:26.135090] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.651 [2024-11-28 23:18:26.135097] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.651 [2024-11-28 23:18:26.135104] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x6ff420) 00:26:22.651 [2024-11-28 23:18:26.135115] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.651 [2024-11-28 23:18:26.135136] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x764b00, cid 0, qid 0 00:26:22.651 [2024-11-28 23:18:26.135294] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:22.651 [2024-11-28 23:18:26.135306] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:22.651 [2024-11-28 23:18:26.135313] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:22.651 [2024-11-28 23:18:26.135335] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x6ff420): datao=0, datal=4096, cccid=0 00:26:22.651 [2024-11-28 23:18:26.135343] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x764b00) on tqpair(0x6ff420): expected_datao=0, payload_size=4096 00:26:22.651 [2024-11-28 23:18:26.135356] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:22.651 [2024-11-28 23:18:26.135364] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:22.651 [2024-11-28 23:18:26.135400] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:22.651 [2024-11-28 23:18:26.135415] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:22.651 [2024-11-28 23:18:26.135422] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:22.651 [2024-11-28 23:18:26.135429] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x764b00) on tqpair=0x6ff420 00:26:22.651 [2024-11-28 23:18:26.135441] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:26:22.651 [2024-11-28 23:18:26.135451] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:26:22.651 [2024-11-28 23:18:26.135458] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:26:22.651 [2024-11-28 23:18:26.135467] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:26:22.651 [2024-11-28 23:18:26.135475] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:26:22.651 [2024-11-28 23:18:26.135482] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:26:22.651 [2024-11-28 23:18:26.135502] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:26:22.651 [2024-11-28 23:18:26.135517] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.651 [2024-11-28 23:18:26.135528] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.651 [2024-11-28 23:18:26.135535] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x6ff420) 00:26:22.651 [2024-11-28 23:18:26.135546] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:26:22.651 [2024-11-28 23:18:26.135570] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x764b00, cid 0, qid 0 00:26:22.651 [2024-11-28 23:18:26.135707] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:22.651 [2024-11-28 23:18:26.135721] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:22.651 [2024-11-28 23:18:26.135728] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:22.651 [2024-11-28 23:18:26.135735] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x764b00) on tqpair=0x6ff420 00:26:22.651 [2024-11-28 23:18:26.135747] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.651 [2024-11-28 23:18:26.135754] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.651 [2024-11-28 23:18:26.135761] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x6ff420) 00:26:22.651 [2024-11-28 23:18:26.135771] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:22.651 [2024-11-28 23:18:26.135782] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.651 [2024-11-28 23:18:26.135789] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.651 [2024-11-28 23:18:26.135795] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x6ff420) 00:26:22.651 [2024-11-28 23:18:26.135804] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:22.651 [2024-11-28 23:18:26.135815] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.651 [2024-11-28 23:18:26.135822] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.651 [2024-11-28 23:18:26.135828] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x6ff420) 00:26:22.651 [2024-11-28 23:18:26.135837] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:22.651 [2024-11-28 23:18:26.135847] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.651 [2024-11-28 23:18:26.135854] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.651 [2024-11-28 23:18:26.135860] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x6ff420) 00:26:22.651 [2024-11-28 23:18:26.135869] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:22.651 [2024-11-28 23:18:26.135893] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:26:22.651 [2024-11-28 23:18:26.135912] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:26:22.651 [2024-11-28 23:18:26.135925] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.651 [2024-11-28 23:18:26.135932] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.651 [2024-11-28 23:18:26.135938] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x6ff420) 00:26:22.651 [2024-11-28 23:18:26.135948] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.651 [2024-11-28 23:18:26.135970] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x764b00, cid 0, qid 0 00:26:22.651 [2024-11-28 23:18:26.135981] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x764c60, cid 1, qid 0 00:26:22.651 [2024-11-28 23:18:26.135989] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x764dc0, cid 2, qid 0 00:26:22.651 [2024-11-28 23:18:26.135996] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x764f20, cid 3, qid 0 00:26:22.651 [2024-11-28 23:18:26.136007] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x765080, cid 4, qid 0 00:26:22.651 [2024-11-28 23:18:26.136169] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:22.651 [2024-11-28 23:18:26.136182] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:22.651 [2024-11-28 23:18:26.136189] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:22.651 [2024-11-28 23:18:26.136195] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x765080) on tqpair=0x6ff420 00:26:22.651 [2024-11-28 23:18:26.136204] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:26:22.651 [2024-11-28 23:18:26.136213] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:26:22.652 [2024-11-28 23:18:26.136229] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.652 [2024-11-28 23:18:26.136239] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.652 [2024-11-28 23:18:26.136245] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x6ff420) 00:26:22.652 [2024-11-28 23:18:26.136256] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.652 [2024-11-28 23:18:26.136292] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x765080, cid 4, qid 0 00:26:22.652 [2024-11-28 23:18:26.136484] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:22.652 [2024-11-28 23:18:26.136501] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:22.652 [2024-11-28 23:18:26.136508] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:22.652 [2024-11-28 23:18:26.136515] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x6ff420): datao=0, datal=4096, cccid=4 00:26:22.652 [2024-11-28 23:18:26.136522] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x765080) on tqpair(0x6ff420): expected_datao=0, payload_size=4096 00:26:22.652 [2024-11-28 23:18:26.136539] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:22.652 [2024-11-28 23:18:26.136549] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:22.652 [2024-11-28 23:18:26.181403] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:22.652 [2024-11-28 23:18:26.181422] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:22.652 [2024-11-28 23:18:26.181429] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:22.652 [2024-11-28 23:18:26.181436] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x765080) on tqpair=0x6ff420 00:26:22.652 [2024-11-28 23:18:26.181456] nvme_ctrlr.c:4024:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:26:22.652 [2024-11-28 23:18:26.181494] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.652 [2024-11-28 23:18:26.181505] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.652 [2024-11-28 23:18:26.181512] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x6ff420) 00:26:22.652 [2024-11-28 23:18:26.181523] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.652 [2024-11-28 23:18:26.181535] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.652 [2024-11-28 23:18:26.181542] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.652 [2024-11-28 23:18:26.181548] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x6ff420) 00:26:22.652 [2024-11-28 23:18:26.181557] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:26:22.652 [2024-11-28 23:18:26.181585] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x765080, cid 4, qid 0 00:26:22.652 [2024-11-28 23:18:26.181597] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x7651e0, cid 5, qid 0 00:26:22.652 [2024-11-28 23:18:26.181755] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:22.652 [2024-11-28 23:18:26.181774] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:22.652 [2024-11-28 23:18:26.181782] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:22.652 [2024-11-28 23:18:26.181788] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x6ff420): datao=0, datal=1024, cccid=4 00:26:22.652 [2024-11-28 23:18:26.181796] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x765080) on tqpair(0x6ff420): expected_datao=0, payload_size=1024 00:26:22.652 [2024-11-28 23:18:26.181807] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:22.652 [2024-11-28 23:18:26.181814] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:22.652 [2024-11-28 23:18:26.181823] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:22.652 [2024-11-28 23:18:26.181831] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:22.652 [2024-11-28 23:18:26.181838] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:22.652 [2024-11-28 23:18:26.181844] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x7651e0) on tqpair=0x6ff420 00:26:22.652 [2024-11-28 23:18:26.223533] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:22.652 [2024-11-28 23:18:26.223553] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:22.652 [2024-11-28 23:18:26.223561] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:22.652 [2024-11-28 23:18:26.223568] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x765080) on tqpair=0x6ff420 00:26:22.652 [2024-11-28 23:18:26.223586] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.652 [2024-11-28 23:18:26.223594] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.652 [2024-11-28 23:18:26.223601] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x6ff420) 00:26:22.652 [2024-11-28 23:18:26.223612] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.652 [2024-11-28 23:18:26.223642] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x765080, cid 4, qid 0 00:26:22.652 [2024-11-28 23:18:26.223766] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:22.652 [2024-11-28 23:18:26.223779] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:22.652 [2024-11-28 23:18:26.223786] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:22.652 [2024-11-28 23:18:26.223792] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x6ff420): datao=0, datal=3072, cccid=4 00:26:22.652 [2024-11-28 23:18:26.223799] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x765080) on tqpair(0x6ff420): expected_datao=0, payload_size=3072 00:26:22.652 [2024-11-28 23:18:26.223810] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:22.652 [2024-11-28 23:18:26.223818] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:22.652 [2024-11-28 23:18:26.223829] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:22.652 [2024-11-28 23:18:26.223839] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:22.652 [2024-11-28 23:18:26.223846] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:22.652 [2024-11-28 23:18:26.223852] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x765080) on tqpair=0x6ff420 00:26:22.652 [2024-11-28 23:18:26.223866] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.652 [2024-11-28 23:18:26.223874] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.652 [2024-11-28 23:18:26.223881] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x6ff420) 00:26:22.652 [2024-11-28 23:18:26.223891] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.652 [2024-11-28 23:18:26.223919] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x765080, cid 4, qid 0 00:26:22.652 [2024-11-28 23:18:26.224033] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:22.652 [2024-11-28 23:18:26.224046] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:22.652 [2024-11-28 23:18:26.224057] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:22.652 [2024-11-28 23:18:26.224064] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x6ff420): datao=0, datal=8, cccid=4 00:26:22.652 [2024-11-28 23:18:26.224071] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x765080) on tqpair(0x6ff420): expected_datao=0, payload_size=8 00:26:22.652 [2024-11-28 23:18:26.224082] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:22.652 [2024-11-28 23:18:26.224089] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:22.913 [2024-11-28 23:18:26.264575] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:22.913 [2024-11-28 23:18:26.264594] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:22.913 [2024-11-28 23:18:26.264602] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:22.913 [2024-11-28 23:18:26.264609] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x765080) on tqpair=0x6ff420 00:26:22.913 ===================================================== 00:26:22.913 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:26:22.913 ===================================================== 00:26:22.913 Controller Capabilities/Features 00:26:22.913 ================================ 00:26:22.913 Vendor ID: 0000 00:26:22.913 Subsystem Vendor ID: 0000 00:26:22.913 Serial Number: .................... 00:26:22.913 Model Number: ........................................ 00:26:22.913 Firmware Version: 24.01.1 00:26:22.913 Recommended Arb Burst: 0 00:26:22.913 IEEE OUI Identifier: 00 00 00 00:26:22.913 Multi-path I/O 00:26:22.913 May have multiple subsystem ports: No 00:26:22.913 May have multiple controllers: No 00:26:22.913 Associated with SR-IOV VF: No 00:26:22.913 Max Data Transfer Size: 131072 00:26:22.913 Max Number of Namespaces: 0 00:26:22.913 Max Number of I/O Queues: 1024 00:26:22.913 NVMe Specification Version (VS): 1.3 00:26:22.913 NVMe Specification Version (Identify): 1.3 00:26:22.913 Maximum Queue Entries: 128 00:26:22.913 Contiguous Queues Required: Yes 00:26:22.913 Arbitration Mechanisms Supported 00:26:22.913 Weighted Round Robin: Not Supported 00:26:22.913 Vendor Specific: Not Supported 00:26:22.913 Reset Timeout: 15000 ms 00:26:22.913 Doorbell Stride: 4 bytes 00:26:22.913 NVM Subsystem Reset: Not Supported 00:26:22.913 Command Sets Supported 00:26:22.913 NVM Command Set: Supported 00:26:22.913 Boot Partition: Not Supported 00:26:22.913 Memory Page Size Minimum: 4096 bytes 00:26:22.913 Memory Page Size Maximum: 4096 bytes 00:26:22.913 Persistent Memory Region: Not Supported 00:26:22.913 Optional Asynchronous Events Supported 00:26:22.913 Namespace Attribute Notices: Not Supported 00:26:22.913 Firmware Activation Notices: Not Supported 00:26:22.913 ANA Change Notices: Not Supported 00:26:22.913 PLE Aggregate Log Change Notices: Not Supported 00:26:22.913 LBA Status Info Alert Notices: Not Supported 00:26:22.913 EGE Aggregate Log Change Notices: Not Supported 00:26:22.913 Normal NVM Subsystem Shutdown event: Not Supported 00:26:22.913 Zone Descriptor Change Notices: Not Supported 00:26:22.913 Discovery Log Change Notices: Supported 00:26:22.913 Controller Attributes 00:26:22.913 128-bit Host Identifier: Not Supported 00:26:22.913 Non-Operational Permissive Mode: Not Supported 00:26:22.913 NVM Sets: Not Supported 00:26:22.913 Read Recovery Levels: Not Supported 00:26:22.913 Endurance Groups: Not Supported 00:26:22.913 Predictable Latency Mode: Not Supported 00:26:22.913 Traffic Based Keep ALive: Not Supported 00:26:22.913 Namespace Granularity: Not Supported 00:26:22.913 SQ Associations: Not Supported 00:26:22.913 UUID List: Not Supported 00:26:22.913 Multi-Domain Subsystem: Not Supported 00:26:22.913 Fixed Capacity Management: Not Supported 00:26:22.913 Variable Capacity Management: Not Supported 00:26:22.913 Delete Endurance Group: Not Supported 00:26:22.913 Delete NVM Set: Not Supported 00:26:22.913 Extended LBA Formats Supported: Not Supported 00:26:22.913 Flexible Data Placement Supported: Not Supported 00:26:22.913 00:26:22.913 Controller Memory Buffer Support 00:26:22.913 ================================ 00:26:22.913 Supported: No 00:26:22.913 00:26:22.913 Persistent Memory Region Support 00:26:22.913 ================================ 00:26:22.913 Supported: No 00:26:22.913 00:26:22.913 Admin Command Set Attributes 00:26:22.913 ============================ 00:26:22.913 Security Send/Receive: Not Supported 00:26:22.913 Format NVM: Not Supported 00:26:22.913 Firmware Activate/Download: Not Supported 00:26:22.913 Namespace Management: Not Supported 00:26:22.913 Device Self-Test: Not Supported 00:26:22.913 Directives: Not Supported 00:26:22.913 NVMe-MI: Not Supported 00:26:22.913 Virtualization Management: Not Supported 00:26:22.913 Doorbell Buffer Config: Not Supported 00:26:22.913 Get LBA Status Capability: Not Supported 00:26:22.913 Command & Feature Lockdown Capability: Not Supported 00:26:22.913 Abort Command Limit: 1 00:26:22.913 Async Event Request Limit: 4 00:26:22.913 Number of Firmware Slots: N/A 00:26:22.913 Firmware Slot 1 Read-Only: N/A 00:26:22.913 Firmware Activation Without Reset: N/A 00:26:22.913 Multiple Update Detection Support: N/A 00:26:22.913 Firmware Update Granularity: No Information Provided 00:26:22.913 Per-Namespace SMART Log: No 00:26:22.913 Asymmetric Namespace Access Log Page: Not Supported 00:26:22.913 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:26:22.913 Command Effects Log Page: Not Supported 00:26:22.913 Get Log Page Extended Data: Supported 00:26:22.913 Telemetry Log Pages: Not Supported 00:26:22.913 Persistent Event Log Pages: Not Supported 00:26:22.913 Supported Log Pages Log Page: May Support 00:26:22.913 Commands Supported & Effects Log Page: Not Supported 00:26:22.914 Feature Identifiers & Effects Log Page:May Support 00:26:22.914 NVMe-MI Commands & Effects Log Page: May Support 00:26:22.914 Data Area 4 for Telemetry Log: Not Supported 00:26:22.914 Error Log Page Entries Supported: 128 00:26:22.914 Keep Alive: Not Supported 00:26:22.914 00:26:22.914 NVM Command Set Attributes 00:26:22.914 ========================== 00:26:22.914 Submission Queue Entry Size 00:26:22.914 Max: 1 00:26:22.914 Min: 1 00:26:22.914 Completion Queue Entry Size 00:26:22.914 Max: 1 00:26:22.914 Min: 1 00:26:22.914 Number of Namespaces: 0 00:26:22.914 Compare Command: Not Supported 00:26:22.914 Write Uncorrectable Command: Not Supported 00:26:22.914 Dataset Management Command: Not Supported 00:26:22.914 Write Zeroes Command: Not Supported 00:26:22.914 Set Features Save Field: Not Supported 00:26:22.914 Reservations: Not Supported 00:26:22.914 Timestamp: Not Supported 00:26:22.914 Copy: Not Supported 00:26:22.914 Volatile Write Cache: Not Present 00:26:22.914 Atomic Write Unit (Normal): 1 00:26:22.914 Atomic Write Unit (PFail): 1 00:26:22.914 Atomic Compare & Write Unit: 1 00:26:22.914 Fused Compare & Write: Supported 00:26:22.914 Scatter-Gather List 00:26:22.914 SGL Command Set: Supported 00:26:22.914 SGL Keyed: Supported 00:26:22.914 SGL Bit Bucket Descriptor: Not Supported 00:26:22.914 SGL Metadata Pointer: Not Supported 00:26:22.914 Oversized SGL: Not Supported 00:26:22.914 SGL Metadata Address: Not Supported 00:26:22.914 SGL Offset: Supported 00:26:22.914 Transport SGL Data Block: Not Supported 00:26:22.914 Replay Protected Memory Block: Not Supported 00:26:22.914 00:26:22.914 Firmware Slot Information 00:26:22.914 ========================= 00:26:22.914 Active slot: 0 00:26:22.914 00:26:22.914 00:26:22.914 Error Log 00:26:22.914 ========= 00:26:22.914 00:26:22.914 Active Namespaces 00:26:22.914 ================= 00:26:22.914 Discovery Log Page 00:26:22.914 ================== 00:26:22.914 Generation Counter: 2 00:26:22.914 Number of Records: 2 00:26:22.914 Record Format: 0 00:26:22.914 00:26:22.914 Discovery Log Entry 0 00:26:22.914 ---------------------- 00:26:22.914 Transport Type: 3 (TCP) 00:26:22.914 Address Family: 1 (IPv4) 00:26:22.914 Subsystem Type: 3 (Current Discovery Subsystem) 00:26:22.914 Entry Flags: 00:26:22.914 Duplicate Returned Information: 1 00:26:22.914 Explicit Persistent Connection Support for Discovery: 1 00:26:22.914 Transport Requirements: 00:26:22.914 Secure Channel: Not Required 00:26:22.914 Port ID: 0 (0x0000) 00:26:22.914 Controller ID: 65535 (0xffff) 00:26:22.914 Admin Max SQ Size: 128 00:26:22.914 Transport Service Identifier: 4420 00:26:22.914 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:26:22.914 Transport Address: 10.0.0.2 00:26:22.914 Discovery Log Entry 1 00:26:22.914 ---------------------- 00:26:22.914 Transport Type: 3 (TCP) 00:26:22.914 Address Family: 1 (IPv4) 00:26:22.914 Subsystem Type: 2 (NVM Subsystem) 00:26:22.914 Entry Flags: 00:26:22.914 Duplicate Returned Information: 0 00:26:22.914 Explicit Persistent Connection Support for Discovery: 0 00:26:22.914 Transport Requirements: 00:26:22.914 Secure Channel: Not Required 00:26:22.914 Port ID: 0 (0x0000) 00:26:22.914 Controller ID: 65535 (0xffff) 00:26:22.914 Admin Max SQ Size: 128 00:26:22.914 Transport Service Identifier: 4420 00:26:22.914 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:26:22.914 Transport Address: 10.0.0.2 [2024-11-28 23:18:26.264738] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:26:22.914 [2024-11-28 23:18:26.264763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:22.914 [2024-11-28 23:18:26.264776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:22.914 [2024-11-28 23:18:26.264786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:22.914 [2024-11-28 23:18:26.264795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:22.914 [2024-11-28 23:18:26.264808] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.914 [2024-11-28 23:18:26.264817] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.914 [2024-11-28 23:18:26.264823] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x6ff420) 00:26:22.914 [2024-11-28 23:18:26.264851] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.914 [2024-11-28 23:18:26.264876] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x764f20, cid 3, qid 0 00:26:22.914 [2024-11-28 23:18:26.265012] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:22.914 [2024-11-28 23:18:26.265028] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:22.914 [2024-11-28 23:18:26.265035] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:22.914 [2024-11-28 23:18:26.265041] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x764f20) on tqpair=0x6ff420 00:26:22.914 [2024-11-28 23:18:26.265053] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.914 [2024-11-28 23:18:26.265061] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.914 [2024-11-28 23:18:26.265068] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x6ff420) 00:26:22.914 [2024-11-28 23:18:26.265078] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.914 [2024-11-28 23:18:26.265105] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x764f20, cid 3, qid 0 00:26:22.914 [2024-11-28 23:18:26.265224] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:22.914 [2024-11-28 23:18:26.265238] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:22.914 [2024-11-28 23:18:26.265245] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:22.914 [2024-11-28 23:18:26.265251] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x764f20) on tqpair=0x6ff420 00:26:22.914 [2024-11-28 23:18:26.265260] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:26:22.914 [2024-11-28 23:18:26.265269] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:26:22.914 [2024-11-28 23:18:26.265291] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.914 [2024-11-28 23:18:26.265302] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.914 [2024-11-28 23:18:26.265308] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x6ff420) 00:26:22.914 [2024-11-28 23:18:26.265319] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.914 [2024-11-28 23:18:26.265340] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x764f20, cid 3, qid 0 00:26:22.914 [2024-11-28 23:18:26.269421] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:22.914 [2024-11-28 23:18:26.269447] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:22.914 [2024-11-28 23:18:26.269454] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:22.914 [2024-11-28 23:18:26.269464] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x764f20) on tqpair=0x6ff420 00:26:22.914 [2024-11-28 23:18:26.269482] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.915 [2024-11-28 23:18:26.269491] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.915 [2024-11-28 23:18:26.269497] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x6ff420) 00:26:22.915 [2024-11-28 23:18:26.269507] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.915 [2024-11-28 23:18:26.269529] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x764f20, cid 3, qid 0 00:26:22.915 [2024-11-28 23:18:26.269668] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:22.915 [2024-11-28 23:18:26.269683] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:22.915 [2024-11-28 23:18:26.269690] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:22.915 [2024-11-28 23:18:26.269696] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x764f20) on tqpair=0x6ff420 00:26:22.915 [2024-11-28 23:18:26.269710] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 4 milliseconds 00:26:22.915 00:26:22.915 23:18:26 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:26:22.915 [2024-11-28 23:18:26.303622] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:22.915 [2024-11-28 23:18:26.303664] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2537068 ] 00:26:22.915 EAL: No free 2048 kB hugepages reported on node 1 00:26:22.915 [2024-11-28 23:18:26.341030] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:26:22.915 [2024-11-28 23:18:26.341080] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:26:22.915 [2024-11-28 23:18:26.341090] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:26:22.915 [2024-11-28 23:18:26.341106] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:26:22.915 [2024-11-28 23:18:26.341119] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:26:22.915 [2024-11-28 23:18:26.344431] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:26:22.915 [2024-11-28 23:18:26.344476] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0xb96420 0 00:26:22.915 [2024-11-28 23:18:26.352427] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:26:22.915 [2024-11-28 23:18:26.352454] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:26:22.915 [2024-11-28 23:18:26.352466] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:26:22.915 [2024-11-28 23:18:26.352473] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:26:22.915 [2024-11-28 23:18:26.352512] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.915 [2024-11-28 23:18:26.352525] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.915 [2024-11-28 23:18:26.352532] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xb96420) 00:26:22.915 [2024-11-28 23:18:26.352546] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:26:22.915 [2024-11-28 23:18:26.352572] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfbb00, cid 0, qid 0 00:26:22.915 [2024-11-28 23:18:26.360410] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:22.915 [2024-11-28 23:18:26.360427] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:22.915 [2024-11-28 23:18:26.360435] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:22.915 [2024-11-28 23:18:26.360442] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfbb00) on tqpair=0xb96420 00:26:22.915 [2024-11-28 23:18:26.360460] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:26:22.915 [2024-11-28 23:18:26.360471] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:26:22.915 [2024-11-28 23:18:26.360481] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:26:22.915 [2024-11-28 23:18:26.360498] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.915 [2024-11-28 23:18:26.360507] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.915 [2024-11-28 23:18:26.360514] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xb96420) 00:26:22.915 [2024-11-28 23:18:26.360525] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.915 [2024-11-28 23:18:26.360549] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfbb00, cid 0, qid 0 00:26:22.915 [2024-11-28 23:18:26.360681] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:22.915 [2024-11-28 23:18:26.360696] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:22.915 [2024-11-28 23:18:26.360704] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:22.915 [2024-11-28 23:18:26.360711] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfbb00) on tqpair=0xb96420 00:26:22.915 [2024-11-28 23:18:26.360720] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:26:22.915 [2024-11-28 23:18:26.360734] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:26:22.915 [2024-11-28 23:18:26.360747] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.915 [2024-11-28 23:18:26.360755] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.915 [2024-11-28 23:18:26.360762] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xb96420) 00:26:22.915 [2024-11-28 23:18:26.360773] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.915 [2024-11-28 23:18:26.360795] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfbb00, cid 0, qid 0 00:26:22.915 [2024-11-28 23:18:26.360885] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:22.915 [2024-11-28 23:18:26.360898] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:22.915 [2024-11-28 23:18:26.360905] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:22.915 [2024-11-28 23:18:26.360912] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfbb00) on tqpair=0xb96420 00:26:22.915 [2024-11-28 23:18:26.360920] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:26:22.915 [2024-11-28 23:18:26.360939] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:26:22.915 [2024-11-28 23:18:26.360953] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.915 [2024-11-28 23:18:26.360961] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.915 [2024-11-28 23:18:26.360968] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xb96420) 00:26:22.915 [2024-11-28 23:18:26.360979] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.915 [2024-11-28 23:18:26.361001] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfbb00, cid 0, qid 0 00:26:22.915 [2024-11-28 23:18:26.361092] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:22.915 [2024-11-28 23:18:26.361107] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:22.915 [2024-11-28 23:18:26.361114] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:22.915 [2024-11-28 23:18:26.361121] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfbb00) on tqpair=0xb96420 00:26:22.915 [2024-11-28 23:18:26.361130] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:26:22.915 [2024-11-28 23:18:26.361148] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.915 [2024-11-28 23:18:26.361158] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.915 [2024-11-28 23:18:26.361165] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xb96420) 00:26:22.915 [2024-11-28 23:18:26.361176] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.915 [2024-11-28 23:18:26.361197] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfbb00, cid 0, qid 0 00:26:22.915 [2024-11-28 23:18:26.361279] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:22.915 [2024-11-28 23:18:26.361292] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:22.915 [2024-11-28 23:18:26.361299] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:22.916 [2024-11-28 23:18:26.361306] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfbb00) on tqpair=0xb96420 00:26:22.916 [2024-11-28 23:18:26.361314] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:26:22.916 [2024-11-28 23:18:26.361323] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:26:22.916 [2024-11-28 23:18:26.361336] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:26:22.916 [2024-11-28 23:18:26.361447] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:26:22.916 [2024-11-28 23:18:26.361457] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:26:22.916 [2024-11-28 23:18:26.361469] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.916 [2024-11-28 23:18:26.361477] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.916 [2024-11-28 23:18:26.361484] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xb96420) 00:26:22.916 [2024-11-28 23:18:26.361495] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.916 [2024-11-28 23:18:26.361518] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfbb00, cid 0, qid 0 00:26:22.916 [2024-11-28 23:18:26.361637] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:22.916 [2024-11-28 23:18:26.361659] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:22.916 [2024-11-28 23:18:26.361666] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:22.916 [2024-11-28 23:18:26.361673] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfbb00) on tqpair=0xb96420 00:26:22.916 [2024-11-28 23:18:26.361686] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:26:22.916 [2024-11-28 23:18:26.361705] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.916 [2024-11-28 23:18:26.361714] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.916 [2024-11-28 23:18:26.361721] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xb96420) 00:26:22.916 [2024-11-28 23:18:26.361732] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.916 [2024-11-28 23:18:26.361754] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfbb00, cid 0, qid 0 00:26:22.916 [2024-11-28 23:18:26.361835] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:22.916 [2024-11-28 23:18:26.361848] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:22.916 [2024-11-28 23:18:26.361855] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:22.916 [2024-11-28 23:18:26.361862] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfbb00) on tqpair=0xb96420 00:26:22.916 [2024-11-28 23:18:26.361870] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:26:22.916 [2024-11-28 23:18:26.361879] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:26:22.916 [2024-11-28 23:18:26.361893] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:26:22.916 [2024-11-28 23:18:26.361912] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:26:22.916 [2024-11-28 23:18:26.361926] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.916 [2024-11-28 23:18:26.361934] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.916 [2024-11-28 23:18:26.361941] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xb96420) 00:26:22.916 [2024-11-28 23:18:26.361952] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.916 [2024-11-28 23:18:26.361981] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfbb00, cid 0, qid 0 00:26:22.916 [2024-11-28 23:18:26.362106] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:22.916 [2024-11-28 23:18:26.362120] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:22.916 [2024-11-28 23:18:26.362131] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:22.916 [2024-11-28 23:18:26.362139] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xb96420): datao=0, datal=4096, cccid=0 00:26:22.916 [2024-11-28 23:18:26.362147] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xbfbb00) on tqpair(0xb96420): expected_datao=0, payload_size=4096 00:26:22.916 [2024-11-28 23:18:26.362166] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:22.916 [2024-11-28 23:18:26.362176] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:22.916 [2024-11-28 23:18:26.362188] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:22.916 [2024-11-28 23:18:26.362198] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:22.916 [2024-11-28 23:18:26.362205] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:22.916 [2024-11-28 23:18:26.362212] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfbb00) on tqpair=0xb96420 00:26:22.916 [2024-11-28 23:18:26.362223] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:26:22.916 [2024-11-28 23:18:26.362232] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:26:22.916 [2024-11-28 23:18:26.362240] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:26:22.916 [2024-11-28 23:18:26.362251] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:26:22.916 [2024-11-28 23:18:26.362259] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:26:22.916 [2024-11-28 23:18:26.362267] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:26:22.916 [2024-11-28 23:18:26.362286] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:26:22.916 [2024-11-28 23:18:26.362300] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.916 [2024-11-28 23:18:26.362309] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.916 [2024-11-28 23:18:26.362315] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xb96420) 00:26:22.916 [2024-11-28 23:18:26.362327] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:26:22.916 [2024-11-28 23:18:26.362350] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfbb00, cid 0, qid 0 00:26:22.916 [2024-11-28 23:18:26.362460] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:22.916 [2024-11-28 23:18:26.362475] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:22.916 [2024-11-28 23:18:26.362483] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:22.916 [2024-11-28 23:18:26.362490] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfbb00) on tqpair=0xb96420 00:26:22.916 [2024-11-28 23:18:26.362500] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.916 [2024-11-28 23:18:26.362508] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.916 [2024-11-28 23:18:26.362515] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xb96420) 00:26:22.916 [2024-11-28 23:18:26.362525] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:22.916 [2024-11-28 23:18:26.362536] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.916 [2024-11-28 23:18:26.362543] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.916 [2024-11-28 23:18:26.362550] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0xb96420) 00:26:22.916 [2024-11-28 23:18:26.362559] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:22.916 [2024-11-28 23:18:26.362569] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.916 [2024-11-28 23:18:26.362577] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.916 [2024-11-28 23:18:26.362583] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0xb96420) 00:26:22.916 [2024-11-28 23:18:26.362592] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:22.916 [2024-11-28 23:18:26.362603] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.916 [2024-11-28 23:18:26.362610] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.916 [2024-11-28 23:18:26.362617] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xb96420) 00:26:22.916 [2024-11-28 23:18:26.362626] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:22.917 [2024-11-28 23:18:26.362636] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:26:22.917 [2024-11-28 23:18:26.362655] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:26:22.917 [2024-11-28 23:18:26.362668] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.917 [2024-11-28 23:18:26.362676] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.917 [2024-11-28 23:18:26.362683] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xb96420) 00:26:22.917 [2024-11-28 23:18:26.362697] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.917 [2024-11-28 23:18:26.362737] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfbb00, cid 0, qid 0 00:26:22.917 [2024-11-28 23:18:26.362749] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfbc60, cid 1, qid 0 00:26:22.917 [2024-11-28 23:18:26.362757] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfbdc0, cid 2, qid 0 00:26:22.917 [2024-11-28 23:18:26.362764] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfbf20, cid 3, qid 0 00:26:22.917 [2024-11-28 23:18:26.362772] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfc080, cid 4, qid 0 00:26:22.917 [2024-11-28 23:18:26.362963] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:22.917 [2024-11-28 23:18:26.362979] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:22.917 [2024-11-28 23:18:26.362986] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:22.917 [2024-11-28 23:18:26.362993] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfc080) on tqpair=0xb96420 00:26:22.917 [2024-11-28 23:18:26.363002] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:26:22.917 [2024-11-28 23:18:26.363011] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:26:22.917 [2024-11-28 23:18:26.363025] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:26:22.917 [2024-11-28 23:18:26.363041] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:26:22.917 [2024-11-28 23:18:26.363053] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.917 [2024-11-28 23:18:26.363061] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.917 [2024-11-28 23:18:26.363068] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xb96420) 00:26:22.917 [2024-11-28 23:18:26.363079] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:26:22.917 [2024-11-28 23:18:26.363115] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfc080, cid 4, qid 0 00:26:22.917 [2024-11-28 23:18:26.363284] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:22.917 [2024-11-28 23:18:26.363299] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:22.917 [2024-11-28 23:18:26.363306] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:22.917 [2024-11-28 23:18:26.363313] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfc080) on tqpair=0xb96420 00:26:22.917 [2024-11-28 23:18:26.363378] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:26:22.917 [2024-11-28 23:18:26.363404] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:26:22.917 [2024-11-28 23:18:26.363420] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.917 [2024-11-28 23:18:26.363428] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.917 [2024-11-28 23:18:26.363435] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xb96420) 00:26:22.917 [2024-11-28 23:18:26.363446] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.917 [2024-11-28 23:18:26.363469] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfc080, cid 4, qid 0 00:26:22.917 [2024-11-28 23:18:26.363608] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:22.917 [2024-11-28 23:18:26.363623] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:22.917 [2024-11-28 23:18:26.363634] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:22.917 [2024-11-28 23:18:26.363642] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xb96420): datao=0, datal=4096, cccid=4 00:26:22.917 [2024-11-28 23:18:26.363650] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xbfc080) on tqpair(0xb96420): expected_datao=0, payload_size=4096 00:26:22.917 [2024-11-28 23:18:26.363678] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:22.917 [2024-11-28 23:18:26.363688] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:22.917 [2024-11-28 23:18:26.407405] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:22.917 [2024-11-28 23:18:26.407424] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:22.917 [2024-11-28 23:18:26.407432] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:22.917 [2024-11-28 23:18:26.407439] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfc080) on tqpair=0xb96420 00:26:22.917 [2024-11-28 23:18:26.407459] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:26:22.917 [2024-11-28 23:18:26.407476] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:26:22.917 [2024-11-28 23:18:26.407494] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:26:22.917 [2024-11-28 23:18:26.407508] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.917 [2024-11-28 23:18:26.407516] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.917 [2024-11-28 23:18:26.407523] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xb96420) 00:26:22.917 [2024-11-28 23:18:26.407534] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.917 [2024-11-28 23:18:26.407558] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfc080, cid 4, qid 0 00:26:22.917 [2024-11-28 23:18:26.407711] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:22.917 [2024-11-28 23:18:26.407727] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:22.917 [2024-11-28 23:18:26.407735] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:22.917 [2024-11-28 23:18:26.407741] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xb96420): datao=0, datal=4096, cccid=4 00:26:22.917 [2024-11-28 23:18:26.407749] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xbfc080) on tqpair(0xb96420): expected_datao=0, payload_size=4096 00:26:22.917 [2024-11-28 23:18:26.407768] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:22.917 [2024-11-28 23:18:26.407778] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:22.917 [2024-11-28 23:18:26.448530] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:22.917 [2024-11-28 23:18:26.448551] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:22.917 [2024-11-28 23:18:26.448559] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:22.917 [2024-11-28 23:18:26.448566] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfc080) on tqpair=0xb96420 00:26:22.917 [2024-11-28 23:18:26.448591] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:26:22.917 [2024-11-28 23:18:26.448612] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:26:22.917 [2024-11-28 23:18:26.448627] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.917 [2024-11-28 23:18:26.448635] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.917 [2024-11-28 23:18:26.448643] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xb96420) 00:26:22.917 [2024-11-28 23:18:26.448655] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.917 [2024-11-28 23:18:26.448683] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfc080, cid 4, qid 0 00:26:22.917 [2024-11-28 23:18:26.448787] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:22.917 [2024-11-28 23:18:26.448804] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:22.917 [2024-11-28 23:18:26.448812] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:22.917 [2024-11-28 23:18:26.448818] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xb96420): datao=0, datal=4096, cccid=4 00:26:22.917 [2024-11-28 23:18:26.448826] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xbfc080) on tqpair(0xb96420): expected_datao=0, payload_size=4096 00:26:22.917 [2024-11-28 23:18:26.448845] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:22.917 [2024-11-28 23:18:26.448855] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:22.918 [2024-11-28 23:18:26.489526] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:22.918 [2024-11-28 23:18:26.489545] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:22.918 [2024-11-28 23:18:26.489553] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:22.918 [2024-11-28 23:18:26.489560] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfc080) on tqpair=0xb96420 00:26:22.918 [2024-11-28 23:18:26.489574] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:26:22.918 [2024-11-28 23:18:26.489590] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:26:22.918 [2024-11-28 23:18:26.489607] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:26:22.918 [2024-11-28 23:18:26.489619] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:26:22.918 [2024-11-28 23:18:26.489628] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:26:22.918 [2024-11-28 23:18:26.489636] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:26:22.918 [2024-11-28 23:18:26.489644] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:26:22.918 [2024-11-28 23:18:26.489653] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:26:22.918 [2024-11-28 23:18:26.489674] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.918 [2024-11-28 23:18:26.489683] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.918 [2024-11-28 23:18:26.489690] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xb96420) 00:26:22.918 [2024-11-28 23:18:26.489702] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.918 [2024-11-28 23:18:26.489714] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.918 [2024-11-28 23:18:26.489722] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.918 [2024-11-28 23:18:26.489729] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xb96420) 00:26:22.918 [2024-11-28 23:18:26.489738] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:26:22.918 [2024-11-28 23:18:26.489767] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfc080, cid 4, qid 0 00:26:22.918 [2024-11-28 23:18:26.489779] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfc1e0, cid 5, qid 0 00:26:22.918 [2024-11-28 23:18:26.489876] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:22.918 [2024-11-28 23:18:26.489890] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:22.918 [2024-11-28 23:18:26.489898] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:22.918 [2024-11-28 23:18:26.489915] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfc080) on tqpair=0xb96420 00:26:22.918 [2024-11-28 23:18:26.489928] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:22.918 [2024-11-28 23:18:26.489939] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:22.918 [2024-11-28 23:18:26.489946] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:22.918 [2024-11-28 23:18:26.489953] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfc1e0) on tqpair=0xb96420 00:26:22.918 [2024-11-28 23:18:26.489969] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.918 [2024-11-28 23:18:26.489979] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.918 [2024-11-28 23:18:26.489986] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xb96420) 00:26:22.918 [2024-11-28 23:18:26.489997] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.918 [2024-11-28 23:18:26.490020] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfc1e0, cid 5, qid 0 00:26:22.918 [2024-11-28 23:18:26.490119] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:22.918 [2024-11-28 23:18:26.490132] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:22.918 [2024-11-28 23:18:26.490139] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:22.918 [2024-11-28 23:18:26.490146] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfc1e0) on tqpair=0xb96420 00:26:22.918 [2024-11-28 23:18:26.490162] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.918 [2024-11-28 23:18:26.490171] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.918 [2024-11-28 23:18:26.490178] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xb96420) 00:26:22.918 [2024-11-28 23:18:26.490189] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.918 [2024-11-28 23:18:26.490210] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfc1e0, cid 5, qid 0 00:26:22.918 [2024-11-28 23:18:26.490309] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:22.918 [2024-11-28 23:18:26.490322] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:22.918 [2024-11-28 23:18:26.490329] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:22.918 [2024-11-28 23:18:26.490336] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfc1e0) on tqpair=0xb96420 00:26:22.918 [2024-11-28 23:18:26.490351] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.918 [2024-11-28 23:18:26.490361] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.918 [2024-11-28 23:18:26.490368] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xb96420) 00:26:22.918 [2024-11-28 23:18:26.490378] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.918 [2024-11-28 23:18:26.494422] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfc1e0, cid 5, qid 0 00:26:22.918 [2024-11-28 23:18:26.494589] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:22.918 [2024-11-28 23:18:26.494603] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:22.918 [2024-11-28 23:18:26.494610] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:22.918 [2024-11-28 23:18:26.494617] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfc1e0) on tqpair=0xb96420 00:26:22.918 [2024-11-28 23:18:26.494637] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.918 [2024-11-28 23:18:26.494648] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.918 [2024-11-28 23:18:26.494655] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xb96420) 00:26:22.918 [2024-11-28 23:18:26.494666] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.918 [2024-11-28 23:18:26.494684] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.918 [2024-11-28 23:18:26.494693] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.918 [2024-11-28 23:18:26.494701] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xb96420) 00:26:22.918 [2024-11-28 23:18:26.494711] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.918 [2024-11-28 23:18:26.494724] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.918 [2024-11-28 23:18:26.494732] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.918 [2024-11-28 23:18:26.494738] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0xb96420) 00:26:22.918 [2024-11-28 23:18:26.494748] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.918 [2024-11-28 23:18:26.494761] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:22.918 [2024-11-28 23:18:26.494769] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:22.918 [2024-11-28 23:18:26.494776] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0xb96420) 00:26:22.918 [2024-11-28 23:18:26.494800] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.918 [2024-11-28 23:18:26.494825] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfc1e0, cid 5, qid 0 00:26:22.918 [2024-11-28 23:18:26.494836] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfc080, cid 4, qid 0 00:26:22.918 [2024-11-28 23:18:26.494859] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfc340, cid 6, qid 0 00:26:22.918 [2024-11-28 23:18:26.494867] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfc4a0, cid 7, qid 0 00:26:22.918 [2024-11-28 23:18:26.495071] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:22.918 [2024-11-28 23:18:26.495086] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:22.918 [2024-11-28 23:18:26.495094] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:22.918 [2024-11-28 23:18:26.495103] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xb96420): datao=0, datal=8192, cccid=5 00:26:22.919 [2024-11-28 23:18:26.495114] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xbfc1e0) on tqpair(0xb96420): expected_datao=0, payload_size=8192 00:26:22.919 [2024-11-28 23:18:26.495138] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:22.919 [2024-11-28 23:18:26.495148] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:22.919 [2024-11-28 23:18:26.495158] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:22.919 [2024-11-28 23:18:26.495167] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:22.919 [2024-11-28 23:18:26.495174] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:22.919 [2024-11-28 23:18:26.495181] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xb96420): datao=0, datal=512, cccid=4 00:26:22.919 [2024-11-28 23:18:26.495188] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xbfc080) on tqpair(0xb96420): expected_datao=0, payload_size=512 00:26:22.919 [2024-11-28 23:18:26.495199] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:22.919 [2024-11-28 23:18:26.495206] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:22.919 [2024-11-28 23:18:26.495215] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:22.919 [2024-11-28 23:18:26.495224] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:22.919 [2024-11-28 23:18:26.495230] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:22.919 [2024-11-28 23:18:26.495237] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xb96420): datao=0, datal=512, cccid=6 00:26:22.919 [2024-11-28 23:18:26.495244] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xbfc340) on tqpair(0xb96420): expected_datao=0, payload_size=512 00:26:22.919 [2024-11-28 23:18:26.495259] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:22.919 [2024-11-28 23:18:26.495267] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:22.919 [2024-11-28 23:18:26.495276] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:22.919 [2024-11-28 23:18:26.495285] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:22.919 [2024-11-28 23:18:26.495292] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:22.919 [2024-11-28 23:18:26.495298] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xb96420): datao=0, datal=4096, cccid=7 00:26:22.919 [2024-11-28 23:18:26.495306] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xbfc4a0) on tqpair(0xb96420): expected_datao=0, payload_size=4096 00:26:22.919 [2024-11-28 23:18:26.495316] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:22.919 [2024-11-28 23:18:26.495324] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:23.178 [2024-11-28 23:18:26.535566] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:23.178 [2024-11-28 23:18:26.535586] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:23.178 [2024-11-28 23:18:26.535594] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:23.178 [2024-11-28 23:18:26.535601] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfc1e0) on tqpair=0xb96420 00:26:23.178 [2024-11-28 23:18:26.535625] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:23.178 [2024-11-28 23:18:26.535637] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:23.178 [2024-11-28 23:18:26.535645] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:23.178 [2024-11-28 23:18:26.535651] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfc080) on tqpair=0xb96420 00:26:23.178 [2024-11-28 23:18:26.535666] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:23.178 [2024-11-28 23:18:26.535677] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:23.178 [2024-11-28 23:18:26.535684] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:23.178 [2024-11-28 23:18:26.535691] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfc340) on tqpair=0xb96420 00:26:23.178 [2024-11-28 23:18:26.535702] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:23.178 [2024-11-28 23:18:26.535712] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:23.178 [2024-11-28 23:18:26.535719] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:23.178 [2024-11-28 23:18:26.535726] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfc4a0) on tqpair=0xb96420 00:26:23.178 ===================================================== 00:26:23.179 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:23.179 ===================================================== 00:26:23.179 Controller Capabilities/Features 00:26:23.179 ================================ 00:26:23.179 Vendor ID: 8086 00:26:23.179 Subsystem Vendor ID: 8086 00:26:23.179 Serial Number: SPDK00000000000001 00:26:23.179 Model Number: SPDK bdev Controller 00:26:23.179 Firmware Version: 24.01.1 00:26:23.179 Recommended Arb Burst: 6 00:26:23.179 IEEE OUI Identifier: e4 d2 5c 00:26:23.179 Multi-path I/O 00:26:23.179 May have multiple subsystem ports: Yes 00:26:23.179 May have multiple controllers: Yes 00:26:23.179 Associated with SR-IOV VF: No 00:26:23.179 Max Data Transfer Size: 131072 00:26:23.179 Max Number of Namespaces: 32 00:26:23.179 Max Number of I/O Queues: 127 00:26:23.179 NVMe Specification Version (VS): 1.3 00:26:23.179 NVMe Specification Version (Identify): 1.3 00:26:23.179 Maximum Queue Entries: 128 00:26:23.179 Contiguous Queues Required: Yes 00:26:23.179 Arbitration Mechanisms Supported 00:26:23.179 Weighted Round Robin: Not Supported 00:26:23.179 Vendor Specific: Not Supported 00:26:23.179 Reset Timeout: 15000 ms 00:26:23.179 Doorbell Stride: 4 bytes 00:26:23.179 NVM Subsystem Reset: Not Supported 00:26:23.179 Command Sets Supported 00:26:23.179 NVM Command Set: Supported 00:26:23.179 Boot Partition: Not Supported 00:26:23.179 Memory Page Size Minimum: 4096 bytes 00:26:23.179 Memory Page Size Maximum: 4096 bytes 00:26:23.179 Persistent Memory Region: Not Supported 00:26:23.179 Optional Asynchronous Events Supported 00:26:23.179 Namespace Attribute Notices: Supported 00:26:23.179 Firmware Activation Notices: Not Supported 00:26:23.179 ANA Change Notices: Not Supported 00:26:23.179 PLE Aggregate Log Change Notices: Not Supported 00:26:23.179 LBA Status Info Alert Notices: Not Supported 00:26:23.179 EGE Aggregate Log Change Notices: Not Supported 00:26:23.179 Normal NVM Subsystem Shutdown event: Not Supported 00:26:23.179 Zone Descriptor Change Notices: Not Supported 00:26:23.179 Discovery Log Change Notices: Not Supported 00:26:23.179 Controller Attributes 00:26:23.179 128-bit Host Identifier: Supported 00:26:23.179 Non-Operational Permissive Mode: Not Supported 00:26:23.179 NVM Sets: Not Supported 00:26:23.179 Read Recovery Levels: Not Supported 00:26:23.179 Endurance Groups: Not Supported 00:26:23.179 Predictable Latency Mode: Not Supported 00:26:23.179 Traffic Based Keep ALive: Not Supported 00:26:23.179 Namespace Granularity: Not Supported 00:26:23.179 SQ Associations: Not Supported 00:26:23.179 UUID List: Not Supported 00:26:23.179 Multi-Domain Subsystem: Not Supported 00:26:23.179 Fixed Capacity Management: Not Supported 00:26:23.179 Variable Capacity Management: Not Supported 00:26:23.179 Delete Endurance Group: Not Supported 00:26:23.179 Delete NVM Set: Not Supported 00:26:23.179 Extended LBA Formats Supported: Not Supported 00:26:23.179 Flexible Data Placement Supported: Not Supported 00:26:23.179 00:26:23.179 Controller Memory Buffer Support 00:26:23.179 ================================ 00:26:23.179 Supported: No 00:26:23.179 00:26:23.179 Persistent Memory Region Support 00:26:23.179 ================================ 00:26:23.179 Supported: No 00:26:23.179 00:26:23.179 Admin Command Set Attributes 00:26:23.179 ============================ 00:26:23.179 Security Send/Receive: Not Supported 00:26:23.179 Format NVM: Not Supported 00:26:23.179 Firmware Activate/Download: Not Supported 00:26:23.179 Namespace Management: Not Supported 00:26:23.179 Device Self-Test: Not Supported 00:26:23.179 Directives: Not Supported 00:26:23.179 NVMe-MI: Not Supported 00:26:23.179 Virtualization Management: Not Supported 00:26:23.179 Doorbell Buffer Config: Not Supported 00:26:23.179 Get LBA Status Capability: Not Supported 00:26:23.179 Command & Feature Lockdown Capability: Not Supported 00:26:23.179 Abort Command Limit: 4 00:26:23.179 Async Event Request Limit: 4 00:26:23.179 Number of Firmware Slots: N/A 00:26:23.179 Firmware Slot 1 Read-Only: N/A 00:26:23.179 Firmware Activation Without Reset: N/A 00:26:23.179 Multiple Update Detection Support: N/A 00:26:23.179 Firmware Update Granularity: No Information Provided 00:26:23.179 Per-Namespace SMART Log: No 00:26:23.179 Asymmetric Namespace Access Log Page: Not Supported 00:26:23.179 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:26:23.179 Command Effects Log Page: Supported 00:26:23.179 Get Log Page Extended Data: Supported 00:26:23.179 Telemetry Log Pages: Not Supported 00:26:23.179 Persistent Event Log Pages: Not Supported 00:26:23.179 Supported Log Pages Log Page: May Support 00:26:23.179 Commands Supported & Effects Log Page: Not Supported 00:26:23.179 Feature Identifiers & Effects Log Page:May Support 00:26:23.179 NVMe-MI Commands & Effects Log Page: May Support 00:26:23.179 Data Area 4 for Telemetry Log: Not Supported 00:26:23.179 Error Log Page Entries Supported: 128 00:26:23.179 Keep Alive: Supported 00:26:23.179 Keep Alive Granularity: 10000 ms 00:26:23.179 00:26:23.179 NVM Command Set Attributes 00:26:23.179 ========================== 00:26:23.179 Submission Queue Entry Size 00:26:23.179 Max: 64 00:26:23.179 Min: 64 00:26:23.179 Completion Queue Entry Size 00:26:23.179 Max: 16 00:26:23.179 Min: 16 00:26:23.179 Number of Namespaces: 32 00:26:23.179 Compare Command: Supported 00:26:23.179 Write Uncorrectable Command: Not Supported 00:26:23.179 Dataset Management Command: Supported 00:26:23.179 Write Zeroes Command: Supported 00:26:23.179 Set Features Save Field: Not Supported 00:26:23.179 Reservations: Supported 00:26:23.179 Timestamp: Not Supported 00:26:23.179 Copy: Supported 00:26:23.179 Volatile Write Cache: Present 00:26:23.179 Atomic Write Unit (Normal): 1 00:26:23.179 Atomic Write Unit (PFail): 1 00:26:23.179 Atomic Compare & Write Unit: 1 00:26:23.179 Fused Compare & Write: Supported 00:26:23.179 Scatter-Gather List 00:26:23.179 SGL Command Set: Supported 00:26:23.179 SGL Keyed: Supported 00:26:23.179 SGL Bit Bucket Descriptor: Not Supported 00:26:23.179 SGL Metadata Pointer: Not Supported 00:26:23.179 Oversized SGL: Not Supported 00:26:23.179 SGL Metadata Address: Not Supported 00:26:23.179 SGL Offset: Supported 00:26:23.179 Transport SGL Data Block: Not Supported 00:26:23.179 Replay Protected Memory Block: Not Supported 00:26:23.179 00:26:23.179 Firmware Slot Information 00:26:23.179 ========================= 00:26:23.179 Active slot: 1 00:26:23.179 Slot 1 Firmware Revision: 24.01.1 00:26:23.179 00:26:23.179 00:26:23.179 Commands Supported and Effects 00:26:23.179 ============================== 00:26:23.179 Admin Commands 00:26:23.179 -------------- 00:26:23.180 Get Log Page (02h): Supported 00:26:23.180 Identify (06h): Supported 00:26:23.180 Abort (08h): Supported 00:26:23.180 Set Features (09h): Supported 00:26:23.180 Get Features (0Ah): Supported 00:26:23.180 Asynchronous Event Request (0Ch): Supported 00:26:23.180 Keep Alive (18h): Supported 00:26:23.180 I/O Commands 00:26:23.180 ------------ 00:26:23.180 Flush (00h): Supported LBA-Change 00:26:23.180 Write (01h): Supported LBA-Change 00:26:23.180 Read (02h): Supported 00:26:23.180 Compare (05h): Supported 00:26:23.180 Write Zeroes (08h): Supported LBA-Change 00:26:23.180 Dataset Management (09h): Supported LBA-Change 00:26:23.180 Copy (19h): Supported LBA-Change 00:26:23.180 Unknown (79h): Supported LBA-Change 00:26:23.180 Unknown (7Ah): Supported 00:26:23.180 00:26:23.180 Error Log 00:26:23.180 ========= 00:26:23.180 00:26:23.180 Arbitration 00:26:23.180 =========== 00:26:23.180 Arbitration Burst: 1 00:26:23.180 00:26:23.180 Power Management 00:26:23.180 ================ 00:26:23.180 Number of Power States: 1 00:26:23.180 Current Power State: Power State #0 00:26:23.180 Power State #0: 00:26:23.180 Max Power: 0.00 W 00:26:23.180 Non-Operational State: Operational 00:26:23.180 Entry Latency: Not Reported 00:26:23.180 Exit Latency: Not Reported 00:26:23.180 Relative Read Throughput: 0 00:26:23.180 Relative Read Latency: 0 00:26:23.180 Relative Write Throughput: 0 00:26:23.180 Relative Write Latency: 0 00:26:23.180 Idle Power: Not Reported 00:26:23.180 Active Power: Not Reported 00:26:23.180 Non-Operational Permissive Mode: Not Supported 00:26:23.180 00:26:23.180 Health Information 00:26:23.180 ================== 00:26:23.180 Critical Warnings: 00:26:23.180 Available Spare Space: OK 00:26:23.180 Temperature: OK 00:26:23.180 Device Reliability: OK 00:26:23.180 Read Only: No 00:26:23.180 Volatile Memory Backup: OK 00:26:23.180 Current Temperature: 0 Kelvin (-273 Celsius) 00:26:23.180 Temperature Threshold: [2024-11-28 23:18:26.535873] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:23.180 [2024-11-28 23:18:26.535886] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:23.180 [2024-11-28 23:18:26.535894] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0xb96420) 00:26:23.180 [2024-11-28 23:18:26.535905] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.180 [2024-11-28 23:18:26.535944] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfc4a0, cid 7, qid 0 00:26:23.180 [2024-11-28 23:18:26.536095] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:23.180 [2024-11-28 23:18:26.536110] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:23.180 [2024-11-28 23:18:26.536117] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:23.180 [2024-11-28 23:18:26.536124] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfc4a0) on tqpair=0xb96420 00:26:23.180 [2024-11-28 23:18:26.536167] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:26:23.180 [2024-11-28 23:18:26.536189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:23.180 [2024-11-28 23:18:26.536202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:23.180 [2024-11-28 23:18:26.536217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:23.180 [2024-11-28 23:18:26.536228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:23.180 [2024-11-28 23:18:26.536241] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:23.180 [2024-11-28 23:18:26.536249] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:23.180 [2024-11-28 23:18:26.536256] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xb96420) 00:26:23.180 [2024-11-28 23:18:26.536267] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.180 [2024-11-28 23:18:26.536306] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfbf20, cid 3, qid 0 00:26:23.180 [2024-11-28 23:18:26.540403] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:23.180 [2024-11-28 23:18:26.540420] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:23.180 [2024-11-28 23:18:26.540428] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:23.180 [2024-11-28 23:18:26.540435] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfbf20) on tqpair=0xb96420 00:26:23.180 [2024-11-28 23:18:26.540447] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:23.180 [2024-11-28 23:18:26.540455] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:23.180 [2024-11-28 23:18:26.540462] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xb96420) 00:26:23.180 [2024-11-28 23:18:26.540473] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.180 [2024-11-28 23:18:26.540501] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfbf20, cid 3, qid 0 00:26:23.180 [2024-11-28 23:18:26.540645] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:23.180 [2024-11-28 23:18:26.540658] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:23.180 [2024-11-28 23:18:26.540665] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:23.180 [2024-11-28 23:18:26.540672] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfbf20) on tqpair=0xb96420 00:26:23.180 [2024-11-28 23:18:26.540680] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:26:23.180 [2024-11-28 23:18:26.540688] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:26:23.180 [2024-11-28 23:18:26.540704] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:23.180 [2024-11-28 23:18:26.540714] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:23.180 [2024-11-28 23:18:26.540721] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xb96420) 00:26:23.180 [2024-11-28 23:18:26.540732] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.180 [2024-11-28 23:18:26.540753] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfbf20, cid 3, qid 0 00:26:23.180 [2024-11-28 23:18:26.540852] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:23.180 [2024-11-28 23:18:26.540866] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:23.180 [2024-11-28 23:18:26.540874] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:23.180 [2024-11-28 23:18:26.540880] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfbf20) on tqpair=0xb96420 00:26:23.180 [2024-11-28 23:18:26.540897] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:23.180 [2024-11-28 23:18:26.540907] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:23.180 [2024-11-28 23:18:26.540915] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xb96420) 00:26:23.180 [2024-11-28 23:18:26.540925] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.180 [2024-11-28 23:18:26.540946] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfbf20, cid 3, qid 0 00:26:23.180 [2024-11-28 23:18:26.541028] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:23.180 [2024-11-28 23:18:26.541042] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:23.180 [2024-11-28 23:18:26.541049] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:23.180 [2024-11-28 23:18:26.541056] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfbf20) on tqpair=0xb96420 00:26:23.180 [2024-11-28 23:18:26.541073] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:23.181 [2024-11-28 23:18:26.541082] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:23.181 [2024-11-28 23:18:26.541090] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xb96420) 00:26:23.181 [2024-11-28 23:18:26.541100] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.181 [2024-11-28 23:18:26.541121] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfbf20, cid 3, qid 0 00:26:23.181 [2024-11-28 23:18:26.541209] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:23.181 [2024-11-28 23:18:26.541223] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:23.181 [2024-11-28 23:18:26.541230] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:23.181 [2024-11-28 23:18:26.541237] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfbf20) on tqpair=0xb96420 00:26:23.181 [2024-11-28 23:18:26.541254] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:23.181 [2024-11-28 23:18:26.541264] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:23.181 [2024-11-28 23:18:26.541271] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xb96420) 00:26:23.181 [2024-11-28 23:18:26.541282] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.181 [2024-11-28 23:18:26.541303] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfbf20, cid 3, qid 0 00:26:23.181 [2024-11-28 23:18:26.541382] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:23.181 [2024-11-28 23:18:26.541402] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:23.181 [2024-11-28 23:18:26.541411] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:23.181 [2024-11-28 23:18:26.541418] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfbf20) on tqpair=0xb96420 00:26:23.181 [2024-11-28 23:18:26.541435] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:23.181 [2024-11-28 23:18:26.541445] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:23.181 [2024-11-28 23:18:26.541452] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xb96420) 00:26:23.181 [2024-11-28 23:18:26.541463] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.181 [2024-11-28 23:18:26.541484] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfbf20, cid 3, qid 0 00:26:23.181 [2024-11-28 23:18:26.541581] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:23.181 [2024-11-28 23:18:26.541594] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:23.181 [2024-11-28 23:18:26.541601] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:23.181 [2024-11-28 23:18:26.541608] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfbf20) on tqpair=0xb96420 00:26:23.181 [2024-11-28 23:18:26.541624] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:23.181 [2024-11-28 23:18:26.541634] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:23.181 [2024-11-28 23:18:26.541641] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xb96420) 00:26:23.181 [2024-11-28 23:18:26.541651] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.181 [2024-11-28 23:18:26.541672] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfbf20, cid 3, qid 0 00:26:23.181 [2024-11-28 23:18:26.541772] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:23.181 [2024-11-28 23:18:26.541785] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:23.181 [2024-11-28 23:18:26.541792] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:23.181 [2024-11-28 23:18:26.541799] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfbf20) on tqpair=0xb96420 00:26:23.181 [2024-11-28 23:18:26.541816] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:23.181 [2024-11-28 23:18:26.541825] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:23.181 [2024-11-28 23:18:26.541833] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xb96420) 00:26:23.181 [2024-11-28 23:18:26.541844] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.181 [2024-11-28 23:18:26.541864] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfbf20, cid 3, qid 0 00:26:23.181 [2024-11-28 23:18:26.541946] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:23.181 [2024-11-28 23:18:26.541959] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:23.181 [2024-11-28 23:18:26.541966] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:23.181 [2024-11-28 23:18:26.541973] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfbf20) on tqpair=0xb96420 00:26:23.181 [2024-11-28 23:18:26.541989] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:23.181 [2024-11-28 23:18:26.541999] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:23.181 [2024-11-28 23:18:26.542006] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xb96420) 00:26:23.181 [2024-11-28 23:18:26.542017] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.181 [2024-11-28 23:18:26.542037] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfbf20, cid 3, qid 0 00:26:23.181 [2024-11-28 23:18:26.542132] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:23.181 [2024-11-28 23:18:26.542145] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:23.181 [2024-11-28 23:18:26.542152] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:23.181 [2024-11-28 23:18:26.542159] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfbf20) on tqpair=0xb96420 00:26:23.181 [2024-11-28 23:18:26.542175] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:23.181 [2024-11-28 23:18:26.542185] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:23.181 [2024-11-28 23:18:26.542192] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xb96420) 00:26:23.181 [2024-11-28 23:18:26.542203] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.181 [2024-11-28 23:18:26.542223] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfbf20, cid 3, qid 0 00:26:23.181 [2024-11-28 23:18:26.542321] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:23.181 [2024-11-28 23:18:26.542335] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:23.181 [2024-11-28 23:18:26.542342] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:23.181 [2024-11-28 23:18:26.542349] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfbf20) on tqpair=0xb96420 00:26:23.181 [2024-11-28 23:18:26.542366] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:23.181 [2024-11-28 23:18:26.542376] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:23.181 [2024-11-28 23:18:26.542383] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xb96420) 00:26:23.181 [2024-11-28 23:18:26.542402] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.181 [2024-11-28 23:18:26.542426] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfbf20, cid 3, qid 0 00:26:23.181 [2024-11-28 23:18:26.542513] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:23.181 [2024-11-28 23:18:26.542532] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:23.181 [2024-11-28 23:18:26.542540] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:23.181 [2024-11-28 23:18:26.542547] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfbf20) on tqpair=0xb96420 00:26:23.181 [2024-11-28 23:18:26.542564] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:23.181 [2024-11-28 23:18:26.542574] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:23.181 [2024-11-28 23:18:26.542582] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xb96420) 00:26:23.181 [2024-11-28 23:18:26.542593] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.181 [2024-11-28 23:18:26.542614] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfbf20, cid 3, qid 0 00:26:23.181 [2024-11-28 23:18:26.542698] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:23.181 [2024-11-28 23:18:26.542710] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:23.181 [2024-11-28 23:18:26.542717] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:23.181 [2024-11-28 23:18:26.542724] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfbf20) on tqpair=0xb96420 00:26:23.181 [2024-11-28 23:18:26.542741] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:23.181 [2024-11-28 23:18:26.542751] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:23.181 [2024-11-28 23:18:26.542758] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xb96420) 00:26:23.181 [2024-11-28 23:18:26.542769] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.181 [2024-11-28 23:18:26.542789] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfbf20, cid 3, qid 0 00:26:23.181 [2024-11-28 23:18:26.542876] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:23.181 [2024-11-28 23:18:26.542891] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:23.181 [2024-11-28 23:18:26.542898] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:23.182 [2024-11-28 23:18:26.542905] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfbf20) on tqpair=0xb96420 00:26:23.182 [2024-11-28 23:18:26.542922] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:23.182 [2024-11-28 23:18:26.542932] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:23.182 [2024-11-28 23:18:26.542939] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xb96420) 00:26:23.182 [2024-11-28 23:18:26.542950] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.182 [2024-11-28 23:18:26.542971] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfbf20, cid 3, qid 0 00:26:23.182 [2024-11-28 23:18:26.543053] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:23.182 [2024-11-28 23:18:26.543065] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:23.182 [2024-11-28 23:18:26.543072] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:23.182 [2024-11-28 23:18:26.543079] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfbf20) on tqpair=0xb96420 00:26:23.182 [2024-11-28 23:18:26.543095] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:23.182 [2024-11-28 23:18:26.543105] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:23.182 [2024-11-28 23:18:26.543112] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xb96420) 00:26:23.182 [2024-11-28 23:18:26.543123] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.182 [2024-11-28 23:18:26.543143] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfbf20, cid 3, qid 0 00:26:23.182 [2024-11-28 23:18:26.543232] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:23.182 [2024-11-28 23:18:26.543246] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:23.182 [2024-11-28 23:18:26.543257] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:23.182 [2024-11-28 23:18:26.543265] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfbf20) on tqpair=0xb96420 00:26:23.182 [2024-11-28 23:18:26.543282] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:23.182 [2024-11-28 23:18:26.543292] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:23.182 [2024-11-28 23:18:26.543299] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xb96420) 00:26:23.182 [2024-11-28 23:18:26.543310] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.182 [2024-11-28 23:18:26.543331] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfbf20, cid 3, qid 0 00:26:23.182 [2024-11-28 23:18:26.543426] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:23.182 [2024-11-28 23:18:26.543441] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:23.182 [2024-11-28 23:18:26.543448] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:23.182 [2024-11-28 23:18:26.543455] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfbf20) on tqpair=0xb96420 00:26:23.182 [2024-11-28 23:18:26.543472] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:23.182 [2024-11-28 23:18:26.543482] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:23.182 [2024-11-28 23:18:26.543490] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xb96420) 00:26:23.182 [2024-11-28 23:18:26.543500] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.182 [2024-11-28 23:18:26.543522] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfbf20, cid 3, qid 0 00:26:23.182 [2024-11-28 23:18:26.543610] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:23.182 [2024-11-28 23:18:26.543625] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:23.182 [2024-11-28 23:18:26.543632] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:23.182 [2024-11-28 23:18:26.543639] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfbf20) on tqpair=0xb96420 00:26:23.182 [2024-11-28 23:18:26.543656] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:23.182 [2024-11-28 23:18:26.543666] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:23.182 [2024-11-28 23:18:26.543673] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xb96420) 00:26:23.182 [2024-11-28 23:18:26.543684] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.182 [2024-11-28 23:18:26.543705] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfbf20, cid 3, qid 0 00:26:23.182 [2024-11-28 23:18:26.543791] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:23.182 [2024-11-28 23:18:26.543804] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:23.182 [2024-11-28 23:18:26.543811] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:23.182 [2024-11-28 23:18:26.543818] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfbf20) on tqpair=0xb96420 00:26:23.182 [2024-11-28 23:18:26.543834] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:23.182 [2024-11-28 23:18:26.543843] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:23.182 [2024-11-28 23:18:26.543850] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xb96420) 00:26:23.182 [2024-11-28 23:18:26.543861] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.182 [2024-11-28 23:18:26.543882] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfbf20, cid 3, qid 0 00:26:23.182 [2024-11-28 23:18:26.543970] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:23.182 [2024-11-28 23:18:26.543984] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:23.182 [2024-11-28 23:18:26.543991] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:23.182 [2024-11-28 23:18:26.543998] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfbf20) on tqpair=0xb96420 00:26:23.182 [2024-11-28 23:18:26.544019] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:23.182 [2024-11-28 23:18:26.544030] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:23.182 [2024-11-28 23:18:26.544037] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xb96420) 00:26:23.182 [2024-11-28 23:18:26.544048] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.182 [2024-11-28 23:18:26.544069] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfbf20, cid 3, qid 0 00:26:23.182 [2024-11-28 23:18:26.544156] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:23.182 [2024-11-28 23:18:26.544170] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:23.182 [2024-11-28 23:18:26.544177] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:23.182 [2024-11-28 23:18:26.544184] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfbf20) on tqpair=0xb96420 00:26:23.182 [2024-11-28 23:18:26.544201] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:23.182 [2024-11-28 23:18:26.544211] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:23.182 [2024-11-28 23:18:26.544218] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xb96420) 00:26:23.182 [2024-11-28 23:18:26.544229] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.182 [2024-11-28 23:18:26.544250] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfbf20, cid 3, qid 0 00:26:23.182 [2024-11-28 23:18:26.544334] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:23.182 [2024-11-28 23:18:26.544348] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:23.182 [2024-11-28 23:18:26.544355] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:23.182 [2024-11-28 23:18:26.544362] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfbf20) on tqpair=0xb96420 00:26:23.182 [2024-11-28 23:18:26.544379] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:23.182 [2024-11-28 23:18:26.544389] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:23.182 [2024-11-28 23:18:26.544404] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xb96420) 00:26:23.182 [2024-11-28 23:18:26.544416] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.182 [2024-11-28 23:18:26.544437] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfbf20, cid 3, qid 0 00:26:23.182 [2024-11-28 23:18:26.544518] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:23.182 [2024-11-28 23:18:26.544531] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:23.182 [2024-11-28 23:18:26.544538] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:23.182 [2024-11-28 23:18:26.544544] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfbf20) on tqpair=0xb96420 00:26:23.182 [2024-11-28 23:18:26.544561] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:23.182 [2024-11-28 23:18:26.544570] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:23.182 [2024-11-28 23:18:26.544578] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xb96420) 00:26:23.182 [2024-11-28 23:18:26.544588] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.182 [2024-11-28 23:18:26.544609] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfbf20, cid 3, qid 0 00:26:23.183 [2024-11-28 23:18:26.544689] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:23.183 [2024-11-28 23:18:26.544702] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:23.183 [2024-11-28 23:18:26.544709] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:23.183 [2024-11-28 23:18:26.544715] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfbf20) on tqpair=0xb96420 00:26:23.183 [2024-11-28 23:18:26.544736] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:23.183 [2024-11-28 23:18:26.544747] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:23.183 [2024-11-28 23:18:26.544754] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xb96420) 00:26:23.183 [2024-11-28 23:18:26.544765] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.183 [2024-11-28 23:18:26.544785] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfbf20, cid 3, qid 0 00:26:23.183 [2024-11-28 23:18:26.544876] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:23.183 [2024-11-28 23:18:26.544890] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:23.183 [2024-11-28 23:18:26.544897] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:23.183 [2024-11-28 23:18:26.544904] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfbf20) on tqpair=0xb96420 00:26:23.183 [2024-11-28 23:18:26.544921] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:23.183 [2024-11-28 23:18:26.544931] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:23.183 [2024-11-28 23:18:26.544938] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xb96420) 00:26:23.183 [2024-11-28 23:18:26.544949] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.183 [2024-11-28 23:18:26.544970] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfbf20, cid 3, qid 0 00:26:23.183 [2024-11-28 23:18:26.545057] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:23.183 [2024-11-28 23:18:26.545071] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:23.183 [2024-11-28 23:18:26.545078] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:23.183 [2024-11-28 23:18:26.545085] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfbf20) on tqpair=0xb96420 00:26:23.183 [2024-11-28 23:18:26.545102] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:23.183 [2024-11-28 23:18:26.545112] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:23.183 [2024-11-28 23:18:26.545119] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xb96420) 00:26:23.183 [2024-11-28 23:18:26.545130] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.183 [2024-11-28 23:18:26.545151] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfbf20, cid 3, qid 0 00:26:23.183 [2024-11-28 23:18:26.545225] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:23.183 [2024-11-28 23:18:26.545239] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:23.183 [2024-11-28 23:18:26.545246] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:23.183 [2024-11-28 23:18:26.545253] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfbf20) on tqpair=0xb96420 00:26:23.183 [2024-11-28 23:18:26.545270] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:23.183 [2024-11-28 23:18:26.545279] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:23.183 [2024-11-28 23:18:26.545287] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xb96420) 00:26:23.183 [2024-11-28 23:18:26.545297] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.183 [2024-11-28 23:18:26.545318] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfbf20, cid 3, qid 0 00:26:23.183 [2024-11-28 23:18:26.545406] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:23.183 [2024-11-28 23:18:26.545421] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:23.183 [2024-11-28 23:18:26.545428] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:23.183 [2024-11-28 23:18:26.545435] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfbf20) on tqpair=0xb96420 00:26:23.183 [2024-11-28 23:18:26.545452] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:23.183 [2024-11-28 23:18:26.545466] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:23.183 [2024-11-28 23:18:26.545474] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xb96420) 00:26:23.183 [2024-11-28 23:18:26.545485] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.183 [2024-11-28 23:18:26.545506] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfbf20, cid 3, qid 0 00:26:23.183 [2024-11-28 23:18:26.545593] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:23.183 [2024-11-28 23:18:26.545606] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:23.183 [2024-11-28 23:18:26.545613] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:23.183 [2024-11-28 23:18:26.545619] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfbf20) on tqpair=0xb96420 00:26:23.183 [2024-11-28 23:18:26.545636] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:23.183 [2024-11-28 23:18:26.545646] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:23.183 [2024-11-28 23:18:26.545653] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xb96420) 00:26:23.183 [2024-11-28 23:18:26.545664] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.183 [2024-11-28 23:18:26.545684] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfbf20, cid 3, qid 0 00:26:23.183 [2024-11-28 23:18:26.549403] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:23.183 [2024-11-28 23:18:26.549420] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:23.183 [2024-11-28 23:18:26.549428] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:23.183 [2024-11-28 23:18:26.549434] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfbf20) on tqpair=0xb96420 00:26:23.183 [2024-11-28 23:18:26.549453] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:23.183 [2024-11-28 23:18:26.549463] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:23.183 [2024-11-28 23:18:26.549470] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xb96420) 00:26:23.183 [2024-11-28 23:18:26.549480] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.183 [2024-11-28 23:18:26.549502] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xbfbf20, cid 3, qid 0 00:26:23.183 [2024-11-28 23:18:26.549624] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:23.183 [2024-11-28 23:18:26.549636] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:23.183 [2024-11-28 23:18:26.549643] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:23.183 [2024-11-28 23:18:26.549650] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xbfbf20) on tqpair=0xb96420 00:26:23.183 [2024-11-28 23:18:26.549663] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 8 milliseconds 00:26:23.183 0 Kelvin (-273 Celsius) 00:26:23.183 Available Spare: 0% 00:26:23.183 Available Spare Threshold: 0% 00:26:23.183 Life Percentage Used: 0% 00:26:23.183 Data Units Read: 0 00:26:23.183 Data Units Written: 0 00:26:23.183 Host Read Commands: 0 00:26:23.183 Host Write Commands: 0 00:26:23.183 Controller Busy Time: 0 minutes 00:26:23.183 Power Cycles: 0 00:26:23.183 Power On Hours: 0 hours 00:26:23.183 Unsafe Shutdowns: 0 00:26:23.183 Unrecoverable Media Errors: 0 00:26:23.183 Lifetime Error Log Entries: 0 00:26:23.183 Warning Temperature Time: 0 minutes 00:26:23.183 Critical Temperature Time: 0 minutes 00:26:23.183 00:26:23.183 Number of Queues 00:26:23.183 ================ 00:26:23.183 Number of I/O Submission Queues: 127 00:26:23.183 Number of I/O Completion Queues: 127 00:26:23.183 00:26:23.183 Active Namespaces 00:26:23.183 ================= 00:26:23.183 Namespace ID:1 00:26:23.183 Error Recovery Timeout: Unlimited 00:26:23.183 Command Set Identifier: NVM (00h) 00:26:23.183 Deallocate: Supported 00:26:23.183 Deallocated/Unwritten Error: Not Supported 00:26:23.184 Deallocated Read Value: Unknown 00:26:23.184 Deallocate in Write Zeroes: Not Supported 00:26:23.184 Deallocated Guard Field: 0xFFFF 00:26:23.184 Flush: Supported 00:26:23.184 Reservation: Supported 00:26:23.184 Namespace Sharing Capabilities: Multiple Controllers 00:26:23.184 Size (in LBAs): 131072 (0GiB) 00:26:23.184 Capacity (in LBAs): 131072 (0GiB) 00:26:23.184 Utilization (in LBAs): 131072 (0GiB) 00:26:23.184 NGUID: ABCDEF0123456789ABCDEF0123456789 00:26:23.184 EUI64: ABCDEF0123456789 00:26:23.184 UUID: 9df92431-a9cd-48c9-ab7f-59791eb9ca9c 00:26:23.184 Thin Provisioning: Not Supported 00:26:23.184 Per-NS Atomic Units: Yes 00:26:23.184 Atomic Boundary Size (Normal): 0 00:26:23.184 Atomic Boundary Size (PFail): 0 00:26:23.184 Atomic Boundary Offset: 0 00:26:23.184 Maximum Single Source Range Length: 65535 00:26:23.184 Maximum Copy Length: 65535 00:26:23.184 Maximum Source Range Count: 1 00:26:23.184 NGUID/EUI64 Never Reused: No 00:26:23.184 Namespace Write Protected: No 00:26:23.184 Number of LBA Formats: 1 00:26:23.184 Current LBA Format: LBA Format #00 00:26:23.184 LBA Format #00: Data Size: 512 Metadata Size: 0 00:26:23.184 00:26:23.184 23:18:26 -- host/identify.sh@51 -- # sync 00:26:23.184 23:18:26 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:23.184 23:18:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:23.184 23:18:26 -- common/autotest_common.sh@10 -- # set +x 00:26:23.184 23:18:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:23.184 23:18:26 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:26:23.184 23:18:26 -- host/identify.sh@56 -- # nvmftestfini 00:26:23.184 23:18:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:23.184 23:18:26 -- nvmf/common.sh@116 -- # sync 00:26:23.184 23:18:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:23.184 23:18:26 -- nvmf/common.sh@119 -- # set +e 00:26:23.184 23:18:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:23.184 23:18:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:23.184 rmmod nvme_tcp 00:26:23.184 rmmod nvme_fabrics 00:26:23.184 rmmod nvme_keyring 00:26:23.184 23:18:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:23.184 23:18:26 -- nvmf/common.sh@123 -- # set -e 00:26:23.184 23:18:26 -- nvmf/common.sh@124 -- # return 0 00:26:23.184 23:18:26 -- nvmf/common.sh@477 -- # '[' -n 2536871 ']' 00:26:23.184 23:18:26 -- nvmf/common.sh@478 -- # killprocess 2536871 00:26:23.184 23:18:26 -- common/autotest_common.sh@936 -- # '[' -z 2536871 ']' 00:26:23.184 23:18:26 -- common/autotest_common.sh@940 -- # kill -0 2536871 00:26:23.184 23:18:26 -- common/autotest_common.sh@941 -- # uname 00:26:23.184 23:18:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:23.184 23:18:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2536871 00:26:23.184 23:18:26 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:23.184 23:18:26 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:23.184 23:18:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2536871' 00:26:23.184 killing process with pid 2536871 00:26:23.184 23:18:26 -- common/autotest_common.sh@955 -- # kill 2536871 00:26:23.184 [2024-11-28 23:18:26.672549] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:26:23.184 23:18:26 -- common/autotest_common.sh@960 -- # wait 2536871 00:26:23.442 23:18:26 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:23.442 23:18:26 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:23.442 23:18:26 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:23.442 23:18:26 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:23.442 23:18:26 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:23.442 23:18:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:23.442 23:18:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:23.442 23:18:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:25.396 23:18:28 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:25.396 00:26:25.396 real 0m6.463s 00:26:25.396 user 0m8.302s 00:26:25.396 sys 0m2.000s 00:26:25.396 23:18:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:25.396 23:18:28 -- common/autotest_common.sh@10 -- # set +x 00:26:25.396 ************************************ 00:26:25.396 END TEST nvmf_identify 00:26:25.396 ************************************ 00:26:25.396 23:18:28 -- nvmf/nvmf.sh@98 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:26:25.396 23:18:28 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:25.396 23:18:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:25.396 23:18:28 -- common/autotest_common.sh@10 -- # set +x 00:26:25.396 ************************************ 00:26:25.396 START TEST nvmf_perf 00:26:25.396 ************************************ 00:26:25.396 23:18:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:26:25.655 * Looking for test storage... 00:26:25.655 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:25.655 23:18:29 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:25.655 23:18:29 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:25.655 23:18:29 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:25.655 23:18:29 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:25.655 23:18:29 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:25.655 23:18:29 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:25.655 23:18:29 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:25.655 23:18:29 -- scripts/common.sh@335 -- # IFS=.-: 00:26:25.655 23:18:29 -- scripts/common.sh@335 -- # read -ra ver1 00:26:25.655 23:18:29 -- scripts/common.sh@336 -- # IFS=.-: 00:26:25.655 23:18:29 -- scripts/common.sh@336 -- # read -ra ver2 00:26:25.655 23:18:29 -- scripts/common.sh@337 -- # local 'op=<' 00:26:25.655 23:18:29 -- scripts/common.sh@339 -- # ver1_l=2 00:26:25.655 23:18:29 -- scripts/common.sh@340 -- # ver2_l=1 00:26:25.655 23:18:29 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:25.655 23:18:29 -- scripts/common.sh@343 -- # case "$op" in 00:26:25.655 23:18:29 -- scripts/common.sh@344 -- # : 1 00:26:25.655 23:18:29 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:25.655 23:18:29 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:25.655 23:18:29 -- scripts/common.sh@364 -- # decimal 1 00:26:25.655 23:18:29 -- scripts/common.sh@352 -- # local d=1 00:26:25.655 23:18:29 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:25.655 23:18:29 -- scripts/common.sh@354 -- # echo 1 00:26:25.655 23:18:29 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:25.655 23:18:29 -- scripts/common.sh@365 -- # decimal 2 00:26:25.655 23:18:29 -- scripts/common.sh@352 -- # local d=2 00:26:25.655 23:18:29 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:25.655 23:18:29 -- scripts/common.sh@354 -- # echo 2 00:26:25.655 23:18:29 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:25.655 23:18:29 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:25.655 23:18:29 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:25.655 23:18:29 -- scripts/common.sh@367 -- # return 0 00:26:25.655 23:18:29 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:25.655 23:18:29 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:25.655 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:25.655 --rc genhtml_branch_coverage=1 00:26:25.655 --rc genhtml_function_coverage=1 00:26:25.655 --rc genhtml_legend=1 00:26:25.655 --rc geninfo_all_blocks=1 00:26:25.655 --rc geninfo_unexecuted_blocks=1 00:26:25.655 00:26:25.655 ' 00:26:25.655 23:18:29 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:25.655 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:25.655 --rc genhtml_branch_coverage=1 00:26:25.655 --rc genhtml_function_coverage=1 00:26:25.655 --rc genhtml_legend=1 00:26:25.655 --rc geninfo_all_blocks=1 00:26:25.655 --rc geninfo_unexecuted_blocks=1 00:26:25.655 00:26:25.655 ' 00:26:25.655 23:18:29 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:25.655 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:25.655 --rc genhtml_branch_coverage=1 00:26:25.655 --rc genhtml_function_coverage=1 00:26:25.655 --rc genhtml_legend=1 00:26:25.655 --rc geninfo_all_blocks=1 00:26:25.655 --rc geninfo_unexecuted_blocks=1 00:26:25.655 00:26:25.655 ' 00:26:25.655 23:18:29 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:25.655 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:25.655 --rc genhtml_branch_coverage=1 00:26:25.655 --rc genhtml_function_coverage=1 00:26:25.655 --rc genhtml_legend=1 00:26:25.655 --rc geninfo_all_blocks=1 00:26:25.655 --rc geninfo_unexecuted_blocks=1 00:26:25.655 00:26:25.655 ' 00:26:25.655 23:18:29 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:25.655 23:18:29 -- nvmf/common.sh@7 -- # uname -s 00:26:25.656 23:18:29 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:25.656 23:18:29 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:25.656 23:18:29 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:25.656 23:18:29 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:25.656 23:18:29 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:25.656 23:18:29 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:25.656 23:18:29 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:25.656 23:18:29 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:25.656 23:18:29 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:25.656 23:18:29 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:25.656 23:18:29 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:25.656 23:18:29 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:25.656 23:18:29 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:25.656 23:18:29 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:25.656 23:18:29 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:25.656 23:18:29 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:25.656 23:18:29 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:25.656 23:18:29 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:25.656 23:18:29 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:25.656 23:18:29 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:25.656 23:18:29 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:25.656 23:18:29 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:25.656 23:18:29 -- paths/export.sh@5 -- # export PATH 00:26:25.656 23:18:29 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:25.656 23:18:29 -- nvmf/common.sh@46 -- # : 0 00:26:25.656 23:18:29 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:25.656 23:18:29 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:25.656 23:18:29 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:25.656 23:18:29 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:25.656 23:18:29 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:25.656 23:18:29 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:25.656 23:18:29 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:25.656 23:18:29 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:25.656 23:18:29 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:26:25.656 23:18:29 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:26:25.656 23:18:29 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:26:25.656 23:18:29 -- host/perf.sh@17 -- # nvmftestinit 00:26:25.656 23:18:29 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:25.656 23:18:29 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:25.656 23:18:29 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:25.656 23:18:29 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:25.656 23:18:29 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:25.656 23:18:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:25.656 23:18:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:25.656 23:18:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:25.656 23:18:29 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:25.656 23:18:29 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:25.656 23:18:29 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:25.656 23:18:29 -- common/autotest_common.sh@10 -- # set +x 00:26:27.559 23:18:31 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:27.559 23:18:31 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:27.559 23:18:31 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:27.559 23:18:31 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:27.559 23:18:31 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:27.559 23:18:31 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:27.559 23:18:31 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:27.559 23:18:31 -- nvmf/common.sh@294 -- # net_devs=() 00:26:27.559 23:18:31 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:27.559 23:18:31 -- nvmf/common.sh@295 -- # e810=() 00:26:27.559 23:18:31 -- nvmf/common.sh@295 -- # local -ga e810 00:26:27.559 23:18:31 -- nvmf/common.sh@296 -- # x722=() 00:26:27.559 23:18:31 -- nvmf/common.sh@296 -- # local -ga x722 00:26:27.559 23:18:31 -- nvmf/common.sh@297 -- # mlx=() 00:26:27.559 23:18:31 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:27.559 23:18:31 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:27.559 23:18:31 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:27.559 23:18:31 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:27.559 23:18:31 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:27.559 23:18:31 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:27.559 23:18:31 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:27.559 23:18:31 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:27.559 23:18:31 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:27.559 23:18:31 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:27.559 23:18:31 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:27.559 23:18:31 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:27.559 23:18:31 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:27.559 23:18:31 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:27.559 23:18:31 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:27.559 23:18:31 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:27.559 23:18:31 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:27.559 23:18:31 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:27.559 23:18:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:27.559 23:18:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:27.559 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:27.559 23:18:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:27.559 23:18:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:27.559 23:18:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:27.559 23:18:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:27.559 23:18:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:27.559 23:18:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:27.559 23:18:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:27.559 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:27.559 23:18:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:27.559 23:18:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:27.559 23:18:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:27.559 23:18:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:27.559 23:18:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:27.559 23:18:31 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:27.559 23:18:31 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:27.559 23:18:31 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:27.559 23:18:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:27.559 23:18:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:27.559 23:18:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:27.559 23:18:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:27.559 23:18:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:27.559 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:27.559 23:18:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:27.559 23:18:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:27.559 23:18:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:27.559 23:18:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:27.559 23:18:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:27.559 23:18:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:27.559 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:27.559 23:18:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:27.559 23:18:31 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:27.559 23:18:31 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:27.559 23:18:31 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:27.559 23:18:31 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:27.559 23:18:31 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:27.559 23:18:31 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:27.559 23:18:31 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:27.559 23:18:31 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:27.559 23:18:31 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:27.559 23:18:31 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:27.559 23:18:31 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:27.559 23:18:31 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:27.559 23:18:31 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:27.559 23:18:31 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:27.559 23:18:31 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:27.559 23:18:31 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:27.559 23:18:31 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:27.559 23:18:31 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:27.819 23:18:31 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:27.819 23:18:31 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:27.819 23:18:31 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:27.819 23:18:31 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:27.819 23:18:31 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:27.819 23:18:31 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:27.819 23:18:31 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:27.819 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:27.819 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.200 ms 00:26:27.819 00:26:27.819 --- 10.0.0.2 ping statistics --- 00:26:27.819 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:27.819 rtt min/avg/max/mdev = 0.200/0.200/0.200/0.000 ms 00:26:27.819 23:18:31 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:27.819 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:27.819 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.125 ms 00:26:27.819 00:26:27.819 --- 10.0.0.1 ping statistics --- 00:26:27.819 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:27.819 rtt min/avg/max/mdev = 0.125/0.125/0.125/0.000 ms 00:26:27.819 23:18:31 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:27.819 23:18:31 -- nvmf/common.sh@410 -- # return 0 00:26:27.819 23:18:31 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:27.819 23:18:31 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:27.819 23:18:31 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:27.819 23:18:31 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:27.819 23:18:31 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:27.819 23:18:31 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:27.819 23:18:31 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:27.819 23:18:31 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:26:27.819 23:18:31 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:27.819 23:18:31 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:27.819 23:18:31 -- common/autotest_common.sh@10 -- # set +x 00:26:27.819 23:18:31 -- nvmf/common.sh@469 -- # nvmfpid=2539113 00:26:27.819 23:18:31 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:26:27.819 23:18:31 -- nvmf/common.sh@470 -- # waitforlisten 2539113 00:26:27.819 23:18:31 -- common/autotest_common.sh@829 -- # '[' -z 2539113 ']' 00:26:27.819 23:18:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:27.819 23:18:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:27.819 23:18:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:27.819 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:27.819 23:18:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:27.819 23:18:31 -- common/autotest_common.sh@10 -- # set +x 00:26:28.077 [2024-11-28 23:18:31.449525] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:28.078 [2024-11-28 23:18:31.449614] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:28.078 EAL: No free 2048 kB hugepages reported on node 1 00:26:28.078 [2024-11-28 23:18:31.520330] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:28.078 [2024-11-28 23:18:31.609500] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:28.078 [2024-11-28 23:18:31.609678] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:28.078 [2024-11-28 23:18:31.609697] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:28.078 [2024-11-28 23:18:31.609711] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:28.078 [2024-11-28 23:18:31.609799] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:28.078 [2024-11-28 23:18:31.609856] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:28.078 [2024-11-28 23:18:31.609973] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:28.078 [2024-11-28 23:18:31.609975] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:29.010 23:18:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:29.010 23:18:32 -- common/autotest_common.sh@862 -- # return 0 00:26:29.010 23:18:32 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:29.010 23:18:32 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:29.010 23:18:32 -- common/autotest_common.sh@10 -- # set +x 00:26:29.010 23:18:32 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:29.010 23:18:32 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:26:29.010 23:18:32 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:26:32.290 23:18:35 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:26:32.290 23:18:35 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:26:32.290 23:18:35 -- host/perf.sh@30 -- # local_nvme_trid=0000:88:00.0 00:26:32.290 23:18:35 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:26:32.547 23:18:36 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:26:32.547 23:18:36 -- host/perf.sh@33 -- # '[' -n 0000:88:00.0 ']' 00:26:32.547 23:18:36 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:26:32.547 23:18:36 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:26:32.547 23:18:36 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:26:32.805 [2024-11-28 23:18:36.252429] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:32.805 23:18:36 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:33.062 23:18:36 -- host/perf.sh@45 -- # for bdev in $bdevs 00:26:33.063 23:18:36 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:26:33.320 23:18:36 -- host/perf.sh@45 -- # for bdev in $bdevs 00:26:33.320 23:18:36 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:26:33.577 23:18:37 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:33.835 [2024-11-28 23:18:37.260280] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:33.835 23:18:37 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:26:34.093 23:18:37 -- host/perf.sh@52 -- # '[' -n 0000:88:00.0 ']' 00:26:34.093 23:18:37 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:26:34.093 23:18:37 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:26:34.093 23:18:37 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:26:35.465 Initializing NVMe Controllers 00:26:35.465 Attached to NVMe Controller at 0000:88:00.0 [8086:0a54] 00:26:35.465 Associating PCIE (0000:88:00.0) NSID 1 with lcore 0 00:26:35.465 Initialization complete. Launching workers. 00:26:35.465 ======================================================== 00:26:35.465 Latency(us) 00:26:35.465 Device Information : IOPS MiB/s Average min max 00:26:35.465 PCIE (0000:88:00.0) NSID 1 from core 0: 87418.77 341.48 365.58 32.79 4506.43 00:26:35.465 ======================================================== 00:26:35.465 Total : 87418.77 341.48 365.58 32.79 4506.43 00:26:35.465 00:26:35.465 23:18:38 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:35.465 EAL: No free 2048 kB hugepages reported on node 1 00:26:36.837 Initializing NVMe Controllers 00:26:36.837 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:36.837 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:36.837 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:36.837 Initialization complete. Launching workers. 00:26:36.837 ======================================================== 00:26:36.837 Latency(us) 00:26:36.837 Device Information : IOPS MiB/s Average min max 00:26:36.837 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 126.55 0.49 7918.14 135.84 45786.72 00:26:36.837 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 55.80 0.22 17919.27 6987.85 47911.73 00:26:36.837 ======================================================== 00:26:36.837 Total : 182.36 0.71 10978.59 135.84 47911.73 00:26:36.837 00:26:36.837 23:18:40 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:36.837 EAL: No free 2048 kB hugepages reported on node 1 00:26:38.210 Initializing NVMe Controllers 00:26:38.210 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:38.210 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:38.210 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:38.210 Initialization complete. Launching workers. 00:26:38.210 ======================================================== 00:26:38.210 Latency(us) 00:26:38.210 Device Information : IOPS MiB/s Average min max 00:26:38.210 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8560.00 33.44 3742.29 565.57 10149.35 00:26:38.210 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3959.00 15.46 8145.87 5018.91 15594.01 00:26:38.210 ======================================================== 00:26:38.210 Total : 12519.00 48.90 5134.87 565.57 15594.01 00:26:38.210 00:26:38.210 23:18:41 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:26:38.210 23:18:41 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:26:38.210 23:18:41 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:38.210 EAL: No free 2048 kB hugepages reported on node 1 00:26:40.738 Initializing NVMe Controllers 00:26:40.738 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:40.738 Controller IO queue size 128, less than required. 00:26:40.738 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:40.738 Controller IO queue size 128, less than required. 00:26:40.738 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:40.738 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:40.738 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:40.738 Initialization complete. Launching workers. 00:26:40.738 ======================================================== 00:26:40.738 Latency(us) 00:26:40.738 Device Information : IOPS MiB/s Average min max 00:26:40.738 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1701.17 425.29 76445.88 48502.58 136475.53 00:26:40.738 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 607.49 151.87 224165.07 78591.21 327593.99 00:26:40.738 ======================================================== 00:26:40.738 Total : 2308.65 577.16 115315.99 48502.58 327593.99 00:26:40.738 00:26:40.738 23:18:44 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:26:40.738 EAL: No free 2048 kB hugepages reported on node 1 00:26:40.738 No valid NVMe controllers or AIO or URING devices found 00:26:40.995 Initializing NVMe Controllers 00:26:40.995 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:40.995 Controller IO queue size 128, less than required. 00:26:40.995 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:40.995 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:26:40.995 Controller IO queue size 128, less than required. 00:26:40.995 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:40.995 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:26:40.995 WARNING: Some requested NVMe devices were skipped 00:26:40.995 23:18:44 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:26:40.995 EAL: No free 2048 kB hugepages reported on node 1 00:26:43.528 Initializing NVMe Controllers 00:26:43.528 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:43.528 Controller IO queue size 128, less than required. 00:26:43.528 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:43.528 Controller IO queue size 128, less than required. 00:26:43.528 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:43.528 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:43.528 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:43.528 Initialization complete. Launching workers. 00:26:43.528 00:26:43.528 ==================== 00:26:43.528 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:26:43.528 TCP transport: 00:26:43.528 polls: 9851 00:26:43.528 idle_polls: 6487 00:26:43.528 sock_completions: 3364 00:26:43.528 nvme_completions: 5986 00:26:43.528 submitted_requests: 9139 00:26:43.528 queued_requests: 1 00:26:43.528 00:26:43.528 ==================== 00:26:43.528 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:26:43.528 TCP transport: 00:26:43.528 polls: 13190 00:26:43.528 idle_polls: 9989 00:26:43.528 sock_completions: 3201 00:26:43.528 nvme_completions: 5492 00:26:43.528 submitted_requests: 8390 00:26:43.528 queued_requests: 1 00:26:43.528 ======================================================== 00:26:43.528 Latency(us) 00:26:43.528 Device Information : IOPS MiB/s Average min max 00:26:43.528 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1560.00 390.00 84838.37 48360.74 138368.88 00:26:43.528 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1436.50 359.12 89033.53 40398.02 133396.90 00:26:43.528 ======================================================== 00:26:43.528 Total : 2996.50 749.12 86849.50 40398.02 138368.88 00:26:43.528 00:26:43.528 23:18:46 -- host/perf.sh@66 -- # sync 00:26:43.528 23:18:46 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:43.528 23:18:47 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:26:43.528 23:18:47 -- host/perf.sh@71 -- # '[' -n 0000:88:00.0 ']' 00:26:43.528 23:18:47 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:26:47.709 23:18:50 -- host/perf.sh@72 -- # ls_guid=956e55e4-159f-47c8-845d-94dc3e3d4036 00:26:47.709 23:18:50 -- host/perf.sh@73 -- # get_lvs_free_mb 956e55e4-159f-47c8-845d-94dc3e3d4036 00:26:47.709 23:18:50 -- common/autotest_common.sh@1353 -- # local lvs_uuid=956e55e4-159f-47c8-845d-94dc3e3d4036 00:26:47.709 23:18:50 -- common/autotest_common.sh@1354 -- # local lvs_info 00:26:47.709 23:18:50 -- common/autotest_common.sh@1355 -- # local fc 00:26:47.709 23:18:50 -- common/autotest_common.sh@1356 -- # local cs 00:26:47.709 23:18:50 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:26:47.709 23:18:50 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:26:47.709 { 00:26:47.709 "uuid": "956e55e4-159f-47c8-845d-94dc3e3d4036", 00:26:47.709 "name": "lvs_0", 00:26:47.709 "base_bdev": "Nvme0n1", 00:26:47.709 "total_data_clusters": 238234, 00:26:47.709 "free_clusters": 238234, 00:26:47.709 "block_size": 512, 00:26:47.709 "cluster_size": 4194304 00:26:47.709 } 00:26:47.709 ]' 00:26:47.709 23:18:50 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="956e55e4-159f-47c8-845d-94dc3e3d4036") .free_clusters' 00:26:47.709 23:18:50 -- common/autotest_common.sh@1358 -- # fc=238234 00:26:47.709 23:18:50 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="956e55e4-159f-47c8-845d-94dc3e3d4036") .cluster_size' 00:26:47.709 23:18:50 -- common/autotest_common.sh@1359 -- # cs=4194304 00:26:47.709 23:18:50 -- common/autotest_common.sh@1362 -- # free_mb=952936 00:26:47.709 23:18:50 -- common/autotest_common.sh@1363 -- # echo 952936 00:26:47.709 952936 00:26:47.709 23:18:50 -- host/perf.sh@77 -- # '[' 952936 -gt 20480 ']' 00:26:47.709 23:18:50 -- host/perf.sh@78 -- # free_mb=20480 00:26:47.709 23:18:50 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 956e55e4-159f-47c8-845d-94dc3e3d4036 lbd_0 20480 00:26:47.709 23:18:51 -- host/perf.sh@80 -- # lb_guid=73e84d6f-e1ad-4be5-b021-f4b780d3e637 00:26:47.709 23:18:51 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore 73e84d6f-e1ad-4be5-b021-f4b780d3e637 lvs_n_0 00:26:48.641 23:18:52 -- host/perf.sh@83 -- # ls_nested_guid=46022b08-c3a0-41f4-b6a2-173cd9d64584 00:26:48.641 23:18:52 -- host/perf.sh@84 -- # get_lvs_free_mb 46022b08-c3a0-41f4-b6a2-173cd9d64584 00:26:48.641 23:18:52 -- common/autotest_common.sh@1353 -- # local lvs_uuid=46022b08-c3a0-41f4-b6a2-173cd9d64584 00:26:48.641 23:18:52 -- common/autotest_common.sh@1354 -- # local lvs_info 00:26:48.641 23:18:52 -- common/autotest_common.sh@1355 -- # local fc 00:26:48.641 23:18:52 -- common/autotest_common.sh@1356 -- # local cs 00:26:48.641 23:18:52 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:26:48.898 23:18:52 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:26:48.898 { 00:26:48.898 "uuid": "956e55e4-159f-47c8-845d-94dc3e3d4036", 00:26:48.898 "name": "lvs_0", 00:26:48.898 "base_bdev": "Nvme0n1", 00:26:48.898 "total_data_clusters": 238234, 00:26:48.898 "free_clusters": 233114, 00:26:48.898 "block_size": 512, 00:26:48.898 "cluster_size": 4194304 00:26:48.898 }, 00:26:48.898 { 00:26:48.898 "uuid": "46022b08-c3a0-41f4-b6a2-173cd9d64584", 00:26:48.898 "name": "lvs_n_0", 00:26:48.898 "base_bdev": "73e84d6f-e1ad-4be5-b021-f4b780d3e637", 00:26:48.898 "total_data_clusters": 5114, 00:26:48.898 "free_clusters": 5114, 00:26:48.898 "block_size": 512, 00:26:48.898 "cluster_size": 4194304 00:26:48.898 } 00:26:48.898 ]' 00:26:48.898 23:18:52 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="46022b08-c3a0-41f4-b6a2-173cd9d64584") .free_clusters' 00:26:48.898 23:18:52 -- common/autotest_common.sh@1358 -- # fc=5114 00:26:48.898 23:18:52 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="46022b08-c3a0-41f4-b6a2-173cd9d64584") .cluster_size' 00:26:48.898 23:18:52 -- common/autotest_common.sh@1359 -- # cs=4194304 00:26:48.898 23:18:52 -- common/autotest_common.sh@1362 -- # free_mb=20456 00:26:48.898 23:18:52 -- common/autotest_common.sh@1363 -- # echo 20456 00:26:48.898 20456 00:26:48.898 23:18:52 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:26:48.898 23:18:52 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 46022b08-c3a0-41f4-b6a2-173cd9d64584 lbd_nest_0 20456 00:26:49.156 23:18:52 -- host/perf.sh@88 -- # lb_nested_guid=ed0ed4a1-7aff-4929-889d-7ea98da2a257 00:26:49.156 23:18:52 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:49.414 23:18:52 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:26:49.414 23:18:52 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 ed0ed4a1-7aff-4929-889d-7ea98da2a257 00:26:49.672 23:18:53 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:49.929 23:18:53 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:26:49.929 23:18:53 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:26:49.929 23:18:53 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:26:49.929 23:18:53 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:49.929 23:18:53 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:49.929 EAL: No free 2048 kB hugepages reported on node 1 00:27:02.115 Initializing NVMe Controllers 00:27:02.115 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:02.115 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:02.115 Initialization complete. Launching workers. 00:27:02.115 ======================================================== 00:27:02.115 Latency(us) 00:27:02.115 Device Information : IOPS MiB/s Average min max 00:27:02.115 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 44.69 0.02 22414.55 173.78 45876.61 00:27:02.115 ======================================================== 00:27:02.115 Total : 44.69 0.02 22414.55 173.78 45876.61 00:27:02.115 00:27:02.115 23:19:03 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:02.115 23:19:03 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:02.115 EAL: No free 2048 kB hugepages reported on node 1 00:27:12.079 Initializing NVMe Controllers 00:27:12.079 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:12.079 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:12.079 Initialization complete. Launching workers. 00:27:12.079 ======================================================== 00:27:12.079 Latency(us) 00:27:12.079 Device Information : IOPS MiB/s Average min max 00:27:12.079 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 82.80 10.35 12091.07 5024.59 47899.51 00:27:12.079 ======================================================== 00:27:12.079 Total : 82.80 10.35 12091.07 5024.59 47899.51 00:27:12.079 00:27:12.079 23:19:14 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:27:12.079 23:19:14 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:12.079 23:19:14 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:12.079 EAL: No free 2048 kB hugepages reported on node 1 00:27:22.039 Initializing NVMe Controllers 00:27:22.039 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:22.039 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:22.039 Initialization complete. Launching workers. 00:27:22.039 ======================================================== 00:27:22.039 Latency(us) 00:27:22.040 Device Information : IOPS MiB/s Average min max 00:27:22.040 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7868.60 3.84 4067.46 306.80 11704.44 00:27:22.040 ======================================================== 00:27:22.040 Total : 7868.60 3.84 4067.46 306.80 11704.44 00:27:22.040 00:27:22.040 23:19:24 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:22.040 23:19:24 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:22.040 EAL: No free 2048 kB hugepages reported on node 1 00:27:32.122 Initializing NVMe Controllers 00:27:32.122 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:32.122 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:32.122 Initialization complete. Launching workers. 00:27:32.122 ======================================================== 00:27:32.122 Latency(us) 00:27:32.122 Device Information : IOPS MiB/s Average min max 00:27:32.122 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 3565.59 445.70 8975.93 907.25 18498.84 00:27:32.122 ======================================================== 00:27:32.122 Total : 3565.59 445.70 8975.93 907.25 18498.84 00:27:32.122 00:27:32.122 23:19:34 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:27:32.122 23:19:34 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:32.122 23:19:34 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:32.122 EAL: No free 2048 kB hugepages reported on node 1 00:27:42.090 Initializing NVMe Controllers 00:27:42.090 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:42.090 Controller IO queue size 128, less than required. 00:27:42.090 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:42.091 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:42.091 Initialization complete. Launching workers. 00:27:42.091 ======================================================== 00:27:42.091 Latency(us) 00:27:42.091 Device Information : IOPS MiB/s Average min max 00:27:42.091 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 12048.44 5.88 10629.44 1851.91 52306.98 00:27:42.091 ======================================================== 00:27:42.091 Total : 12048.44 5.88 10629.44 1851.91 52306.98 00:27:42.091 00:27:42.091 23:19:45 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:42.091 23:19:45 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:42.091 EAL: No free 2048 kB hugepages reported on node 1 00:27:54.286 Initializing NVMe Controllers 00:27:54.286 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:54.286 Controller IO queue size 128, less than required. 00:27:54.286 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:54.286 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:54.286 Initialization complete. Launching workers. 00:27:54.286 ======================================================== 00:27:54.286 Latency(us) 00:27:54.286 Device Information : IOPS MiB/s Average min max 00:27:54.286 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1201.58 150.20 106902.63 15721.36 222826.98 00:27:54.286 ======================================================== 00:27:54.287 Total : 1201.58 150.20 106902.63 15721.36 222826.98 00:27:54.287 00:27:54.287 23:19:55 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:54.287 23:19:55 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete ed0ed4a1-7aff-4929-889d-7ea98da2a257 00:27:54.287 23:19:56 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:27:54.287 23:19:57 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 73e84d6f-e1ad-4be5-b021-f4b780d3e637 00:27:54.287 23:19:57 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:27:54.287 23:19:57 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:27:54.287 23:19:57 -- host/perf.sh@114 -- # nvmftestfini 00:27:54.287 23:19:57 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:54.287 23:19:57 -- nvmf/common.sh@116 -- # sync 00:27:54.287 23:19:57 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:54.287 23:19:57 -- nvmf/common.sh@119 -- # set +e 00:27:54.287 23:19:57 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:54.287 23:19:57 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:54.287 rmmod nvme_tcp 00:27:54.287 rmmod nvme_fabrics 00:27:54.287 rmmod nvme_keyring 00:27:54.287 23:19:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:54.287 23:19:57 -- nvmf/common.sh@123 -- # set -e 00:27:54.287 23:19:57 -- nvmf/common.sh@124 -- # return 0 00:27:54.287 23:19:57 -- nvmf/common.sh@477 -- # '[' -n 2539113 ']' 00:27:54.287 23:19:57 -- nvmf/common.sh@478 -- # killprocess 2539113 00:27:54.287 23:19:57 -- common/autotest_common.sh@936 -- # '[' -z 2539113 ']' 00:27:54.287 23:19:57 -- common/autotest_common.sh@940 -- # kill -0 2539113 00:27:54.287 23:19:57 -- common/autotest_common.sh@941 -- # uname 00:27:54.287 23:19:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:54.287 23:19:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2539113 00:27:54.287 23:19:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:54.287 23:19:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:54.287 23:19:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2539113' 00:27:54.287 killing process with pid 2539113 00:27:54.287 23:19:57 -- common/autotest_common.sh@955 -- # kill 2539113 00:27:54.287 23:19:57 -- common/autotest_common.sh@960 -- # wait 2539113 00:27:56.188 23:19:59 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:56.188 23:19:59 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:56.188 23:19:59 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:56.188 23:19:59 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:56.188 23:19:59 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:56.188 23:19:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:56.188 23:19:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:56.188 23:19:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:58.094 23:20:01 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:58.094 00:27:58.094 real 1m32.392s 00:27:58.094 user 5m40.490s 00:27:58.094 sys 0m15.536s 00:27:58.094 23:20:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:58.094 23:20:01 -- common/autotest_common.sh@10 -- # set +x 00:27:58.094 ************************************ 00:27:58.094 END TEST nvmf_perf 00:27:58.094 ************************************ 00:27:58.094 23:20:01 -- nvmf/nvmf.sh@99 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:27:58.094 23:20:01 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:58.094 23:20:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:58.094 23:20:01 -- common/autotest_common.sh@10 -- # set +x 00:27:58.094 ************************************ 00:27:58.094 START TEST nvmf_fio_host 00:27:58.094 ************************************ 00:27:58.094 23:20:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:27:58.094 * Looking for test storage... 00:27:58.094 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:58.094 23:20:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:58.094 23:20:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:58.094 23:20:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:58.094 23:20:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:58.094 23:20:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:58.094 23:20:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:58.094 23:20:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:58.094 23:20:01 -- scripts/common.sh@335 -- # IFS=.-: 00:27:58.094 23:20:01 -- scripts/common.sh@335 -- # read -ra ver1 00:27:58.094 23:20:01 -- scripts/common.sh@336 -- # IFS=.-: 00:27:58.094 23:20:01 -- scripts/common.sh@336 -- # read -ra ver2 00:27:58.094 23:20:01 -- scripts/common.sh@337 -- # local 'op=<' 00:27:58.094 23:20:01 -- scripts/common.sh@339 -- # ver1_l=2 00:27:58.094 23:20:01 -- scripts/common.sh@340 -- # ver2_l=1 00:27:58.094 23:20:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:58.094 23:20:01 -- scripts/common.sh@343 -- # case "$op" in 00:27:58.094 23:20:01 -- scripts/common.sh@344 -- # : 1 00:27:58.094 23:20:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:58.094 23:20:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:58.094 23:20:01 -- scripts/common.sh@364 -- # decimal 1 00:27:58.094 23:20:01 -- scripts/common.sh@352 -- # local d=1 00:27:58.094 23:20:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:58.094 23:20:01 -- scripts/common.sh@354 -- # echo 1 00:27:58.094 23:20:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:58.094 23:20:01 -- scripts/common.sh@365 -- # decimal 2 00:27:58.094 23:20:01 -- scripts/common.sh@352 -- # local d=2 00:27:58.094 23:20:01 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:58.094 23:20:01 -- scripts/common.sh@354 -- # echo 2 00:27:58.094 23:20:01 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:58.094 23:20:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:58.094 23:20:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:58.094 23:20:01 -- scripts/common.sh@367 -- # return 0 00:27:58.094 23:20:01 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:58.094 23:20:01 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:58.094 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:58.094 --rc genhtml_branch_coverage=1 00:27:58.094 --rc genhtml_function_coverage=1 00:27:58.094 --rc genhtml_legend=1 00:27:58.094 --rc geninfo_all_blocks=1 00:27:58.094 --rc geninfo_unexecuted_blocks=1 00:27:58.094 00:27:58.094 ' 00:27:58.094 23:20:01 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:58.094 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:58.094 --rc genhtml_branch_coverage=1 00:27:58.094 --rc genhtml_function_coverage=1 00:27:58.094 --rc genhtml_legend=1 00:27:58.094 --rc geninfo_all_blocks=1 00:27:58.094 --rc geninfo_unexecuted_blocks=1 00:27:58.094 00:27:58.094 ' 00:27:58.094 23:20:01 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:58.094 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:58.094 --rc genhtml_branch_coverage=1 00:27:58.094 --rc genhtml_function_coverage=1 00:27:58.094 --rc genhtml_legend=1 00:27:58.094 --rc geninfo_all_blocks=1 00:27:58.094 --rc geninfo_unexecuted_blocks=1 00:27:58.094 00:27:58.094 ' 00:27:58.094 23:20:01 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:58.094 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:58.094 --rc genhtml_branch_coverage=1 00:27:58.094 --rc genhtml_function_coverage=1 00:27:58.094 --rc genhtml_legend=1 00:27:58.095 --rc geninfo_all_blocks=1 00:27:58.095 --rc geninfo_unexecuted_blocks=1 00:27:58.095 00:27:58.095 ' 00:27:58.095 23:20:01 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:58.095 23:20:01 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:58.095 23:20:01 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:58.095 23:20:01 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:58.095 23:20:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:58.095 23:20:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:58.095 23:20:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:58.095 23:20:01 -- paths/export.sh@5 -- # export PATH 00:27:58.095 23:20:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:58.095 23:20:01 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:58.095 23:20:01 -- nvmf/common.sh@7 -- # uname -s 00:27:58.095 23:20:01 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:58.095 23:20:01 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:58.095 23:20:01 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:58.095 23:20:01 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:58.095 23:20:01 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:58.095 23:20:01 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:58.095 23:20:01 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:58.095 23:20:01 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:58.095 23:20:01 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:58.095 23:20:01 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:58.095 23:20:01 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:58.095 23:20:01 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:58.095 23:20:01 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:58.095 23:20:01 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:58.095 23:20:01 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:58.095 23:20:01 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:58.095 23:20:01 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:58.095 23:20:01 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:58.095 23:20:01 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:58.095 23:20:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:58.095 23:20:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:58.095 23:20:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:58.095 23:20:01 -- paths/export.sh@5 -- # export PATH 00:27:58.095 23:20:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:58.095 23:20:01 -- nvmf/common.sh@46 -- # : 0 00:27:58.095 23:20:01 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:58.095 23:20:01 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:58.095 23:20:01 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:58.095 23:20:01 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:58.095 23:20:01 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:58.095 23:20:01 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:58.095 23:20:01 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:58.095 23:20:01 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:58.095 23:20:01 -- host/fio.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:27:58.095 23:20:01 -- host/fio.sh@14 -- # nvmftestinit 00:27:58.095 23:20:01 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:58.095 23:20:01 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:58.095 23:20:01 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:58.095 23:20:01 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:58.095 23:20:01 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:58.095 23:20:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:58.095 23:20:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:58.095 23:20:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:58.095 23:20:01 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:58.095 23:20:01 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:58.095 23:20:01 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:58.095 23:20:01 -- common/autotest_common.sh@10 -- # set +x 00:27:59.996 23:20:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:59.996 23:20:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:59.996 23:20:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:59.996 23:20:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:59.996 23:20:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:59.996 23:20:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:59.996 23:20:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:59.996 23:20:03 -- nvmf/common.sh@294 -- # net_devs=() 00:27:59.996 23:20:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:59.996 23:20:03 -- nvmf/common.sh@295 -- # e810=() 00:27:59.996 23:20:03 -- nvmf/common.sh@295 -- # local -ga e810 00:27:59.996 23:20:03 -- nvmf/common.sh@296 -- # x722=() 00:27:59.996 23:20:03 -- nvmf/common.sh@296 -- # local -ga x722 00:27:59.996 23:20:03 -- nvmf/common.sh@297 -- # mlx=() 00:27:59.996 23:20:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:59.996 23:20:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:59.996 23:20:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:59.996 23:20:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:59.996 23:20:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:59.996 23:20:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:59.996 23:20:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:59.996 23:20:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:59.996 23:20:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:59.996 23:20:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:59.996 23:20:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:59.996 23:20:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:59.996 23:20:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:59.996 23:20:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:59.996 23:20:03 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:59.996 23:20:03 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:59.996 23:20:03 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:59.996 23:20:03 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:59.996 23:20:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:59.996 23:20:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:59.996 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:59.996 23:20:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:59.996 23:20:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:59.996 23:20:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:59.996 23:20:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:59.996 23:20:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:59.996 23:20:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:59.996 23:20:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:59.996 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:59.996 23:20:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:59.996 23:20:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:59.996 23:20:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:59.996 23:20:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:59.996 23:20:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:59.996 23:20:03 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:59.996 23:20:03 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:59.996 23:20:03 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:59.996 23:20:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:59.996 23:20:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:59.996 23:20:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:59.996 23:20:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:59.996 23:20:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:59.996 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:59.996 23:20:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:59.996 23:20:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:59.996 23:20:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:59.996 23:20:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:59.996 23:20:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:59.996 23:20:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:59.996 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:59.996 23:20:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:59.996 23:20:03 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:59.996 23:20:03 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:59.996 23:20:03 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:59.996 23:20:03 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:59.996 23:20:03 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:59.996 23:20:03 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:59.996 23:20:03 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:59.996 23:20:03 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:59.996 23:20:03 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:59.996 23:20:03 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:59.997 23:20:03 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:59.997 23:20:03 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:59.997 23:20:03 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:59.997 23:20:03 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:59.997 23:20:03 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:59.997 23:20:03 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:59.997 23:20:03 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:59.997 23:20:03 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:00.255 23:20:03 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:00.255 23:20:03 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:00.255 23:20:03 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:00.255 23:20:03 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:00.255 23:20:03 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:00.255 23:20:03 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:00.255 23:20:03 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:00.255 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:00.255 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.210 ms 00:28:00.255 00:28:00.255 --- 10.0.0.2 ping statistics --- 00:28:00.255 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:00.255 rtt min/avg/max/mdev = 0.210/0.210/0.210/0.000 ms 00:28:00.255 23:20:03 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:00.255 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:00.255 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.072 ms 00:28:00.255 00:28:00.256 --- 10.0.0.1 ping statistics --- 00:28:00.256 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:00.256 rtt min/avg/max/mdev = 0.072/0.072/0.072/0.000 ms 00:28:00.256 23:20:03 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:00.256 23:20:03 -- nvmf/common.sh@410 -- # return 0 00:28:00.256 23:20:03 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:00.256 23:20:03 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:00.256 23:20:03 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:00.256 23:20:03 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:00.256 23:20:03 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:00.256 23:20:03 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:00.256 23:20:03 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:00.256 23:20:03 -- host/fio.sh@16 -- # [[ y != y ]] 00:28:00.256 23:20:03 -- host/fio.sh@21 -- # timing_enter start_nvmf_tgt 00:28:00.256 23:20:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:00.256 23:20:03 -- common/autotest_common.sh@10 -- # set +x 00:28:00.256 23:20:03 -- host/fio.sh@24 -- # nvmfpid=2551560 00:28:00.256 23:20:03 -- host/fio.sh@23 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:28:00.256 23:20:03 -- host/fio.sh@26 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:00.256 23:20:03 -- host/fio.sh@28 -- # waitforlisten 2551560 00:28:00.256 23:20:03 -- common/autotest_common.sh@829 -- # '[' -z 2551560 ']' 00:28:00.256 23:20:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:00.256 23:20:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:00.256 23:20:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:00.256 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:00.256 23:20:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:00.256 23:20:03 -- common/autotest_common.sh@10 -- # set +x 00:28:00.256 [2024-11-28 23:20:03.765617] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:00.256 [2024-11-28 23:20:03.765715] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:00.256 EAL: No free 2048 kB hugepages reported on node 1 00:28:00.256 [2024-11-28 23:20:03.837512] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:28:00.514 [2024-11-28 23:20:03.929836] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:00.514 [2024-11-28 23:20:03.929997] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:00.514 [2024-11-28 23:20:03.930017] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:00.514 [2024-11-28 23:20:03.930031] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:00.514 [2024-11-28 23:20:03.930085] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:00.514 [2024-11-28 23:20:03.930613] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:28:00.514 [2024-11-28 23:20:03.930637] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:28:00.514 [2024-11-28 23:20:03.930640] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:01.448 23:20:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:01.448 23:20:04 -- common/autotest_common.sh@862 -- # return 0 00:28:01.448 23:20:04 -- host/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:28:01.448 [2024-11-28 23:20:04.997878] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:01.448 23:20:05 -- host/fio.sh@30 -- # timing_exit start_nvmf_tgt 00:28:01.448 23:20:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:01.448 23:20:05 -- common/autotest_common.sh@10 -- # set +x 00:28:01.448 23:20:05 -- host/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:28:01.714 Malloc1 00:28:01.971 23:20:05 -- host/fio.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:28:01.971 23:20:05 -- host/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:28:02.228 23:20:05 -- host/fio.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:02.510 [2024-11-28 23:20:06.047955] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:02.510 23:20:06 -- host/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:28:02.768 23:20:06 -- host/fio.sh@38 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:28:02.768 23:20:06 -- host/fio.sh@41 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:02.768 23:20:06 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:02.768 23:20:06 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:02.768 23:20:06 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:02.768 23:20:06 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:02.768 23:20:06 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:02.768 23:20:06 -- common/autotest_common.sh@1330 -- # shift 00:28:02.768 23:20:06 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:02.768 23:20:06 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:02.768 23:20:06 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:02.768 23:20:06 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:02.768 23:20:06 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:02.768 23:20:06 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:02.768 23:20:06 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:02.768 23:20:06 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:02.768 23:20:06 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:02.768 23:20:06 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:02.768 23:20:06 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:02.768 23:20:06 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:02.768 23:20:06 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:02.768 23:20:06 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:28:02.768 23:20:06 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:03.025 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:28:03.025 fio-3.35 00:28:03.025 Starting 1 thread 00:28:03.025 EAL: No free 2048 kB hugepages reported on node 1 00:28:05.553 00:28:05.553 test: (groupid=0, jobs=1): err= 0: pid=2552060: Thu Nov 28 23:20:08 2024 00:28:05.553 read: IOPS=9350, BW=36.5MiB/s (38.3MB/s)(74.8MiB/2048msec) 00:28:05.553 slat (nsec): min=1860, max=112961, avg=2417.92, stdev=1401.58 00:28:05.553 clat (usec): min=2243, max=54421, avg=7528.41, stdev=2676.33 00:28:05.553 lat (usec): min=2265, max=54423, avg=7530.82, stdev=2676.32 00:28:05.553 clat percentiles (usec): 00:28:05.553 | 1.00th=[ 6063], 5.00th=[ 6456], 10.00th=[ 6718], 20.00th=[ 6915], 00:28:05.553 | 30.00th=[ 7111], 40.00th=[ 7242], 50.00th=[ 7373], 60.00th=[ 7504], 00:28:05.553 | 70.00th=[ 7635], 80.00th=[ 7832], 90.00th=[ 8029], 95.00th=[ 8291], 00:28:05.553 | 99.00th=[ 8717], 99.50th=[ 8979], 99.90th=[52167], 99.95th=[54264], 00:28:05.553 | 99.99th=[54264] 00:28:05.553 bw ( KiB/s): min=37080, max=38584, per=100.00%, avg=38162.00, stdev=722.70, samples=4 00:28:05.553 iops : min= 9270, max= 9646, avg=9540.50, stdev=180.68, samples=4 00:28:05.553 write: IOPS=9361, BW=36.6MiB/s (38.3MB/s)(74.9MiB/2048msec); 0 zone resets 00:28:05.553 slat (nsec): min=1927, max=89674, avg=2501.61, stdev=1127.68 00:28:05.553 clat (usec): min=973, max=52641, avg=6098.89, stdev=2476.05 00:28:05.553 lat (usec): min=979, max=52644, avg=6101.39, stdev=2476.03 00:28:05.553 clat percentiles (usec): 00:28:05.553 | 1.00th=[ 4883], 5.00th=[ 5211], 10.00th=[ 5407], 20.00th=[ 5604], 00:28:05.553 | 30.00th=[ 5735], 40.00th=[ 5866], 50.00th=[ 5997], 60.00th=[ 6063], 00:28:05.553 | 70.00th=[ 6194], 80.00th=[ 6325], 90.00th=[ 6521], 95.00th=[ 6718], 00:28:05.553 | 99.00th=[ 7046], 99.50th=[ 7242], 99.90th=[51119], 99.95th=[52167], 00:28:05.553 | 99.99th=[52691] 00:28:05.553 bw ( KiB/s): min=37792, max=38720, per=100.00%, avg=38228.00, stdev=465.08, samples=4 00:28:05.553 iops : min= 9448, max= 9680, avg=9557.00, stdev=116.27, samples=4 00:28:05.553 lat (usec) : 1000=0.01% 00:28:05.553 lat (msec) : 2=0.02%, 4=0.11%, 10=99.54%, 50=0.13%, 100=0.20% 00:28:05.553 cpu : usr=63.56%, sys=34.39%, ctx=84, majf=0, minf=41 00:28:05.553 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:28:05.553 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:05.553 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:28:05.553 issued rwts: total=19150,19172,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:05.553 latency : target=0, window=0, percentile=100.00%, depth=128 00:28:05.553 00:28:05.553 Run status group 0 (all jobs): 00:28:05.553 READ: bw=36.5MiB/s (38.3MB/s), 36.5MiB/s-36.5MiB/s (38.3MB/s-38.3MB/s), io=74.8MiB (78.4MB), run=2048-2048msec 00:28:05.553 WRITE: bw=36.6MiB/s (38.3MB/s), 36.6MiB/s-36.6MiB/s (38.3MB/s-38.3MB/s), io=74.9MiB (78.5MB), run=2048-2048msec 00:28:05.553 23:20:08 -- host/fio.sh@45 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:28:05.553 23:20:08 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:28:05.553 23:20:08 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:05.553 23:20:08 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:05.553 23:20:08 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:05.553 23:20:08 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:05.553 23:20:08 -- common/autotest_common.sh@1330 -- # shift 00:28:05.553 23:20:08 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:05.553 23:20:08 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:05.553 23:20:08 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:05.553 23:20:08 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:05.553 23:20:08 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:05.553 23:20:08 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:05.553 23:20:08 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:05.553 23:20:08 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:05.553 23:20:08 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:05.553 23:20:08 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:05.553 23:20:08 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:05.553 23:20:09 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:05.553 23:20:09 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:05.553 23:20:09 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:28:05.553 23:20:09 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:28:05.810 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:28:05.810 fio-3.35 00:28:05.810 Starting 1 thread 00:28:05.810 EAL: No free 2048 kB hugepages reported on node 1 00:28:08.338 00:28:08.338 test: (groupid=0, jobs=1): err= 0: pid=2552466: Thu Nov 28 23:20:11 2024 00:28:08.338 read: IOPS=7738, BW=121MiB/s (127MB/s)(243MiB/2010msec) 00:28:08.338 slat (usec): min=2, max=107, avg= 3.75, stdev= 2.11 00:28:08.338 clat (usec): min=2732, max=19593, avg=9285.19, stdev=2121.18 00:28:08.338 lat (usec): min=2736, max=19597, avg=9288.94, stdev=2121.23 00:28:08.338 clat percentiles (usec): 00:28:08.338 | 1.00th=[ 4686], 5.00th=[ 5800], 10.00th=[ 6652], 20.00th=[ 7570], 00:28:08.338 | 30.00th=[ 8291], 40.00th=[ 8979], 50.00th=[ 9372], 60.00th=[ 9634], 00:28:08.338 | 70.00th=[10028], 80.00th=[10683], 90.00th=[11863], 95.00th=[13042], 00:28:08.338 | 99.00th=[15401], 99.50th=[16057], 99.90th=[16909], 99.95th=[17171], 00:28:08.338 | 99.99th=[19530] 00:28:08.338 bw ( KiB/s): min=51104, max=72256, per=50.74%, avg=62824.00, stdev=8794.95, samples=4 00:28:08.338 iops : min= 3194, max= 4516, avg=3926.50, stdev=549.68, samples=4 00:28:08.338 write: IOPS=4578, BW=71.5MiB/s (75.0MB/s)(128MiB/1794msec); 0 zone resets 00:28:08.338 slat (usec): min=30, max=189, avg=34.41, stdev= 6.41 00:28:08.338 clat (usec): min=6767, max=26469, avg=12712.59, stdev=2736.40 00:28:08.338 lat (usec): min=6799, max=26503, avg=12747.00, stdev=2736.71 00:28:08.338 clat percentiles (usec): 00:28:08.338 | 1.00th=[ 7504], 5.00th=[ 8455], 10.00th=[ 9110], 20.00th=[10159], 00:28:08.338 | 30.00th=[10945], 40.00th=[11731], 50.00th=[12649], 60.00th=[13566], 00:28:08.338 | 70.00th=[14484], 80.00th=[15270], 90.00th=[16188], 95.00th=[16909], 00:28:08.338 | 99.00th=[18744], 99.50th=[19268], 99.90th=[24249], 99.95th=[25297], 00:28:08.338 | 99.99th=[26346] 00:28:08.338 bw ( KiB/s): min=53024, max=74784, per=89.00%, avg=65200.00, stdev=9042.69, samples=4 00:28:08.338 iops : min= 3314, max= 4674, avg=4075.00, stdev=565.17, samples=4 00:28:08.339 lat (msec) : 4=0.19%, 10=51.31%, 20=48.37%, 50=0.13% 00:28:08.339 cpu : usr=72.42%, sys=26.03%, ctx=45, majf=0, minf=75 00:28:08.339 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:28:08.339 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:08.339 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:28:08.339 issued rwts: total=15555,8214,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:08.339 latency : target=0, window=0, percentile=100.00%, depth=128 00:28:08.339 00:28:08.339 Run status group 0 (all jobs): 00:28:08.339 READ: bw=121MiB/s (127MB/s), 121MiB/s-121MiB/s (127MB/s-127MB/s), io=243MiB (255MB), run=2010-2010msec 00:28:08.339 WRITE: bw=71.5MiB/s (75.0MB/s), 71.5MiB/s-71.5MiB/s (75.0MB/s-75.0MB/s), io=128MiB (135MB), run=1794-1794msec 00:28:08.339 23:20:11 -- host/fio.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:08.596 23:20:11 -- host/fio.sh@49 -- # '[' 1 -eq 1 ']' 00:28:08.596 23:20:11 -- host/fio.sh@51 -- # bdfs=($(get_nvme_bdfs)) 00:28:08.596 23:20:11 -- host/fio.sh@51 -- # get_nvme_bdfs 00:28:08.596 23:20:11 -- common/autotest_common.sh@1508 -- # bdfs=() 00:28:08.596 23:20:11 -- common/autotest_common.sh@1508 -- # local bdfs 00:28:08.596 23:20:11 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:28:08.596 23:20:11 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:28:08.596 23:20:11 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:28:08.596 23:20:12 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:28:08.596 23:20:12 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:28:08.596 23:20:12 -- host/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 -i 10.0.0.2 00:28:11.875 Nvme0n1 00:28:11.875 23:20:15 -- host/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:28:15.155 23:20:18 -- host/fio.sh@53 -- # ls_guid=38987a77-5f6c-4d0a-9465-bf84bc7610bd 00:28:15.155 23:20:18 -- host/fio.sh@54 -- # get_lvs_free_mb 38987a77-5f6c-4d0a-9465-bf84bc7610bd 00:28:15.155 23:20:18 -- common/autotest_common.sh@1353 -- # local lvs_uuid=38987a77-5f6c-4d0a-9465-bf84bc7610bd 00:28:15.155 23:20:18 -- common/autotest_common.sh@1354 -- # local lvs_info 00:28:15.155 23:20:18 -- common/autotest_common.sh@1355 -- # local fc 00:28:15.155 23:20:18 -- common/autotest_common.sh@1356 -- # local cs 00:28:15.155 23:20:18 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:28:15.155 23:20:18 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:28:15.155 { 00:28:15.155 "uuid": "38987a77-5f6c-4d0a-9465-bf84bc7610bd", 00:28:15.155 "name": "lvs_0", 00:28:15.155 "base_bdev": "Nvme0n1", 00:28:15.155 "total_data_clusters": 930, 00:28:15.155 "free_clusters": 930, 00:28:15.155 "block_size": 512, 00:28:15.155 "cluster_size": 1073741824 00:28:15.155 } 00:28:15.155 ]' 00:28:15.155 23:20:18 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="38987a77-5f6c-4d0a-9465-bf84bc7610bd") .free_clusters' 00:28:15.155 23:20:18 -- common/autotest_common.sh@1358 -- # fc=930 00:28:15.155 23:20:18 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="38987a77-5f6c-4d0a-9465-bf84bc7610bd") .cluster_size' 00:28:15.155 23:20:18 -- common/autotest_common.sh@1359 -- # cs=1073741824 00:28:15.155 23:20:18 -- common/autotest_common.sh@1362 -- # free_mb=952320 00:28:15.155 23:20:18 -- common/autotest_common.sh@1363 -- # echo 952320 00:28:15.155 952320 00:28:15.155 23:20:18 -- host/fio.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_0 lbd_0 952320 00:28:15.413 7253f42e-53c3-4339-9c15-e330fee0b005 00:28:15.413 23:20:18 -- host/fio.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:28:15.671 23:20:19 -- host/fio.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:28:15.929 23:20:19 -- host/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:28:16.187 23:20:19 -- host/fio.sh@59 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:16.187 23:20:19 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:16.187 23:20:19 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:16.187 23:20:19 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:16.187 23:20:19 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:16.187 23:20:19 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:16.187 23:20:19 -- common/autotest_common.sh@1330 -- # shift 00:28:16.187 23:20:19 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:16.187 23:20:19 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:16.187 23:20:19 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:16.187 23:20:19 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:16.187 23:20:19 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:16.187 23:20:19 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:16.187 23:20:19 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:16.187 23:20:19 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:16.187 23:20:19 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:16.187 23:20:19 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:16.187 23:20:19 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:16.187 23:20:19 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:16.187 23:20:19 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:16.187 23:20:19 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:28:16.187 23:20:19 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:16.187 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:28:16.187 fio-3.35 00:28:16.187 Starting 1 thread 00:28:16.445 EAL: No free 2048 kB hugepages reported on node 1 00:28:18.974 00:28:18.974 test: (groupid=0, jobs=1): err= 0: pid=2553841: Thu Nov 28 23:20:22 2024 00:28:18.974 read: IOPS=5915, BW=23.1MiB/s (24.2MB/s)(46.4MiB/2008msec) 00:28:18.974 slat (nsec): min=1903, max=173542, avg=2798.63, stdev=2803.28 00:28:18.974 clat (usec): min=1285, max=170945, avg=11867.86, stdev=11671.58 00:28:18.974 lat (usec): min=1287, max=170978, avg=11870.66, stdev=11671.92 00:28:18.974 clat percentiles (msec): 00:28:18.974 | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 10], 20.00th=[ 11], 00:28:18.974 | 30.00th=[ 11], 40.00th=[ 11], 50.00th=[ 11], 60.00th=[ 12], 00:28:18.974 | 70.00th=[ 12], 80.00th=[ 12], 90.00th=[ 13], 95.00th=[ 13], 00:28:18.974 | 99.00th=[ 14], 99.50th=[ 157], 99.90th=[ 171], 99.95th=[ 171], 00:28:18.974 | 99.99th=[ 171] 00:28:18.974 bw ( KiB/s): min=16912, max=25984, per=99.86%, avg=23630.00, stdev=4480.86, samples=4 00:28:18.974 iops : min= 4228, max= 6496, avg=5907.50, stdev=1120.21, samples=4 00:28:18.974 write: IOPS=5914, BW=23.1MiB/s (24.2MB/s)(46.4MiB/2008msec); 0 zone resets 00:28:18.974 slat (nsec): min=1956, max=146420, avg=2840.04, stdev=2101.63 00:28:18.974 clat (usec): min=296, max=169126, avg=9665.55, stdev=10962.25 00:28:18.974 lat (usec): min=299, max=169133, avg=9668.39, stdev=10962.58 00:28:18.974 clat percentiles (msec): 00:28:18.974 | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9], 00:28:18.974 | 30.00th=[ 9], 40.00th=[ 9], 50.00th=[ 9], 60.00th=[ 10], 00:28:18.974 | 70.00th=[ 10], 80.00th=[ 10], 90.00th=[ 10], 95.00th=[ 11], 00:28:18.974 | 99.00th=[ 11], 99.50th=[ 17], 99.90th=[ 169], 99.95th=[ 169], 00:28:18.974 | 99.99th=[ 169] 00:28:18.974 bw ( KiB/s): min=17896, max=25664, per=99.87%, avg=23626.00, stdev=3822.50, samples=4 00:28:18.974 iops : min= 4474, max= 6416, avg=5906.50, stdev=955.63, samples=4 00:28:18.974 lat (usec) : 500=0.01%, 750=0.01% 00:28:18.974 lat (msec) : 2=0.03%, 4=0.14%, 10=52.42%, 20=46.85%, 250=0.54% 00:28:18.974 cpu : usr=55.95%, sys=42.40%, ctx=88, majf=0, minf=41 00:28:18.974 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:28:18.974 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:18.974 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:28:18.974 issued rwts: total=11879,11876,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:18.974 latency : target=0, window=0, percentile=100.00%, depth=128 00:28:18.974 00:28:18.974 Run status group 0 (all jobs): 00:28:18.974 READ: bw=23.1MiB/s (24.2MB/s), 23.1MiB/s-23.1MiB/s (24.2MB/s-24.2MB/s), io=46.4MiB (48.7MB), run=2008-2008msec 00:28:18.974 WRITE: bw=23.1MiB/s (24.2MB/s), 23.1MiB/s-23.1MiB/s (24.2MB/s-24.2MB/s), io=46.4MiB (48.6MB), run=2008-2008msec 00:28:18.974 23:20:22 -- host/fio.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:28:18.974 23:20:22 -- host/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:28:20.366 23:20:23 -- host/fio.sh@64 -- # ls_nested_guid=ff40757c-19d2-4d40-ba39-f1407a383e27 00:28:20.366 23:20:23 -- host/fio.sh@65 -- # get_lvs_free_mb ff40757c-19d2-4d40-ba39-f1407a383e27 00:28:20.366 23:20:23 -- common/autotest_common.sh@1353 -- # local lvs_uuid=ff40757c-19d2-4d40-ba39-f1407a383e27 00:28:20.366 23:20:23 -- common/autotest_common.sh@1354 -- # local lvs_info 00:28:20.366 23:20:23 -- common/autotest_common.sh@1355 -- # local fc 00:28:20.366 23:20:23 -- common/autotest_common.sh@1356 -- # local cs 00:28:20.366 23:20:23 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:28:20.366 23:20:23 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:28:20.366 { 00:28:20.366 "uuid": "38987a77-5f6c-4d0a-9465-bf84bc7610bd", 00:28:20.366 "name": "lvs_0", 00:28:20.366 "base_bdev": "Nvme0n1", 00:28:20.366 "total_data_clusters": 930, 00:28:20.366 "free_clusters": 0, 00:28:20.366 "block_size": 512, 00:28:20.366 "cluster_size": 1073741824 00:28:20.366 }, 00:28:20.366 { 00:28:20.366 "uuid": "ff40757c-19d2-4d40-ba39-f1407a383e27", 00:28:20.366 "name": "lvs_n_0", 00:28:20.366 "base_bdev": "7253f42e-53c3-4339-9c15-e330fee0b005", 00:28:20.366 "total_data_clusters": 237847, 00:28:20.366 "free_clusters": 237847, 00:28:20.366 "block_size": 512, 00:28:20.366 "cluster_size": 4194304 00:28:20.366 } 00:28:20.366 ]' 00:28:20.366 23:20:23 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="ff40757c-19d2-4d40-ba39-f1407a383e27") .free_clusters' 00:28:20.366 23:20:23 -- common/autotest_common.sh@1358 -- # fc=237847 00:28:20.366 23:20:23 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="ff40757c-19d2-4d40-ba39-f1407a383e27") .cluster_size' 00:28:20.366 23:20:23 -- common/autotest_common.sh@1359 -- # cs=4194304 00:28:20.366 23:20:23 -- common/autotest_common.sh@1362 -- # free_mb=951388 00:28:20.366 23:20:23 -- common/autotest_common.sh@1363 -- # echo 951388 00:28:20.366 951388 00:28:20.366 23:20:23 -- host/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_n_0 lbd_nest_0 951388 00:28:21.294 8d5fb061-56f0-409b-a388-dd01bc0d20b9 00:28:21.294 23:20:24 -- host/fio.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:28:21.294 23:20:24 -- host/fio.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:28:21.552 23:20:25 -- host/fio.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:28:21.817 23:20:25 -- host/fio.sh@70 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:21.817 23:20:25 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:21.817 23:20:25 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:21.817 23:20:25 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:21.817 23:20:25 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:21.817 23:20:25 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:21.817 23:20:25 -- common/autotest_common.sh@1330 -- # shift 00:28:21.817 23:20:25 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:21.817 23:20:25 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:21.817 23:20:25 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:21.817 23:20:25 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:21.817 23:20:25 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:21.817 23:20:25 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:21.817 23:20:25 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:21.817 23:20:25 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:21.817 23:20:25 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:21.817 23:20:25 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:21.817 23:20:25 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:21.817 23:20:25 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:21.817 23:20:25 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:21.817 23:20:25 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:28:21.817 23:20:25 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:22.076 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:28:22.076 fio-3.35 00:28:22.076 Starting 1 thread 00:28:22.076 EAL: No free 2048 kB hugepages reported on node 1 00:28:24.632 00:28:24.632 test: (groupid=0, jobs=1): err= 0: pid=2554597: Thu Nov 28 23:20:27 2024 00:28:24.632 read: IOPS=6114, BW=23.9MiB/s (25.0MB/s)(48.0MiB/2009msec) 00:28:24.632 slat (nsec): min=1998, max=251894, avg=2669.27, stdev=3210.44 00:28:24.632 clat (usec): min=4652, max=17940, avg=11543.32, stdev=1003.50 00:28:24.632 lat (usec): min=4668, max=17942, avg=11545.99, stdev=1003.32 00:28:24.632 clat percentiles (usec): 00:28:24.632 | 1.00th=[ 9110], 5.00th=[ 9896], 10.00th=[10290], 20.00th=[10814], 00:28:24.632 | 30.00th=[11076], 40.00th=[11338], 50.00th=[11600], 60.00th=[11731], 00:28:24.632 | 70.00th=[11994], 80.00th=[12387], 90.00th=[12780], 95.00th=[13042], 00:28:24.632 | 99.00th=[13698], 99.50th=[13960], 99.90th=[16581], 99.95th=[17695], 00:28:24.632 | 99.99th=[17957] 00:28:24.632 bw ( KiB/s): min=23176, max=24992, per=99.92%, avg=24438.00, stdev=856.62, samples=4 00:28:24.632 iops : min= 5794, max= 6248, avg=6109.50, stdev=214.15, samples=4 00:28:24.632 write: IOPS=6096, BW=23.8MiB/s (25.0MB/s)(47.8MiB/2009msec); 0 zone resets 00:28:24.632 slat (usec): min=2, max=195, avg= 2.74, stdev= 2.36 00:28:24.632 clat (usec): min=2310, max=16735, avg=9276.75, stdev=866.57 00:28:24.632 lat (usec): min=2322, max=16737, avg=9279.49, stdev=866.51 00:28:24.632 clat percentiles (usec): 00:28:24.632 | 1.00th=[ 7308], 5.00th=[ 7963], 10.00th=[ 8225], 20.00th=[ 8586], 00:28:24.632 | 30.00th=[ 8848], 40.00th=[ 9110], 50.00th=[ 9241], 60.00th=[ 9503], 00:28:24.632 | 70.00th=[ 9634], 80.00th=[ 9896], 90.00th=[10290], 95.00th=[10552], 00:28:24.632 | 99.00th=[11207], 99.50th=[11338], 99.90th=[15664], 99.95th=[16450], 00:28:24.632 | 99.99th=[16712] 00:28:24.632 bw ( KiB/s): min=24160, max=24512, per=99.94%, avg=24372.00, stdev=172.02, samples=4 00:28:24.633 iops : min= 6040, max= 6128, avg=6093.00, stdev=43.00, samples=4 00:28:24.633 lat (msec) : 4=0.04%, 10=43.92%, 20=56.04% 00:28:24.633 cpu : usr=61.40%, sys=36.95%, ctx=78, majf=0, minf=41 00:28:24.633 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:28:24.633 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:24.633 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:28:24.633 issued rwts: total=12284,12248,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:24.633 latency : target=0, window=0, percentile=100.00%, depth=128 00:28:24.633 00:28:24.633 Run status group 0 (all jobs): 00:28:24.633 READ: bw=23.9MiB/s (25.0MB/s), 23.9MiB/s-23.9MiB/s (25.0MB/s-25.0MB/s), io=48.0MiB (50.3MB), run=2009-2009msec 00:28:24.633 WRITE: bw=23.8MiB/s (25.0MB/s), 23.8MiB/s-23.8MiB/s (25.0MB/s-25.0MB/s), io=47.8MiB (50.2MB), run=2009-2009msec 00:28:24.633 23:20:27 -- host/fio.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:28:24.890 23:20:28 -- host/fio.sh@74 -- # sync 00:28:24.890 23:20:28 -- host/fio.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -t 120 bdev_lvol_delete lvs_n_0/lbd_nest_0 00:28:29.082 23:20:32 -- host/fio.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:28:29.082 23:20:32 -- host/fio.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete lvs_0/lbd_0 00:28:31.610 23:20:35 -- host/fio.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:28:31.868 23:20:35 -- host/fio.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_detach_controller Nvme0 00:28:34.396 23:20:37 -- host/fio.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:28:34.396 23:20:37 -- host/fio.sh@85 -- # rm -f ./local-test-0-verify.state 00:28:34.396 23:20:37 -- host/fio.sh@86 -- # nvmftestfini 00:28:34.396 23:20:37 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:34.396 23:20:37 -- nvmf/common.sh@116 -- # sync 00:28:34.396 23:20:37 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:34.396 23:20:37 -- nvmf/common.sh@119 -- # set +e 00:28:34.396 23:20:37 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:34.396 23:20:37 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:34.396 rmmod nvme_tcp 00:28:34.396 rmmod nvme_fabrics 00:28:34.396 rmmod nvme_keyring 00:28:34.396 23:20:37 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:34.396 23:20:37 -- nvmf/common.sh@123 -- # set -e 00:28:34.396 23:20:37 -- nvmf/common.sh@124 -- # return 0 00:28:34.396 23:20:37 -- nvmf/common.sh@477 -- # '[' -n 2551560 ']' 00:28:34.396 23:20:37 -- nvmf/common.sh@478 -- # killprocess 2551560 00:28:34.396 23:20:37 -- common/autotest_common.sh@936 -- # '[' -z 2551560 ']' 00:28:34.396 23:20:37 -- common/autotest_common.sh@940 -- # kill -0 2551560 00:28:34.396 23:20:37 -- common/autotest_common.sh@941 -- # uname 00:28:34.396 23:20:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:34.396 23:20:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2551560 00:28:34.396 23:20:37 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:34.396 23:20:37 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:34.396 23:20:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2551560' 00:28:34.396 killing process with pid 2551560 00:28:34.396 23:20:37 -- common/autotest_common.sh@955 -- # kill 2551560 00:28:34.396 23:20:37 -- common/autotest_common.sh@960 -- # wait 2551560 00:28:34.396 23:20:37 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:34.396 23:20:37 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:34.396 23:20:37 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:34.396 23:20:37 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:34.396 23:20:37 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:34.396 23:20:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:34.396 23:20:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:34.396 23:20:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:36.301 23:20:39 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:36.302 00:28:36.302 real 0m38.366s 00:28:36.302 user 2m27.303s 00:28:36.302 sys 0m7.293s 00:28:36.302 23:20:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:36.302 23:20:39 -- common/autotest_common.sh@10 -- # set +x 00:28:36.302 ************************************ 00:28:36.302 END TEST nvmf_fio_host 00:28:36.302 ************************************ 00:28:36.302 23:20:39 -- nvmf/nvmf.sh@100 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:28:36.302 23:20:39 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:36.302 23:20:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:36.302 23:20:39 -- common/autotest_common.sh@10 -- # set +x 00:28:36.302 ************************************ 00:28:36.302 START TEST nvmf_failover 00:28:36.302 ************************************ 00:28:36.302 23:20:39 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:28:36.302 * Looking for test storage... 00:28:36.302 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:28:36.302 23:20:39 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:36.302 23:20:39 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:36.302 23:20:39 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:36.561 23:20:39 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:36.561 23:20:39 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:36.561 23:20:39 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:36.561 23:20:39 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:36.561 23:20:39 -- scripts/common.sh@335 -- # IFS=.-: 00:28:36.561 23:20:39 -- scripts/common.sh@335 -- # read -ra ver1 00:28:36.561 23:20:39 -- scripts/common.sh@336 -- # IFS=.-: 00:28:36.561 23:20:39 -- scripts/common.sh@336 -- # read -ra ver2 00:28:36.561 23:20:39 -- scripts/common.sh@337 -- # local 'op=<' 00:28:36.561 23:20:39 -- scripts/common.sh@339 -- # ver1_l=2 00:28:36.561 23:20:39 -- scripts/common.sh@340 -- # ver2_l=1 00:28:36.561 23:20:39 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:36.561 23:20:39 -- scripts/common.sh@343 -- # case "$op" in 00:28:36.561 23:20:39 -- scripts/common.sh@344 -- # : 1 00:28:36.561 23:20:39 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:36.561 23:20:39 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:36.561 23:20:39 -- scripts/common.sh@364 -- # decimal 1 00:28:36.561 23:20:39 -- scripts/common.sh@352 -- # local d=1 00:28:36.561 23:20:39 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:36.561 23:20:39 -- scripts/common.sh@354 -- # echo 1 00:28:36.561 23:20:39 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:36.561 23:20:39 -- scripts/common.sh@365 -- # decimal 2 00:28:36.561 23:20:39 -- scripts/common.sh@352 -- # local d=2 00:28:36.561 23:20:39 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:36.561 23:20:39 -- scripts/common.sh@354 -- # echo 2 00:28:36.561 23:20:39 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:36.561 23:20:39 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:36.561 23:20:39 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:36.561 23:20:39 -- scripts/common.sh@367 -- # return 0 00:28:36.561 23:20:39 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:36.561 23:20:39 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:36.561 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:36.561 --rc genhtml_branch_coverage=1 00:28:36.561 --rc genhtml_function_coverage=1 00:28:36.561 --rc genhtml_legend=1 00:28:36.561 --rc geninfo_all_blocks=1 00:28:36.561 --rc geninfo_unexecuted_blocks=1 00:28:36.561 00:28:36.561 ' 00:28:36.561 23:20:39 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:36.561 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:36.561 --rc genhtml_branch_coverage=1 00:28:36.561 --rc genhtml_function_coverage=1 00:28:36.561 --rc genhtml_legend=1 00:28:36.561 --rc geninfo_all_blocks=1 00:28:36.561 --rc geninfo_unexecuted_blocks=1 00:28:36.561 00:28:36.561 ' 00:28:36.561 23:20:39 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:36.561 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:36.561 --rc genhtml_branch_coverage=1 00:28:36.561 --rc genhtml_function_coverage=1 00:28:36.561 --rc genhtml_legend=1 00:28:36.561 --rc geninfo_all_blocks=1 00:28:36.561 --rc geninfo_unexecuted_blocks=1 00:28:36.561 00:28:36.561 ' 00:28:36.561 23:20:39 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:36.561 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:36.561 --rc genhtml_branch_coverage=1 00:28:36.561 --rc genhtml_function_coverage=1 00:28:36.561 --rc genhtml_legend=1 00:28:36.561 --rc geninfo_all_blocks=1 00:28:36.561 --rc geninfo_unexecuted_blocks=1 00:28:36.561 00:28:36.561 ' 00:28:36.561 23:20:39 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:36.561 23:20:39 -- nvmf/common.sh@7 -- # uname -s 00:28:36.561 23:20:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:36.561 23:20:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:36.561 23:20:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:36.562 23:20:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:36.562 23:20:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:36.562 23:20:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:36.562 23:20:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:36.562 23:20:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:36.562 23:20:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:36.562 23:20:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:36.562 23:20:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:36.562 23:20:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:36.562 23:20:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:36.562 23:20:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:36.562 23:20:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:36.562 23:20:39 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:36.562 23:20:39 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:36.562 23:20:39 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:36.562 23:20:39 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:36.562 23:20:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:36.562 23:20:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:36.562 23:20:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:36.562 23:20:39 -- paths/export.sh@5 -- # export PATH 00:28:36.562 23:20:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:36.562 23:20:39 -- nvmf/common.sh@46 -- # : 0 00:28:36.562 23:20:39 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:36.562 23:20:39 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:36.562 23:20:39 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:36.562 23:20:39 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:36.562 23:20:39 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:36.562 23:20:39 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:36.562 23:20:39 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:36.562 23:20:39 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:36.562 23:20:39 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:28:36.562 23:20:39 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:28:36.562 23:20:39 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:28:36.562 23:20:39 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:28:36.562 23:20:39 -- host/failover.sh@18 -- # nvmftestinit 00:28:36.562 23:20:39 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:36.562 23:20:39 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:36.562 23:20:39 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:36.562 23:20:39 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:36.562 23:20:39 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:36.562 23:20:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:36.562 23:20:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:36.562 23:20:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:36.562 23:20:39 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:36.562 23:20:39 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:36.562 23:20:39 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:36.562 23:20:39 -- common/autotest_common.sh@10 -- # set +x 00:28:38.465 23:20:41 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:38.465 23:20:41 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:38.465 23:20:41 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:38.465 23:20:41 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:38.465 23:20:41 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:38.465 23:20:41 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:38.465 23:20:41 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:38.465 23:20:41 -- nvmf/common.sh@294 -- # net_devs=() 00:28:38.465 23:20:41 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:38.465 23:20:41 -- nvmf/common.sh@295 -- # e810=() 00:28:38.465 23:20:41 -- nvmf/common.sh@295 -- # local -ga e810 00:28:38.465 23:20:41 -- nvmf/common.sh@296 -- # x722=() 00:28:38.465 23:20:41 -- nvmf/common.sh@296 -- # local -ga x722 00:28:38.465 23:20:41 -- nvmf/common.sh@297 -- # mlx=() 00:28:38.465 23:20:41 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:38.465 23:20:41 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:38.465 23:20:41 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:38.465 23:20:41 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:38.465 23:20:41 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:38.465 23:20:41 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:38.465 23:20:41 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:38.465 23:20:41 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:38.465 23:20:41 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:38.465 23:20:41 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:38.465 23:20:41 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:38.465 23:20:41 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:38.465 23:20:41 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:38.465 23:20:41 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:38.465 23:20:41 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:38.465 23:20:41 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:38.465 23:20:41 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:38.465 23:20:41 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:38.465 23:20:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:38.465 23:20:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:38.465 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:38.465 23:20:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:38.465 23:20:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:38.465 23:20:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:38.465 23:20:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:38.465 23:20:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:38.465 23:20:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:38.465 23:20:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:38.465 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:38.465 23:20:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:38.465 23:20:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:38.465 23:20:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:38.465 23:20:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:38.465 23:20:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:38.465 23:20:41 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:38.465 23:20:41 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:38.465 23:20:41 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:38.465 23:20:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:38.465 23:20:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:38.465 23:20:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:38.465 23:20:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:38.465 23:20:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:38.465 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:38.465 23:20:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:38.465 23:20:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:38.465 23:20:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:38.465 23:20:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:38.465 23:20:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:38.465 23:20:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:38.465 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:38.465 23:20:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:38.465 23:20:41 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:38.465 23:20:41 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:38.465 23:20:41 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:38.465 23:20:41 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:38.465 23:20:41 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:38.465 23:20:41 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:38.465 23:20:41 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:38.465 23:20:41 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:38.465 23:20:41 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:38.465 23:20:41 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:38.465 23:20:41 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:38.465 23:20:41 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:38.465 23:20:41 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:38.465 23:20:41 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:38.465 23:20:41 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:38.465 23:20:42 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:38.465 23:20:42 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:38.465 23:20:42 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:38.465 23:20:42 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:38.465 23:20:42 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:38.465 23:20:42 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:38.465 23:20:42 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:38.724 23:20:42 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:38.724 23:20:42 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:38.724 23:20:42 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:38.724 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:38.724 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.235 ms 00:28:38.724 00:28:38.724 --- 10.0.0.2 ping statistics --- 00:28:38.724 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:38.724 rtt min/avg/max/mdev = 0.235/0.235/0.235/0.000 ms 00:28:38.724 23:20:42 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:38.724 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:38.724 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.073 ms 00:28:38.724 00:28:38.724 --- 10.0.0.1 ping statistics --- 00:28:38.724 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:38.724 rtt min/avg/max/mdev = 0.073/0.073/0.073/0.000 ms 00:28:38.724 23:20:42 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:38.724 23:20:42 -- nvmf/common.sh@410 -- # return 0 00:28:38.724 23:20:42 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:38.724 23:20:42 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:38.724 23:20:42 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:38.724 23:20:42 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:38.724 23:20:42 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:38.724 23:20:42 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:38.724 23:20:42 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:38.725 23:20:42 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:28:38.725 23:20:42 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:38.725 23:20:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:38.725 23:20:42 -- common/autotest_common.sh@10 -- # set +x 00:28:38.725 23:20:42 -- nvmf/common.sh@469 -- # nvmfpid=2557963 00:28:38.725 23:20:42 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:28:38.725 23:20:42 -- nvmf/common.sh@470 -- # waitforlisten 2557963 00:28:38.725 23:20:42 -- common/autotest_common.sh@829 -- # '[' -z 2557963 ']' 00:28:38.725 23:20:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:38.725 23:20:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:38.725 23:20:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:38.725 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:38.725 23:20:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:38.725 23:20:42 -- common/autotest_common.sh@10 -- # set +x 00:28:38.725 [2024-11-28 23:20:42.184281] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:38.725 [2024-11-28 23:20:42.184354] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:38.725 EAL: No free 2048 kB hugepages reported on node 1 00:28:38.725 [2024-11-28 23:20:42.251611] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:28:38.983 [2024-11-28 23:20:42.338301] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:38.983 [2024-11-28 23:20:42.338458] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:38.983 [2024-11-28 23:20:42.338476] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:38.983 [2024-11-28 23:20:42.338488] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:38.983 [2024-11-28 23:20:42.338570] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:28:38.983 [2024-11-28 23:20:42.338634] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:28:38.983 [2024-11-28 23:20:42.338637] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:39.550 23:20:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:39.550 23:20:43 -- common/autotest_common.sh@862 -- # return 0 00:28:39.550 23:20:43 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:39.550 23:20:43 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:39.550 23:20:43 -- common/autotest_common.sh@10 -- # set +x 00:28:39.808 23:20:43 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:39.808 23:20:43 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:28:40.065 [2024-11-28 23:20:43.425292] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:40.065 23:20:43 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:28:40.324 Malloc0 00:28:40.324 23:20:43 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:28:40.581 23:20:43 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:28:40.839 23:20:44 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:41.097 [2024-11-28 23:20:44.503345] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:41.097 23:20:44 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:41.354 [2024-11-28 23:20:44.748084] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:28:41.354 23:20:44 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:41.613 [2024-11-28 23:20:44.992954] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:28:41.613 23:20:45 -- host/failover.sh@31 -- # bdevperf_pid=2558334 00:28:41.613 23:20:45 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:28:41.613 23:20:45 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:41.613 23:20:45 -- host/failover.sh@34 -- # waitforlisten 2558334 /var/tmp/bdevperf.sock 00:28:41.613 23:20:45 -- common/autotest_common.sh@829 -- # '[' -z 2558334 ']' 00:28:41.613 23:20:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:28:41.613 23:20:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:41.613 23:20:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:28:41.613 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:28:41.613 23:20:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:41.613 23:20:45 -- common/autotest_common.sh@10 -- # set +x 00:28:42.545 23:20:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:42.545 23:20:46 -- common/autotest_common.sh@862 -- # return 0 00:28:42.545 23:20:46 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:42.803 NVMe0n1 00:28:42.804 23:20:46 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:43.062 00:28:43.320 23:20:46 -- host/failover.sh@39 -- # run_test_pid=2558567 00:28:43.320 23:20:46 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:28:43.320 23:20:46 -- host/failover.sh@41 -- # sleep 1 00:28:44.256 23:20:47 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:44.515 [2024-11-28 23:20:47.924574] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.515 [2024-11-28 23:20:47.924635] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.515 [2024-11-28 23:20:47.924662] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.515 [2024-11-28 23:20:47.924675] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.515 [2024-11-28 23:20:47.924688] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.515 [2024-11-28 23:20:47.924700] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.515 [2024-11-28 23:20:47.924712] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.515 [2024-11-28 23:20:47.924724] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.515 [2024-11-28 23:20:47.924736] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.515 [2024-11-28 23:20:47.924748] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.515 [2024-11-28 23:20:47.924760] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.515 [2024-11-28 23:20:47.924772] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.515 [2024-11-28 23:20:47.924784] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.515 [2024-11-28 23:20:47.924797] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.515 [2024-11-28 23:20:47.924809] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.515 [2024-11-28 23:20:47.924821] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.515 [2024-11-28 23:20:47.924833] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.515 [2024-11-28 23:20:47.924845] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.515 [2024-11-28 23:20:47.924856] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.924868] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.924881] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.924893] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.924927] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.924941] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.924952] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.924964] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.924991] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.925002] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.925013] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.925025] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.925036] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.925047] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.925058] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.925085] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.925097] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.925110] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.925122] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.925133] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.925145] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.925157] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.925169] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.925182] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.925194] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.925206] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.925217] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.925229] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.925241] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.925253] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.925265] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.925280] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.925292] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.925304] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.925316] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.925328] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.925339] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.925351] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.925363] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.925375] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.925386] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.925406] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.925419] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.925431] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.925458] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.925469] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.925481] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.925493] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 [2024-11-28 23:20:47.925505] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1713930 is same with the state(5) to be set 00:28:44.516 23:20:47 -- host/failover.sh@45 -- # sleep 3 00:28:47.800 23:20:50 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:47.800 00:28:47.800 23:20:51 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:48.058 [2024-11-28 23:20:51.586533] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.586601] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.586626] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.586639] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.586651] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.586663] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.586699] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.586712] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.586723] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.586734] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.586746] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.586757] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.586768] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.586780] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.586792] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.586804] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.586815] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.586826] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.586839] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.586851] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.586862] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.586874] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.586886] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.586897] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.586910] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.586921] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.586931] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.586942] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.586953] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.586964] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.586975] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.586985] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.586997] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.587011] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.587023] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.587034] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.587045] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.587056] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.587067] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.587093] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.587105] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.587117] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.587128] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.587139] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.587165] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.587178] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.587189] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.587201] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.587213] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.587224] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.587236] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.587248] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.587260] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.587272] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.587283] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.587295] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.587307] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.587319] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.587330] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.587342] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.587357] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.587369] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.587389] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.587410] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.587422] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.587434] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 [2024-11-28 23:20:51.587447] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17147c0 is same with the state(5) to be set 00:28:48.059 23:20:51 -- host/failover.sh@50 -- # sleep 3 00:28:51.342 23:20:54 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:51.342 [2024-11-28 23:20:54.854109] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:51.342 23:20:54 -- host/failover.sh@55 -- # sleep 1 00:28:52.276 23:20:55 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:52.535 [2024-11-28 23:20:56.113528] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1715310 is same with the state(5) to be set 00:28:52.535 [2024-11-28 23:20:56.113611] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1715310 is same with the state(5) to be set 00:28:52.535 [2024-11-28 23:20:56.113628] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1715310 is same with the state(5) to be set 00:28:52.535 [2024-11-28 23:20:56.113641] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1715310 is same with the state(5) to be set 00:28:52.535 [2024-11-28 23:20:56.113653] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1715310 is same with the state(5) to be set 00:28:52.535 [2024-11-28 23:20:56.113665] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1715310 is same with the state(5) to be set 00:28:52.535 [2024-11-28 23:20:56.113678] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1715310 is same with the state(5) to be set 00:28:52.535 [2024-11-28 23:20:56.113705] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1715310 is same with the state(5) to be set 00:28:52.535 [2024-11-28 23:20:56.113717] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1715310 is same with the state(5) to be set 00:28:52.535 [2024-11-28 23:20:56.113730] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1715310 is same with the state(5) to be set 00:28:52.535 [2024-11-28 23:20:56.113742] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1715310 is same with the state(5) to be set 00:28:52.535 [2024-11-28 23:20:56.113754] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1715310 is same with the state(5) to be set 00:28:52.535 [2024-11-28 23:20:56.113765] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1715310 is same with the state(5) to be set 00:28:52.535 [2024-11-28 23:20:56.113777] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1715310 is same with the state(5) to be set 00:28:52.535 [2024-11-28 23:20:56.113789] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1715310 is same with the state(5) to be set 00:28:52.535 [2024-11-28 23:20:56.113815] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1715310 is same with the state(5) to be set 00:28:52.535 [2024-11-28 23:20:56.113838] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1715310 is same with the state(5) to be set 00:28:52.535 [2024-11-28 23:20:56.113850] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1715310 is same with the state(5) to be set 00:28:52.535 [2024-11-28 23:20:56.113862] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1715310 is same with the state(5) to be set 00:28:52.535 [2024-11-28 23:20:56.113873] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1715310 is same with the state(5) to be set 00:28:52.535 [2024-11-28 23:20:56.113884] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1715310 is same with the state(5) to be set 00:28:52.535 [2024-11-28 23:20:56.113896] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1715310 is same with the state(5) to be set 00:28:52.535 [2024-11-28 23:20:56.113909] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1715310 is same with the state(5) to be set 00:28:52.535 [2024-11-28 23:20:56.113920] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1715310 is same with the state(5) to be set 00:28:52.535 [2024-11-28 23:20:56.113931] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1715310 is same with the state(5) to be set 00:28:52.535 [2024-11-28 23:20:56.113943] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1715310 is same with the state(5) to be set 00:28:52.535 23:20:56 -- host/failover.sh@59 -- # wait 2558567 00:28:59.100 0 00:28:59.100 23:21:01 -- host/failover.sh@61 -- # killprocess 2558334 00:28:59.100 23:21:01 -- common/autotest_common.sh@936 -- # '[' -z 2558334 ']' 00:28:59.100 23:21:01 -- common/autotest_common.sh@940 -- # kill -0 2558334 00:28:59.100 23:21:01 -- common/autotest_common.sh@941 -- # uname 00:28:59.100 23:21:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:59.100 23:21:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2558334 00:28:59.100 23:21:01 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:59.100 23:21:01 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:59.100 23:21:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2558334' 00:28:59.100 killing process with pid 2558334 00:28:59.100 23:21:01 -- common/autotest_common.sh@955 -- # kill 2558334 00:28:59.100 23:21:01 -- common/autotest_common.sh@960 -- # wait 2558334 00:28:59.100 23:21:02 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:59.100 [2024-11-28 23:20:45.055710] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:59.100 [2024-11-28 23:20:45.055802] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2558334 ] 00:28:59.100 EAL: No free 2048 kB hugepages reported on node 1 00:28:59.100 [2024-11-28 23:20:45.116746] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:59.100 [2024-11-28 23:20:45.200495] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:59.100 Running I/O for 15 seconds... 00:28:59.100 [2024-11-28 23:20:47.925772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:118144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.100 [2024-11-28 23:20:47.925813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.100 [2024-11-28 23:20:47.925841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:118152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.100 [2024-11-28 23:20:47.925858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.100 [2024-11-28 23:20:47.925875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:118168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.100 [2024-11-28 23:20:47.925889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.100 [2024-11-28 23:20:47.925905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:118184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.100 [2024-11-28 23:20:47.925918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.100 [2024-11-28 23:20:47.925934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:118192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.100 [2024-11-28 23:20:47.925947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.100 [2024-11-28 23:20:47.925962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:118200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.100 [2024-11-28 23:20:47.925975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.100 [2024-11-28 23:20:47.925991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:118216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.100 [2024-11-28 23:20:47.926005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.100 [2024-11-28 23:20:47.926020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:118240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.100 [2024-11-28 23:20:47.926034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.100 [2024-11-28 23:20:47.926049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:118688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.100 [2024-11-28 23:20:47.926062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.100 [2024-11-28 23:20:47.926077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:118704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.100 [2024-11-28 23:20:47.926091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.100 [2024-11-28 23:20:47.926106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:118712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.100 [2024-11-28 23:20:47.926120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.100 [2024-11-28 23:20:47.926142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:118744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.100 [2024-11-28 23:20:47.926157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.100 [2024-11-28 23:20:47.926171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:118752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.100 [2024-11-28 23:20:47.926184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.100 [2024-11-28 23:20:47.926199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:118760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.100 [2024-11-28 23:20:47.926212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.100 [2024-11-28 23:20:47.926227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:118768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.100 [2024-11-28 23:20:47.926240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.100 [2024-11-28 23:20:47.926255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:118776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.100 [2024-11-28 23:20:47.926284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.100 [2024-11-28 23:20:47.926299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:118248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.100 [2024-11-28 23:20:47.926312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.101 [2024-11-28 23:20:47.926341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:118256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.101 [2024-11-28 23:20:47.926354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.101 [2024-11-28 23:20:47.926369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:118264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.101 [2024-11-28 23:20:47.926385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.101 [2024-11-28 23:20:47.926424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:118272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.101 [2024-11-28 23:20:47.926440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.101 [2024-11-28 23:20:47.926454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:118288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.101 [2024-11-28 23:20:47.926467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.101 [2024-11-28 23:20:47.926481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:118304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.101 [2024-11-28 23:20:47.926494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.101 [2024-11-28 23:20:47.926509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:118312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.101 [2024-11-28 23:20:47.926522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.101 [2024-11-28 23:20:47.926536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:118328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.101 [2024-11-28 23:20:47.926553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.101 [2024-11-28 23:20:47.926569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:118784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.101 [2024-11-28 23:20:47.926582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.101 [2024-11-28 23:20:47.926596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:118792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.101 [2024-11-28 23:20:47.926609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.101 [2024-11-28 23:20:47.926623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:118832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.101 [2024-11-28 23:20:47.926636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.101 [2024-11-28 23:20:47.926650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:118848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.101 [2024-11-28 23:20:47.926663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.101 [2024-11-28 23:20:47.926677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:118864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.101 [2024-11-28 23:20:47.926691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.101 [2024-11-28 23:20:47.926727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:118872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.101 [2024-11-28 23:20:47.926740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.101 [2024-11-28 23:20:47.926754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:118896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.101 [2024-11-28 23:20:47.926766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.101 [2024-11-28 23:20:47.926796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:118904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.101 [2024-11-28 23:20:47.926809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.101 [2024-11-28 23:20:47.926823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:118920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.101 [2024-11-28 23:20:47.926842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.101 [2024-11-28 23:20:47.926857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:118928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.101 [2024-11-28 23:20:47.926870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.101 [2024-11-28 23:20:47.926885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:118944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.101 [2024-11-28 23:20:47.926898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.101 [2024-11-28 23:20:47.926912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:118952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.101 [2024-11-28 23:20:47.926926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.101 [2024-11-28 23:20:47.926944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:118960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.101 [2024-11-28 23:20:47.926957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.101 [2024-11-28 23:20:47.926972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:118968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.101 [2024-11-28 23:20:47.926984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.101 [2024-11-28 23:20:47.926999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:118976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.101 [2024-11-28 23:20:47.927012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.101 [2024-11-28 23:20:47.927026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:118984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.101 [2024-11-28 23:20:47.927038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.101 [2024-11-28 23:20:47.927053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:118992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.101 [2024-11-28 23:20:47.927067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.101 [2024-11-28 23:20:47.927082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:119000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.101 [2024-11-28 23:20:47.927096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.101 [2024-11-28 23:20:47.927111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:119008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.101 [2024-11-28 23:20:47.927125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.101 [2024-11-28 23:20:47.927141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:119016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.101 [2024-11-28 23:20:47.927154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.101 [2024-11-28 23:20:47.927169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:119024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.101 [2024-11-28 23:20:47.927182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.101 [2024-11-28 23:20:47.927197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:119032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.101 [2024-11-28 23:20:47.927210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.101 [2024-11-28 23:20:47.927225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:119040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.101 [2024-11-28 23:20:47.927238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.101 [2024-11-28 23:20:47.927252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:118344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.101 [2024-11-28 23:20:47.927265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.101 [2024-11-28 23:20:47.927280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:118368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.101 [2024-11-28 23:20:47.927305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.101 [2024-11-28 23:20:47.927321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:118376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.101 [2024-11-28 23:20:47.927334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.101 [2024-11-28 23:20:47.927348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:118384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.101 [2024-11-28 23:20:47.927361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.101 [2024-11-28 23:20:47.927376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:118400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.101 [2024-11-28 23:20:47.927390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.101 [2024-11-28 23:20:47.927431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:118408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.101 [2024-11-28 23:20:47.927446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.101 [2024-11-28 23:20:47.927460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:118416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.101 [2024-11-28 23:20:47.927474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.101 [2024-11-28 23:20:47.927489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:118424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.101 [2024-11-28 23:20:47.927502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.101 [2024-11-28 23:20:47.927518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:118432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.101 [2024-11-28 23:20:47.927531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.101 [2024-11-28 23:20:47.927546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:118440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.101 [2024-11-28 23:20:47.927559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.102 [2024-11-28 23:20:47.927574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:118448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.102 [2024-11-28 23:20:47.927587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.102 [2024-11-28 23:20:47.927602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:118456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.102 [2024-11-28 23:20:47.927616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.102 [2024-11-28 23:20:47.927631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:118488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.102 [2024-11-28 23:20:47.927645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.102 [2024-11-28 23:20:47.927661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:118496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.102 [2024-11-28 23:20:47.927674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.102 [2024-11-28 23:20:47.927693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:118504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.102 [2024-11-28 23:20:47.927723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.102 [2024-11-28 23:20:47.927749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:118520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.102 [2024-11-28 23:20:47.927761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.102 [2024-11-28 23:20:47.927776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:119048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.102 [2024-11-28 23:20:47.927789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.102 [2024-11-28 23:20:47.927803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:119056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.102 [2024-11-28 23:20:47.927821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.102 [2024-11-28 23:20:47.927836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:119064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.102 [2024-11-28 23:20:47.927849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.102 [2024-11-28 23:20:47.927863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:119072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.102 [2024-11-28 23:20:47.927877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.102 [2024-11-28 23:20:47.927891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:119080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.102 [2024-11-28 23:20:47.927904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.102 [2024-11-28 23:20:47.927918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:119088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.102 [2024-11-28 23:20:47.927931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.102 [2024-11-28 23:20:47.927946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:119096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.102 [2024-11-28 23:20:47.927959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.102 [2024-11-28 23:20:47.927973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:119104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.102 [2024-11-28 23:20:47.927986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.102 [2024-11-28 23:20:47.928001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:119112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.102 [2024-11-28 23:20:47.928014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.102 [2024-11-28 23:20:47.928028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:119120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.102 [2024-11-28 23:20:47.928041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.102 [2024-11-28 23:20:47.928056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:119128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.102 [2024-11-28 23:20:47.928072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.102 [2024-11-28 23:20:47.928087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:119136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.102 [2024-11-28 23:20:47.928101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.102 [2024-11-28 23:20:47.928116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:119144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.102 [2024-11-28 23:20:47.928129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.102 [2024-11-28 23:20:47.928144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:119152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.102 [2024-11-28 23:20:47.928157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.102 [2024-11-28 23:20:47.928172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:119160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.102 [2024-11-28 23:20:47.928185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.102 [2024-11-28 23:20:47.928199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:118528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.102 [2024-11-28 23:20:47.928212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.102 [2024-11-28 23:20:47.928226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:118552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.102 [2024-11-28 23:20:47.928239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.102 [2024-11-28 23:20:47.928254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:118568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.102 [2024-11-28 23:20:47.928272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.102 [2024-11-28 23:20:47.928287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:118584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.102 [2024-11-28 23:20:47.928300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.102 [2024-11-28 23:20:47.928315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:118624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.102 [2024-11-28 23:20:47.928328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.102 [2024-11-28 23:20:47.928342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:118632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.102 [2024-11-28 23:20:47.928355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.102 [2024-11-28 23:20:47.928370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:118640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.102 [2024-11-28 23:20:47.928383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.102 [2024-11-28 23:20:47.928422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:118648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.102 [2024-11-28 23:20:47.928439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.102 [2024-11-28 23:20:47.928454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:118672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.102 [2024-11-28 23:20:47.928472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.102 [2024-11-28 23:20:47.928489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:118680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.102 [2024-11-28 23:20:47.928503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.102 [2024-11-28 23:20:47.928518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:118696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.102 [2024-11-28 23:20:47.928532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.102 [2024-11-28 23:20:47.928547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:118720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.102 [2024-11-28 23:20:47.928561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.102 [2024-11-28 23:20:47.928576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:118728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.102 [2024-11-28 23:20:47.928589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.102 [2024-11-28 23:20:47.928605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:118736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.102 [2024-11-28 23:20:47.928618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.102 [2024-11-28 23:20:47.928634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:118800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.102 [2024-11-28 23:20:47.928647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.102 [2024-11-28 23:20:47.928662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:118808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.102 [2024-11-28 23:20:47.928675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.102 [2024-11-28 23:20:47.928690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:119168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.102 [2024-11-28 23:20:47.928718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.102 [2024-11-28 23:20:47.928733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:119176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.102 [2024-11-28 23:20:47.928747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.102 [2024-11-28 23:20:47.928761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:119184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.102 [2024-11-28 23:20:47.928779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.103 [2024-11-28 23:20:47.928795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:119192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.103 [2024-11-28 23:20:47.928809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.103 [2024-11-28 23:20:47.928823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:119200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.103 [2024-11-28 23:20:47.928836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.103 [2024-11-28 23:20:47.928854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:119208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.103 [2024-11-28 23:20:47.928868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.103 [2024-11-28 23:20:47.928883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:119216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.103 [2024-11-28 23:20:47.928896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.103 [2024-11-28 23:20:47.928910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:119224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.103 [2024-11-28 23:20:47.928923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.103 [2024-11-28 23:20:47.928938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:119232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.103 [2024-11-28 23:20:47.928951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.103 [2024-11-28 23:20:47.928965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:119240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.103 [2024-11-28 23:20:47.928978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.103 [2024-11-28 23:20:47.928993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:119248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.103 [2024-11-28 23:20:47.929006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.103 [2024-11-28 23:20:47.929020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:119256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.103 [2024-11-28 23:20:47.929033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.103 [2024-11-28 23:20:47.929048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:119264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.103 [2024-11-28 23:20:47.929061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.103 [2024-11-28 23:20:47.929075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:119272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.103 [2024-11-28 23:20:47.929088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.103 [2024-11-28 23:20:47.929103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:119280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.103 [2024-11-28 23:20:47.929116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.103 [2024-11-28 23:20:47.929130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:119288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.103 [2024-11-28 23:20:47.929144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.103 [2024-11-28 23:20:47.929159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:119296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.103 [2024-11-28 23:20:47.929172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.103 [2024-11-28 23:20:47.929187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:119304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.103 [2024-11-28 23:20:47.929203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.103 [2024-11-28 23:20:47.929218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:119312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.103 [2024-11-28 23:20:47.929233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.103 [2024-11-28 23:20:47.929248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:119320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.103 [2024-11-28 23:20:47.929262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.103 [2024-11-28 23:20:47.929277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:119328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.103 [2024-11-28 23:20:47.929290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.103 [2024-11-28 23:20:47.929305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:119336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.103 [2024-11-28 23:20:47.929318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.103 [2024-11-28 23:20:47.929333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:119344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.103 [2024-11-28 23:20:47.929346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.103 [2024-11-28 23:20:47.929362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:119352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.103 [2024-11-28 23:20:47.929375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.103 [2024-11-28 23:20:47.929390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:119360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.103 [2024-11-28 23:20:47.929426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.103 [2024-11-28 23:20:47.929443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:119368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.103 [2024-11-28 23:20:47.929457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.103 [2024-11-28 23:20:47.929472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:118816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.103 [2024-11-28 23:20:47.929485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.103 [2024-11-28 23:20:47.929501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:118824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.103 [2024-11-28 23:20:47.929514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.103 [2024-11-28 23:20:47.929529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:118840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.103 [2024-11-28 23:20:47.929543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.103 [2024-11-28 23:20:47.929558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:118856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.103 [2024-11-28 23:20:47.929572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.103 [2024-11-28 23:20:47.929591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:118880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.103 [2024-11-28 23:20:47.929606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.103 [2024-11-28 23:20:47.929621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:118888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.103 [2024-11-28 23:20:47.929634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.103 [2024-11-28 23:20:47.929649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:118912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.103 [2024-11-28 23:20:47.929663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.103 [2024-11-28 23:20:47.929677] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2476c60 is same with the state(5) to be set 00:28:59.103 [2024-11-28 23:20:47.929693] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:59.103 [2024-11-28 23:20:47.929720] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:59.103 [2024-11-28 23:20:47.929732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:118936 len:8 PRP1 0x0 PRP2 0x0 00:28:59.103 [2024-11-28 23:20:47.929744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.103 [2024-11-28 23:20:47.929801] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2476c60 was disconnected and freed. reset controller. 00:28:59.103 [2024-11-28 23:20:47.929826] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:28:59.103 [2024-11-28 23:20:47.929874] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:59.103 [2024-11-28 23:20:47.929894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.103 [2024-11-28 23:20:47.929909] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:59.103 [2024-11-28 23:20:47.929922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.103 [2024-11-28 23:20:47.929936] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:59.103 [2024-11-28 23:20:47.929949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.103 [2024-11-28 23:20:47.929963] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:59.103 [2024-11-28 23:20:47.929976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.103 [2024-11-28 23:20:47.929989] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:59.103 [2024-11-28 23:20:47.932222] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:59.103 [2024-11-28 23:20:47.932266] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2458000 (9): Bad file descriptor 00:28:59.103 [2024-11-28 23:20:48.041985] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:59.103 [2024-11-28 23:20:51.587623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:10016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.103 [2024-11-28 23:20:51.587667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.104 [2024-11-28 23:20:51.587711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:10032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.104 [2024-11-28 23:20:51.587752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.104 [2024-11-28 23:20:51.587768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.104 [2024-11-28 23:20:51.587782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.104 [2024-11-28 23:20:51.587797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:10048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.104 [2024-11-28 23:20:51.587810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.104 [2024-11-28 23:20:51.587825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:10064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.104 [2024-11-28 23:20:51.587838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.104 [2024-11-28 23:20:51.587868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:10112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.104 [2024-11-28 23:20:51.587881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.104 [2024-11-28 23:20:51.587896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:10120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.104 [2024-11-28 23:20:51.587909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.104 [2024-11-28 23:20:51.587923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:10128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.104 [2024-11-28 23:20:51.587936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.104 [2024-11-28 23:20:51.587950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:10136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.104 [2024-11-28 23:20:51.587963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.104 [2024-11-28 23:20:51.587977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:10144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.104 [2024-11-28 23:20:51.587990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.104 [2024-11-28 23:20:51.588004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:10152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.104 [2024-11-28 23:20:51.588017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.104 [2024-11-28 23:20:51.588031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:10160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.104 [2024-11-28 23:20:51.588044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.104 [2024-11-28 23:20:51.588058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:10168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.104 [2024-11-28 23:20:51.588070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.104 [2024-11-28 23:20:51.588084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:10176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.104 [2024-11-28 23:20:51.588101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.104 [2024-11-28 23:20:51.588116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:10184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.104 [2024-11-28 23:20:51.588128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.104 [2024-11-28 23:20:51.588143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:9488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.104 [2024-11-28 23:20:51.588156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.104 [2024-11-28 23:20:51.588171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:9496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.104 [2024-11-28 23:20:51.588183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.104 [2024-11-28 23:20:51.588197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:9512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.104 [2024-11-28 23:20:51.588210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.104 [2024-11-28 23:20:51.588224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:9520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.104 [2024-11-28 23:20:51.588237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.104 [2024-11-28 23:20:51.588251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:9528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.104 [2024-11-28 23:20:51.588263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.104 [2024-11-28 23:20:51.588277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:9552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.104 [2024-11-28 23:20:51.588290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.104 [2024-11-28 23:20:51.588304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:9560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.104 [2024-11-28 23:20:51.588316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.104 [2024-11-28 23:20:51.588330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:9584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.104 [2024-11-28 23:20:51.588342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.104 [2024-11-28 23:20:51.588355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:9592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.104 [2024-11-28 23:20:51.588368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.104 [2024-11-28 23:20:51.588405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:9608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.104 [2024-11-28 23:20:51.588421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.104 [2024-11-28 23:20:51.588436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:9640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.104 [2024-11-28 23:20:51.588449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.104 [2024-11-28 23:20:51.588464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.104 [2024-11-28 23:20:51.588482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.104 [2024-11-28 23:20:51.588497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:9664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.104 [2024-11-28 23:20:51.588509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.104 [2024-11-28 23:20:51.588524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:9672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.104 [2024-11-28 23:20:51.588536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.104 [2024-11-28 23:20:51.588550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:9680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.104 [2024-11-28 23:20:51.588563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.104 [2024-11-28 23:20:51.588577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:9688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.104 [2024-11-28 23:20:51.588590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.104 [2024-11-28 23:20:51.588605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:10192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.104 [2024-11-28 23:20:51.588617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.104 [2024-11-28 23:20:51.588632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:10200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.104 [2024-11-28 23:20:51.588645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.104 [2024-11-28 23:20:51.588659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:10208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.104 [2024-11-28 23:20:51.588672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.105 [2024-11-28 23:20:51.588701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:10216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.105 [2024-11-28 23:20:51.588724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.105 [2024-11-28 23:20:51.588738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:10224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.105 [2024-11-28 23:20:51.588750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.105 [2024-11-28 23:20:51.588764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:10232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.105 [2024-11-28 23:20:51.588777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.105 [2024-11-28 23:20:51.588791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.105 [2024-11-28 23:20:51.588803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.105 [2024-11-28 23:20:51.588817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:10248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.105 [2024-11-28 23:20:51.588830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.105 [2024-11-28 23:20:51.588847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:10256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.105 [2024-11-28 23:20:51.588860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.105 [2024-11-28 23:20:51.588874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:10264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.105 [2024-11-28 23:20:51.588886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.105 [2024-11-28 23:20:51.588900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:10272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.105 [2024-11-28 23:20:51.588912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.105 [2024-11-28 23:20:51.588926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:10280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.105 [2024-11-28 23:20:51.588939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.105 [2024-11-28 23:20:51.588953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:10288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.105 [2024-11-28 23:20:51.588965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.105 [2024-11-28 23:20:51.588979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:9696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.105 [2024-11-28 23:20:51.588992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.105 [2024-11-28 23:20:51.589006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:9704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.105 [2024-11-28 23:20:51.589018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.105 [2024-11-28 23:20:51.589032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:9712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.105 [2024-11-28 23:20:51.589052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.105 [2024-11-28 23:20:51.589066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:9720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.105 [2024-11-28 23:20:51.589078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.105 [2024-11-28 23:20:51.589093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:9728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.105 [2024-11-28 23:20:51.589108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.105 [2024-11-28 23:20:51.589123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:9760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.105 [2024-11-28 23:20:51.589136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.105 [2024-11-28 23:20:51.589151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:9768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.105 [2024-11-28 23:20:51.589165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.105 [2024-11-28 23:20:51.589179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.105 [2024-11-28 23:20:51.589197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.105 [2024-11-28 23:20:51.589211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:10296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.105 [2024-11-28 23:20:51.589224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.105 [2024-11-28 23:20:51.589238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:10304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.105 [2024-11-28 23:20:51.589250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.105 [2024-11-28 23:20:51.589264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:10312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.105 [2024-11-28 23:20:51.589277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.105 [2024-11-28 23:20:51.589291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:10320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.105 [2024-11-28 23:20:51.589303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.105 [2024-11-28 23:20:51.589317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:10328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.105 [2024-11-28 23:20:51.589329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.105 [2024-11-28 23:20:51.589343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:9808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.105 [2024-11-28 23:20:51.589356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.105 [2024-11-28 23:20:51.589369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:9832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.105 [2024-11-28 23:20:51.589399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.105 [2024-11-28 23:20:51.589434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:9848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.105 [2024-11-28 23:20:51.589447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.105 [2024-11-28 23:20:51.589462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:9880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.105 [2024-11-28 23:20:51.589476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.105 [2024-11-28 23:20:51.589491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:9928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.105 [2024-11-28 23:20:51.589504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.105 [2024-11-28 23:20:51.589518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:9936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.105 [2024-11-28 23:20:51.589531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.105 [2024-11-28 23:20:51.589546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:9976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.105 [2024-11-28 23:20:51.589559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.105 [2024-11-28 23:20:51.589577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:9984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.105 [2024-11-28 23:20:51.589591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.105 [2024-11-28 23:20:51.589606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:10336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.105 [2024-11-28 23:20:51.589619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.105 [2024-11-28 23:20:51.589634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:10344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.105 [2024-11-28 23:20:51.589647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.105 [2024-11-28 23:20:51.589661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:10352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.105 [2024-11-28 23:20:51.589674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.105 [2024-11-28 23:20:51.589689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:10360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.105 [2024-11-28 23:20:51.589717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.105 [2024-11-28 23:20:51.589732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:10368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.105 [2024-11-28 23:20:51.589744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.105 [2024-11-28 23:20:51.589758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:10376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.105 [2024-11-28 23:20:51.589771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.105 [2024-11-28 23:20:51.589786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:10384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.105 [2024-11-28 23:20:51.589799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.105 [2024-11-28 23:20:51.589813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:10392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.105 [2024-11-28 23:20:51.589826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.105 [2024-11-28 23:20:51.589840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:10400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.106 [2024-11-28 23:20:51.589852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.106 [2024-11-28 23:20:51.589866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:10408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.106 [2024-11-28 23:20:51.589879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.106 [2024-11-28 23:20:51.589893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:10416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.106 [2024-11-28 23:20:51.589906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.106 [2024-11-28 23:20:51.589920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:10424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.106 [2024-11-28 23:20:51.589933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.106 [2024-11-28 23:20:51.589950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:10432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.106 [2024-11-28 23:20:51.589964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.106 [2024-11-28 23:20:51.589978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:10440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.106 [2024-11-28 23:20:51.589991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.106 [2024-11-28 23:20:51.590005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:10448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.106 [2024-11-28 23:20:51.590017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.106 [2024-11-28 23:20:51.590032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:10456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.106 [2024-11-28 23:20:51.590045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.106 [2024-11-28 23:20:51.590060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:10464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.106 [2024-11-28 23:20:51.590073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.106 [2024-11-28 23:20:51.590087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:10472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.106 [2024-11-28 23:20:51.590099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.106 [2024-11-28 23:20:51.590114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:10480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.106 [2024-11-28 23:20:51.590126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.106 [2024-11-28 23:20:51.590141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:10488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.106 [2024-11-28 23:20:51.590153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.106 [2024-11-28 23:20:51.590167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:10496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.106 [2024-11-28 23:20:51.590180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.106 [2024-11-28 23:20:51.590194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:10504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.106 [2024-11-28 23:20:51.590207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.106 [2024-11-28 23:20:51.590221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:10512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.106 [2024-11-28 23:20:51.590233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.106 [2024-11-28 23:20:51.590247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:10520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.106 [2024-11-28 23:20:51.590260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.106 [2024-11-28 23:20:51.590274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:10528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.106 [2024-11-28 23:20:51.590305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.106 [2024-11-28 23:20:51.590322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:10536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.106 [2024-11-28 23:20:51.590335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.106 [2024-11-28 23:20:51.590349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:10544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.106 [2024-11-28 23:20:51.590362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.106 [2024-11-28 23:20:51.590377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:10552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.106 [2024-11-28 23:20:51.590390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.106 [2024-11-28 23:20:51.590429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:10560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.106 [2024-11-28 23:20:51.590444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.106 [2024-11-28 23:20:51.590460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:10568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.106 [2024-11-28 23:20:51.590474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.106 [2024-11-28 23:20:51.590489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:10576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.106 [2024-11-28 23:20:51.590502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.106 [2024-11-28 23:20:51.590517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:10584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.106 [2024-11-28 23:20:51.590530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.106 [2024-11-28 23:20:51.590546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:10592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.106 [2024-11-28 23:20:51.590560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.106 [2024-11-28 23:20:51.590575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:10600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.106 [2024-11-28 23:20:51.590588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.106 [2024-11-28 23:20:51.590603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:10608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.106 [2024-11-28 23:20:51.590617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.106 [2024-11-28 23:20:51.590631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:10616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.106 [2024-11-28 23:20:51.590645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.106 [2024-11-28 23:20:51.590660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:10624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.106 [2024-11-28 23:20:51.590673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.106 [2024-11-28 23:20:51.590693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:10632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.106 [2024-11-28 23:20:51.590722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.106 [2024-11-28 23:20:51.590737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:10640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.106 [2024-11-28 23:20:51.590751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.106 [2024-11-28 23:20:51.590766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:10648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.106 [2024-11-28 23:20:51.590779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.106 [2024-11-28 23:20:51.590793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:10656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.106 [2024-11-28 23:20:51.590806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.106 [2024-11-28 23:20:51.590821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:10664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.106 [2024-11-28 23:20:51.590834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.106 [2024-11-28 23:20:51.590848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:10672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.106 [2024-11-28 23:20:51.590862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.106 [2024-11-28 23:20:51.590876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:10680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.106 [2024-11-28 23:20:51.590889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.106 [2024-11-28 23:20:51.590903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:10688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.106 [2024-11-28 23:20:51.590916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.106 [2024-11-28 23:20:51.590930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:10696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.106 [2024-11-28 23:20:51.590943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.106 [2024-11-28 23:20:51.590958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:10704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.106 [2024-11-28 23:20:51.590971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.106 [2024-11-28 23:20:51.590985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:10712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.106 [2024-11-28 23:20:51.590999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.106 [2024-11-28 23:20:51.591014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:10720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.107 [2024-11-28 23:20:51.591028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.107 [2024-11-28 23:20:51.591043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:10728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.107 [2024-11-28 23:20:51.591059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.107 [2024-11-28 23:20:51.591075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:10736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.107 [2024-11-28 23:20:51.591088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.107 [2024-11-28 23:20:51.591103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:10744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.107 [2024-11-28 23:20:51.591116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.107 [2024-11-28 23:20:51.591131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:10752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.107 [2024-11-28 23:20:51.591144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.107 [2024-11-28 23:20:51.591159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:10760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.107 [2024-11-28 23:20:51.591172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.107 [2024-11-28 23:20:51.591187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:10768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.107 [2024-11-28 23:20:51.591201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.107 [2024-11-28 23:20:51.591215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:10008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.107 [2024-11-28 23:20:51.591229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.107 [2024-11-28 23:20:51.591243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:10024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.107 [2024-11-28 23:20:51.591257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.107 [2024-11-28 23:20:51.591271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:10056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.107 [2024-11-28 23:20:51.591284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.107 [2024-11-28 23:20:51.591299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:10072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.107 [2024-11-28 23:20:51.591312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.107 [2024-11-28 23:20:51.591327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:10080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.107 [2024-11-28 23:20:51.591339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.107 [2024-11-28 23:20:51.591353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:10088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.107 [2024-11-28 23:20:51.591367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.107 [2024-11-28 23:20:51.591381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:10096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.107 [2024-11-28 23:20:51.591415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.107 [2024-11-28 23:20:51.591432] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24644b0 is same with the state(5) to be set 00:28:59.107 [2024-11-28 23:20:51.591453] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:59.107 [2024-11-28 23:20:51.591465] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:59.107 [2024-11-28 23:20:51.591483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10104 len:8 PRP1 0x0 PRP2 0x0 00:28:59.107 [2024-11-28 23:20:51.591496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.107 [2024-11-28 23:20:51.591554] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x24644b0 was disconnected and freed. reset controller. 00:28:59.107 [2024-11-28 23:20:51.591572] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:28:59.107 [2024-11-28 23:20:51.591606] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:59.107 [2024-11-28 23:20:51.591625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.107 [2024-11-28 23:20:51.591640] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:59.107 [2024-11-28 23:20:51.591653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.107 [2024-11-28 23:20:51.591667] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:59.107 [2024-11-28 23:20:51.591679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.107 [2024-11-28 23:20:51.591694] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:59.107 [2024-11-28 23:20:51.591708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.107 [2024-11-28 23:20:51.591721] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:59.107 [2024-11-28 23:20:51.591772] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2458000 (9): Bad file descriptor 00:28:59.107 [2024-11-28 23:20:51.593921] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:59.107 [2024-11-28 23:20:51.785451] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:59.107 [2024-11-28 23:20:56.114074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:5976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.107 [2024-11-28 23:20:56.114118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.107 [2024-11-28 23:20:56.114146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:5984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.107 [2024-11-28 23:20:56.114162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.107 [2024-11-28 23:20:56.114178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:5992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.107 [2024-11-28 23:20:56.114192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.107 [2024-11-28 23:20:56.114207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:6008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.107 [2024-11-28 23:20:56.114220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.107 [2024-11-28 23:20:56.114234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:6016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.107 [2024-11-28 23:20:56.114254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.107 [2024-11-28 23:20:56.114270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:5328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.107 [2024-11-28 23:20:56.114283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.107 [2024-11-28 23:20:56.114298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.107 [2024-11-28 23:20:56.114326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.107 [2024-11-28 23:20:56.114341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:5352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.107 [2024-11-28 23:20:56.114353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.107 [2024-11-28 23:20:56.114368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:5368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.107 [2024-11-28 23:20:56.114405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.107 [2024-11-28 23:20:56.114423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:5376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.107 [2024-11-28 23:20:56.114436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.107 [2024-11-28 23:20:56.114451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.107 [2024-11-28 23:20:56.114464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.107 [2024-11-28 23:20:56.114478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:5400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.107 [2024-11-28 23:20:56.114491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.107 [2024-11-28 23:20:56.114506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:5416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.107 [2024-11-28 23:20:56.114519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.107 [2024-11-28 23:20:56.114534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:5424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.107 [2024-11-28 23:20:56.114546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.107 [2024-11-28 23:20:56.114561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:5448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.107 [2024-11-28 23:20:56.114574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.107 [2024-11-28 23:20:56.114588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:5464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.107 [2024-11-28 23:20:56.114601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.107 [2024-11-28 23:20:56.114615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:5496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.107 [2024-11-28 23:20:56.114629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.107 [2024-11-28 23:20:56.114654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:5504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.107 [2024-11-28 23:20:56.114668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.108 [2024-11-28 23:20:56.114698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:5544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.108 [2024-11-28 23:20:56.114712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.108 [2024-11-28 23:20:56.114726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:5560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.108 [2024-11-28 23:20:56.114738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.108 [2024-11-28 23:20:56.114752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:5576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.108 [2024-11-28 23:20:56.114765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.108 [2024-11-28 23:20:56.114779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:6032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.108 [2024-11-28 23:20:56.114791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.108 [2024-11-28 23:20:56.114805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:6048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.108 [2024-11-28 23:20:56.114818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.108 [2024-11-28 23:20:56.114832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:6072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.108 [2024-11-28 23:20:56.114845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.108 [2024-11-28 23:20:56.114859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:6080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.108 [2024-11-28 23:20:56.114872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.108 [2024-11-28 23:20:56.114886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:6096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.108 [2024-11-28 23:20:56.114899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.108 [2024-11-28 23:20:56.114913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:6104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.108 [2024-11-28 23:20:56.114925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.108 [2024-11-28 23:20:56.114939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:6112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.108 [2024-11-28 23:20:56.114952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.108 [2024-11-28 23:20:56.114966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:6120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.108 [2024-11-28 23:20:56.114979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.108 [2024-11-28 23:20:56.114992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:5584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.108 [2024-11-28 23:20:56.115009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.108 [2024-11-28 23:20:56.115023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:5624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.108 [2024-11-28 23:20:56.115036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.108 [2024-11-28 23:20:56.115051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:5632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.108 [2024-11-28 23:20:56.115063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.108 [2024-11-28 23:20:56.115078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:5640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.108 [2024-11-28 23:20:56.115091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.108 [2024-11-28 23:20:56.115105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:5672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.108 [2024-11-28 23:20:56.115117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.108 [2024-11-28 23:20:56.115132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:5688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.108 [2024-11-28 23:20:56.115144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.108 [2024-11-28 23:20:56.115158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:5696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.108 [2024-11-28 23:20:56.115171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.108 [2024-11-28 23:20:56.115184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:5704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.108 [2024-11-28 23:20:56.115197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.108 [2024-11-28 23:20:56.115211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:6128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.108 [2024-11-28 23:20:56.115224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.108 [2024-11-28 23:20:56.115238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:6136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.108 [2024-11-28 23:20:56.115251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.108 [2024-11-28 23:20:56.115265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:6144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.108 [2024-11-28 23:20:56.115278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.108 [2024-11-28 23:20:56.115292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:6152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.108 [2024-11-28 23:20:56.115304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.108 [2024-11-28 23:20:56.115318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:6160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.108 [2024-11-28 23:20:56.115330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.108 [2024-11-28 23:20:56.115344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:6168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.108 [2024-11-28 23:20:56.115360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.108 [2024-11-28 23:20:56.115391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:6176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.108 [2024-11-28 23:20:56.115413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.108 [2024-11-28 23:20:56.115428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:6184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.108 [2024-11-28 23:20:56.115441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.108 [2024-11-28 23:20:56.115456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:6192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.108 [2024-11-28 23:20:56.115469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.108 [2024-11-28 23:20:56.115483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:6200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.108 [2024-11-28 23:20:56.115496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.108 [2024-11-28 23:20:56.115510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:6208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.108 [2024-11-28 23:20:56.115523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.108 [2024-11-28 23:20:56.115537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:6216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.108 [2024-11-28 23:20:56.115550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.108 [2024-11-28 23:20:56.115565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:6224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.108 [2024-11-28 23:20:56.115577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.108 [2024-11-28 23:20:56.115592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:6232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.108 [2024-11-28 23:20:56.115605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.108 [2024-11-28 23:20:56.115619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:6240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.108 [2024-11-28 23:20:56.115631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.108 [2024-11-28 23:20:56.115646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:6248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.108 [2024-11-28 23:20:56.115659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.108 [2024-11-28 23:20:56.115674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:6256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.108 [2024-11-28 23:20:56.115687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.108 [2024-11-28 23:20:56.115702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:6264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.108 [2024-11-28 23:20:56.115715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.108 [2024-11-28 23:20:56.115748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:6272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.108 [2024-11-28 23:20:56.115762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.108 [2024-11-28 23:20:56.115775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:6280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.108 [2024-11-28 23:20:56.115788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.109 [2024-11-28 23:20:56.115802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:6288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.109 [2024-11-28 23:20:56.115814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.109 [2024-11-28 23:20:56.115829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:6296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.109 [2024-11-28 23:20:56.115841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.109 [2024-11-28 23:20:56.115855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:6304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.109 [2024-11-28 23:20:56.115867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.109 [2024-11-28 23:20:56.115882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:6312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.109 [2024-11-28 23:20:56.115894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.109 [2024-11-28 23:20:56.115908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:6320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.109 [2024-11-28 23:20:56.115920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.109 [2024-11-28 23:20:56.115933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:6328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.109 [2024-11-28 23:20:56.115946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.109 [2024-11-28 23:20:56.115960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:6336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.109 [2024-11-28 23:20:56.115972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.109 [2024-11-28 23:20:56.115986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:6344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.109 [2024-11-28 23:20:56.115999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.109 [2024-11-28 23:20:56.116013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:5712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.109 [2024-11-28 23:20:56.116025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.109 [2024-11-28 23:20:56.116039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:5728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.109 [2024-11-28 23:20:56.116051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.109 [2024-11-28 23:20:56.116065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:5736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.109 [2024-11-28 23:20:56.116082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.109 [2024-11-28 23:20:56.116096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:5744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.109 [2024-11-28 23:20:56.116109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.109 [2024-11-28 23:20:56.116123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:5752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.109 [2024-11-28 23:20:56.116135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.109 [2024-11-28 23:20:56.116149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:5776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.109 [2024-11-28 23:20:56.116161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.109 [2024-11-28 23:20:56.116175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:5784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.109 [2024-11-28 23:20:56.116187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.109 [2024-11-28 23:20:56.116201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:5800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.109 [2024-11-28 23:20:56.116214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.109 [2024-11-28 23:20:56.116227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:6352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.109 [2024-11-28 23:20:56.116240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.109 [2024-11-28 23:20:56.116255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:6360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.109 [2024-11-28 23:20:56.116267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.109 [2024-11-28 23:20:56.116281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:6368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.109 [2024-11-28 23:20:56.116293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.109 [2024-11-28 23:20:56.116307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:6376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.109 [2024-11-28 23:20:56.116319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.109 [2024-11-28 23:20:56.116333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:6384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.109 [2024-11-28 23:20:56.116346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.109 [2024-11-28 23:20:56.116360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:6392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.109 [2024-11-28 23:20:56.116387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.109 [2024-11-28 23:20:56.116410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:6400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.109 [2024-11-28 23:20:56.116424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.109 [2024-11-28 23:20:56.116443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:6408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.109 [2024-11-28 23:20:56.116464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.109 [2024-11-28 23:20:56.116480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:6416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.109 [2024-11-28 23:20:56.116493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.109 [2024-11-28 23:20:56.116507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:6424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.109 [2024-11-28 23:20:56.116522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.109 [2024-11-28 23:20:56.116537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:6432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.109 [2024-11-28 23:20:56.116550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.109 [2024-11-28 23:20:56.116567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:6440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.109 [2024-11-28 23:20:56.116582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.109 [2024-11-28 23:20:56.116596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:6448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.109 [2024-11-28 23:20:56.116609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.109 [2024-11-28 23:20:56.116623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:6456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.109 [2024-11-28 23:20:56.116637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.109 [2024-11-28 23:20:56.116654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:6464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.109 [2024-11-28 23:20:56.116667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.109 [2024-11-28 23:20:56.116682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:6472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.109 [2024-11-28 23:20:56.116712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.109 [2024-11-28 23:20:56.116728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:5808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.109 [2024-11-28 23:20:56.116743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.109 [2024-11-28 23:20:56.116758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:5832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.109 [2024-11-28 23:20:56.116771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.109 [2024-11-28 23:20:56.116785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:5840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.110 [2024-11-28 23:20:56.116798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.110 [2024-11-28 23:20:56.116811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:5856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.110 [2024-11-28 23:20:56.116824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.110 [2024-11-28 23:20:56.116841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:5864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.110 [2024-11-28 23:20:56.116855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.110 [2024-11-28 23:20:56.116869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:5920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.110 [2024-11-28 23:20:56.116882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.110 [2024-11-28 23:20:56.116896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.110 [2024-11-28 23:20:56.116908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.110 [2024-11-28 23:20:56.116921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:5952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.110 [2024-11-28 23:20:56.116935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.110 [2024-11-28 23:20:56.116949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:6480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.110 [2024-11-28 23:20:56.116962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.110 [2024-11-28 23:20:56.116976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:6488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.110 [2024-11-28 23:20:56.116989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.110 [2024-11-28 23:20:56.117003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.110 [2024-11-28 23:20:56.117016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.110 [2024-11-28 23:20:56.117030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:6504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.110 [2024-11-28 23:20:56.117043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.110 [2024-11-28 23:20:56.117057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:6512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.110 [2024-11-28 23:20:56.117070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.110 [2024-11-28 23:20:56.117083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:6520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.110 [2024-11-28 23:20:56.117096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.110 [2024-11-28 23:20:56.117109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:6528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.110 [2024-11-28 23:20:56.117122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.110 [2024-11-28 23:20:56.117136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:6536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.110 [2024-11-28 23:20:56.117149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.110 [2024-11-28 23:20:56.117162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:6544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.110 [2024-11-28 23:20:56.117178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.110 [2024-11-28 23:20:56.117193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:6552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.110 [2024-11-28 23:20:56.117206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.110 [2024-11-28 23:20:56.117220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:6560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.110 [2024-11-28 23:20:56.117234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.110 [2024-11-28 23:20:56.117248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:6568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.110 [2024-11-28 23:20:56.117260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.110 [2024-11-28 23:20:56.117274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:6576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.110 [2024-11-28 23:20:56.117287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.110 [2024-11-28 23:20:56.117302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:6584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.110 [2024-11-28 23:20:56.117315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.110 [2024-11-28 23:20:56.117329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:6592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.110 [2024-11-28 23:20:56.117342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.110 [2024-11-28 23:20:56.117372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:6600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.110 [2024-11-28 23:20:56.117386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.110 [2024-11-28 23:20:56.117408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:6608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.110 [2024-11-28 23:20:56.117438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.110 [2024-11-28 23:20:56.117455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:6616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.110 [2024-11-28 23:20:56.117469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.110 [2024-11-28 23:20:56.117484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:59.110 [2024-11-28 23:20:56.117497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.110 [2024-11-28 23:20:56.117512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:6632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.110 [2024-11-28 23:20:56.117526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.110 [2024-11-28 23:20:56.117541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:6640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.110 [2024-11-28 23:20:56.117555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.110 [2024-11-28 23:20:56.117573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:6648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.110 [2024-11-28 23:20:56.117588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.110 [2024-11-28 23:20:56.117603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:6656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.110 [2024-11-28 23:20:56.117617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.110 [2024-11-28 23:20:56.117631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:5960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.110 [2024-11-28 23:20:56.117645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.110 [2024-11-28 23:20:56.117660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:5968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.110 [2024-11-28 23:20:56.117674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.110 [2024-11-28 23:20:56.117689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:6000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.110 [2024-11-28 23:20:56.117703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.110 [2024-11-28 23:20:56.117732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:6024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.110 [2024-11-28 23:20:56.117747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.110 [2024-11-28 23:20:56.117762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:6040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.110 [2024-11-28 23:20:56.117775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.110 [2024-11-28 23:20:56.117789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:6056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.110 [2024-11-28 23:20:56.117802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.110 [2024-11-28 23:20:56.117817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:6064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:59.110 [2024-11-28 23:20:56.117830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.110 [2024-11-28 23:20:56.117844] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2478c20 is same with the state(5) to be set 00:28:59.110 [2024-11-28 23:20:56.117860] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:59.110 [2024-11-28 23:20:56.117871] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:59.110 [2024-11-28 23:20:56.117882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6088 len:8 PRP1 0x0 PRP2 0x0 00:28:59.110 [2024-11-28 23:20:56.117895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.110 [2024-11-28 23:20:56.117955] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2478c20 was disconnected and freed. reset controller. 00:28:59.110 [2024-11-28 23:20:56.117973] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:28:59.110 [2024-11-28 23:20:56.118021] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:59.110 [2024-11-28 23:20:56.118041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.110 [2024-11-28 23:20:56.118061] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:59.111 [2024-11-28 23:20:56.118075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.111 [2024-11-28 23:20:56.118088] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:59.111 [2024-11-28 23:20:56.118101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.111 [2024-11-28 23:20:56.118115] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:59.111 [2024-11-28 23:20:56.118128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.111 [2024-11-28 23:20:56.118141] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:59.111 [2024-11-28 23:20:56.118193] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2458000 (9): Bad file descriptor 00:28:59.111 [2024-11-28 23:20:56.120408] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:59.111 [2024-11-28 23:20:56.154057] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:59.111 00:28:59.111 Latency(us) 00:28:59.111 [2024-11-28T22:21:02.717Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:59.111 [2024-11-28T22:21:02.717Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:28:59.111 Verification LBA range: start 0x0 length 0x4000 00:28:59.111 NVMe0n1 : 15.01 12411.72 48.48 1319.13 0.00 9305.26 606.81 15243.19 00:28:59.111 [2024-11-28T22:21:02.717Z] =================================================================================================================== 00:28:59.111 [2024-11-28T22:21:02.717Z] Total : 12411.72 48.48 1319.13 0.00 9305.26 606.81 15243.19 00:28:59.111 Received shutdown signal, test time was about 15.000000 seconds 00:28:59.111 00:28:59.111 Latency(us) 00:28:59.111 [2024-11-28T22:21:02.717Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:59.111 [2024-11-28T22:21:02.717Z] =================================================================================================================== 00:28:59.111 [2024-11-28T22:21:02.717Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:28:59.111 23:21:02 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:28:59.111 23:21:02 -- host/failover.sh@65 -- # count=3 00:28:59.111 23:21:02 -- host/failover.sh@67 -- # (( count != 3 )) 00:28:59.111 23:21:02 -- host/failover.sh@73 -- # bdevperf_pid=2560491 00:28:59.111 23:21:02 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:28:59.111 23:21:02 -- host/failover.sh@75 -- # waitforlisten 2560491 /var/tmp/bdevperf.sock 00:28:59.111 23:21:02 -- common/autotest_common.sh@829 -- # '[' -z 2560491 ']' 00:28:59.111 23:21:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:28:59.111 23:21:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:59.111 23:21:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:28:59.111 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:28:59.111 23:21:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:59.111 23:21:02 -- common/autotest_common.sh@10 -- # set +x 00:28:59.676 23:21:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:59.676 23:21:03 -- common/autotest_common.sh@862 -- # return 0 00:28:59.676 23:21:03 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:59.933 [2024-11-28 23:21:03.441624] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:28:59.933 23:21:03 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:29:00.190 [2024-11-28 23:21:03.742532] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:29:00.190 23:21:03 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:29:00.755 NVMe0n1 00:29:00.755 23:21:04 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:29:01.013 00:29:01.013 23:21:04 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:29:01.577 00:29:01.577 23:21:05 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:29:01.577 23:21:05 -- host/failover.sh@82 -- # grep -q NVMe0 00:29:01.834 23:21:05 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:29:02.091 23:21:05 -- host/failover.sh@87 -- # sleep 3 00:29:05.426 23:21:08 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:29:05.426 23:21:08 -- host/failover.sh@88 -- # grep -q NVMe0 00:29:05.426 23:21:08 -- host/failover.sh@90 -- # run_test_pid=2561782 00:29:05.426 23:21:08 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:29:05.426 23:21:08 -- host/failover.sh@92 -- # wait 2561782 00:29:06.360 0 00:29:06.360 23:21:09 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:29:06.360 [2024-11-28 23:21:02.152939] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:06.360 [2024-11-28 23:21:02.153039] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2560491 ] 00:29:06.360 EAL: No free 2048 kB hugepages reported on node 1 00:29:06.360 [2024-11-28 23:21:02.215274] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:06.360 [2024-11-28 23:21:02.301026] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:06.360 [2024-11-28 23:21:05.529560] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:29:06.360 [2024-11-28 23:21:05.529665] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:06.360 [2024-11-28 23:21:05.529688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:06.360 [2024-11-28 23:21:05.529705] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:06.360 [2024-11-28 23:21:05.529719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:06.360 [2024-11-28 23:21:05.529733] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:06.360 [2024-11-28 23:21:05.529747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:06.360 [2024-11-28 23:21:05.529761] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:06.360 [2024-11-28 23:21:05.529775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:06.360 [2024-11-28 23:21:05.529790] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:06.360 [2024-11-28 23:21:05.529828] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:06.360 [2024-11-28 23:21:05.529859] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2136000 (9): Bad file descriptor 00:29:06.360 [2024-11-28 23:21:05.579839] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:29:06.360 Running I/O for 1 seconds... 00:29:06.360 00:29:06.360 Latency(us) 00:29:06.360 [2024-11-28T22:21:09.966Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:06.360 [2024-11-28T22:21:09.966Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:29:06.360 Verification LBA range: start 0x0 length 0x4000 00:29:06.360 NVMe0n1 : 1.01 12791.41 49.97 0.00 0.00 9962.31 940.56 15631.55 00:29:06.360 [2024-11-28T22:21:09.966Z] =================================================================================================================== 00:29:06.360 [2024-11-28T22:21:09.966Z] Total : 12791.41 49.97 0.00 0.00 9962.31 940.56 15631.55 00:29:06.360 23:21:09 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:29:06.360 23:21:09 -- host/failover.sh@95 -- # grep -q NVMe0 00:29:06.618 23:21:10 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:29:07.183 23:21:10 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:29:07.183 23:21:10 -- host/failover.sh@99 -- # grep -q NVMe0 00:29:07.183 23:21:10 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:29:07.440 23:21:11 -- host/failover.sh@101 -- # sleep 3 00:29:10.720 23:21:14 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:29:10.720 23:21:14 -- host/failover.sh@103 -- # grep -q NVMe0 00:29:10.720 23:21:14 -- host/failover.sh@108 -- # killprocess 2560491 00:29:10.720 23:21:14 -- common/autotest_common.sh@936 -- # '[' -z 2560491 ']' 00:29:10.720 23:21:14 -- common/autotest_common.sh@940 -- # kill -0 2560491 00:29:10.720 23:21:14 -- common/autotest_common.sh@941 -- # uname 00:29:10.720 23:21:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:10.720 23:21:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2560491 00:29:10.979 23:21:14 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:10.979 23:21:14 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:10.979 23:21:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2560491' 00:29:10.979 killing process with pid 2560491 00:29:10.979 23:21:14 -- common/autotest_common.sh@955 -- # kill 2560491 00:29:10.979 23:21:14 -- common/autotest_common.sh@960 -- # wait 2560491 00:29:10.979 23:21:14 -- host/failover.sh@110 -- # sync 00:29:10.979 23:21:14 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:11.544 23:21:14 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:29:11.545 23:21:14 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:29:11.545 23:21:14 -- host/failover.sh@116 -- # nvmftestfini 00:29:11.545 23:21:14 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:11.545 23:21:14 -- nvmf/common.sh@116 -- # sync 00:29:11.545 23:21:14 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:11.545 23:21:14 -- nvmf/common.sh@119 -- # set +e 00:29:11.545 23:21:14 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:11.545 23:21:14 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:11.545 rmmod nvme_tcp 00:29:11.545 rmmod nvme_fabrics 00:29:11.545 rmmod nvme_keyring 00:29:11.545 23:21:14 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:11.545 23:21:14 -- nvmf/common.sh@123 -- # set -e 00:29:11.545 23:21:14 -- nvmf/common.sh@124 -- # return 0 00:29:11.545 23:21:14 -- nvmf/common.sh@477 -- # '[' -n 2557963 ']' 00:29:11.545 23:21:14 -- nvmf/common.sh@478 -- # killprocess 2557963 00:29:11.545 23:21:14 -- common/autotest_common.sh@936 -- # '[' -z 2557963 ']' 00:29:11.545 23:21:14 -- common/autotest_common.sh@940 -- # kill -0 2557963 00:29:11.545 23:21:14 -- common/autotest_common.sh@941 -- # uname 00:29:11.545 23:21:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:11.545 23:21:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2557963 00:29:11.545 23:21:14 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:11.545 23:21:14 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:11.545 23:21:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2557963' 00:29:11.545 killing process with pid 2557963 00:29:11.545 23:21:14 -- common/autotest_common.sh@955 -- # kill 2557963 00:29:11.545 23:21:14 -- common/autotest_common.sh@960 -- # wait 2557963 00:29:11.803 23:21:15 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:11.803 23:21:15 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:11.803 23:21:15 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:11.803 23:21:15 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:11.803 23:21:15 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:11.803 23:21:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:11.803 23:21:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:11.803 23:21:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:13.705 23:21:17 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:13.705 00:29:13.705 real 0m37.425s 00:29:13.705 user 2m13.190s 00:29:13.705 sys 0m5.823s 00:29:13.705 23:21:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:13.705 23:21:17 -- common/autotest_common.sh@10 -- # set +x 00:29:13.705 ************************************ 00:29:13.705 END TEST nvmf_failover 00:29:13.705 ************************************ 00:29:13.705 23:21:17 -- nvmf/nvmf.sh@101 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:29:13.705 23:21:17 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:29:13.705 23:21:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:13.705 23:21:17 -- common/autotest_common.sh@10 -- # set +x 00:29:13.705 ************************************ 00:29:13.705 START TEST nvmf_discovery 00:29:13.705 ************************************ 00:29:13.705 23:21:17 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:29:13.705 * Looking for test storage... 00:29:13.705 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:13.705 23:21:17 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:13.705 23:21:17 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:13.705 23:21:17 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:13.964 23:21:17 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:13.964 23:21:17 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:13.964 23:21:17 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:13.964 23:21:17 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:13.964 23:21:17 -- scripts/common.sh@335 -- # IFS=.-: 00:29:13.964 23:21:17 -- scripts/common.sh@335 -- # read -ra ver1 00:29:13.964 23:21:17 -- scripts/common.sh@336 -- # IFS=.-: 00:29:13.964 23:21:17 -- scripts/common.sh@336 -- # read -ra ver2 00:29:13.964 23:21:17 -- scripts/common.sh@337 -- # local 'op=<' 00:29:13.964 23:21:17 -- scripts/common.sh@339 -- # ver1_l=2 00:29:13.964 23:21:17 -- scripts/common.sh@340 -- # ver2_l=1 00:29:13.964 23:21:17 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:13.964 23:21:17 -- scripts/common.sh@343 -- # case "$op" in 00:29:13.964 23:21:17 -- scripts/common.sh@344 -- # : 1 00:29:13.964 23:21:17 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:13.964 23:21:17 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:13.964 23:21:17 -- scripts/common.sh@364 -- # decimal 1 00:29:13.964 23:21:17 -- scripts/common.sh@352 -- # local d=1 00:29:13.964 23:21:17 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:13.964 23:21:17 -- scripts/common.sh@354 -- # echo 1 00:29:13.964 23:21:17 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:13.964 23:21:17 -- scripts/common.sh@365 -- # decimal 2 00:29:13.964 23:21:17 -- scripts/common.sh@352 -- # local d=2 00:29:13.964 23:21:17 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:13.964 23:21:17 -- scripts/common.sh@354 -- # echo 2 00:29:13.964 23:21:17 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:13.964 23:21:17 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:13.964 23:21:17 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:13.964 23:21:17 -- scripts/common.sh@367 -- # return 0 00:29:13.964 23:21:17 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:13.964 23:21:17 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:13.964 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:13.964 --rc genhtml_branch_coverage=1 00:29:13.964 --rc genhtml_function_coverage=1 00:29:13.964 --rc genhtml_legend=1 00:29:13.964 --rc geninfo_all_blocks=1 00:29:13.964 --rc geninfo_unexecuted_blocks=1 00:29:13.964 00:29:13.964 ' 00:29:13.964 23:21:17 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:13.964 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:13.964 --rc genhtml_branch_coverage=1 00:29:13.964 --rc genhtml_function_coverage=1 00:29:13.964 --rc genhtml_legend=1 00:29:13.964 --rc geninfo_all_blocks=1 00:29:13.964 --rc geninfo_unexecuted_blocks=1 00:29:13.964 00:29:13.964 ' 00:29:13.964 23:21:17 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:13.964 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:13.964 --rc genhtml_branch_coverage=1 00:29:13.964 --rc genhtml_function_coverage=1 00:29:13.964 --rc genhtml_legend=1 00:29:13.964 --rc geninfo_all_blocks=1 00:29:13.964 --rc geninfo_unexecuted_blocks=1 00:29:13.964 00:29:13.964 ' 00:29:13.964 23:21:17 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:13.964 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:13.964 --rc genhtml_branch_coverage=1 00:29:13.964 --rc genhtml_function_coverage=1 00:29:13.964 --rc genhtml_legend=1 00:29:13.964 --rc geninfo_all_blocks=1 00:29:13.964 --rc geninfo_unexecuted_blocks=1 00:29:13.964 00:29:13.964 ' 00:29:13.964 23:21:17 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:13.964 23:21:17 -- nvmf/common.sh@7 -- # uname -s 00:29:13.964 23:21:17 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:13.964 23:21:17 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:13.964 23:21:17 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:13.964 23:21:17 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:13.964 23:21:17 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:13.964 23:21:17 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:13.964 23:21:17 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:13.964 23:21:17 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:13.964 23:21:17 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:13.964 23:21:17 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:13.964 23:21:17 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:13.964 23:21:17 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:13.964 23:21:17 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:13.964 23:21:17 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:13.964 23:21:17 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:13.964 23:21:17 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:13.964 23:21:17 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:13.964 23:21:17 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:13.964 23:21:17 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:13.964 23:21:17 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:13.964 23:21:17 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:13.964 23:21:17 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:13.964 23:21:17 -- paths/export.sh@5 -- # export PATH 00:29:13.964 23:21:17 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:13.964 23:21:17 -- nvmf/common.sh@46 -- # : 0 00:29:13.964 23:21:17 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:13.964 23:21:17 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:13.964 23:21:17 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:13.964 23:21:17 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:13.964 23:21:17 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:13.964 23:21:17 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:13.964 23:21:17 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:13.964 23:21:17 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:13.964 23:21:17 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:29:13.964 23:21:17 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:29:13.964 23:21:17 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:29:13.964 23:21:17 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:29:13.964 23:21:17 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:29:13.964 23:21:17 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:29:13.964 23:21:17 -- host/discovery.sh@25 -- # nvmftestinit 00:29:13.964 23:21:17 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:13.964 23:21:17 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:13.964 23:21:17 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:13.964 23:21:17 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:13.964 23:21:17 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:13.964 23:21:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:13.964 23:21:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:13.964 23:21:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:13.964 23:21:17 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:13.964 23:21:17 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:13.964 23:21:17 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:13.964 23:21:17 -- common/autotest_common.sh@10 -- # set +x 00:29:16.495 23:21:19 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:16.495 23:21:19 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:16.495 23:21:19 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:16.495 23:21:19 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:16.495 23:21:19 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:16.495 23:21:19 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:16.495 23:21:19 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:16.495 23:21:19 -- nvmf/common.sh@294 -- # net_devs=() 00:29:16.495 23:21:19 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:16.495 23:21:19 -- nvmf/common.sh@295 -- # e810=() 00:29:16.495 23:21:19 -- nvmf/common.sh@295 -- # local -ga e810 00:29:16.495 23:21:19 -- nvmf/common.sh@296 -- # x722=() 00:29:16.495 23:21:19 -- nvmf/common.sh@296 -- # local -ga x722 00:29:16.495 23:21:19 -- nvmf/common.sh@297 -- # mlx=() 00:29:16.495 23:21:19 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:16.495 23:21:19 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:16.495 23:21:19 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:16.495 23:21:19 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:16.495 23:21:19 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:16.495 23:21:19 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:16.495 23:21:19 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:16.495 23:21:19 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:16.495 23:21:19 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:16.495 23:21:19 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:16.495 23:21:19 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:16.495 23:21:19 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:16.495 23:21:19 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:16.495 23:21:19 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:16.495 23:21:19 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:16.495 23:21:19 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:16.495 23:21:19 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:16.495 23:21:19 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:16.495 23:21:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:16.495 23:21:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:16.495 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:16.495 23:21:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:16.495 23:21:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:16.495 23:21:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:16.495 23:21:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:16.495 23:21:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:16.495 23:21:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:16.495 23:21:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:16.495 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:16.495 23:21:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:16.495 23:21:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:16.495 23:21:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:16.495 23:21:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:16.495 23:21:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:16.495 23:21:19 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:16.495 23:21:19 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:16.495 23:21:19 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:16.495 23:21:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:16.495 23:21:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:16.495 23:21:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:16.495 23:21:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:16.495 23:21:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:16.495 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:16.495 23:21:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:16.495 23:21:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:16.495 23:21:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:16.495 23:21:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:16.495 23:21:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:16.495 23:21:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:16.495 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:16.495 23:21:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:16.495 23:21:19 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:16.495 23:21:19 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:16.495 23:21:19 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:16.495 23:21:19 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:16.495 23:21:19 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:16.495 23:21:19 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:16.495 23:21:19 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:16.495 23:21:19 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:16.495 23:21:19 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:16.495 23:21:19 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:16.495 23:21:19 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:16.495 23:21:19 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:16.495 23:21:19 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:16.495 23:21:19 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:16.495 23:21:19 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:16.495 23:21:19 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:16.495 23:21:19 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:16.495 23:21:19 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:16.495 23:21:19 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:16.495 23:21:19 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:16.495 23:21:19 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:16.495 23:21:19 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:16.495 23:21:19 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:16.495 23:21:19 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:16.495 23:21:19 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:16.495 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:16.495 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.271 ms 00:29:16.495 00:29:16.495 --- 10.0.0.2 ping statistics --- 00:29:16.495 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:16.495 rtt min/avg/max/mdev = 0.271/0.271/0.271/0.000 ms 00:29:16.495 23:21:19 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:16.495 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:16.495 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.133 ms 00:29:16.495 00:29:16.495 --- 10.0.0.1 ping statistics --- 00:29:16.495 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:16.495 rtt min/avg/max/mdev = 0.133/0.133/0.133/0.000 ms 00:29:16.496 23:21:19 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:16.496 23:21:19 -- nvmf/common.sh@410 -- # return 0 00:29:16.496 23:21:19 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:16.496 23:21:19 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:16.496 23:21:19 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:16.496 23:21:19 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:16.496 23:21:19 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:16.496 23:21:19 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:16.496 23:21:19 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:16.496 23:21:19 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:29:16.496 23:21:19 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:16.496 23:21:19 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:16.496 23:21:19 -- common/autotest_common.sh@10 -- # set +x 00:29:16.496 23:21:19 -- nvmf/common.sh@469 -- # nvmfpid=2564592 00:29:16.496 23:21:19 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:29:16.496 23:21:19 -- nvmf/common.sh@470 -- # waitforlisten 2564592 00:29:16.496 23:21:19 -- common/autotest_common.sh@829 -- # '[' -z 2564592 ']' 00:29:16.496 23:21:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:16.496 23:21:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:16.496 23:21:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:16.496 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:16.496 23:21:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:16.496 23:21:19 -- common/autotest_common.sh@10 -- # set +x 00:29:16.496 [2024-11-28 23:21:19.687215] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:16.496 [2024-11-28 23:21:19.687297] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:16.496 EAL: No free 2048 kB hugepages reported on node 1 00:29:16.496 [2024-11-28 23:21:19.758039] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:16.496 [2024-11-28 23:21:19.850646] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:16.496 [2024-11-28 23:21:19.850815] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:16.496 [2024-11-28 23:21:19.850836] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:16.496 [2024-11-28 23:21:19.850852] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:16.496 [2024-11-28 23:21:19.850896] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:17.430 23:21:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:17.430 23:21:20 -- common/autotest_common.sh@862 -- # return 0 00:29:17.430 23:21:20 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:17.430 23:21:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:17.430 23:21:20 -- common/autotest_common.sh@10 -- # set +x 00:29:17.430 23:21:20 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:17.430 23:21:20 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:29:17.430 23:21:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:17.430 23:21:20 -- common/autotest_common.sh@10 -- # set +x 00:29:17.430 [2024-11-28 23:21:20.745039] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:17.430 23:21:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:17.430 23:21:20 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:29:17.430 23:21:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:17.430 23:21:20 -- common/autotest_common.sh@10 -- # set +x 00:29:17.430 [2024-11-28 23:21:20.753192] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:29:17.430 23:21:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:17.430 23:21:20 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:29:17.430 23:21:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:17.430 23:21:20 -- common/autotest_common.sh@10 -- # set +x 00:29:17.430 null0 00:29:17.430 23:21:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:17.430 23:21:20 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:29:17.430 23:21:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:17.430 23:21:20 -- common/autotest_common.sh@10 -- # set +x 00:29:17.430 null1 00:29:17.430 23:21:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:17.430 23:21:20 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:29:17.430 23:21:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:17.430 23:21:20 -- common/autotest_common.sh@10 -- # set +x 00:29:17.430 23:21:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:17.430 23:21:20 -- host/discovery.sh@45 -- # hostpid=2564747 00:29:17.430 23:21:20 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:29:17.430 23:21:20 -- host/discovery.sh@46 -- # waitforlisten 2564747 /tmp/host.sock 00:29:17.431 23:21:20 -- common/autotest_common.sh@829 -- # '[' -z 2564747 ']' 00:29:17.431 23:21:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:29:17.431 23:21:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:17.431 23:21:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:29:17.431 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:29:17.431 23:21:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:17.431 23:21:20 -- common/autotest_common.sh@10 -- # set +x 00:29:17.431 [2024-11-28 23:21:20.823947] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:17.431 [2024-11-28 23:21:20.824012] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2564747 ] 00:29:17.431 EAL: No free 2048 kB hugepages reported on node 1 00:29:17.431 [2024-11-28 23:21:20.885242] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:17.431 [2024-11-28 23:21:20.973469] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:17.431 [2024-11-28 23:21:20.973634] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:18.365 23:21:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:18.365 23:21:21 -- common/autotest_common.sh@862 -- # return 0 00:29:18.365 23:21:21 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:29:18.365 23:21:21 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:29:18.365 23:21:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.365 23:21:21 -- common/autotest_common.sh@10 -- # set +x 00:29:18.365 23:21:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.365 23:21:21 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:29:18.365 23:21:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.365 23:21:21 -- common/autotest_common.sh@10 -- # set +x 00:29:18.365 23:21:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.365 23:21:21 -- host/discovery.sh@72 -- # notify_id=0 00:29:18.365 23:21:21 -- host/discovery.sh@78 -- # get_subsystem_names 00:29:18.365 23:21:21 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:18.365 23:21:21 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:18.365 23:21:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.365 23:21:21 -- host/discovery.sh@59 -- # sort 00:29:18.365 23:21:21 -- common/autotest_common.sh@10 -- # set +x 00:29:18.365 23:21:21 -- host/discovery.sh@59 -- # xargs 00:29:18.365 23:21:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.365 23:21:21 -- host/discovery.sh@78 -- # [[ '' == '' ]] 00:29:18.365 23:21:21 -- host/discovery.sh@79 -- # get_bdev_list 00:29:18.365 23:21:21 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:18.365 23:21:21 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:18.365 23:21:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.365 23:21:21 -- host/discovery.sh@55 -- # sort 00:29:18.365 23:21:21 -- common/autotest_common.sh@10 -- # set +x 00:29:18.365 23:21:21 -- host/discovery.sh@55 -- # xargs 00:29:18.365 23:21:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.365 23:21:21 -- host/discovery.sh@79 -- # [[ '' == '' ]] 00:29:18.365 23:21:21 -- host/discovery.sh@81 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:29:18.365 23:21:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.365 23:21:21 -- common/autotest_common.sh@10 -- # set +x 00:29:18.365 23:21:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.365 23:21:21 -- host/discovery.sh@82 -- # get_subsystem_names 00:29:18.365 23:21:21 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:18.365 23:21:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.365 23:21:21 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:18.365 23:21:21 -- common/autotest_common.sh@10 -- # set +x 00:29:18.365 23:21:21 -- host/discovery.sh@59 -- # sort 00:29:18.365 23:21:21 -- host/discovery.sh@59 -- # xargs 00:29:18.365 23:21:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.365 23:21:21 -- host/discovery.sh@82 -- # [[ '' == '' ]] 00:29:18.365 23:21:21 -- host/discovery.sh@83 -- # get_bdev_list 00:29:18.365 23:21:21 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:18.365 23:21:21 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:18.365 23:21:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.365 23:21:21 -- common/autotest_common.sh@10 -- # set +x 00:29:18.365 23:21:21 -- host/discovery.sh@55 -- # sort 00:29:18.365 23:21:21 -- host/discovery.sh@55 -- # xargs 00:29:18.365 23:21:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.365 23:21:21 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:29:18.365 23:21:21 -- host/discovery.sh@85 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:29:18.365 23:21:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.365 23:21:21 -- common/autotest_common.sh@10 -- # set +x 00:29:18.623 23:21:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.623 23:21:21 -- host/discovery.sh@86 -- # get_subsystem_names 00:29:18.623 23:21:21 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:18.623 23:21:21 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:18.623 23:21:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.623 23:21:21 -- common/autotest_common.sh@10 -- # set +x 00:29:18.623 23:21:21 -- host/discovery.sh@59 -- # sort 00:29:18.623 23:21:21 -- host/discovery.sh@59 -- # xargs 00:29:18.623 23:21:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.623 23:21:22 -- host/discovery.sh@86 -- # [[ '' == '' ]] 00:29:18.623 23:21:22 -- host/discovery.sh@87 -- # get_bdev_list 00:29:18.623 23:21:22 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:18.623 23:21:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.623 23:21:22 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:18.623 23:21:22 -- common/autotest_common.sh@10 -- # set +x 00:29:18.623 23:21:22 -- host/discovery.sh@55 -- # sort 00:29:18.623 23:21:22 -- host/discovery.sh@55 -- # xargs 00:29:18.623 23:21:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.623 23:21:22 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:29:18.623 23:21:22 -- host/discovery.sh@91 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:18.623 23:21:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.623 23:21:22 -- common/autotest_common.sh@10 -- # set +x 00:29:18.623 [2024-11-28 23:21:22.060856] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:18.623 23:21:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.623 23:21:22 -- host/discovery.sh@92 -- # get_subsystem_names 00:29:18.623 23:21:22 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:18.623 23:21:22 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:18.623 23:21:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.623 23:21:22 -- common/autotest_common.sh@10 -- # set +x 00:29:18.623 23:21:22 -- host/discovery.sh@59 -- # sort 00:29:18.623 23:21:22 -- host/discovery.sh@59 -- # xargs 00:29:18.623 23:21:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.623 23:21:22 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:29:18.623 23:21:22 -- host/discovery.sh@93 -- # get_bdev_list 00:29:18.623 23:21:22 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:18.623 23:21:22 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:18.623 23:21:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.623 23:21:22 -- host/discovery.sh@55 -- # sort 00:29:18.623 23:21:22 -- common/autotest_common.sh@10 -- # set +x 00:29:18.623 23:21:22 -- host/discovery.sh@55 -- # xargs 00:29:18.623 23:21:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.623 23:21:22 -- host/discovery.sh@93 -- # [[ '' == '' ]] 00:29:18.623 23:21:22 -- host/discovery.sh@94 -- # get_notification_count 00:29:18.623 23:21:22 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:29:18.623 23:21:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.623 23:21:22 -- host/discovery.sh@74 -- # jq '. | length' 00:29:18.623 23:21:22 -- common/autotest_common.sh@10 -- # set +x 00:29:18.623 23:21:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.623 23:21:22 -- host/discovery.sh@74 -- # notification_count=0 00:29:18.623 23:21:22 -- host/discovery.sh@75 -- # notify_id=0 00:29:18.623 23:21:22 -- host/discovery.sh@95 -- # [[ 0 == 0 ]] 00:29:18.623 23:21:22 -- host/discovery.sh@99 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:29:18.623 23:21:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.623 23:21:22 -- common/autotest_common.sh@10 -- # set +x 00:29:18.623 23:21:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.623 23:21:22 -- host/discovery.sh@100 -- # sleep 1 00:29:19.557 [2024-11-28 23:21:22.803683] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:19.557 [2024-11-28 23:21:22.803722] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:19.557 [2024-11-28 23:21:22.803761] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:19.557 [2024-11-28 23:21:22.931142] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:29:19.557 [2024-11-28 23:21:23.116122] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:29:19.557 [2024-11-28 23:21:23.116148] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:19.815 23:21:23 -- host/discovery.sh@101 -- # get_subsystem_names 00:29:19.815 23:21:23 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:19.815 23:21:23 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:19.815 23:21:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.815 23:21:23 -- host/discovery.sh@59 -- # sort 00:29:19.815 23:21:23 -- common/autotest_common.sh@10 -- # set +x 00:29:19.815 23:21:23 -- host/discovery.sh@59 -- # xargs 00:29:19.815 23:21:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.815 23:21:23 -- host/discovery.sh@101 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:19.816 23:21:23 -- host/discovery.sh@102 -- # get_bdev_list 00:29:19.816 23:21:23 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:19.816 23:21:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.816 23:21:23 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:19.816 23:21:23 -- common/autotest_common.sh@10 -- # set +x 00:29:19.816 23:21:23 -- host/discovery.sh@55 -- # sort 00:29:19.816 23:21:23 -- host/discovery.sh@55 -- # xargs 00:29:19.816 23:21:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.816 23:21:23 -- host/discovery.sh@102 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:29:19.816 23:21:23 -- host/discovery.sh@103 -- # get_subsystem_paths nvme0 00:29:19.816 23:21:23 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:29:19.816 23:21:23 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:29:19.816 23:21:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.816 23:21:23 -- common/autotest_common.sh@10 -- # set +x 00:29:19.816 23:21:23 -- host/discovery.sh@63 -- # sort -n 00:29:19.816 23:21:23 -- host/discovery.sh@63 -- # xargs 00:29:19.816 23:21:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.816 23:21:23 -- host/discovery.sh@103 -- # [[ 4420 == \4\4\2\0 ]] 00:29:19.816 23:21:23 -- host/discovery.sh@104 -- # get_notification_count 00:29:19.816 23:21:23 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:29:19.816 23:21:23 -- host/discovery.sh@74 -- # jq '. | length' 00:29:19.816 23:21:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.816 23:21:23 -- common/autotest_common.sh@10 -- # set +x 00:29:19.816 23:21:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.816 23:21:23 -- host/discovery.sh@74 -- # notification_count=1 00:29:19.816 23:21:23 -- host/discovery.sh@75 -- # notify_id=1 00:29:19.816 23:21:23 -- host/discovery.sh@105 -- # [[ 1 == 1 ]] 00:29:19.816 23:21:23 -- host/discovery.sh@108 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:29:19.816 23:21:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.816 23:21:23 -- common/autotest_common.sh@10 -- # set +x 00:29:19.816 23:21:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.816 23:21:23 -- host/discovery.sh@109 -- # sleep 1 00:29:21.189 23:21:24 -- host/discovery.sh@110 -- # get_bdev_list 00:29:21.189 23:21:24 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:21.189 23:21:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:21.189 23:21:24 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:21.189 23:21:24 -- common/autotest_common.sh@10 -- # set +x 00:29:21.189 23:21:24 -- host/discovery.sh@55 -- # sort 00:29:21.189 23:21:24 -- host/discovery.sh@55 -- # xargs 00:29:21.189 23:21:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:21.189 23:21:24 -- host/discovery.sh@110 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:21.189 23:21:24 -- host/discovery.sh@111 -- # get_notification_count 00:29:21.189 23:21:24 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:29:21.189 23:21:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:21.189 23:21:24 -- host/discovery.sh@74 -- # jq '. | length' 00:29:21.189 23:21:24 -- common/autotest_common.sh@10 -- # set +x 00:29:21.189 23:21:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:21.189 23:21:24 -- host/discovery.sh@74 -- # notification_count=1 00:29:21.189 23:21:24 -- host/discovery.sh@75 -- # notify_id=2 00:29:21.189 23:21:24 -- host/discovery.sh@112 -- # [[ 1 == 1 ]] 00:29:21.189 23:21:24 -- host/discovery.sh@116 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:29:21.189 23:21:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:21.189 23:21:24 -- common/autotest_common.sh@10 -- # set +x 00:29:21.189 [2024-11-28 23:21:24.447846] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:29:21.189 [2024-11-28 23:21:24.448539] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:29:21.189 [2024-11-28 23:21:24.448570] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:21.189 23:21:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:21.189 23:21:24 -- host/discovery.sh@117 -- # sleep 1 00:29:21.189 [2024-11-28 23:21:24.576026] bdev_nvme.c:6683:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:29:21.447 [2024-11-28 23:21:24.842268] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:29:21.447 [2024-11-28 23:21:24.842293] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:21.447 [2024-11-28 23:21:24.842304] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:29:22.010 23:21:25 -- host/discovery.sh@118 -- # get_subsystem_names 00:29:22.010 23:21:25 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:22.010 23:21:25 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:22.010 23:21:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.010 23:21:25 -- host/discovery.sh@59 -- # sort 00:29:22.010 23:21:25 -- common/autotest_common.sh@10 -- # set +x 00:29:22.010 23:21:25 -- host/discovery.sh@59 -- # xargs 00:29:22.010 23:21:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.010 23:21:25 -- host/discovery.sh@118 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:22.010 23:21:25 -- host/discovery.sh@119 -- # get_bdev_list 00:29:22.011 23:21:25 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:22.011 23:21:25 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:22.011 23:21:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.011 23:21:25 -- host/discovery.sh@55 -- # sort 00:29:22.011 23:21:25 -- common/autotest_common.sh@10 -- # set +x 00:29:22.011 23:21:25 -- host/discovery.sh@55 -- # xargs 00:29:22.011 23:21:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.011 23:21:25 -- host/discovery.sh@119 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:22.011 23:21:25 -- host/discovery.sh@120 -- # get_subsystem_paths nvme0 00:29:22.011 23:21:25 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:29:22.011 23:21:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.011 23:21:25 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:29:22.011 23:21:25 -- common/autotest_common.sh@10 -- # set +x 00:29:22.011 23:21:25 -- host/discovery.sh@63 -- # sort -n 00:29:22.011 23:21:25 -- host/discovery.sh@63 -- # xargs 00:29:22.011 23:21:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.011 23:21:25 -- host/discovery.sh@120 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:29:22.011 23:21:25 -- host/discovery.sh@121 -- # get_notification_count 00:29:22.011 23:21:25 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:29:22.011 23:21:25 -- host/discovery.sh@74 -- # jq '. | length' 00:29:22.011 23:21:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.011 23:21:25 -- common/autotest_common.sh@10 -- # set +x 00:29:22.011 23:21:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.269 23:21:25 -- host/discovery.sh@74 -- # notification_count=0 00:29:22.269 23:21:25 -- host/discovery.sh@75 -- # notify_id=2 00:29:22.269 23:21:25 -- host/discovery.sh@122 -- # [[ 0 == 0 ]] 00:29:22.269 23:21:25 -- host/discovery.sh@126 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:22.269 23:21:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.269 23:21:25 -- common/autotest_common.sh@10 -- # set +x 00:29:22.269 [2024-11-28 23:21:25.632220] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:29:22.269 [2024-11-28 23:21:25.632253] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:22.269 23:21:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.269 23:21:25 -- host/discovery.sh@127 -- # sleep 1 00:29:22.269 [2024-11-28 23:21:25.639774] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:22.269 [2024-11-28 23:21:25.639809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:22.269 [2024-11-28 23:21:25.639829] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:22.269 [2024-11-28 23:21:25.639853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:22.269 [2024-11-28 23:21:25.639873] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:22.269 [2024-11-28 23:21:25.639888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:22.269 [2024-11-28 23:21:25.639903] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:22.269 [2024-11-28 23:21:25.639918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:22.269 [2024-11-28 23:21:25.639934] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20dd410 is same with the state(5) to be set 00:29:22.269 [2024-11-28 23:21:25.649782] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x20dd410 (9): Bad file descriptor 00:29:22.269 [2024-11-28 23:21:25.659831] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:22.269 [2024-11-28 23:21:25.660005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:22.269 [2024-11-28 23:21:25.660187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:22.269 [2024-11-28 23:21:25.660215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20dd410 with addr=10.0.0.2, port=4420 00:29:22.269 [2024-11-28 23:21:25.660232] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20dd410 is same with the state(5) to be set 00:29:22.269 [2024-11-28 23:21:25.660256] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x20dd410 (9): Bad file descriptor 00:29:22.269 [2024-11-28 23:21:25.660293] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:22.269 [2024-11-28 23:21:25.660307] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:22.269 [2024-11-28 23:21:25.660322] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:22.269 [2024-11-28 23:21:25.660370] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:22.269 [2024-11-28 23:21:25.669914] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:22.269 [2024-11-28 23:21:25.670072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:22.269 [2024-11-28 23:21:25.670215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:22.269 [2024-11-28 23:21:25.670244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20dd410 with addr=10.0.0.2, port=4420 00:29:22.269 [2024-11-28 23:21:25.670262] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20dd410 is same with the state(5) to be set 00:29:22.269 [2024-11-28 23:21:25.670287] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x20dd410 (9): Bad file descriptor 00:29:22.269 [2024-11-28 23:21:25.670310] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:22.269 [2024-11-28 23:21:25.670326] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:22.269 [2024-11-28 23:21:25.670342] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:22.269 [2024-11-28 23:21:25.670364] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:22.269 [2024-11-28 23:21:25.679992] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:22.269 [2024-11-28 23:21:25.680169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:22.269 [2024-11-28 23:21:25.680306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:22.269 [2024-11-28 23:21:25.680334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20dd410 with addr=10.0.0.2, port=4420 00:29:22.269 [2024-11-28 23:21:25.680354] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20dd410 is same with the state(5) to be set 00:29:22.269 [2024-11-28 23:21:25.680379] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x20dd410 (9): Bad file descriptor 00:29:22.269 [2024-11-28 23:21:25.680412] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:22.269 [2024-11-28 23:21:25.680445] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:22.269 [2024-11-28 23:21:25.680459] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:22.269 [2024-11-28 23:21:25.680493] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:22.269 [2024-11-28 23:21:25.690076] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:22.269 [2024-11-28 23:21:25.690266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:22.269 [2024-11-28 23:21:25.690410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:22.269 [2024-11-28 23:21:25.690453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20dd410 with addr=10.0.0.2, port=4420 00:29:22.269 [2024-11-28 23:21:25.690471] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20dd410 is same with the state(5) to be set 00:29:22.269 [2024-11-28 23:21:25.690494] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x20dd410 (9): Bad file descriptor 00:29:22.269 [2024-11-28 23:21:25.690528] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:22.269 [2024-11-28 23:21:25.690547] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:22.269 [2024-11-28 23:21:25.690562] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:22.269 [2024-11-28 23:21:25.690581] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:22.269 [2024-11-28 23:21:25.700154] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:22.269 [2024-11-28 23:21:25.700320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:22.269 [2024-11-28 23:21:25.700428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:22.269 [2024-11-28 23:21:25.700472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20dd410 with addr=10.0.0.2, port=4420 00:29:22.269 [2024-11-28 23:21:25.700489] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20dd410 is same with the state(5) to be set 00:29:22.269 [2024-11-28 23:21:25.700511] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x20dd410 (9): Bad file descriptor 00:29:22.269 [2024-11-28 23:21:25.700531] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:22.269 [2024-11-28 23:21:25.700546] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:22.269 [2024-11-28 23:21:25.700561] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:22.269 [2024-11-28 23:21:25.700593] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:22.269 [2024-11-28 23:21:25.710238] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:22.269 [2024-11-28 23:21:25.710483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:22.269 [2024-11-28 23:21:25.710630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:22.269 [2024-11-28 23:21:25.710657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20dd410 with addr=10.0.0.2, port=4420 00:29:22.269 [2024-11-28 23:21:25.710692] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20dd410 is same with the state(5) to be set 00:29:22.269 [2024-11-28 23:21:25.710717] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x20dd410 (9): Bad file descriptor 00:29:22.269 [2024-11-28 23:21:25.710755] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:22.269 [2024-11-28 23:21:25.710775] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:22.269 [2024-11-28 23:21:25.710791] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:22.269 [2024-11-28 23:21:25.710813] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:22.270 [2024-11-28 23:21:25.718767] bdev_nvme.c:6546:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:29:22.270 [2024-11-28 23:21:25.718795] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:29:23.202 23:21:26 -- host/discovery.sh@128 -- # get_subsystem_names 00:29:23.202 23:21:26 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:23.202 23:21:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:23.202 23:21:26 -- common/autotest_common.sh@10 -- # set +x 00:29:23.202 23:21:26 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:23.202 23:21:26 -- host/discovery.sh@59 -- # sort 00:29:23.202 23:21:26 -- host/discovery.sh@59 -- # xargs 00:29:23.202 23:21:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:23.202 23:21:26 -- host/discovery.sh@128 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:23.202 23:21:26 -- host/discovery.sh@129 -- # get_bdev_list 00:29:23.202 23:21:26 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:23.202 23:21:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:23.202 23:21:26 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:23.202 23:21:26 -- common/autotest_common.sh@10 -- # set +x 00:29:23.202 23:21:26 -- host/discovery.sh@55 -- # sort 00:29:23.202 23:21:26 -- host/discovery.sh@55 -- # xargs 00:29:23.202 23:21:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:23.202 23:21:26 -- host/discovery.sh@129 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:23.202 23:21:26 -- host/discovery.sh@130 -- # get_subsystem_paths nvme0 00:29:23.202 23:21:26 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:29:23.202 23:21:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:23.202 23:21:26 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:29:23.202 23:21:26 -- common/autotest_common.sh@10 -- # set +x 00:29:23.202 23:21:26 -- host/discovery.sh@63 -- # sort -n 00:29:23.202 23:21:26 -- host/discovery.sh@63 -- # xargs 00:29:23.202 23:21:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:23.202 23:21:26 -- host/discovery.sh@130 -- # [[ 4421 == \4\4\2\1 ]] 00:29:23.203 23:21:26 -- host/discovery.sh@131 -- # get_notification_count 00:29:23.203 23:21:26 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:29:23.203 23:21:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:23.203 23:21:26 -- common/autotest_common.sh@10 -- # set +x 00:29:23.203 23:21:26 -- host/discovery.sh@74 -- # jq '. | length' 00:29:23.203 23:21:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:23.203 23:21:26 -- host/discovery.sh@74 -- # notification_count=0 00:29:23.203 23:21:26 -- host/discovery.sh@75 -- # notify_id=2 00:29:23.203 23:21:26 -- host/discovery.sh@132 -- # [[ 0 == 0 ]] 00:29:23.203 23:21:26 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:29:23.203 23:21:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:23.203 23:21:26 -- common/autotest_common.sh@10 -- # set +x 00:29:23.460 23:21:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:23.460 23:21:26 -- host/discovery.sh@135 -- # sleep 1 00:29:24.394 23:21:27 -- host/discovery.sh@136 -- # get_subsystem_names 00:29:24.394 23:21:27 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:24.394 23:21:27 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:24.394 23:21:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:24.394 23:21:27 -- common/autotest_common.sh@10 -- # set +x 00:29:24.394 23:21:27 -- host/discovery.sh@59 -- # sort 00:29:24.394 23:21:27 -- host/discovery.sh@59 -- # xargs 00:29:24.394 23:21:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:24.394 23:21:27 -- host/discovery.sh@136 -- # [[ '' == '' ]] 00:29:24.394 23:21:27 -- host/discovery.sh@137 -- # get_bdev_list 00:29:24.394 23:21:27 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:24.394 23:21:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:24.394 23:21:27 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:24.394 23:21:27 -- host/discovery.sh@55 -- # sort 00:29:24.394 23:21:27 -- common/autotest_common.sh@10 -- # set +x 00:29:24.394 23:21:27 -- host/discovery.sh@55 -- # xargs 00:29:24.394 23:21:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:24.394 23:21:27 -- host/discovery.sh@137 -- # [[ '' == '' ]] 00:29:24.394 23:21:27 -- host/discovery.sh@138 -- # get_notification_count 00:29:24.394 23:21:27 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:29:24.394 23:21:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:24.394 23:21:27 -- host/discovery.sh@74 -- # jq '. | length' 00:29:24.394 23:21:27 -- common/autotest_common.sh@10 -- # set +x 00:29:24.394 23:21:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:24.394 23:21:27 -- host/discovery.sh@74 -- # notification_count=2 00:29:24.394 23:21:27 -- host/discovery.sh@75 -- # notify_id=4 00:29:24.394 23:21:27 -- host/discovery.sh@139 -- # [[ 2 == 2 ]] 00:29:24.394 23:21:27 -- host/discovery.sh@142 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:24.394 23:21:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:24.394 23:21:27 -- common/autotest_common.sh@10 -- # set +x 00:29:25.767 [2024-11-28 23:21:28.992061] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:25.767 [2024-11-28 23:21:28.992104] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:25.767 [2024-11-28 23:21:28.992129] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:25.767 [2024-11-28 23:21:29.120566] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:29:26.025 [2024-11-28 23:21:29.387508] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:29:26.025 [2024-11-28 23:21:29.387551] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:29:26.025 23:21:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:26.025 23:21:29 -- host/discovery.sh@144 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:26.025 23:21:29 -- common/autotest_common.sh@650 -- # local es=0 00:29:26.025 23:21:29 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:26.025 23:21:29 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:29:26.025 23:21:29 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:26.025 23:21:29 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:29:26.025 23:21:29 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:26.025 23:21:29 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:26.025 23:21:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:26.025 23:21:29 -- common/autotest_common.sh@10 -- # set +x 00:29:26.025 request: 00:29:26.025 { 00:29:26.025 "name": "nvme", 00:29:26.025 "trtype": "tcp", 00:29:26.025 "traddr": "10.0.0.2", 00:29:26.025 "hostnqn": "nqn.2021-12.io.spdk:test", 00:29:26.025 "adrfam": "ipv4", 00:29:26.025 "trsvcid": "8009", 00:29:26.025 "wait_for_attach": true, 00:29:26.025 "method": "bdev_nvme_start_discovery", 00:29:26.025 "req_id": 1 00:29:26.025 } 00:29:26.025 Got JSON-RPC error response 00:29:26.025 response: 00:29:26.025 { 00:29:26.025 "code": -17, 00:29:26.025 "message": "File exists" 00:29:26.025 } 00:29:26.025 23:21:29 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:29:26.025 23:21:29 -- common/autotest_common.sh@653 -- # es=1 00:29:26.025 23:21:29 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:29:26.025 23:21:29 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:29:26.025 23:21:29 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:29:26.025 23:21:29 -- host/discovery.sh@146 -- # get_discovery_ctrlrs 00:29:26.025 23:21:29 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:29:26.025 23:21:29 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:29:26.025 23:21:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:26.025 23:21:29 -- common/autotest_common.sh@10 -- # set +x 00:29:26.025 23:21:29 -- host/discovery.sh@67 -- # sort 00:29:26.025 23:21:29 -- host/discovery.sh@67 -- # xargs 00:29:26.025 23:21:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:26.025 23:21:29 -- host/discovery.sh@146 -- # [[ nvme == \n\v\m\e ]] 00:29:26.025 23:21:29 -- host/discovery.sh@147 -- # get_bdev_list 00:29:26.025 23:21:29 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:26.025 23:21:29 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:26.025 23:21:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:26.025 23:21:29 -- common/autotest_common.sh@10 -- # set +x 00:29:26.025 23:21:29 -- host/discovery.sh@55 -- # sort 00:29:26.025 23:21:29 -- host/discovery.sh@55 -- # xargs 00:29:26.025 23:21:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:26.025 23:21:29 -- host/discovery.sh@147 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:26.025 23:21:29 -- host/discovery.sh@150 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:26.025 23:21:29 -- common/autotest_common.sh@650 -- # local es=0 00:29:26.025 23:21:29 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:26.025 23:21:29 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:29:26.025 23:21:29 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:26.025 23:21:29 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:29:26.025 23:21:29 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:26.025 23:21:29 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:26.025 23:21:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:26.025 23:21:29 -- common/autotest_common.sh@10 -- # set +x 00:29:26.025 request: 00:29:26.025 { 00:29:26.025 "name": "nvme_second", 00:29:26.025 "trtype": "tcp", 00:29:26.025 "traddr": "10.0.0.2", 00:29:26.025 "hostnqn": "nqn.2021-12.io.spdk:test", 00:29:26.025 "adrfam": "ipv4", 00:29:26.025 "trsvcid": "8009", 00:29:26.025 "wait_for_attach": true, 00:29:26.025 "method": "bdev_nvme_start_discovery", 00:29:26.025 "req_id": 1 00:29:26.025 } 00:29:26.025 Got JSON-RPC error response 00:29:26.025 response: 00:29:26.025 { 00:29:26.025 "code": -17, 00:29:26.025 "message": "File exists" 00:29:26.025 } 00:29:26.025 23:21:29 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:29:26.025 23:21:29 -- common/autotest_common.sh@653 -- # es=1 00:29:26.025 23:21:29 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:29:26.025 23:21:29 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:29:26.025 23:21:29 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:29:26.025 23:21:29 -- host/discovery.sh@152 -- # get_discovery_ctrlrs 00:29:26.025 23:21:29 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:29:26.025 23:21:29 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:29:26.025 23:21:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:26.025 23:21:29 -- host/discovery.sh@67 -- # sort 00:29:26.025 23:21:29 -- common/autotest_common.sh@10 -- # set +x 00:29:26.025 23:21:29 -- host/discovery.sh@67 -- # xargs 00:29:26.025 23:21:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:26.025 23:21:29 -- host/discovery.sh@152 -- # [[ nvme == \n\v\m\e ]] 00:29:26.025 23:21:29 -- host/discovery.sh@153 -- # get_bdev_list 00:29:26.025 23:21:29 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:26.025 23:21:29 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:26.025 23:21:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:26.025 23:21:29 -- common/autotest_common.sh@10 -- # set +x 00:29:26.025 23:21:29 -- host/discovery.sh@55 -- # sort 00:29:26.025 23:21:29 -- host/discovery.sh@55 -- # xargs 00:29:26.025 23:21:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:26.026 23:21:29 -- host/discovery.sh@153 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:26.026 23:21:29 -- host/discovery.sh@156 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:29:26.026 23:21:29 -- common/autotest_common.sh@650 -- # local es=0 00:29:26.026 23:21:29 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:29:26.026 23:21:29 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:29:26.026 23:21:29 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:26.026 23:21:29 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:29:26.026 23:21:29 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:26.026 23:21:29 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:29:26.026 23:21:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:26.026 23:21:29 -- common/autotest_common.sh@10 -- # set +x 00:29:27.397 [2024-11-28 23:21:30.603678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:27.397 [2024-11-28 23:21:30.603883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:27.397 [2024-11-28 23:21:30.603911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20542e0 with addr=10.0.0.2, port=8010 00:29:27.397 [2024-11-28 23:21:30.603941] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:29:27.397 [2024-11-28 23:21:30.603956] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:29:27.397 [2024-11-28 23:21:30.603969] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:29:28.331 [2024-11-28 23:21:31.605942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:28.331 [2024-11-28 23:21:31.606120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:28.331 [2024-11-28 23:21:31.606151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20542e0 with addr=10.0.0.2, port=8010 00:29:28.331 [2024-11-28 23:21:31.606174] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:29:28.331 [2024-11-28 23:21:31.606190] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:29:28.331 [2024-11-28 23:21:31.606205] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:29:29.265 [2024-11-28 23:21:32.608272] bdev_nvme.c:6802:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:29:29.265 request: 00:29:29.265 { 00:29:29.265 "name": "nvme_second", 00:29:29.265 "trtype": "tcp", 00:29:29.265 "traddr": "10.0.0.2", 00:29:29.265 "hostnqn": "nqn.2021-12.io.spdk:test", 00:29:29.265 "adrfam": "ipv4", 00:29:29.265 "trsvcid": "8010", 00:29:29.265 "attach_timeout_ms": 3000, 00:29:29.265 "method": "bdev_nvme_start_discovery", 00:29:29.265 "req_id": 1 00:29:29.265 } 00:29:29.265 Got JSON-RPC error response 00:29:29.265 response: 00:29:29.265 { 00:29:29.265 "code": -110, 00:29:29.265 "message": "Connection timed out" 00:29:29.265 } 00:29:29.265 23:21:32 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:29:29.265 23:21:32 -- common/autotest_common.sh@653 -- # es=1 00:29:29.265 23:21:32 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:29:29.265 23:21:32 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:29:29.265 23:21:32 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:29:29.265 23:21:32 -- host/discovery.sh@158 -- # get_discovery_ctrlrs 00:29:29.265 23:21:32 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:29:29.265 23:21:32 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:29:29.265 23:21:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:29.265 23:21:32 -- host/discovery.sh@67 -- # sort 00:29:29.265 23:21:32 -- common/autotest_common.sh@10 -- # set +x 00:29:29.265 23:21:32 -- host/discovery.sh@67 -- # xargs 00:29:29.265 23:21:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:29.265 23:21:32 -- host/discovery.sh@158 -- # [[ nvme == \n\v\m\e ]] 00:29:29.265 23:21:32 -- host/discovery.sh@160 -- # trap - SIGINT SIGTERM EXIT 00:29:29.265 23:21:32 -- host/discovery.sh@162 -- # kill 2564747 00:29:29.265 23:21:32 -- host/discovery.sh@163 -- # nvmftestfini 00:29:29.265 23:21:32 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:29.265 23:21:32 -- nvmf/common.sh@116 -- # sync 00:29:29.265 23:21:32 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:29.265 23:21:32 -- nvmf/common.sh@119 -- # set +e 00:29:29.265 23:21:32 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:29.265 23:21:32 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:29.265 rmmod nvme_tcp 00:29:29.265 rmmod nvme_fabrics 00:29:29.265 rmmod nvme_keyring 00:29:29.265 23:21:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:29.265 23:21:32 -- nvmf/common.sh@123 -- # set -e 00:29:29.265 23:21:32 -- nvmf/common.sh@124 -- # return 0 00:29:29.265 23:21:32 -- nvmf/common.sh@477 -- # '[' -n 2564592 ']' 00:29:29.265 23:21:32 -- nvmf/common.sh@478 -- # killprocess 2564592 00:29:29.265 23:21:32 -- common/autotest_common.sh@936 -- # '[' -z 2564592 ']' 00:29:29.265 23:21:32 -- common/autotest_common.sh@940 -- # kill -0 2564592 00:29:29.265 23:21:32 -- common/autotest_common.sh@941 -- # uname 00:29:29.265 23:21:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:29.265 23:21:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2564592 00:29:29.265 23:21:32 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:29.265 23:21:32 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:29.265 23:21:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2564592' 00:29:29.265 killing process with pid 2564592 00:29:29.265 23:21:32 -- common/autotest_common.sh@955 -- # kill 2564592 00:29:29.265 23:21:32 -- common/autotest_common.sh@960 -- # wait 2564592 00:29:29.525 23:21:32 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:29.525 23:21:32 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:29.525 23:21:32 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:29.525 23:21:32 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:29.525 23:21:32 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:29.525 23:21:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:29.525 23:21:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:29.525 23:21:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:32.061 23:21:35 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:32.061 00:29:32.061 real 0m17.789s 00:29:32.061 user 0m27.550s 00:29:32.061 sys 0m2.954s 00:29:32.061 23:21:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:32.061 23:21:35 -- common/autotest_common.sh@10 -- # set +x 00:29:32.061 ************************************ 00:29:32.061 END TEST nvmf_discovery 00:29:32.061 ************************************ 00:29:32.061 23:21:35 -- nvmf/nvmf.sh@102 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:29:32.061 23:21:35 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:29:32.061 23:21:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:32.061 23:21:35 -- common/autotest_common.sh@10 -- # set +x 00:29:32.061 ************************************ 00:29:32.061 START TEST nvmf_discovery_remove_ifc 00:29:32.061 ************************************ 00:29:32.061 23:21:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:29:32.061 * Looking for test storage... 00:29:32.061 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:32.061 23:21:35 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:32.061 23:21:35 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:32.061 23:21:35 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:32.061 23:21:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:32.061 23:21:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:32.061 23:21:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:32.061 23:21:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:32.061 23:21:35 -- scripts/common.sh@335 -- # IFS=.-: 00:29:32.061 23:21:35 -- scripts/common.sh@335 -- # read -ra ver1 00:29:32.061 23:21:35 -- scripts/common.sh@336 -- # IFS=.-: 00:29:32.061 23:21:35 -- scripts/common.sh@336 -- # read -ra ver2 00:29:32.061 23:21:35 -- scripts/common.sh@337 -- # local 'op=<' 00:29:32.061 23:21:35 -- scripts/common.sh@339 -- # ver1_l=2 00:29:32.061 23:21:35 -- scripts/common.sh@340 -- # ver2_l=1 00:29:32.061 23:21:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:32.061 23:21:35 -- scripts/common.sh@343 -- # case "$op" in 00:29:32.061 23:21:35 -- scripts/common.sh@344 -- # : 1 00:29:32.061 23:21:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:32.061 23:21:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:32.061 23:21:35 -- scripts/common.sh@364 -- # decimal 1 00:29:32.061 23:21:35 -- scripts/common.sh@352 -- # local d=1 00:29:32.061 23:21:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:32.061 23:21:35 -- scripts/common.sh@354 -- # echo 1 00:29:32.061 23:21:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:32.061 23:21:35 -- scripts/common.sh@365 -- # decimal 2 00:29:32.061 23:21:35 -- scripts/common.sh@352 -- # local d=2 00:29:32.061 23:21:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:32.061 23:21:35 -- scripts/common.sh@354 -- # echo 2 00:29:32.061 23:21:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:32.061 23:21:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:32.061 23:21:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:32.061 23:21:35 -- scripts/common.sh@367 -- # return 0 00:29:32.061 23:21:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:32.061 23:21:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:32.061 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:32.061 --rc genhtml_branch_coverage=1 00:29:32.061 --rc genhtml_function_coverage=1 00:29:32.061 --rc genhtml_legend=1 00:29:32.061 --rc geninfo_all_blocks=1 00:29:32.061 --rc geninfo_unexecuted_blocks=1 00:29:32.061 00:29:32.061 ' 00:29:32.061 23:21:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:32.061 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:32.061 --rc genhtml_branch_coverage=1 00:29:32.061 --rc genhtml_function_coverage=1 00:29:32.061 --rc genhtml_legend=1 00:29:32.061 --rc geninfo_all_blocks=1 00:29:32.061 --rc geninfo_unexecuted_blocks=1 00:29:32.061 00:29:32.061 ' 00:29:32.061 23:21:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:32.061 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:32.061 --rc genhtml_branch_coverage=1 00:29:32.061 --rc genhtml_function_coverage=1 00:29:32.061 --rc genhtml_legend=1 00:29:32.061 --rc geninfo_all_blocks=1 00:29:32.061 --rc geninfo_unexecuted_blocks=1 00:29:32.061 00:29:32.061 ' 00:29:32.061 23:21:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:32.061 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:32.061 --rc genhtml_branch_coverage=1 00:29:32.061 --rc genhtml_function_coverage=1 00:29:32.061 --rc genhtml_legend=1 00:29:32.061 --rc geninfo_all_blocks=1 00:29:32.061 --rc geninfo_unexecuted_blocks=1 00:29:32.061 00:29:32.061 ' 00:29:32.061 23:21:35 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:32.061 23:21:35 -- nvmf/common.sh@7 -- # uname -s 00:29:32.061 23:21:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:32.061 23:21:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:32.061 23:21:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:32.061 23:21:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:32.061 23:21:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:32.061 23:21:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:32.061 23:21:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:32.061 23:21:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:32.061 23:21:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:32.061 23:21:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:32.061 23:21:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:32.061 23:21:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:32.061 23:21:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:32.062 23:21:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:32.062 23:21:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:32.062 23:21:35 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:32.062 23:21:35 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:32.062 23:21:35 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:32.062 23:21:35 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:32.062 23:21:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:32.062 23:21:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:32.062 23:21:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:32.062 23:21:35 -- paths/export.sh@5 -- # export PATH 00:29:32.062 23:21:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:32.062 23:21:35 -- nvmf/common.sh@46 -- # : 0 00:29:32.062 23:21:35 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:32.062 23:21:35 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:32.062 23:21:35 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:32.062 23:21:35 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:32.062 23:21:35 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:32.062 23:21:35 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:32.062 23:21:35 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:32.062 23:21:35 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:32.062 23:21:35 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:29:32.062 23:21:35 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:29:32.062 23:21:35 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:29:32.062 23:21:35 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:29:32.062 23:21:35 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:29:32.062 23:21:35 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:29:32.062 23:21:35 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:29:32.062 23:21:35 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:32.062 23:21:35 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:32.062 23:21:35 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:32.062 23:21:35 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:32.062 23:21:35 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:32.062 23:21:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:32.062 23:21:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:32.062 23:21:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:32.062 23:21:35 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:32.062 23:21:35 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:32.062 23:21:35 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:32.062 23:21:35 -- common/autotest_common.sh@10 -- # set +x 00:29:33.963 23:21:37 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:33.963 23:21:37 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:33.963 23:21:37 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:33.963 23:21:37 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:33.963 23:21:37 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:33.963 23:21:37 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:33.963 23:21:37 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:33.963 23:21:37 -- nvmf/common.sh@294 -- # net_devs=() 00:29:33.963 23:21:37 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:33.963 23:21:37 -- nvmf/common.sh@295 -- # e810=() 00:29:33.963 23:21:37 -- nvmf/common.sh@295 -- # local -ga e810 00:29:33.963 23:21:37 -- nvmf/common.sh@296 -- # x722=() 00:29:33.963 23:21:37 -- nvmf/common.sh@296 -- # local -ga x722 00:29:33.963 23:21:37 -- nvmf/common.sh@297 -- # mlx=() 00:29:33.963 23:21:37 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:33.963 23:21:37 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:33.963 23:21:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:33.963 23:21:37 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:33.963 23:21:37 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:33.963 23:21:37 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:33.963 23:21:37 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:33.963 23:21:37 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:33.964 23:21:37 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:33.964 23:21:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:33.964 23:21:37 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:33.964 23:21:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:33.964 23:21:37 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:33.964 23:21:37 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:33.964 23:21:37 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:33.964 23:21:37 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:33.964 23:21:37 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:33.964 23:21:37 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:33.964 23:21:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:33.964 23:21:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:33.964 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:33.964 23:21:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:33.964 23:21:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:33.964 23:21:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:33.964 23:21:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:33.964 23:21:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:33.964 23:21:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:33.964 23:21:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:33.964 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:33.964 23:21:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:33.964 23:21:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:33.964 23:21:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:33.964 23:21:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:33.964 23:21:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:33.964 23:21:37 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:33.964 23:21:37 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:33.964 23:21:37 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:33.964 23:21:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:33.964 23:21:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:33.964 23:21:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:33.964 23:21:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:33.964 23:21:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:33.964 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:33.964 23:21:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:33.964 23:21:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:33.964 23:21:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:33.964 23:21:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:33.964 23:21:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:33.964 23:21:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:33.964 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:33.964 23:21:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:33.964 23:21:37 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:33.964 23:21:37 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:33.964 23:21:37 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:33.964 23:21:37 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:33.964 23:21:37 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:33.964 23:21:37 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:33.964 23:21:37 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:33.964 23:21:37 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:33.964 23:21:37 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:33.964 23:21:37 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:33.964 23:21:37 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:33.964 23:21:37 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:33.964 23:21:37 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:33.964 23:21:37 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:33.964 23:21:37 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:33.964 23:21:37 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:33.964 23:21:37 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:33.964 23:21:37 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:33.964 23:21:37 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:33.964 23:21:37 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:33.964 23:21:37 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:33.964 23:21:37 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:33.964 23:21:37 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:33.964 23:21:37 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:33.964 23:21:37 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:33.964 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:33.964 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.200 ms 00:29:33.964 00:29:33.964 --- 10.0.0.2 ping statistics --- 00:29:33.964 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:33.964 rtt min/avg/max/mdev = 0.200/0.200/0.200/0.000 ms 00:29:33.964 23:21:37 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:33.964 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:33.964 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.082 ms 00:29:33.964 00:29:33.964 --- 10.0.0.1 ping statistics --- 00:29:33.964 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:33.964 rtt min/avg/max/mdev = 0.082/0.082/0.082/0.000 ms 00:29:33.964 23:21:37 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:33.964 23:21:37 -- nvmf/common.sh@410 -- # return 0 00:29:33.964 23:21:37 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:33.964 23:21:37 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:33.964 23:21:37 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:33.964 23:21:37 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:33.964 23:21:37 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:33.964 23:21:37 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:33.964 23:21:37 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:33.964 23:21:37 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:29:33.964 23:21:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:33.964 23:21:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:33.964 23:21:37 -- common/autotest_common.sh@10 -- # set +x 00:29:33.964 23:21:37 -- nvmf/common.sh@469 -- # nvmfpid=2568224 00:29:33.964 23:21:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:29:33.964 23:21:37 -- nvmf/common.sh@470 -- # waitforlisten 2568224 00:29:33.964 23:21:37 -- common/autotest_common.sh@829 -- # '[' -z 2568224 ']' 00:29:33.964 23:21:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:33.964 23:21:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:33.964 23:21:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:33.964 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:33.964 23:21:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:33.964 23:21:37 -- common/autotest_common.sh@10 -- # set +x 00:29:33.964 [2024-11-28 23:21:37.451207] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:33.964 [2024-11-28 23:21:37.451290] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:33.964 EAL: No free 2048 kB hugepages reported on node 1 00:29:33.964 [2024-11-28 23:21:37.526236] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:34.223 [2024-11-28 23:21:37.614286] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:34.223 [2024-11-28 23:21:37.614480] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:34.223 [2024-11-28 23:21:37.614501] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:34.223 [2024-11-28 23:21:37.614516] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:34.223 [2024-11-28 23:21:37.614549] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:35.158 23:21:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:35.158 23:21:38 -- common/autotest_common.sh@862 -- # return 0 00:29:35.158 23:21:38 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:35.158 23:21:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:35.158 23:21:38 -- common/autotest_common.sh@10 -- # set +x 00:29:35.158 23:21:38 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:35.158 23:21:38 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:29:35.158 23:21:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:35.158 23:21:38 -- common/autotest_common.sh@10 -- # set +x 00:29:35.158 [2024-11-28 23:21:38.444319] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:35.158 [2024-11-28 23:21:38.452492] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:29:35.158 null0 00:29:35.158 [2024-11-28 23:21:38.484489] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:35.158 23:21:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:35.158 23:21:38 -- host/discovery_remove_ifc.sh@59 -- # hostpid=2568380 00:29:35.158 23:21:38 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:29:35.158 23:21:38 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 2568380 /tmp/host.sock 00:29:35.158 23:21:38 -- common/autotest_common.sh@829 -- # '[' -z 2568380 ']' 00:29:35.158 23:21:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:29:35.158 23:21:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:35.158 23:21:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:29:35.158 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:29:35.158 23:21:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:35.158 23:21:38 -- common/autotest_common.sh@10 -- # set +x 00:29:35.158 [2024-11-28 23:21:38.551261] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:35.158 [2024-11-28 23:21:38.551340] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2568380 ] 00:29:35.158 EAL: No free 2048 kB hugepages reported on node 1 00:29:35.158 [2024-11-28 23:21:38.618368] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:35.158 [2024-11-28 23:21:38.706532] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:35.158 [2024-11-28 23:21:38.706701] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:35.158 23:21:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:35.158 23:21:38 -- common/autotest_common.sh@862 -- # return 0 00:29:35.158 23:21:38 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:29:35.158 23:21:38 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:29:35.158 23:21:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:35.158 23:21:38 -- common/autotest_common.sh@10 -- # set +x 00:29:35.448 23:21:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:35.448 23:21:38 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:29:35.448 23:21:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:35.448 23:21:38 -- common/autotest_common.sh@10 -- # set +x 00:29:35.448 23:21:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:35.448 23:21:38 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:29:35.448 23:21:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:35.448 23:21:38 -- common/autotest_common.sh@10 -- # set +x 00:29:36.380 [2024-11-28 23:21:39.912025] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:36.380 [2024-11-28 23:21:39.912052] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:36.380 [2024-11-28 23:21:39.912074] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:36.637 [2024-11-28 23:21:40.039559] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:29:36.637 [2024-11-28 23:21:40.223866] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:29:36.637 [2024-11-28 23:21:40.223930] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:29:36.637 [2024-11-28 23:21:40.223973] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:29:36.637 [2024-11-28 23:21:40.223999] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:29:36.637 [2024-11-28 23:21:40.224036] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:36.637 23:21:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:36.637 23:21:40 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:29:36.637 23:21:40 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:36.637 23:21:40 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:36.637 23:21:40 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:36.637 23:21:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:36.637 23:21:40 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:36.637 23:21:40 -- common/autotest_common.sh@10 -- # set +x 00:29:36.637 23:21:40 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:36.637 [2024-11-28 23:21:40.230500] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x1041c50 was disconnected and freed. delete nvme_qpair. 00:29:36.637 23:21:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:36.894 23:21:40 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:29:36.894 23:21:40 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:29:36.894 23:21:40 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:29:36.894 23:21:40 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:29:36.894 23:21:40 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:36.894 23:21:40 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:36.894 23:21:40 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:36.894 23:21:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:36.894 23:21:40 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:36.894 23:21:40 -- common/autotest_common.sh@10 -- # set +x 00:29:36.894 23:21:40 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:36.894 23:21:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:36.894 23:21:40 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:36.894 23:21:40 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:37.824 23:21:41 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:37.824 23:21:41 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:37.824 23:21:41 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:37.824 23:21:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:37.825 23:21:41 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:37.825 23:21:41 -- common/autotest_common.sh@10 -- # set +x 00:29:37.825 23:21:41 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:37.825 23:21:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:37.825 23:21:41 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:37.825 23:21:41 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:39.194 23:21:42 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:39.194 23:21:42 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:39.194 23:21:42 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:39.194 23:21:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:39.194 23:21:42 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:39.194 23:21:42 -- common/autotest_common.sh@10 -- # set +x 00:29:39.194 23:21:42 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:39.194 23:21:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:39.194 23:21:42 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:39.194 23:21:42 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:40.128 23:21:43 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:40.128 23:21:43 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:40.128 23:21:43 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:40.128 23:21:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:40.128 23:21:43 -- common/autotest_common.sh@10 -- # set +x 00:29:40.128 23:21:43 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:40.128 23:21:43 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:40.128 23:21:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:40.128 23:21:43 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:40.128 23:21:43 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:41.096 23:21:44 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:41.096 23:21:44 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:41.096 23:21:44 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:41.096 23:21:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:41.096 23:21:44 -- common/autotest_common.sh@10 -- # set +x 00:29:41.096 23:21:44 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:41.096 23:21:44 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:41.096 23:21:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:41.096 23:21:44 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:41.096 23:21:44 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:42.064 23:21:45 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:42.064 23:21:45 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:42.064 23:21:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:42.064 23:21:45 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:42.064 23:21:45 -- common/autotest_common.sh@10 -- # set +x 00:29:42.064 23:21:45 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:42.064 23:21:45 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:42.064 23:21:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:42.064 23:21:45 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:42.064 23:21:45 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:42.064 [2024-11-28 23:21:45.664979] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:29:42.064 [2024-11-28 23:21:45.665053] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:42.064 [2024-11-28 23:21:45.665077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:42.064 [2024-11-28 23:21:45.665106] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:42.064 [2024-11-28 23:21:45.665130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:42.064 [2024-11-28 23:21:45.665146] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:42.064 [2024-11-28 23:21:45.665161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:42.064 [2024-11-28 23:21:45.665177] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:42.064 [2024-11-28 23:21:45.665192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:42.064 [2024-11-28 23:21:45.665208] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:29:42.064 [2024-11-28 23:21:45.665223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:42.064 [2024-11-28 23:21:45.665238] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10080b0 is same with the state(5) to be set 00:29:42.321 [2024-11-28 23:21:45.674998] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10080b0 (9): Bad file descriptor 00:29:42.321 [2024-11-28 23:21:45.685046] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:43.254 23:21:46 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:43.254 23:21:46 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:43.254 23:21:46 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:43.254 23:21:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:43.254 23:21:46 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:43.254 23:21:46 -- common/autotest_common.sh@10 -- # set +x 00:29:43.254 23:21:46 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:43.254 [2024-11-28 23:21:46.730422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:29:44.188 [2024-11-28 23:21:47.754420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:29:44.188 [2024-11-28 23:21:47.754481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10080b0 with addr=10.0.0.2, port=4420 00:29:44.188 [2024-11-28 23:21:47.754506] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10080b0 is same with the state(5) to be set 00:29:44.188 [2024-11-28 23:21:47.754540] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:44.188 [2024-11-28 23:21:47.754558] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:44.188 [2024-11-28 23:21:47.754572] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:44.188 [2024-11-28 23:21:47.754589] nvme_ctrlr.c:1017:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] already in failed state 00:29:44.188 [2024-11-28 23:21:47.754981] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10080b0 (9): Bad file descriptor 00:29:44.188 [2024-11-28 23:21:47.755033] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:44.188 [2024-11-28 23:21:47.755073] bdev_nvme.c:6510:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:29:44.188 [2024-11-28 23:21:47.755111] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:44.188 [2024-11-28 23:21:47.755133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:44.188 [2024-11-28 23:21:47.755153] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:44.188 [2024-11-28 23:21:47.755168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:44.188 [2024-11-28 23:21:47.755192] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:44.188 [2024-11-28 23:21:47.755208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:44.188 [2024-11-28 23:21:47.755223] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:44.188 [2024-11-28 23:21:47.755238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:44.188 [2024-11-28 23:21:47.755253] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:29:44.188 [2024-11-28 23:21:47.755268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:44.188 [2024-11-28 23:21:47.755283] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:29:44.188 [2024-11-28 23:21:47.755541] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10084c0 (9): Bad file descriptor 00:29:44.188 [2024-11-28 23:21:47.756557] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:29:44.188 [2024-11-28 23:21:47.756578] nvme_ctrlr.c:1136:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:29:44.188 23:21:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:44.188 23:21:47 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:44.189 23:21:47 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:45.564 23:21:48 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:45.564 23:21:48 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:45.564 23:21:48 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:45.564 23:21:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:45.564 23:21:48 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:45.564 23:21:48 -- common/autotest_common.sh@10 -- # set +x 00:29:45.564 23:21:48 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:45.564 23:21:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:45.564 23:21:48 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:29:45.564 23:21:48 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:45.564 23:21:48 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:45.564 23:21:48 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:29:45.564 23:21:48 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:45.564 23:21:48 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:45.564 23:21:48 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:45.564 23:21:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:45.564 23:21:48 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:45.564 23:21:48 -- common/autotest_common.sh@10 -- # set +x 00:29:45.564 23:21:48 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:45.564 23:21:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:45.564 23:21:48 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:29:45.564 23:21:48 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:46.498 [2024-11-28 23:21:49.809540] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:46.498 [2024-11-28 23:21:49.809561] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:46.498 [2024-11-28 23:21:49.809583] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:46.498 23:21:49 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:46.498 23:21:49 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:46.498 23:21:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:46.498 23:21:49 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:46.498 23:21:49 -- common/autotest_common.sh@10 -- # set +x 00:29:46.498 23:21:49 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:46.498 23:21:49 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:46.498 [2024-11-28 23:21:49.896923] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:29:46.498 23:21:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:46.498 23:21:49 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:29:46.498 23:21:49 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:46.498 [2024-11-28 23:21:50.080377] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:29:46.498 [2024-11-28 23:21:50.080488] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:29:46.498 [2024-11-28 23:21:50.080519] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:29:46.498 [2024-11-28 23:21:50.080550] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:29:46.498 [2024-11-28 23:21:50.080565] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:46.498 [2024-11-28 23:21:50.086948] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x1016a00 was disconnected and freed. delete nvme_qpair. 00:29:47.433 23:21:50 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:47.433 23:21:50 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:47.433 23:21:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:47.433 23:21:50 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:47.433 23:21:50 -- common/autotest_common.sh@10 -- # set +x 00:29:47.433 23:21:50 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:47.433 23:21:50 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:47.433 23:21:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:47.433 23:21:50 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:29:47.433 23:21:50 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:29:47.433 23:21:50 -- host/discovery_remove_ifc.sh@90 -- # killprocess 2568380 00:29:47.433 23:21:50 -- common/autotest_common.sh@936 -- # '[' -z 2568380 ']' 00:29:47.433 23:21:50 -- common/autotest_common.sh@940 -- # kill -0 2568380 00:29:47.433 23:21:50 -- common/autotest_common.sh@941 -- # uname 00:29:47.433 23:21:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:47.433 23:21:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2568380 00:29:47.433 23:21:51 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:47.433 23:21:51 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:47.433 23:21:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2568380' 00:29:47.433 killing process with pid 2568380 00:29:47.433 23:21:51 -- common/autotest_common.sh@955 -- # kill 2568380 00:29:47.433 23:21:51 -- common/autotest_common.sh@960 -- # wait 2568380 00:29:47.691 23:21:51 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:29:47.691 23:21:51 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:47.691 23:21:51 -- nvmf/common.sh@116 -- # sync 00:29:47.691 23:21:51 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:47.691 23:21:51 -- nvmf/common.sh@119 -- # set +e 00:29:47.691 23:21:51 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:47.691 23:21:51 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:47.691 rmmod nvme_tcp 00:29:47.691 rmmod nvme_fabrics 00:29:47.691 rmmod nvme_keyring 00:29:47.691 23:21:51 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:47.691 23:21:51 -- nvmf/common.sh@123 -- # set -e 00:29:47.691 23:21:51 -- nvmf/common.sh@124 -- # return 0 00:29:47.691 23:21:51 -- nvmf/common.sh@477 -- # '[' -n 2568224 ']' 00:29:47.691 23:21:51 -- nvmf/common.sh@478 -- # killprocess 2568224 00:29:47.691 23:21:51 -- common/autotest_common.sh@936 -- # '[' -z 2568224 ']' 00:29:47.691 23:21:51 -- common/autotest_common.sh@940 -- # kill -0 2568224 00:29:47.691 23:21:51 -- common/autotest_common.sh@941 -- # uname 00:29:47.691 23:21:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:47.691 23:21:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2568224 00:29:47.950 23:21:51 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:47.950 23:21:51 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:47.950 23:21:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2568224' 00:29:47.950 killing process with pid 2568224 00:29:47.950 23:21:51 -- common/autotest_common.sh@955 -- # kill 2568224 00:29:47.950 23:21:51 -- common/autotest_common.sh@960 -- # wait 2568224 00:29:47.950 23:21:51 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:47.950 23:21:51 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:47.950 23:21:51 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:47.950 23:21:51 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:47.950 23:21:51 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:47.950 23:21:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:47.950 23:21:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:47.950 23:21:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:50.484 23:21:53 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:50.484 00:29:50.484 real 0m18.486s 00:29:50.484 user 0m25.614s 00:29:50.484 sys 0m2.899s 00:29:50.484 23:21:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:50.484 23:21:53 -- common/autotest_common.sh@10 -- # set +x 00:29:50.484 ************************************ 00:29:50.484 END TEST nvmf_discovery_remove_ifc 00:29:50.484 ************************************ 00:29:50.484 23:21:53 -- nvmf/nvmf.sh@106 -- # [[ tcp == \t\c\p ]] 00:29:50.484 23:21:53 -- nvmf/nvmf.sh@107 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:29:50.484 23:21:53 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:29:50.484 23:21:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:50.484 23:21:53 -- common/autotest_common.sh@10 -- # set +x 00:29:50.484 ************************************ 00:29:50.484 START TEST nvmf_digest 00:29:50.484 ************************************ 00:29:50.484 23:21:53 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:29:50.484 * Looking for test storage... 00:29:50.484 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:50.484 23:21:53 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:50.484 23:21:53 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:50.484 23:21:53 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:50.484 23:21:53 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:50.484 23:21:53 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:50.484 23:21:53 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:50.484 23:21:53 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:50.484 23:21:53 -- scripts/common.sh@335 -- # IFS=.-: 00:29:50.484 23:21:53 -- scripts/common.sh@335 -- # read -ra ver1 00:29:50.484 23:21:53 -- scripts/common.sh@336 -- # IFS=.-: 00:29:50.484 23:21:53 -- scripts/common.sh@336 -- # read -ra ver2 00:29:50.484 23:21:53 -- scripts/common.sh@337 -- # local 'op=<' 00:29:50.484 23:21:53 -- scripts/common.sh@339 -- # ver1_l=2 00:29:50.484 23:21:53 -- scripts/common.sh@340 -- # ver2_l=1 00:29:50.484 23:21:53 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:50.484 23:21:53 -- scripts/common.sh@343 -- # case "$op" in 00:29:50.484 23:21:53 -- scripts/common.sh@344 -- # : 1 00:29:50.484 23:21:53 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:50.484 23:21:53 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:50.484 23:21:53 -- scripts/common.sh@364 -- # decimal 1 00:29:50.484 23:21:53 -- scripts/common.sh@352 -- # local d=1 00:29:50.484 23:21:53 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:50.485 23:21:53 -- scripts/common.sh@354 -- # echo 1 00:29:50.485 23:21:53 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:50.485 23:21:53 -- scripts/common.sh@365 -- # decimal 2 00:29:50.485 23:21:53 -- scripts/common.sh@352 -- # local d=2 00:29:50.485 23:21:53 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:50.485 23:21:53 -- scripts/common.sh@354 -- # echo 2 00:29:50.485 23:21:53 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:50.485 23:21:53 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:50.485 23:21:53 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:50.485 23:21:53 -- scripts/common.sh@367 -- # return 0 00:29:50.485 23:21:53 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:50.485 23:21:53 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:50.485 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:50.485 --rc genhtml_branch_coverage=1 00:29:50.485 --rc genhtml_function_coverage=1 00:29:50.485 --rc genhtml_legend=1 00:29:50.485 --rc geninfo_all_blocks=1 00:29:50.485 --rc geninfo_unexecuted_blocks=1 00:29:50.485 00:29:50.485 ' 00:29:50.485 23:21:53 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:50.485 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:50.485 --rc genhtml_branch_coverage=1 00:29:50.485 --rc genhtml_function_coverage=1 00:29:50.485 --rc genhtml_legend=1 00:29:50.485 --rc geninfo_all_blocks=1 00:29:50.485 --rc geninfo_unexecuted_blocks=1 00:29:50.485 00:29:50.485 ' 00:29:50.485 23:21:53 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:50.485 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:50.485 --rc genhtml_branch_coverage=1 00:29:50.485 --rc genhtml_function_coverage=1 00:29:50.485 --rc genhtml_legend=1 00:29:50.485 --rc geninfo_all_blocks=1 00:29:50.485 --rc geninfo_unexecuted_blocks=1 00:29:50.485 00:29:50.485 ' 00:29:50.485 23:21:53 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:50.485 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:50.485 --rc genhtml_branch_coverage=1 00:29:50.485 --rc genhtml_function_coverage=1 00:29:50.485 --rc genhtml_legend=1 00:29:50.485 --rc geninfo_all_blocks=1 00:29:50.485 --rc geninfo_unexecuted_blocks=1 00:29:50.485 00:29:50.485 ' 00:29:50.485 23:21:53 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:50.485 23:21:53 -- nvmf/common.sh@7 -- # uname -s 00:29:50.485 23:21:53 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:50.485 23:21:53 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:50.485 23:21:53 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:50.485 23:21:53 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:50.485 23:21:53 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:50.485 23:21:53 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:50.485 23:21:53 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:50.485 23:21:53 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:50.485 23:21:53 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:50.485 23:21:53 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:50.485 23:21:53 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:50.485 23:21:53 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:50.485 23:21:53 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:50.485 23:21:53 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:50.485 23:21:53 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:50.485 23:21:53 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:50.485 23:21:53 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:50.485 23:21:53 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:50.485 23:21:53 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:50.485 23:21:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:50.485 23:21:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:50.485 23:21:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:50.485 23:21:53 -- paths/export.sh@5 -- # export PATH 00:29:50.485 23:21:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:50.485 23:21:53 -- nvmf/common.sh@46 -- # : 0 00:29:50.485 23:21:53 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:50.485 23:21:53 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:50.485 23:21:53 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:50.485 23:21:53 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:50.485 23:21:53 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:50.485 23:21:53 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:50.485 23:21:53 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:50.485 23:21:53 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:50.485 23:21:53 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:29:50.485 23:21:53 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:29:50.485 23:21:53 -- host/digest.sh@16 -- # runtime=2 00:29:50.485 23:21:53 -- host/digest.sh@130 -- # [[ tcp != \t\c\p ]] 00:29:50.485 23:21:53 -- host/digest.sh@132 -- # nvmftestinit 00:29:50.485 23:21:53 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:50.485 23:21:53 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:50.485 23:21:53 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:50.485 23:21:53 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:50.485 23:21:53 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:50.485 23:21:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:50.485 23:21:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:50.485 23:21:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:50.485 23:21:53 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:50.485 23:21:53 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:50.485 23:21:53 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:50.485 23:21:53 -- common/autotest_common.sh@10 -- # set +x 00:29:52.386 23:21:55 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:52.386 23:21:55 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:52.386 23:21:55 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:52.386 23:21:55 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:52.386 23:21:55 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:52.386 23:21:55 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:52.386 23:21:55 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:52.386 23:21:55 -- nvmf/common.sh@294 -- # net_devs=() 00:29:52.386 23:21:55 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:52.386 23:21:55 -- nvmf/common.sh@295 -- # e810=() 00:29:52.386 23:21:55 -- nvmf/common.sh@295 -- # local -ga e810 00:29:52.386 23:21:55 -- nvmf/common.sh@296 -- # x722=() 00:29:52.386 23:21:55 -- nvmf/common.sh@296 -- # local -ga x722 00:29:52.386 23:21:55 -- nvmf/common.sh@297 -- # mlx=() 00:29:52.386 23:21:55 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:52.386 23:21:55 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:52.386 23:21:55 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:52.386 23:21:55 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:52.386 23:21:55 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:52.386 23:21:55 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:52.386 23:21:55 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:52.386 23:21:55 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:52.386 23:21:55 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:52.386 23:21:55 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:52.386 23:21:55 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:52.386 23:21:55 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:52.386 23:21:55 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:52.386 23:21:55 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:52.386 23:21:55 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:52.386 23:21:55 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:52.386 23:21:55 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:52.386 23:21:55 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:52.386 23:21:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:52.386 23:21:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:52.386 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:52.386 23:21:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:52.386 23:21:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:52.386 23:21:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:52.386 23:21:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:52.386 23:21:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:52.386 23:21:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:52.386 23:21:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:52.386 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:52.386 23:21:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:52.386 23:21:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:52.386 23:21:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:52.386 23:21:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:52.386 23:21:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:52.386 23:21:55 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:52.386 23:21:55 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:52.386 23:21:55 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:52.386 23:21:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:52.386 23:21:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:52.386 23:21:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:52.386 23:21:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:52.386 23:21:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:52.386 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:52.386 23:21:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:52.386 23:21:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:52.386 23:21:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:52.386 23:21:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:52.386 23:21:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:52.386 23:21:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:52.386 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:52.386 23:21:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:52.386 23:21:55 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:52.386 23:21:55 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:52.386 23:21:55 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:52.386 23:21:55 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:52.386 23:21:55 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:52.386 23:21:55 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:52.386 23:21:55 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:52.386 23:21:55 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:52.386 23:21:55 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:52.386 23:21:55 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:52.386 23:21:55 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:52.386 23:21:55 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:52.386 23:21:55 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:52.386 23:21:55 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:52.386 23:21:55 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:52.386 23:21:55 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:52.386 23:21:55 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:52.386 23:21:55 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:52.386 23:21:55 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:52.386 23:21:55 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:52.386 23:21:55 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:52.386 23:21:55 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:52.386 23:21:55 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:52.386 23:21:55 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:52.386 23:21:55 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:52.386 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:52.386 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.230 ms 00:29:52.386 00:29:52.386 --- 10.0.0.2 ping statistics --- 00:29:52.386 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:52.386 rtt min/avg/max/mdev = 0.230/0.230/0.230/0.000 ms 00:29:52.386 23:21:55 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:52.386 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:52.386 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.082 ms 00:29:52.386 00:29:52.386 --- 10.0.0.1 ping statistics --- 00:29:52.386 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:52.386 rtt min/avg/max/mdev = 0.082/0.082/0.082/0.000 ms 00:29:52.386 23:21:55 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:52.386 23:21:55 -- nvmf/common.sh@410 -- # return 0 00:29:52.386 23:21:55 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:52.386 23:21:55 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:52.386 23:21:55 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:52.386 23:21:55 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:52.386 23:21:55 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:52.386 23:21:55 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:52.387 23:21:55 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:52.387 23:21:55 -- host/digest.sh@134 -- # trap cleanup SIGINT SIGTERM EXIT 00:29:52.387 23:21:55 -- host/digest.sh@135 -- # run_test nvmf_digest_clean run_digest 00:29:52.387 23:21:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:52.387 23:21:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:52.387 23:21:55 -- common/autotest_common.sh@10 -- # set +x 00:29:52.387 ************************************ 00:29:52.387 START TEST nvmf_digest_clean 00:29:52.387 ************************************ 00:29:52.387 23:21:55 -- common/autotest_common.sh@1114 -- # run_digest 00:29:52.387 23:21:55 -- host/digest.sh@119 -- # nvmfappstart --wait-for-rpc 00:29:52.387 23:21:55 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:52.387 23:21:55 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:52.387 23:21:55 -- common/autotest_common.sh@10 -- # set +x 00:29:52.387 23:21:55 -- nvmf/common.sh@469 -- # nvmfpid=2571904 00:29:52.387 23:21:55 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:29:52.387 23:21:55 -- nvmf/common.sh@470 -- # waitforlisten 2571904 00:29:52.387 23:21:55 -- common/autotest_common.sh@829 -- # '[' -z 2571904 ']' 00:29:52.387 23:21:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:52.387 23:21:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:52.387 23:21:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:52.387 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:52.387 23:21:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:52.387 23:21:55 -- common/autotest_common.sh@10 -- # set +x 00:29:52.387 [2024-11-28 23:21:55.888819] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:52.387 [2024-11-28 23:21:55.888895] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:52.387 EAL: No free 2048 kB hugepages reported on node 1 00:29:52.387 [2024-11-28 23:21:55.959922] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:52.645 [2024-11-28 23:21:56.050617] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:52.645 [2024-11-28 23:21:56.050803] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:52.645 [2024-11-28 23:21:56.050823] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:52.645 [2024-11-28 23:21:56.050847] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:52.645 [2024-11-28 23:21:56.050888] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:52.645 23:21:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:52.645 23:21:56 -- common/autotest_common.sh@862 -- # return 0 00:29:52.645 23:21:56 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:52.645 23:21:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:52.645 23:21:56 -- common/autotest_common.sh@10 -- # set +x 00:29:52.645 23:21:56 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:52.645 23:21:56 -- host/digest.sh@120 -- # common_target_config 00:29:52.645 23:21:56 -- host/digest.sh@43 -- # rpc_cmd 00:29:52.645 23:21:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:52.645 23:21:56 -- common/autotest_common.sh@10 -- # set +x 00:29:52.645 null0 00:29:52.645 [2024-11-28 23:21:56.250105] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:52.904 [2024-11-28 23:21:56.274337] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:52.904 23:21:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:52.904 23:21:56 -- host/digest.sh@122 -- # run_bperf randread 4096 128 00:29:52.904 23:21:56 -- host/digest.sh@77 -- # local rw bs qd 00:29:52.904 23:21:56 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:52.904 23:21:56 -- host/digest.sh@80 -- # rw=randread 00:29:52.904 23:21:56 -- host/digest.sh@80 -- # bs=4096 00:29:52.904 23:21:56 -- host/digest.sh@80 -- # qd=128 00:29:52.904 23:21:56 -- host/digest.sh@82 -- # bperfpid=2572048 00:29:52.904 23:21:56 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:29:52.904 23:21:56 -- host/digest.sh@83 -- # waitforlisten 2572048 /var/tmp/bperf.sock 00:29:52.904 23:21:56 -- common/autotest_common.sh@829 -- # '[' -z 2572048 ']' 00:29:52.904 23:21:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:52.904 23:21:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:52.904 23:21:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:52.904 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:52.904 23:21:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:52.904 23:21:56 -- common/autotest_common.sh@10 -- # set +x 00:29:52.904 [2024-11-28 23:21:56.316609] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:52.904 [2024-11-28 23:21:56.316687] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2572048 ] 00:29:52.904 EAL: No free 2048 kB hugepages reported on node 1 00:29:52.904 [2024-11-28 23:21:56.378837] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:52.904 [2024-11-28 23:21:56.468803] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:53.162 23:21:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:53.162 23:21:56 -- common/autotest_common.sh@862 -- # return 0 00:29:53.162 23:21:56 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:53.162 23:21:56 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:53.162 23:21:56 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:53.421 23:21:56 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:53.421 23:21:56 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:53.987 nvme0n1 00:29:53.987 23:21:57 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:53.987 23:21:57 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:53.987 Running I/O for 2 seconds... 00:29:56.515 00:29:56.515 Latency(us) 00:29:56.515 [2024-11-28T22:22:00.121Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:56.515 [2024-11-28T22:22:00.121Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:29:56.515 nvme0n1 : 2.05 16231.25 63.40 0.00 0.00 7726.66 3543.80 47380.10 00:29:56.515 [2024-11-28T22:22:00.121Z] =================================================================================================================== 00:29:56.515 [2024-11-28T22:22:00.121Z] Total : 16231.25 63.40 0.00 0.00 7726.66 3543.80 47380.10 00:29:56.515 0 00:29:56.515 23:21:59 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:56.515 23:21:59 -- host/digest.sh@92 -- # get_accel_stats 00:29:56.515 23:21:59 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:56.515 23:21:59 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:56.515 23:21:59 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:56.515 | select(.opcode=="crc32c") 00:29:56.515 | "\(.module_name) \(.executed)"' 00:29:56.515 23:21:59 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:56.515 23:21:59 -- host/digest.sh@93 -- # exp_module=software 00:29:56.515 23:21:59 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:56.515 23:21:59 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:56.515 23:21:59 -- host/digest.sh@97 -- # killprocess 2572048 00:29:56.515 23:21:59 -- common/autotest_common.sh@936 -- # '[' -z 2572048 ']' 00:29:56.515 23:21:59 -- common/autotest_common.sh@940 -- # kill -0 2572048 00:29:56.515 23:21:59 -- common/autotest_common.sh@941 -- # uname 00:29:56.515 23:21:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:56.515 23:21:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2572048 00:29:56.515 23:21:59 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:56.515 23:21:59 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:56.515 23:21:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2572048' 00:29:56.515 killing process with pid 2572048 00:29:56.515 23:21:59 -- common/autotest_common.sh@955 -- # kill 2572048 00:29:56.515 Received shutdown signal, test time was about 2.000000 seconds 00:29:56.515 00:29:56.515 Latency(us) 00:29:56.515 [2024-11-28T22:22:00.121Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:56.515 [2024-11-28T22:22:00.122Z] =================================================================================================================== 00:29:56.516 [2024-11-28T22:22:00.122Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:56.516 23:21:59 -- common/autotest_common.sh@960 -- # wait 2572048 00:29:56.774 23:22:00 -- host/digest.sh@123 -- # run_bperf randread 131072 16 00:29:56.774 23:22:00 -- host/digest.sh@77 -- # local rw bs qd 00:29:56.774 23:22:00 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:56.774 23:22:00 -- host/digest.sh@80 -- # rw=randread 00:29:56.774 23:22:00 -- host/digest.sh@80 -- # bs=131072 00:29:56.774 23:22:00 -- host/digest.sh@80 -- # qd=16 00:29:56.774 23:22:00 -- host/digest.sh@82 -- # bperfpid=2572470 00:29:56.774 23:22:00 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:29:56.774 23:22:00 -- host/digest.sh@83 -- # waitforlisten 2572470 /var/tmp/bperf.sock 00:29:56.774 23:22:00 -- common/autotest_common.sh@829 -- # '[' -z 2572470 ']' 00:29:56.774 23:22:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:56.774 23:22:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:56.774 23:22:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:56.774 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:56.774 23:22:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:56.774 23:22:00 -- common/autotest_common.sh@10 -- # set +x 00:29:56.774 [2024-11-28 23:22:00.202320] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:56.774 [2024-11-28 23:22:00.202420] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2572470 ] 00:29:56.774 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:56.774 Zero copy mechanism will not be used. 00:29:56.774 EAL: No free 2048 kB hugepages reported on node 1 00:29:56.774 [2024-11-28 23:22:00.266358] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:56.774 [2024-11-28 23:22:00.355202] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:57.032 23:22:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:57.032 23:22:00 -- common/autotest_common.sh@862 -- # return 0 00:29:57.032 23:22:00 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:57.032 23:22:00 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:57.032 23:22:00 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:57.290 23:22:00 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:57.290 23:22:00 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:57.548 nvme0n1 00:29:57.807 23:22:01 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:57.807 23:22:01 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:57.807 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:57.807 Zero copy mechanism will not be used. 00:29:57.807 Running I/O for 2 seconds... 00:29:59.706 00:29:59.706 Latency(us) 00:29:59.706 [2024-11-28T22:22:03.312Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:59.706 [2024-11-28T22:22:03.312Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:29:59.706 nvme0n1 : 2.00 6696.30 837.04 0.00 0.00 2385.67 609.85 9951.76 00:29:59.706 [2024-11-28T22:22:03.312Z] =================================================================================================================== 00:29:59.706 [2024-11-28T22:22:03.312Z] Total : 6696.30 837.04 0.00 0.00 2385.67 609.85 9951.76 00:29:59.706 0 00:29:59.706 23:22:03 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:59.706 23:22:03 -- host/digest.sh@92 -- # get_accel_stats 00:29:59.706 23:22:03 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:59.706 23:22:03 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:59.707 | select(.opcode=="crc32c") 00:29:59.707 | "\(.module_name) \(.executed)"' 00:29:59.707 23:22:03 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:59.964 23:22:03 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:59.964 23:22:03 -- host/digest.sh@93 -- # exp_module=software 00:29:59.964 23:22:03 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:59.964 23:22:03 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:59.964 23:22:03 -- host/digest.sh@97 -- # killprocess 2572470 00:29:59.964 23:22:03 -- common/autotest_common.sh@936 -- # '[' -z 2572470 ']' 00:29:59.964 23:22:03 -- common/autotest_common.sh@940 -- # kill -0 2572470 00:29:59.964 23:22:03 -- common/autotest_common.sh@941 -- # uname 00:29:59.964 23:22:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:59.964 23:22:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2572470 00:30:00.223 23:22:03 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:00.223 23:22:03 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:00.223 23:22:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2572470' 00:30:00.223 killing process with pid 2572470 00:30:00.223 23:22:03 -- common/autotest_common.sh@955 -- # kill 2572470 00:30:00.223 Received shutdown signal, test time was about 2.000000 seconds 00:30:00.223 00:30:00.223 Latency(us) 00:30:00.223 [2024-11-28T22:22:03.829Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:00.223 [2024-11-28T22:22:03.829Z] =================================================================================================================== 00:30:00.223 [2024-11-28T22:22:03.829Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:00.223 23:22:03 -- common/autotest_common.sh@960 -- # wait 2572470 00:30:00.223 23:22:03 -- host/digest.sh@124 -- # run_bperf randwrite 4096 128 00:30:00.223 23:22:03 -- host/digest.sh@77 -- # local rw bs qd 00:30:00.223 23:22:03 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:30:00.223 23:22:03 -- host/digest.sh@80 -- # rw=randwrite 00:30:00.223 23:22:03 -- host/digest.sh@80 -- # bs=4096 00:30:00.223 23:22:03 -- host/digest.sh@80 -- # qd=128 00:30:00.223 23:22:03 -- host/digest.sh@82 -- # bperfpid=2572890 00:30:00.223 23:22:03 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:30:00.223 23:22:03 -- host/digest.sh@83 -- # waitforlisten 2572890 /var/tmp/bperf.sock 00:30:00.223 23:22:03 -- common/autotest_common.sh@829 -- # '[' -z 2572890 ']' 00:30:00.223 23:22:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:30:00.223 23:22:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:00.223 23:22:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:30:00.223 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:30:00.223 23:22:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:00.223 23:22:03 -- common/autotest_common.sh@10 -- # set +x 00:30:00.482 [2024-11-28 23:22:03.843967] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:00.482 [2024-11-28 23:22:03.844054] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2572890 ] 00:30:00.482 EAL: No free 2048 kB hugepages reported on node 1 00:30:00.482 [2024-11-28 23:22:03.911136] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:00.482 [2024-11-28 23:22:04.000032] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:00.740 23:22:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:00.741 23:22:04 -- common/autotest_common.sh@862 -- # return 0 00:30:00.741 23:22:04 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:30:00.741 23:22:04 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:30:00.741 23:22:04 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:30:00.999 23:22:04 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:00.999 23:22:04 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:01.565 nvme0n1 00:30:01.565 23:22:04 -- host/digest.sh@91 -- # bperf_py perform_tests 00:30:01.565 23:22:04 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:30:01.565 Running I/O for 2 seconds... 00:30:03.464 00:30:03.464 Latency(us) 00:30:03.464 [2024-11-28T22:22:07.070Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:03.464 [2024-11-28T22:22:07.070Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:30:03.464 nvme0n1 : 2.00 21231.96 82.94 0.00 0.00 6020.70 3070.48 15243.19 00:30:03.464 [2024-11-28T22:22:07.070Z] =================================================================================================================== 00:30:03.464 [2024-11-28T22:22:07.070Z] Total : 21231.96 82.94 0.00 0.00 6020.70 3070.48 15243.19 00:30:03.464 0 00:30:03.464 23:22:07 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:30:03.464 23:22:07 -- host/digest.sh@92 -- # get_accel_stats 00:30:03.464 23:22:07 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:30:03.464 23:22:07 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:30:03.464 23:22:07 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:30:03.464 | select(.opcode=="crc32c") 00:30:03.464 | "\(.module_name) \(.executed)"' 00:30:03.722 23:22:07 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:30:03.723 23:22:07 -- host/digest.sh@93 -- # exp_module=software 00:30:03.723 23:22:07 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:30:03.723 23:22:07 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:30:03.723 23:22:07 -- host/digest.sh@97 -- # killprocess 2572890 00:30:03.723 23:22:07 -- common/autotest_common.sh@936 -- # '[' -z 2572890 ']' 00:30:03.723 23:22:07 -- common/autotest_common.sh@940 -- # kill -0 2572890 00:30:03.723 23:22:07 -- common/autotest_common.sh@941 -- # uname 00:30:03.723 23:22:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:03.723 23:22:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2572890 00:30:03.982 23:22:07 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:03.982 23:22:07 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:03.982 23:22:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2572890' 00:30:03.982 killing process with pid 2572890 00:30:03.982 23:22:07 -- common/autotest_common.sh@955 -- # kill 2572890 00:30:03.982 Received shutdown signal, test time was about 2.000000 seconds 00:30:03.982 00:30:03.982 Latency(us) 00:30:03.982 [2024-11-28T22:22:07.588Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:03.982 [2024-11-28T22:22:07.588Z] =================================================================================================================== 00:30:03.982 [2024-11-28T22:22:07.588Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:03.982 23:22:07 -- common/autotest_common.sh@960 -- # wait 2572890 00:30:03.982 23:22:07 -- host/digest.sh@125 -- # run_bperf randwrite 131072 16 00:30:03.982 23:22:07 -- host/digest.sh@77 -- # local rw bs qd 00:30:03.982 23:22:07 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:30:03.982 23:22:07 -- host/digest.sh@80 -- # rw=randwrite 00:30:03.982 23:22:07 -- host/digest.sh@80 -- # bs=131072 00:30:03.982 23:22:07 -- host/digest.sh@80 -- # qd=16 00:30:03.982 23:22:07 -- host/digest.sh@82 -- # bperfpid=2573434 00:30:03.982 23:22:07 -- host/digest.sh@83 -- # waitforlisten 2573434 /var/tmp/bperf.sock 00:30:03.982 23:22:07 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:30:03.982 23:22:07 -- common/autotest_common.sh@829 -- # '[' -z 2573434 ']' 00:30:03.982 23:22:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:30:03.982 23:22:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:03.982 23:22:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:30:03.982 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:30:03.982 23:22:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:03.982 23:22:07 -- common/autotest_common.sh@10 -- # set +x 00:30:04.241 [2024-11-28 23:22:07.616590] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:04.241 [2024-11-28 23:22:07.616681] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2573434 ] 00:30:04.241 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:04.241 Zero copy mechanism will not be used. 00:30:04.241 EAL: No free 2048 kB hugepages reported on node 1 00:30:04.241 [2024-11-28 23:22:07.679628] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:04.241 [2024-11-28 23:22:07.765915] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:04.241 23:22:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:04.241 23:22:07 -- common/autotest_common.sh@862 -- # return 0 00:30:04.241 23:22:07 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:30:04.241 23:22:07 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:30:04.241 23:22:07 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:30:04.809 23:22:08 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:04.809 23:22:08 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:05.067 nvme0n1 00:30:05.067 23:22:08 -- host/digest.sh@91 -- # bperf_py perform_tests 00:30:05.067 23:22:08 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:30:05.326 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:05.326 Zero copy mechanism will not be used. 00:30:05.326 Running I/O for 2 seconds... 00:30:07.223 00:30:07.223 Latency(us) 00:30:07.223 [2024-11-28T22:22:10.829Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:07.223 [2024-11-28T22:22:10.829Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:30:07.223 nvme0n1 : 2.00 6457.97 807.25 0.00 0.00 2470.11 1784.04 4393.34 00:30:07.223 [2024-11-28T22:22:10.829Z] =================================================================================================================== 00:30:07.223 [2024-11-28T22:22:10.829Z] Total : 6457.97 807.25 0.00 0.00 2470.11 1784.04 4393.34 00:30:07.223 0 00:30:07.223 23:22:10 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:30:07.223 23:22:10 -- host/digest.sh@92 -- # get_accel_stats 00:30:07.223 23:22:10 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:30:07.223 23:22:10 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:30:07.223 | select(.opcode=="crc32c") 00:30:07.223 | "\(.module_name) \(.executed)"' 00:30:07.223 23:22:10 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:30:07.481 23:22:10 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:30:07.481 23:22:10 -- host/digest.sh@93 -- # exp_module=software 00:30:07.481 23:22:10 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:30:07.481 23:22:10 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:30:07.481 23:22:10 -- host/digest.sh@97 -- # killprocess 2573434 00:30:07.481 23:22:10 -- common/autotest_common.sh@936 -- # '[' -z 2573434 ']' 00:30:07.481 23:22:10 -- common/autotest_common.sh@940 -- # kill -0 2573434 00:30:07.481 23:22:10 -- common/autotest_common.sh@941 -- # uname 00:30:07.481 23:22:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:07.481 23:22:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2573434 00:30:07.481 23:22:10 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:07.481 23:22:10 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:07.481 23:22:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2573434' 00:30:07.481 killing process with pid 2573434 00:30:07.481 23:22:10 -- common/autotest_common.sh@955 -- # kill 2573434 00:30:07.481 Received shutdown signal, test time was about 2.000000 seconds 00:30:07.481 00:30:07.481 Latency(us) 00:30:07.481 [2024-11-28T22:22:11.087Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:07.481 [2024-11-28T22:22:11.087Z] =================================================================================================================== 00:30:07.481 [2024-11-28T22:22:11.087Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:07.481 23:22:10 -- common/autotest_common.sh@960 -- # wait 2573434 00:30:07.738 23:22:11 -- host/digest.sh@126 -- # killprocess 2571904 00:30:07.738 23:22:11 -- common/autotest_common.sh@936 -- # '[' -z 2571904 ']' 00:30:07.738 23:22:11 -- common/autotest_common.sh@940 -- # kill -0 2571904 00:30:07.738 23:22:11 -- common/autotest_common.sh@941 -- # uname 00:30:07.738 23:22:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:07.738 23:22:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2571904 00:30:07.738 23:22:11 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:30:07.738 23:22:11 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:30:07.738 23:22:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2571904' 00:30:07.738 killing process with pid 2571904 00:30:07.738 23:22:11 -- common/autotest_common.sh@955 -- # kill 2571904 00:30:07.738 23:22:11 -- common/autotest_common.sh@960 -- # wait 2571904 00:30:07.997 00:30:07.997 real 0m15.663s 00:30:07.997 user 0m31.177s 00:30:07.997 sys 0m4.389s 00:30:07.997 23:22:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:07.997 23:22:11 -- common/autotest_common.sh@10 -- # set +x 00:30:07.997 ************************************ 00:30:07.997 END TEST nvmf_digest_clean 00:30:07.997 ************************************ 00:30:07.997 23:22:11 -- host/digest.sh@136 -- # run_test nvmf_digest_error run_digest_error 00:30:07.997 23:22:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:07.997 23:22:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:07.997 23:22:11 -- common/autotest_common.sh@10 -- # set +x 00:30:07.997 ************************************ 00:30:07.997 START TEST nvmf_digest_error 00:30:07.997 ************************************ 00:30:07.997 23:22:11 -- common/autotest_common.sh@1114 -- # run_digest_error 00:30:07.997 23:22:11 -- host/digest.sh@101 -- # nvmfappstart --wait-for-rpc 00:30:07.997 23:22:11 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:07.997 23:22:11 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:07.997 23:22:11 -- common/autotest_common.sh@10 -- # set +x 00:30:07.997 23:22:11 -- nvmf/common.sh@469 -- # nvmfpid=2573879 00:30:07.997 23:22:11 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:30:07.997 23:22:11 -- nvmf/common.sh@470 -- # waitforlisten 2573879 00:30:07.997 23:22:11 -- common/autotest_common.sh@829 -- # '[' -z 2573879 ']' 00:30:07.997 23:22:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:07.997 23:22:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:07.997 23:22:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:07.997 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:07.997 23:22:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:07.997 23:22:11 -- common/autotest_common.sh@10 -- # set +x 00:30:07.997 [2024-11-28 23:22:11.582425] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:07.997 [2024-11-28 23:22:11.582516] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:08.256 EAL: No free 2048 kB hugepages reported on node 1 00:30:08.256 [2024-11-28 23:22:11.651123] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:08.256 [2024-11-28 23:22:11.740976] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:08.256 [2024-11-28 23:22:11.741148] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:08.256 [2024-11-28 23:22:11.741168] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:08.256 [2024-11-28 23:22:11.741193] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:08.256 [2024-11-28 23:22:11.741224] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:08.256 23:22:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:08.256 23:22:11 -- common/autotest_common.sh@862 -- # return 0 00:30:08.256 23:22:11 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:08.256 23:22:11 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:08.256 23:22:11 -- common/autotest_common.sh@10 -- # set +x 00:30:08.256 23:22:11 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:08.256 23:22:11 -- host/digest.sh@103 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:30:08.256 23:22:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:08.256 23:22:11 -- common/autotest_common.sh@10 -- # set +x 00:30:08.256 [2024-11-28 23:22:11.825889] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:30:08.256 23:22:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:08.256 23:22:11 -- host/digest.sh@104 -- # common_target_config 00:30:08.256 23:22:11 -- host/digest.sh@43 -- # rpc_cmd 00:30:08.256 23:22:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:08.256 23:22:11 -- common/autotest_common.sh@10 -- # set +x 00:30:08.515 null0 00:30:08.515 [2024-11-28 23:22:11.944997] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:08.515 [2024-11-28 23:22:11.969240] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:08.515 23:22:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:08.515 23:22:11 -- host/digest.sh@107 -- # run_bperf_err randread 4096 128 00:30:08.515 23:22:11 -- host/digest.sh@54 -- # local rw bs qd 00:30:08.515 23:22:11 -- host/digest.sh@56 -- # rw=randread 00:30:08.515 23:22:11 -- host/digest.sh@56 -- # bs=4096 00:30:08.515 23:22:11 -- host/digest.sh@56 -- # qd=128 00:30:08.515 23:22:11 -- host/digest.sh@58 -- # bperfpid=2574026 00:30:08.515 23:22:11 -- host/digest.sh@60 -- # waitforlisten 2574026 /var/tmp/bperf.sock 00:30:08.515 23:22:11 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:30:08.515 23:22:11 -- common/autotest_common.sh@829 -- # '[' -z 2574026 ']' 00:30:08.515 23:22:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:30:08.515 23:22:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:08.515 23:22:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:30:08.515 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:30:08.515 23:22:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:08.515 23:22:11 -- common/autotest_common.sh@10 -- # set +x 00:30:08.515 [2024-11-28 23:22:12.017830] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:08.515 [2024-11-28 23:22:12.017906] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2574026 ] 00:30:08.515 EAL: No free 2048 kB hugepages reported on node 1 00:30:08.515 [2024-11-28 23:22:12.082854] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:08.773 [2024-11-28 23:22:12.173726] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:09.708 23:22:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:09.708 23:22:13 -- common/autotest_common.sh@862 -- # return 0 00:30:09.708 23:22:13 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:09.708 23:22:13 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:09.708 23:22:13 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:30:09.708 23:22:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:09.708 23:22:13 -- common/autotest_common.sh@10 -- # set +x 00:30:09.708 23:22:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:09.708 23:22:13 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:09.708 23:22:13 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:10.274 nvme0n1 00:30:10.274 23:22:13 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:30:10.274 23:22:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:10.274 23:22:13 -- common/autotest_common.sh@10 -- # set +x 00:30:10.274 23:22:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:10.274 23:22:13 -- host/digest.sh@69 -- # bperf_py perform_tests 00:30:10.274 23:22:13 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:30:10.532 Running I/O for 2 seconds... 00:30:10.532 [2024-11-28 23:22:13.938086] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:10.532 [2024-11-28 23:22:13.938148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:5412 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:10.532 [2024-11-28 23:22:13.938169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:10.532 [2024-11-28 23:22:13.951193] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:10.532 [2024-11-28 23:22:13.951225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:15655 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:10.532 [2024-11-28 23:22:13.951242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:10.532 [2024-11-28 23:22:13.966912] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:10.532 [2024-11-28 23:22:13.966944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:10400 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:10.532 [2024-11-28 23:22:13.966963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:10.532 [2024-11-28 23:22:13.976931] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:10.532 [2024-11-28 23:22:13.976962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:24043 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:10.532 [2024-11-28 23:22:13.976978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:10.532 [2024-11-28 23:22:13.992116] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:10.532 [2024-11-28 23:22:13.992156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:11643 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:10.532 [2024-11-28 23:22:13.992173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:10.532 [2024-11-28 23:22:14.007243] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:10.532 [2024-11-28 23:22:14.007273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:8638 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:10.532 [2024-11-28 23:22:14.007289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:10.532 [2024-11-28 23:22:14.022555] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:10.532 [2024-11-28 23:22:14.022585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:16897 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:10.533 [2024-11-28 23:22:14.022601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:10.533 [2024-11-28 23:22:14.039154] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:10.533 [2024-11-28 23:22:14.039185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:1829 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:10.533 [2024-11-28 23:22:14.039201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:10.533 [2024-11-28 23:22:14.052178] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:10.533 [2024-11-28 23:22:14.052208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:8223 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:10.533 [2024-11-28 23:22:14.052225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:10.533 [2024-11-28 23:22:14.062099] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:10.533 [2024-11-28 23:22:14.062130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:1793 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:10.533 [2024-11-28 23:22:14.062148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:10.533 [2024-11-28 23:22:14.077433] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:10.533 [2024-11-28 23:22:14.077470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:13970 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:10.533 [2024-11-28 23:22:14.077487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:10.533 [2024-11-28 23:22:14.088201] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:10.533 [2024-11-28 23:22:14.088230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:25397 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:10.533 [2024-11-28 23:22:14.088246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:10.533 [2024-11-28 23:22:14.103801] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:10.533 [2024-11-28 23:22:14.103832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:24850 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:10.533 [2024-11-28 23:22:14.103847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:10.533 [2024-11-28 23:22:14.118439] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:10.533 [2024-11-28 23:22:14.118470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:93 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:10.533 [2024-11-28 23:22:14.118487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:10.533 [2024-11-28 23:22:14.133745] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:10.533 [2024-11-28 23:22:14.133777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:12172 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:10.533 [2024-11-28 23:22:14.133794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:10.791 [2024-11-28 23:22:14.144007] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:10.792 [2024-11-28 23:22:14.144038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:24189 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:10.792 [2024-11-28 23:22:14.144055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:10.792 [2024-11-28 23:22:14.159012] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:10.792 [2024-11-28 23:22:14.159044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:17479 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:10.792 [2024-11-28 23:22:14.159062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:10.792 [2024-11-28 23:22:14.174957] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:10.792 [2024-11-28 23:22:14.174985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:8367 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:10.792 [2024-11-28 23:22:14.175001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:10.792 [2024-11-28 23:22:14.188984] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:10.792 [2024-11-28 23:22:14.189031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:12570 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:10.792 [2024-11-28 23:22:14.189049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:10.792 [2024-11-28 23:22:14.199989] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:10.792 [2024-11-28 23:22:14.200019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:3030 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:10.792 [2024-11-28 23:22:14.200034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:10.792 [2024-11-28 23:22:14.215171] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:10.792 [2024-11-28 23:22:14.215201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:18334 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:10.792 [2024-11-28 23:22:14.215218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:10.792 [2024-11-28 23:22:14.227780] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:10.792 [2024-11-28 23:22:14.227809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:6215 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:10.792 [2024-11-28 23:22:14.227832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:10.792 [2024-11-28 23:22:14.238524] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:10.792 [2024-11-28 23:22:14.238555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:7254 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:10.792 [2024-11-28 23:22:14.238572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:10.792 [2024-11-28 23:22:14.254170] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:10.792 [2024-11-28 23:22:14.254198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:2691 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:10.792 [2024-11-28 23:22:14.254214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:10.792 [2024-11-28 23:22:14.265026] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:10.792 [2024-11-28 23:22:14.265055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:1257 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:10.792 [2024-11-28 23:22:14.265070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:10.792 [2024-11-28 23:22:14.279779] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:10.792 [2024-11-28 23:22:14.279809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:7904 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:10.792 [2024-11-28 23:22:14.279845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:10.792 [2024-11-28 23:22:14.295801] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:10.792 [2024-11-28 23:22:14.295833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:11592 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:10.792 [2024-11-28 23:22:14.295850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:10.792 [2024-11-28 23:22:14.306042] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:10.792 [2024-11-28 23:22:14.306071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:3130 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:10.792 [2024-11-28 23:22:14.306088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:10.792 [2024-11-28 23:22:14.320313] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:10.792 [2024-11-28 23:22:14.320342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:13289 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:10.792 [2024-11-28 23:22:14.320358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:10.792 [2024-11-28 23:22:14.335495] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:10.792 [2024-11-28 23:22:14.335525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:17832 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:10.792 [2024-11-28 23:22:14.335541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:10.792 [2024-11-28 23:22:14.355917] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:10.792 [2024-11-28 23:22:14.355954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:12522 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:10.792 [2024-11-28 23:22:14.355973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:10.792 [2024-11-28 23:22:14.366915] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:10.792 [2024-11-28 23:22:14.366946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:5922 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:10.792 [2024-11-28 23:22:14.366964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:10.792 [2024-11-28 23:22:14.383165] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:10.792 [2024-11-28 23:22:14.383194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:9296 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:10.792 [2024-11-28 23:22:14.383210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.051 [2024-11-28 23:22:14.398748] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.051 [2024-11-28 23:22:14.398780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:7484 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.051 [2024-11-28 23:22:14.398798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.051 [2024-11-28 23:22:14.414251] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.051 [2024-11-28 23:22:14.414280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:7974 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.051 [2024-11-28 23:22:14.414295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.051 [2024-11-28 23:22:14.429626] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.051 [2024-11-28 23:22:14.429656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:21456 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.051 [2024-11-28 23:22:14.429672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.051 [2024-11-28 23:22:14.445003] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.051 [2024-11-28 23:22:14.445033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:17343 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.051 [2024-11-28 23:22:14.445049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.051 [2024-11-28 23:22:14.460726] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.051 [2024-11-28 23:22:14.460769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:5035 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.051 [2024-11-28 23:22:14.460786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.051 [2024-11-28 23:22:14.476251] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.051 [2024-11-28 23:22:14.476280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:1237 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.051 [2024-11-28 23:22:14.476295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.051 [2024-11-28 23:22:14.491993] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.051 [2024-11-28 23:22:14.492023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:16200 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.051 [2024-11-28 23:22:14.492039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.051 [2024-11-28 23:22:14.507237] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.051 [2024-11-28 23:22:14.507265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:22472 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.051 [2024-11-28 23:22:14.507281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.051 [2024-11-28 23:22:14.522584] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.051 [2024-11-28 23:22:14.522613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:11889 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.051 [2024-11-28 23:22:14.522629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.051 [2024-11-28 23:22:14.537688] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.051 [2024-11-28 23:22:14.537716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:3521 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.051 [2024-11-28 23:22:14.537731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.051 [2024-11-28 23:22:14.552787] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.051 [2024-11-28 23:22:14.552815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:12543 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.051 [2024-11-28 23:22:14.552831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.051 [2024-11-28 23:22:14.568232] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.051 [2024-11-28 23:22:14.568260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:4076 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.051 [2024-11-28 23:22:14.568275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.051 [2024-11-28 23:22:14.583546] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.051 [2024-11-28 23:22:14.583575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:20606 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.051 [2024-11-28 23:22:14.583591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.051 [2024-11-28 23:22:14.598695] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.051 [2024-11-28 23:22:14.598723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:25251 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.051 [2024-11-28 23:22:14.598739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.051 [2024-11-28 23:22:14.614554] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.051 [2024-11-28 23:22:14.614591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:22751 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.051 [2024-11-28 23:22:14.614610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.051 [2024-11-28 23:22:14.629904] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.052 [2024-11-28 23:22:14.629931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:3998 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.052 [2024-11-28 23:22:14.629946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.052 [2024-11-28 23:22:14.645037] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.052 [2024-11-28 23:22:14.645064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:21549 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.052 [2024-11-28 23:22:14.645079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.310 [2024-11-28 23:22:14.660851] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.310 [2024-11-28 23:22:14.660879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:14116 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.310 [2024-11-28 23:22:14.660894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.310 [2024-11-28 23:22:14.670630] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.310 [2024-11-28 23:22:14.670658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:13625 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.310 [2024-11-28 23:22:14.670674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.310 [2024-11-28 23:22:14.684332] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.310 [2024-11-28 23:22:14.684359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:6206 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.310 [2024-11-28 23:22:14.684389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.310 [2024-11-28 23:22:14.699961] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.310 [2024-11-28 23:22:14.699990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:19787 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.310 [2024-11-28 23:22:14.700021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.310 [2024-11-28 23:22:14.714665] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.310 [2024-11-28 23:22:14.714706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:22495 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.310 [2024-11-28 23:22:14.714721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.310 [2024-11-28 23:22:14.729887] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.310 [2024-11-28 23:22:14.729916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:14548 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.310 [2024-11-28 23:22:14.729931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.310 [2024-11-28 23:22:14.745617] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.310 [2024-11-28 23:22:14.745648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:20253 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.310 [2024-11-28 23:22:14.745681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.310 [2024-11-28 23:22:14.761295] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.310 [2024-11-28 23:22:14.761327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:24343 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.310 [2024-11-28 23:22:14.761344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.310 [2024-11-28 23:22:14.775833] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.310 [2024-11-28 23:22:14.775861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:9308 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.310 [2024-11-28 23:22:14.775876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.310 [2024-11-28 23:22:14.786302] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.310 [2024-11-28 23:22:14.786330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:11493 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.310 [2024-11-28 23:22:14.786344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.310 [2024-11-28 23:22:14.801636] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.310 [2024-11-28 23:22:14.801666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:14206 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.310 [2024-11-28 23:22:14.801682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.310 [2024-11-28 23:22:14.817456] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.310 [2024-11-28 23:22:14.817485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:4672 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.310 [2024-11-28 23:22:14.817500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.310 [2024-11-28 23:22:14.832602] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.310 [2024-11-28 23:22:14.832631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:18709 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.310 [2024-11-28 23:22:14.832647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.310 [2024-11-28 23:22:14.847618] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.310 [2024-11-28 23:22:14.847646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:20243 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.310 [2024-11-28 23:22:14.847663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.310 [2024-11-28 23:22:14.861722] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.310 [2024-11-28 23:22:14.861768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:17553 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.310 [2024-11-28 23:22:14.861791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.310 [2024-11-28 23:22:14.872759] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.310 [2024-11-28 23:22:14.872788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:5857 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.310 [2024-11-28 23:22:14.872803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.310 [2024-11-28 23:22:14.887932] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.310 [2024-11-28 23:22:14.887960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:15732 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.310 [2024-11-28 23:22:14.887976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.310 [2024-11-28 23:22:14.903355] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.310 [2024-11-28 23:22:14.903384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:6002 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.310 [2024-11-28 23:22:14.903423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.569 [2024-11-28 23:22:14.919290] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.569 [2024-11-28 23:22:14.919318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:18298 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.569 [2024-11-28 23:22:14.919334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.569 [2024-11-28 23:22:14.934405] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.569 [2024-11-28 23:22:14.934434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:5767 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.569 [2024-11-28 23:22:14.934450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.569 [2024-11-28 23:22:14.949629] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.569 [2024-11-28 23:22:14.949658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:5586 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.569 [2024-11-28 23:22:14.949673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.569 [2024-11-28 23:22:14.964938] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.569 [2024-11-28 23:22:14.964965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:20104 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.569 [2024-11-28 23:22:14.964980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.569 [2024-11-28 23:22:14.980170] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.569 [2024-11-28 23:22:14.980198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:18760 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.569 [2024-11-28 23:22:14.980213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.569 [2024-11-28 23:22:14.995774] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.569 [2024-11-28 23:22:14.995807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:11826 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.569 [2024-11-28 23:22:14.995824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.569 [2024-11-28 23:22:15.009869] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.569 [2024-11-28 23:22:15.009897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:7544 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.569 [2024-11-28 23:22:15.009914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.569 [2024-11-28 23:22:15.026292] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.569 [2024-11-28 23:22:15.026320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:19274 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.569 [2024-11-28 23:22:15.026335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.569 [2024-11-28 23:22:15.036332] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.569 [2024-11-28 23:22:15.036360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:4349 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.569 [2024-11-28 23:22:15.036389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.569 [2024-11-28 23:22:15.050574] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.569 [2024-11-28 23:22:15.050602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:18510 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.569 [2024-11-28 23:22:15.050617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.569 [2024-11-28 23:22:15.066001] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.569 [2024-11-28 23:22:15.066029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:14497 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.569 [2024-11-28 23:22:15.066046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.569 [2024-11-28 23:22:15.081160] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.569 [2024-11-28 23:22:15.081187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:287 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.569 [2024-11-28 23:22:15.081203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.569 [2024-11-28 23:22:15.096282] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.569 [2024-11-28 23:22:15.096310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:7564 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.569 [2024-11-28 23:22:15.096326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.569 [2024-11-28 23:22:15.111890] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.569 [2024-11-28 23:22:15.111935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:16057 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.569 [2024-11-28 23:22:15.111952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.569 [2024-11-28 23:22:15.122536] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.569 [2024-11-28 23:22:15.122566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:6773 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.569 [2024-11-28 23:22:15.122583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.569 [2024-11-28 23:22:15.135573] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.569 [2024-11-28 23:22:15.135602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:24027 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.569 [2024-11-28 23:22:15.135619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.569 [2024-11-28 23:22:15.150895] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.569 [2024-11-28 23:22:15.150923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:10196 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.569 [2024-11-28 23:22:15.150938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.569 [2024-11-28 23:22:15.166252] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.569 [2024-11-28 23:22:15.166280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:9407 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.569 [2024-11-28 23:22:15.166295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.827 [2024-11-28 23:22:15.178853] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.827 [2024-11-28 23:22:15.178901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:25359 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.827 [2024-11-28 23:22:15.178918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.827 [2024-11-28 23:22:15.189437] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.827 [2024-11-28 23:22:15.189470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:963 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.827 [2024-11-28 23:22:15.189488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.827 [2024-11-28 23:22:15.202896] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.827 [2024-11-28 23:22:15.202924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:22697 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.827 [2024-11-28 23:22:15.202940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.827 [2024-11-28 23:22:15.219048] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.827 [2024-11-28 23:22:15.219077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:3360 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.827 [2024-11-28 23:22:15.219092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.827 [2024-11-28 23:22:15.234781] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.827 [2024-11-28 23:22:15.234824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:13686 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.827 [2024-11-28 23:22:15.234846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.827 [2024-11-28 23:22:15.250297] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.827 [2024-11-28 23:22:15.250332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:17295 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.827 [2024-11-28 23:22:15.250351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.827 [2024-11-28 23:22:15.265557] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.827 [2024-11-28 23:22:15.265589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17098 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.827 [2024-11-28 23:22:15.265606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.827 [2024-11-28 23:22:15.282412] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.827 [2024-11-28 23:22:15.282462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:22535 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.827 [2024-11-28 23:22:15.282479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.827 [2024-11-28 23:22:15.299542] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.827 [2024-11-28 23:22:15.299573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:6567 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.827 [2024-11-28 23:22:15.299591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.827 [2024-11-28 23:22:15.311144] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.827 [2024-11-28 23:22:15.311178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:3683 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.828 [2024-11-28 23:22:15.311197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.828 [2024-11-28 23:22:15.328313] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.828 [2024-11-28 23:22:15.328347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:10475 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.828 [2024-11-28 23:22:15.328366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.828 [2024-11-28 23:22:15.344942] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.828 [2024-11-28 23:22:15.344977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:6420 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.828 [2024-11-28 23:22:15.344996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.828 [2024-11-28 23:22:15.361968] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.828 [2024-11-28 23:22:15.362003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:8840 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.828 [2024-11-28 23:22:15.362023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.828 [2024-11-28 23:22:15.378698] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.828 [2024-11-28 23:22:15.378744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:2003 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.828 [2024-11-28 23:22:15.378764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.828 [2024-11-28 23:22:15.395937] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.828 [2024-11-28 23:22:15.395972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:7084 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.828 [2024-11-28 23:22:15.395991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.828 [2024-11-28 23:22:15.412846] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.828 [2024-11-28 23:22:15.412881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:20819 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.828 [2024-11-28 23:22:15.412900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.828 [2024-11-28 23:22:15.430104] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:11.828 [2024-11-28 23:22:15.430138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:24565 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:11.828 [2024-11-28 23:22:15.430157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:12.085 [2024-11-28 23:22:15.447298] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:12.085 [2024-11-28 23:22:15.447333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:20455 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:12.085 [2024-11-28 23:22:15.447352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:12.085 [2024-11-28 23:22:15.463898] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:12.085 [2024-11-28 23:22:15.463932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:9118 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:12.085 [2024-11-28 23:22:15.463950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:12.085 [2024-11-28 23:22:15.480943] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:12.085 [2024-11-28 23:22:15.480977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:10561 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:12.085 [2024-11-28 23:22:15.480996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:12.085 [2024-11-28 23:22:15.497788] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:12.085 [2024-11-28 23:22:15.497822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:12470 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:12.085 [2024-11-28 23:22:15.497841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:12.085 [2024-11-28 23:22:15.514674] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:12.085 [2024-11-28 23:22:15.514704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:14612 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:12.085 [2024-11-28 23:22:15.514725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:12.085 [2024-11-28 23:22:15.531346] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:12.085 [2024-11-28 23:22:15.531383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:1861 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:12.085 [2024-11-28 23:22:15.531412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:12.085 [2024-11-28 23:22:15.547010] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:12.085 [2024-11-28 23:22:15.547045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:2765 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:12.085 [2024-11-28 23:22:15.547064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:12.085 [2024-11-28 23:22:15.562179] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:12.085 [2024-11-28 23:22:15.562214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:7301 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:12.085 [2024-11-28 23:22:15.562234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:12.085 [2024-11-28 23:22:15.574185] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:12.085 [2024-11-28 23:22:15.574220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:10814 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:12.085 [2024-11-28 23:22:15.574239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:12.085 [2024-11-28 23:22:15.590375] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:12.085 [2024-11-28 23:22:15.590418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:17680 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:12.085 [2024-11-28 23:22:15.590452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:12.085 [2024-11-28 23:22:15.606211] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:12.085 [2024-11-28 23:22:15.606245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:22355 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:12.085 [2024-11-28 23:22:15.606265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:12.085 [2024-11-28 23:22:15.623273] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:12.085 [2024-11-28 23:22:15.623307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:15885 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:12.085 [2024-11-28 23:22:15.623327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:12.085 [2024-11-28 23:22:15.639894] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:12.085 [2024-11-28 23:22:15.639928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:13500 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:12.085 [2024-11-28 23:22:15.639948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:12.086 [2024-11-28 23:22:15.656631] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:12.086 [2024-11-28 23:22:15.656670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:17761 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:12.086 [2024-11-28 23:22:15.656704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:12.086 [2024-11-28 23:22:15.674051] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:12.086 [2024-11-28 23:22:15.674086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20897 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:12.086 [2024-11-28 23:22:15.674106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:12.343 [2024-11-28 23:22:15.691049] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:12.343 [2024-11-28 23:22:15.691084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:8420 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:12.343 [2024-11-28 23:22:15.691103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:12.343 [2024-11-28 23:22:15.707835] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:12.343 [2024-11-28 23:22:15.707869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:18003 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:12.343 [2024-11-28 23:22:15.707888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:12.343 [2024-11-28 23:22:15.724713] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:12.343 [2024-11-28 23:22:15.724747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:5259 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:12.343 [2024-11-28 23:22:15.724767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:12.343 [2024-11-28 23:22:15.741490] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:12.343 [2024-11-28 23:22:15.741519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:18422 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:12.343 [2024-11-28 23:22:15.741535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:12.343 [2024-11-28 23:22:15.758351] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:12.343 [2024-11-28 23:22:15.758385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:16279 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:12.343 [2024-11-28 23:22:15.758413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:12.343 [2024-11-28 23:22:15.775404] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:12.343 [2024-11-28 23:22:15.775450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:21304 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:12.343 [2024-11-28 23:22:15.775466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:12.343 [2024-11-28 23:22:15.792467] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:12.343 [2024-11-28 23:22:15.792495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:23757 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:12.343 [2024-11-28 23:22:15.792512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:12.343 [2024-11-28 23:22:15.809099] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:12.343 [2024-11-28 23:22:15.809133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:13822 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:12.343 [2024-11-28 23:22:15.809152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:12.343 [2024-11-28 23:22:15.825924] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:12.343 [2024-11-28 23:22:15.825958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:19870 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:12.343 [2024-11-28 23:22:15.825978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:12.344 [2024-11-28 23:22:15.842847] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:12.344 [2024-11-28 23:22:15.842881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:10257 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:12.344 [2024-11-28 23:22:15.842901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:12.344 [2024-11-28 23:22:15.859636] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:12.344 [2024-11-28 23:22:15.859665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:19547 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:12.344 [2024-11-28 23:22:15.859681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:12.344 [2024-11-28 23:22:15.876511] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:12.344 [2024-11-28 23:22:15.876539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:726 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:12.344 [2024-11-28 23:22:15.876555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:12.344 [2024-11-28 23:22:15.893377] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:12.344 [2024-11-28 23:22:15.893418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:20835 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:12.344 [2024-11-28 23:22:15.893452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:12.344 [2024-11-28 23:22:15.910245] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:12.344 [2024-11-28 23:22:15.910280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:11252 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:12.344 [2024-11-28 23:22:15.910299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:12.344 [2024-11-28 23:22:15.927222] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x137c300) 00:30:12.344 [2024-11-28 23:22:15.927256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:24405 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:12.344 [2024-11-28 23:22:15.927276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:12.344 00:30:12.344 Latency(us) 00:30:12.344 [2024-11-28T22:22:15.950Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:12.344 [2024-11-28T22:22:15.950Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:30:12.344 nvme0n1 : 2.01 16945.57 66.19 0.00 0.00 7546.39 3252.53 25243.50 00:30:12.344 [2024-11-28T22:22:15.950Z] =================================================================================================================== 00:30:12.344 [2024-11-28T22:22:15.950Z] Total : 16945.57 66.19 0.00 0.00 7546.39 3252.53 25243.50 00:30:12.344 0 00:30:12.602 23:22:15 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:30:12.602 23:22:15 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:30:12.602 23:22:15 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:30:12.602 23:22:15 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:30:12.602 | .driver_specific 00:30:12.602 | .nvme_error 00:30:12.602 | .status_code 00:30:12.602 | .command_transient_transport_error' 00:30:12.602 23:22:16 -- host/digest.sh@71 -- # (( 133 > 0 )) 00:30:12.602 23:22:16 -- host/digest.sh@73 -- # killprocess 2574026 00:30:12.602 23:22:16 -- common/autotest_common.sh@936 -- # '[' -z 2574026 ']' 00:30:12.602 23:22:16 -- common/autotest_common.sh@940 -- # kill -0 2574026 00:30:12.602 23:22:16 -- common/autotest_common.sh@941 -- # uname 00:30:12.602 23:22:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:12.602 23:22:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2574026 00:30:12.860 23:22:16 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:12.860 23:22:16 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:12.860 23:22:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2574026' 00:30:12.860 killing process with pid 2574026 00:30:12.860 23:22:16 -- common/autotest_common.sh@955 -- # kill 2574026 00:30:12.860 Received shutdown signal, test time was about 2.000000 seconds 00:30:12.860 00:30:12.860 Latency(us) 00:30:12.860 [2024-11-28T22:22:16.466Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:12.860 [2024-11-28T22:22:16.466Z] =================================================================================================================== 00:30:12.860 [2024-11-28T22:22:16.466Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:12.860 23:22:16 -- common/autotest_common.sh@960 -- # wait 2574026 00:30:12.860 23:22:16 -- host/digest.sh@108 -- # run_bperf_err randread 131072 16 00:30:12.860 23:22:16 -- host/digest.sh@54 -- # local rw bs qd 00:30:12.860 23:22:16 -- host/digest.sh@56 -- # rw=randread 00:30:12.860 23:22:16 -- host/digest.sh@56 -- # bs=131072 00:30:12.860 23:22:16 -- host/digest.sh@56 -- # qd=16 00:30:12.860 23:22:16 -- host/digest.sh@58 -- # bperfpid=2574583 00:30:12.860 23:22:16 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:30:12.860 23:22:16 -- host/digest.sh@60 -- # waitforlisten 2574583 /var/tmp/bperf.sock 00:30:12.860 23:22:16 -- common/autotest_common.sh@829 -- # '[' -z 2574583 ']' 00:30:12.860 23:22:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:30:12.860 23:22:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:12.860 23:22:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:30:12.860 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:30:12.860 23:22:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:12.860 23:22:16 -- common/autotest_common.sh@10 -- # set +x 00:30:13.119 [2024-11-28 23:22:16.492458] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:13.119 [2024-11-28 23:22:16.492558] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2574583 ] 00:30:13.119 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:13.119 Zero copy mechanism will not be used. 00:30:13.119 EAL: No free 2048 kB hugepages reported on node 1 00:30:13.119 [2024-11-28 23:22:16.555738] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:13.119 [2024-11-28 23:22:16.641735] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:14.096 23:22:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:14.096 23:22:17 -- common/autotest_common.sh@862 -- # return 0 00:30:14.096 23:22:17 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:14.096 23:22:17 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:14.383 23:22:17 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:30:14.383 23:22:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:14.383 23:22:17 -- common/autotest_common.sh@10 -- # set +x 00:30:14.383 23:22:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:14.383 23:22:17 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:14.383 23:22:17 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:14.951 nvme0n1 00:30:14.951 23:22:18 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:30:14.951 23:22:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:14.951 23:22:18 -- common/autotest_common.sh@10 -- # set +x 00:30:14.951 23:22:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:14.951 23:22:18 -- host/digest.sh@69 -- # bperf_py perform_tests 00:30:14.951 23:22:18 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:30:14.951 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:14.951 Zero copy mechanism will not be used. 00:30:14.951 Running I/O for 2 seconds... 00:30:14.951 [2024-11-28 23:22:18.394917] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:14.951 [2024-11-28 23:22:18.394972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.951 [2024-11-28 23:22:18.394993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:14.951 [2024-11-28 23:22:18.399764] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:14.951 [2024-11-28 23:22:18.399796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.951 [2024-11-28 23:22:18.399814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:14.951 [2024-11-28 23:22:18.404423] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:14.951 [2024-11-28 23:22:18.404470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.951 [2024-11-28 23:22:18.404488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:14.951 [2024-11-28 23:22:18.408954] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:14.951 [2024-11-28 23:22:18.409000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.951 [2024-11-28 23:22:18.409017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.951 [2024-11-28 23:22:18.413902] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:14.951 [2024-11-28 23:22:18.413948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.951 [2024-11-28 23:22:18.413966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:14.951 [2024-11-28 23:22:18.418512] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:14.951 [2024-11-28 23:22:18.418544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.951 [2024-11-28 23:22:18.418562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:14.951 [2024-11-28 23:22:18.423267] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:14.951 [2024-11-28 23:22:18.423312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.951 [2024-11-28 23:22:18.423329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:14.951 [2024-11-28 23:22:18.428073] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:14.951 [2024-11-28 23:22:18.428103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.951 [2024-11-28 23:22:18.428120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.951 [2024-11-28 23:22:18.432829] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:14.951 [2024-11-28 23:22:18.432859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:6336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.951 [2024-11-28 23:22:18.432876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:14.951 [2024-11-28 23:22:18.437329] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:14.951 [2024-11-28 23:22:18.437359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.951 [2024-11-28 23:22:18.437403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:14.951 [2024-11-28 23:22:18.442063] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:14.951 [2024-11-28 23:22:18.442094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.951 [2024-11-28 23:22:18.442110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:14.951 [2024-11-28 23:22:18.446790] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:14.951 [2024-11-28 23:22:18.446819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.951 [2024-11-28 23:22:18.446835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.951 [2024-11-28 23:22:18.451489] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:14.951 [2024-11-28 23:22:18.451520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.951 [2024-11-28 23:22:18.451538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:14.951 [2024-11-28 23:22:18.456264] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:14.951 [2024-11-28 23:22:18.456293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.951 [2024-11-28 23:22:18.456315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:14.951 [2024-11-28 23:22:18.460962] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:14.951 [2024-11-28 23:22:18.460992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.951 [2024-11-28 23:22:18.461010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:14.951 [2024-11-28 23:22:18.465885] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:14.951 [2024-11-28 23:22:18.465915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.951 [2024-11-28 23:22:18.465933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.951 [2024-11-28 23:22:18.471553] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:14.951 [2024-11-28 23:22:18.471585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.951 [2024-11-28 23:22:18.471604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:14.951 [2024-11-28 23:22:18.476899] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:14.951 [2024-11-28 23:22:18.476945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.951 [2024-11-28 23:22:18.476962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:14.951 [2024-11-28 23:22:18.482209] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:14.951 [2024-11-28 23:22:18.482238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:11872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.951 [2024-11-28 23:22:18.482255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:14.951 [2024-11-28 23:22:18.487096] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:14.951 [2024-11-28 23:22:18.487142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.951 [2024-11-28 23:22:18.487159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.951 [2024-11-28 23:22:18.491982] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:14.951 [2024-11-28 23:22:18.492013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.951 [2024-11-28 23:22:18.492030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:14.951 [2024-11-28 23:22:18.496778] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:14.951 [2024-11-28 23:22:18.496810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.951 [2024-11-28 23:22:18.496828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:14.951 [2024-11-28 23:22:18.502363] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:14.951 [2024-11-28 23:22:18.502425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.951 [2024-11-28 23:22:18.502450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:14.951 [2024-11-28 23:22:18.506721] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:14.952 [2024-11-28 23:22:18.506777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.952 [2024-11-28 23:22:18.506795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.952 [2024-11-28 23:22:18.511674] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:14.952 [2024-11-28 23:22:18.511705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.952 [2024-11-28 23:22:18.511723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:14.952 [2024-11-28 23:22:18.516306] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:14.952 [2024-11-28 23:22:18.516353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.952 [2024-11-28 23:22:18.516371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:14.952 [2024-11-28 23:22:18.520748] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:14.952 [2024-11-28 23:22:18.520794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.952 [2024-11-28 23:22:18.520811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:14.952 [2024-11-28 23:22:18.525585] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:14.952 [2024-11-28 23:22:18.525631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.952 [2024-11-28 23:22:18.525649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.952 [2024-11-28 23:22:18.530166] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:14.952 [2024-11-28 23:22:18.530197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:6720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.952 [2024-11-28 23:22:18.530214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:14.952 [2024-11-28 23:22:18.534097] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:14.952 [2024-11-28 23:22:18.534128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.952 [2024-11-28 23:22:18.534146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:14.952 [2024-11-28 23:22:18.538989] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:14.952 [2024-11-28 23:22:18.539019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.952 [2024-11-28 23:22:18.539036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:14.952 [2024-11-28 23:22:18.544435] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:14.952 [2024-11-28 23:22:18.544481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.952 [2024-11-28 23:22:18.544499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.952 [2024-11-28 23:22:18.549504] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:14.952 [2024-11-28 23:22:18.549537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.952 [2024-11-28 23:22:18.549555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:14.952 [2024-11-28 23:22:18.554554] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:14.952 [2024-11-28 23:22:18.554587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.952 [2024-11-28 23:22:18.554606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.212 [2024-11-28 23:22:18.560284] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.212 [2024-11-28 23:22:18.560318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:6560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.212 [2024-11-28 23:22:18.560337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.212 [2024-11-28 23:22:18.565053] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.212 [2024-11-28 23:22:18.565084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.212 [2024-11-28 23:22:18.565102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.212 [2024-11-28 23:22:18.570566] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.212 [2024-11-28 23:22:18.570612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.212 [2024-11-28 23:22:18.570630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.212 [2024-11-28 23:22:18.575883] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.212 [2024-11-28 23:22:18.575939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.212 [2024-11-28 23:22:18.575956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.212 [2024-11-28 23:22:18.580605] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.212 [2024-11-28 23:22:18.580637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:12576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.212 [2024-11-28 23:22:18.580670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.212 [2024-11-28 23:22:18.586033] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.212 [2024-11-28 23:22:18.586078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.212 [2024-11-28 23:22:18.586102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.212 [2024-11-28 23:22:18.590148] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.212 [2024-11-28 23:22:18.590177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.212 [2024-11-28 23:22:18.590194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.212 [2024-11-28 23:22:18.594862] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.212 [2024-11-28 23:22:18.594893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.212 [2024-11-28 23:22:18.594911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.212 [2024-11-28 23:22:18.599640] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.212 [2024-11-28 23:22:18.599670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.212 [2024-11-28 23:22:18.599688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.212 [2024-11-28 23:22:18.604525] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.212 [2024-11-28 23:22:18.604556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.212 [2024-11-28 23:22:18.604573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.212 [2024-11-28 23:22:18.609289] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.212 [2024-11-28 23:22:18.609318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.212 [2024-11-28 23:22:18.609335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.212 [2024-11-28 23:22:18.614042] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.212 [2024-11-28 23:22:18.614096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:12320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.212 [2024-11-28 23:22:18.614113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.212 [2024-11-28 23:22:18.618788] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.212 [2024-11-28 23:22:18.618818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.212 [2024-11-28 23:22:18.618835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.212 [2024-11-28 23:22:18.623368] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.212 [2024-11-28 23:22:18.623420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.212 [2024-11-28 23:22:18.623452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.212 [2024-11-28 23:22:18.627930] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.212 [2024-11-28 23:22:18.627961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.212 [2024-11-28 23:22:18.627979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.212 [2024-11-28 23:22:18.631800] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.212 [2024-11-28 23:22:18.631830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:6976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.212 [2024-11-28 23:22:18.631847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.212 [2024-11-28 23:22:18.635931] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.212 [2024-11-28 23:22:18.635978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.212 [2024-11-28 23:22:18.635996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.212 [2024-11-28 23:22:18.639807] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.212 [2024-11-28 23:22:18.639836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.212 [2024-11-28 23:22:18.639855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.212 [2024-11-28 23:22:18.643725] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.212 [2024-11-28 23:22:18.643773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:2976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.212 [2024-11-28 23:22:18.643793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.212 [2024-11-28 23:22:18.647968] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.212 [2024-11-28 23:22:18.647997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.212 [2024-11-28 23:22:18.648015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.212 [2024-11-28 23:22:18.652594] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.212 [2024-11-28 23:22:18.652625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.212 [2024-11-28 23:22:18.652643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.212 [2024-11-28 23:22:18.657882] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.212 [2024-11-28 23:22:18.657912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.212 [2024-11-28 23:22:18.657932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.212 [2024-11-28 23:22:18.662036] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.212 [2024-11-28 23:22:18.662078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.212 [2024-11-28 23:22:18.662101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.212 [2024-11-28 23:22:18.666671] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.212 [2024-11-28 23:22:18.666701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.212 [2024-11-28 23:22:18.666718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.212 [2024-11-28 23:22:18.671658] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.212 [2024-11-28 23:22:18.671707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:13376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.212 [2024-11-28 23:22:18.671724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.212 [2024-11-28 23:22:18.676428] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.212 [2024-11-28 23:22:18.676468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.212 [2024-11-28 23:22:18.676486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.212 [2024-11-28 23:22:18.681130] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.213 [2024-11-28 23:22:18.681160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.213 [2024-11-28 23:22:18.681177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.213 [2024-11-28 23:22:18.686099] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.213 [2024-11-28 23:22:18.686129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:13792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.213 [2024-11-28 23:22:18.686146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.213 [2024-11-28 23:22:18.690697] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.213 [2024-11-28 23:22:18.690742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:11808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.213 [2024-11-28 23:22:18.690759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.213 [2024-11-28 23:22:18.695529] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.213 [2024-11-28 23:22:18.695560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:6784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.213 [2024-11-28 23:22:18.695578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.213 [2024-11-28 23:22:18.700294] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.213 [2024-11-28 23:22:18.700325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.213 [2024-11-28 23:22:18.700344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.213 [2024-11-28 23:22:18.705093] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.213 [2024-11-28 23:22:18.705130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.213 [2024-11-28 23:22:18.705148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.213 [2024-11-28 23:22:18.709558] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.213 [2024-11-28 23:22:18.709589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.213 [2024-11-28 23:22:18.709607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.213 [2024-11-28 23:22:18.714035] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.213 [2024-11-28 23:22:18.714065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.213 [2024-11-28 23:22:18.714082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.213 [2024-11-28 23:22:18.718762] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.213 [2024-11-28 23:22:18.718792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:15072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.213 [2024-11-28 23:22:18.718825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.213 [2024-11-28 23:22:18.723285] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.213 [2024-11-28 23:22:18.723314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.213 [2024-11-28 23:22:18.723331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.213 [2024-11-28 23:22:18.728031] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.213 [2024-11-28 23:22:18.728060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:6816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.213 [2024-11-28 23:22:18.728078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.213 [2024-11-28 23:22:18.732558] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.213 [2024-11-28 23:22:18.732588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.213 [2024-11-28 23:22:18.732609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.213 [2024-11-28 23:22:18.737667] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.213 [2024-11-28 23:22:18.737699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.213 [2024-11-28 23:22:18.737718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.213 [2024-11-28 23:22:18.742925] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.213 [2024-11-28 23:22:18.742956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.213 [2024-11-28 23:22:18.742974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.213 [2024-11-28 23:22:18.747692] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.213 [2024-11-28 23:22:18.747734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:3648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.213 [2024-11-28 23:22:18.747752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.213 [2024-11-28 23:22:18.752871] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.213 [2024-11-28 23:22:18.752900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.213 [2024-11-28 23:22:18.752918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.213 [2024-11-28 23:22:18.758196] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.213 [2024-11-28 23:22:18.758228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:15072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.213 [2024-11-28 23:22:18.758246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.213 [2024-11-28 23:22:18.765049] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.213 [2024-11-28 23:22:18.765080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.213 [2024-11-28 23:22:18.765097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.213 [2024-11-28 23:22:18.770655] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.213 [2024-11-28 23:22:18.770701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.213 [2024-11-28 23:22:18.770718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.213 [2024-11-28 23:22:18.776272] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.213 [2024-11-28 23:22:18.776303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.213 [2024-11-28 23:22:18.776320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.213 [2024-11-28 23:22:18.781769] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.213 [2024-11-28 23:22:18.781799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.213 [2024-11-28 23:22:18.781816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.213 [2024-11-28 23:22:18.787540] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.213 [2024-11-28 23:22:18.787571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.213 [2024-11-28 23:22:18.787590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.213 [2024-11-28 23:22:18.794845] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.213 [2024-11-28 23:22:18.794891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.213 [2024-11-28 23:22:18.794914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.213 [2024-11-28 23:22:18.801319] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.213 [2024-11-28 23:22:18.801352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.213 [2024-11-28 23:22:18.801371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.213 [2024-11-28 23:22:18.806211] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.213 [2024-11-28 23:22:18.806242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.213 [2024-11-28 23:22:18.806261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.213 [2024-11-28 23:22:18.811870] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.213 [2024-11-28 23:22:18.811920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.213 [2024-11-28 23:22:18.811940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.473 [2024-11-28 23:22:18.817892] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.473 [2024-11-28 23:22:18.817924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.473 [2024-11-28 23:22:18.817941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.473 [2024-11-28 23:22:18.823759] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.473 [2024-11-28 23:22:18.823806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.473 [2024-11-28 23:22:18.823826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.473 [2024-11-28 23:22:18.828113] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.473 [2024-11-28 23:22:18.828146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.473 [2024-11-28 23:22:18.828165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.473 [2024-11-28 23:22:18.831961] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.473 [2024-11-28 23:22:18.831993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.473 [2024-11-28 23:22:18.832010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.473 [2024-11-28 23:22:18.835877] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.473 [2024-11-28 23:22:18.835924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.473 [2024-11-28 23:22:18.835943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.473 [2024-11-28 23:22:18.839808] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.473 [2024-11-28 23:22:18.839839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.473 [2024-11-28 23:22:18.839857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.473 [2024-11-28 23:22:18.844046] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.473 [2024-11-28 23:22:18.844078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.473 [2024-11-28 23:22:18.844096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.473 [2024-11-28 23:22:18.848455] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.473 [2024-11-28 23:22:18.848487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.473 [2024-11-28 23:22:18.848505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.473 [2024-11-28 23:22:18.852712] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.473 [2024-11-28 23:22:18.852744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.473 [2024-11-28 23:22:18.852777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.473 [2024-11-28 23:22:18.857502] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.473 [2024-11-28 23:22:18.857534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:6368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.473 [2024-11-28 23:22:18.857552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.473 [2024-11-28 23:22:18.862429] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.473 [2024-11-28 23:22:18.862459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.474 [2024-11-28 23:22:18.862476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.474 [2024-11-28 23:22:18.867079] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.474 [2024-11-28 23:22:18.867109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.474 [2024-11-28 23:22:18.867126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.474 [2024-11-28 23:22:18.871824] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.474 [2024-11-28 23:22:18.871870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.474 [2024-11-28 23:22:18.871888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.474 [2024-11-28 23:22:18.876729] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.474 [2024-11-28 23:22:18.876775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.474 [2024-11-28 23:22:18.876797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.474 [2024-11-28 23:22:18.881644] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.474 [2024-11-28 23:22:18.881674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.474 [2024-11-28 23:22:18.881705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.474 [2024-11-28 23:22:18.886515] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.474 [2024-11-28 23:22:18.886546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.474 [2024-11-28 23:22:18.886564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.474 [2024-11-28 23:22:18.891067] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.474 [2024-11-28 23:22:18.891099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.474 [2024-11-28 23:22:18.891118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.474 [2024-11-28 23:22:18.896457] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.474 [2024-11-28 23:22:18.896489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.474 [2024-11-28 23:22:18.896507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.474 [2024-11-28 23:22:18.901312] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.474 [2024-11-28 23:22:18.901343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.474 [2024-11-28 23:22:18.901375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.474 [2024-11-28 23:22:18.905668] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.474 [2024-11-28 23:22:18.905699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:15520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.474 [2024-11-28 23:22:18.905717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.474 [2024-11-28 23:22:18.910538] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.474 [2024-11-28 23:22:18.910570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.474 [2024-11-28 23:22:18.910589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.474 [2024-11-28 23:22:18.914684] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.474 [2024-11-28 23:22:18.914732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:14016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.474 [2024-11-28 23:22:18.914750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.474 [2024-11-28 23:22:18.918214] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.474 [2024-11-28 23:22:18.918265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.474 [2024-11-28 23:22:18.918283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.474 [2024-11-28 23:22:18.922165] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.474 [2024-11-28 23:22:18.922195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.474 [2024-11-28 23:22:18.922212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.474 [2024-11-28 23:22:18.926048] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.474 [2024-11-28 23:22:18.926079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.474 [2024-11-28 23:22:18.926095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.474 [2024-11-28 23:22:18.929905] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.474 [2024-11-28 23:22:18.929952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.474 [2024-11-28 23:22:18.929970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.474 [2024-11-28 23:22:18.933604] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.474 [2024-11-28 23:22:18.933649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.474 [2024-11-28 23:22:18.933666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.474 [2024-11-28 23:22:18.937354] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.474 [2024-11-28 23:22:18.937386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.474 [2024-11-28 23:22:18.937416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.474 [2024-11-28 23:22:18.941736] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.474 [2024-11-28 23:22:18.941767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.474 [2024-11-28 23:22:18.941785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.474 [2024-11-28 23:22:18.945544] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.474 [2024-11-28 23:22:18.945575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:14112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.474 [2024-11-28 23:22:18.945593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.474 [2024-11-28 23:22:18.949380] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.474 [2024-11-28 23:22:18.949431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.474 [2024-11-28 23:22:18.949451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.474 [2024-11-28 23:22:18.953250] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.474 [2024-11-28 23:22:18.953281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:14784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.474 [2024-11-28 23:22:18.953299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.474 [2024-11-28 23:22:18.957182] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.474 [2024-11-28 23:22:18.957213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.474 [2024-11-28 23:22:18.957230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.474 [2024-11-28 23:22:18.961437] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.474 [2024-11-28 23:22:18.961469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.474 [2024-11-28 23:22:18.961487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.474 [2024-11-28 23:22:18.967875] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.474 [2024-11-28 23:22:18.967905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.474 [2024-11-28 23:22:18.967923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.474 [2024-11-28 23:22:18.973926] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.474 [2024-11-28 23:22:18.973956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.474 [2024-11-28 23:22:18.973974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.474 [2024-11-28 23:22:18.979721] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.474 [2024-11-28 23:22:18.979751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.474 [2024-11-28 23:22:18.979768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.474 [2024-11-28 23:22:18.985517] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.474 [2024-11-28 23:22:18.985549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.475 [2024-11-28 23:22:18.985566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.475 [2024-11-28 23:22:18.991255] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.475 [2024-11-28 23:22:18.991285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.475 [2024-11-28 23:22:18.991302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.475 [2024-11-28 23:22:18.996953] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.475 [2024-11-28 23:22:18.996999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.475 [2024-11-28 23:22:18.997024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.475 [2024-11-28 23:22:19.001976] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.475 [2024-11-28 23:22:19.002009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:12704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.475 [2024-11-28 23:22:19.002027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.475 [2024-11-28 23:22:19.006879] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.475 [2024-11-28 23:22:19.006926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.475 [2024-11-28 23:22:19.006943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.475 [2024-11-28 23:22:19.012256] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.475 [2024-11-28 23:22:19.012301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.475 [2024-11-28 23:22:19.012319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.475 [2024-11-28 23:22:19.018007] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.475 [2024-11-28 23:22:19.018040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.475 [2024-11-28 23:22:19.018058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.475 [2024-11-28 23:22:19.023937] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.475 [2024-11-28 23:22:19.023969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:14336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.475 [2024-11-28 23:22:19.023987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.475 [2024-11-28 23:22:19.031177] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.475 [2024-11-28 23:22:19.031208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:13024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.475 [2024-11-28 23:22:19.031225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.475 [2024-11-28 23:22:19.037435] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.475 [2024-11-28 23:22:19.037483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.475 [2024-11-28 23:22:19.037501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.475 [2024-11-28 23:22:19.043204] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.475 [2024-11-28 23:22:19.043250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:25056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.475 [2024-11-28 23:22:19.043267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.475 [2024-11-28 23:22:19.049138] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.475 [2024-11-28 23:22:19.049175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.475 [2024-11-28 23:22:19.049208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.475 [2024-11-28 23:22:19.055329] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.475 [2024-11-28 23:22:19.055379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.475 [2024-11-28 23:22:19.055407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.475 [2024-11-28 23:22:19.059993] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.475 [2024-11-28 23:22:19.060025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.475 [2024-11-28 23:22:19.060046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.475 [2024-11-28 23:22:19.063950] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.475 [2024-11-28 23:22:19.063982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.475 [2024-11-28 23:22:19.063999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.475 [2024-11-28 23:22:19.067737] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.475 [2024-11-28 23:22:19.067769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.475 [2024-11-28 23:22:19.067787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.475 [2024-11-28 23:22:19.071648] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.475 [2024-11-28 23:22:19.071683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:20768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.475 [2024-11-28 23:22:19.071718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.475 [2024-11-28 23:22:19.075497] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.475 [2024-11-28 23:22:19.075540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:15808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.475 [2024-11-28 23:22:19.075572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.735 [2024-11-28 23:22:19.079895] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.735 [2024-11-28 23:22:19.079928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.735 [2024-11-28 23:22:19.079947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.735 [2024-11-28 23:22:19.083797] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.735 [2024-11-28 23:22:19.083832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.735 [2024-11-28 23:22:19.083851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.735 [2024-11-28 23:22:19.088186] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.735 [2024-11-28 23:22:19.088218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:12736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.736 [2024-11-28 23:22:19.088236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.736 [2024-11-28 23:22:19.093304] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.736 [2024-11-28 23:22:19.093350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:22656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.736 [2024-11-28 23:22:19.093368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.736 [2024-11-28 23:22:19.099349] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.736 [2024-11-28 23:22:19.099382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.736 [2024-11-28 23:22:19.099412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.736 [2024-11-28 23:22:19.104621] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.736 [2024-11-28 23:22:19.104653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:4448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.736 [2024-11-28 23:22:19.104686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.736 [2024-11-28 23:22:19.109163] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.736 [2024-11-28 23:22:19.109196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.736 [2024-11-28 23:22:19.109214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.736 [2024-11-28 23:22:19.113480] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.736 [2024-11-28 23:22:19.113512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.736 [2024-11-28 23:22:19.113530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.736 [2024-11-28 23:22:19.117912] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.736 [2024-11-28 23:22:19.117945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.736 [2024-11-28 23:22:19.117963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.736 [2024-11-28 23:22:19.122429] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.736 [2024-11-28 23:22:19.122461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.736 [2024-11-28 23:22:19.122480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.736 [2024-11-28 23:22:19.127765] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.736 [2024-11-28 23:22:19.127797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.736 [2024-11-28 23:22:19.127822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.736 [2024-11-28 23:22:19.132960] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.736 [2024-11-28 23:22:19.133007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:9920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.736 [2024-11-28 23:22:19.133025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.736 [2024-11-28 23:22:19.138373] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.736 [2024-11-28 23:22:19.138414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:4288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.736 [2024-11-28 23:22:19.138434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.736 [2024-11-28 23:22:19.143774] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.736 [2024-11-28 23:22:19.143806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.736 [2024-11-28 23:22:19.143825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.736 [2024-11-28 23:22:19.148794] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.736 [2024-11-28 23:22:19.148841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:12192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.736 [2024-11-28 23:22:19.148860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.736 [2024-11-28 23:22:19.154140] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.736 [2024-11-28 23:22:19.154173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.736 [2024-11-28 23:22:19.154192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.736 [2024-11-28 23:22:19.159288] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.736 [2024-11-28 23:22:19.159320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.736 [2024-11-28 23:22:19.159338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.736 [2024-11-28 23:22:19.164703] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.736 [2024-11-28 23:22:19.164750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:9344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.736 [2024-11-28 23:22:19.164768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.736 [2024-11-28 23:22:19.170054] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.736 [2024-11-28 23:22:19.170086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.736 [2024-11-28 23:22:19.170104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.736 [2024-11-28 23:22:19.175766] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.736 [2024-11-28 23:22:19.175798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:15872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.736 [2024-11-28 23:22:19.175817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.736 [2024-11-28 23:22:19.182945] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.736 [2024-11-28 23:22:19.182992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.736 [2024-11-28 23:22:19.183010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.736 [2024-11-28 23:22:19.189462] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.736 [2024-11-28 23:22:19.189494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:6048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.736 [2024-11-28 23:22:19.189512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.736 [2024-11-28 23:22:19.194717] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.736 [2024-11-28 23:22:19.194750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:7936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.736 [2024-11-28 23:22:19.194769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.736 [2024-11-28 23:22:19.200647] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.736 [2024-11-28 23:22:19.200680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.736 [2024-11-28 23:22:19.200698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.736 [2024-11-28 23:22:19.207254] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.736 [2024-11-28 23:22:19.207287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:4416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.736 [2024-11-28 23:22:19.207305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.736 [2024-11-28 23:22:19.214510] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.736 [2024-11-28 23:22:19.214542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:18336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.736 [2024-11-28 23:22:19.214560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.736 [2024-11-28 23:22:19.221071] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.736 [2024-11-28 23:22:19.221119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.736 [2024-11-28 23:22:19.221137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.736 [2024-11-28 23:22:19.227410] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.736 [2024-11-28 23:22:19.227442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.736 [2024-11-28 23:22:19.227465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.736 [2024-11-28 23:22:19.232364] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.736 [2024-11-28 23:22:19.232406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.736 [2024-11-28 23:22:19.232427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.736 [2024-11-28 23:22:19.236625] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.737 [2024-11-28 23:22:19.236657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:13888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.737 [2024-11-28 23:22:19.236675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.737 [2024-11-28 23:22:19.241245] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.737 [2024-11-28 23:22:19.241276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.737 [2024-11-28 23:22:19.241295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.737 [2024-11-28 23:22:19.246026] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.737 [2024-11-28 23:22:19.246057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.737 [2024-11-28 23:22:19.246074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.737 [2024-11-28 23:22:19.250755] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.737 [2024-11-28 23:22:19.250786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.737 [2024-11-28 23:22:19.250803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.737 [2024-11-28 23:22:19.255452] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.737 [2024-11-28 23:22:19.255483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:21184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.737 [2024-11-28 23:22:19.255501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.737 [2024-11-28 23:22:19.260208] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.737 [2024-11-28 23:22:19.260255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.737 [2024-11-28 23:22:19.260272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.737 [2024-11-28 23:22:19.264857] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.737 [2024-11-28 23:22:19.264888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:21728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.737 [2024-11-28 23:22:19.264905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.737 [2024-11-28 23:22:19.269733] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.737 [2024-11-28 23:22:19.269783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.737 [2024-11-28 23:22:19.269801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.737 [2024-11-28 23:22:19.274918] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.737 [2024-11-28 23:22:19.274963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.737 [2024-11-28 23:22:19.274981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.737 [2024-11-28 23:22:19.279644] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.737 [2024-11-28 23:22:19.279675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:9088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.737 [2024-11-28 23:22:19.279708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.737 [2024-11-28 23:22:19.284332] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.737 [2024-11-28 23:22:19.284362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.737 [2024-11-28 23:22:19.284380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.737 [2024-11-28 23:22:19.288836] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.737 [2024-11-28 23:22:19.288865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:14528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.737 [2024-11-28 23:22:19.288883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.737 [2024-11-28 23:22:19.293725] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.737 [2024-11-28 23:22:19.293771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:1344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.737 [2024-11-28 23:22:19.293788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.737 [2024-11-28 23:22:19.298571] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.737 [2024-11-28 23:22:19.298602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.737 [2024-11-28 23:22:19.298621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.737 [2024-11-28 23:22:19.303101] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.737 [2024-11-28 23:22:19.303130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.737 [2024-11-28 23:22:19.303147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.737 [2024-11-28 23:22:19.307769] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.737 [2024-11-28 23:22:19.307815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:21184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.737 [2024-11-28 23:22:19.307832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.737 [2024-11-28 23:22:19.312082] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.737 [2024-11-28 23:22:19.312114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:10272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.737 [2024-11-28 23:22:19.312132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.737 [2024-11-28 23:22:19.316109] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.737 [2024-11-28 23:22:19.316140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:9088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.737 [2024-11-28 23:22:19.316158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.737 [2024-11-28 23:22:19.320311] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.737 [2024-11-28 23:22:19.320341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.737 [2024-11-28 23:22:19.320359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.737 [2024-11-28 23:22:19.325097] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.737 [2024-11-28 23:22:19.325126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.737 [2024-11-28 23:22:19.325143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.737 [2024-11-28 23:22:19.329624] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.737 [2024-11-28 23:22:19.329654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.737 [2024-11-28 23:22:19.329672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.737 [2024-11-28 23:22:19.333887] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.737 [2024-11-28 23:22:19.333919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:18944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.737 [2024-11-28 23:22:19.333937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.737 [2024-11-28 23:22:19.337840] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.737 [2024-11-28 23:22:19.337882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.737 [2024-11-28 23:22:19.337913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.997 [2024-11-28 23:22:19.342129] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.997 [2024-11-28 23:22:19.342176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:18944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.997 [2024-11-28 23:22:19.342195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.997 [2024-11-28 23:22:19.346946] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.997 [2024-11-28 23:22:19.346978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:10880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.997 [2024-11-28 23:22:19.347004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.997 [2024-11-28 23:22:19.351718] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.997 [2024-11-28 23:22:19.351765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:20864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.997 [2024-11-28 23:22:19.351783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.997 [2024-11-28 23:22:19.356566] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.997 [2024-11-28 23:22:19.356597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.997 [2024-11-28 23:22:19.356617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.997 [2024-11-28 23:22:19.361460] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.997 [2024-11-28 23:22:19.361493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.997 [2024-11-28 23:22:19.361511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.997 [2024-11-28 23:22:19.366426] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.997 [2024-11-28 23:22:19.366458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:2752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.997 [2024-11-28 23:22:19.366476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.997 [2024-11-28 23:22:19.371445] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.997 [2024-11-28 23:22:19.371490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:6368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.997 [2024-11-28 23:22:19.371509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.997 [2024-11-28 23:22:19.376586] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.997 [2024-11-28 23:22:19.376632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.997 [2024-11-28 23:22:19.376650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.997 [2024-11-28 23:22:19.381825] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.997 [2024-11-28 23:22:19.381870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:3552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.997 [2024-11-28 23:22:19.381887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.997 [2024-11-28 23:22:19.386760] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.997 [2024-11-28 23:22:19.386806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:16640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.997 [2024-11-28 23:22:19.386823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.997 [2024-11-28 23:22:19.392509] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.997 [2024-11-28 23:22:19.392561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.997 [2024-11-28 23:22:19.392579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.997 [2024-11-28 23:22:19.398168] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.997 [2024-11-28 23:22:19.398200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.997 [2024-11-28 23:22:19.398233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.997 [2024-11-28 23:22:19.403359] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.997 [2024-11-28 23:22:19.403416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:0 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.997 [2024-11-28 23:22:19.403451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.997 [2024-11-28 23:22:19.408270] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.997 [2024-11-28 23:22:19.408301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.998 [2024-11-28 23:22:19.408318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.998 [2024-11-28 23:22:19.413063] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.998 [2024-11-28 23:22:19.413094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:22688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.998 [2024-11-28 23:22:19.413113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.998 [2024-11-28 23:22:19.417822] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.998 [2024-11-28 23:22:19.417851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.998 [2024-11-28 23:22:19.417883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.998 [2024-11-28 23:22:19.422649] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.998 [2024-11-28 23:22:19.422680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:11680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.998 [2024-11-28 23:22:19.422714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.998 [2024-11-28 23:22:19.427369] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.998 [2024-11-28 23:22:19.427421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:2880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.998 [2024-11-28 23:22:19.427441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.998 [2024-11-28 23:22:19.431838] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.998 [2024-11-28 23:22:19.431884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.998 [2024-11-28 23:22:19.431901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.998 [2024-11-28 23:22:19.436623] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.998 [2024-11-28 23:22:19.436655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:4896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.998 [2024-11-28 23:22:19.436674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.998 [2024-11-28 23:22:19.441499] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.998 [2024-11-28 23:22:19.441530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:15008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.998 [2024-11-28 23:22:19.441548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.998 [2024-11-28 23:22:19.446956] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.998 [2024-11-28 23:22:19.446989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.998 [2024-11-28 23:22:19.447007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.998 [2024-11-28 23:22:19.452102] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.998 [2024-11-28 23:22:19.452149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.998 [2024-11-28 23:22:19.452168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.998 [2024-11-28 23:22:19.457019] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.998 [2024-11-28 23:22:19.457051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:12736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.998 [2024-11-28 23:22:19.457084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.998 [2024-11-28 23:22:19.462569] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.998 [2024-11-28 23:22:19.462600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:6400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.998 [2024-11-28 23:22:19.462620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.998 [2024-11-28 23:22:19.468300] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.998 [2024-11-28 23:22:19.468333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.998 [2024-11-28 23:22:19.468366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.998 [2024-11-28 23:22:19.473947] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.998 [2024-11-28 23:22:19.473979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:13792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.998 [2024-11-28 23:22:19.474013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.998 [2024-11-28 23:22:19.480183] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.998 [2024-11-28 23:22:19.480216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:20288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.998 [2024-11-28 23:22:19.480240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.998 [2024-11-28 23:22:19.485986] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.998 [2024-11-28 23:22:19.486018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:6304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.998 [2024-11-28 23:22:19.486037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.998 [2024-11-28 23:22:19.491660] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.998 [2024-11-28 23:22:19.491692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:10336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.998 [2024-11-28 23:22:19.491711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.998 [2024-11-28 23:22:19.497413] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.998 [2024-11-28 23:22:19.497444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:20960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.998 [2024-11-28 23:22:19.497462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.998 [2024-11-28 23:22:19.502448] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.998 [2024-11-28 23:22:19.502483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:17824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.998 [2024-11-28 23:22:19.502503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.998 [2024-11-28 23:22:19.507682] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.998 [2024-11-28 23:22:19.507713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.998 [2024-11-28 23:22:19.507746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.998 [2024-11-28 23:22:19.512538] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.998 [2024-11-28 23:22:19.512570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.998 [2024-11-28 23:22:19.512589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.998 [2024-11-28 23:22:19.516803] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.998 [2024-11-28 23:22:19.516835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:12896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.998 [2024-11-28 23:22:19.516855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.998 [2024-11-28 23:22:19.521303] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.998 [2024-11-28 23:22:19.521334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.998 [2024-11-28 23:22:19.521353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.998 [2024-11-28 23:22:19.524428] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.998 [2024-11-28 23:22:19.524462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.998 [2024-11-28 23:22:19.524482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.998 [2024-11-28 23:22:19.528650] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.998 [2024-11-28 23:22:19.528695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.998 [2024-11-28 23:22:19.528714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.998 [2024-11-28 23:22:19.533400] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.998 [2024-11-28 23:22:19.533432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.998 [2024-11-28 23:22:19.533451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.998 [2024-11-28 23:22:19.537948] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.998 [2024-11-28 23:22:19.537980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.998 [2024-11-28 23:22:19.537999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.998 [2024-11-28 23:22:19.543025] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.998 [2024-11-28 23:22:19.543056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.999 [2024-11-28 23:22:19.543074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.999 [2024-11-28 23:22:19.547762] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.999 [2024-11-28 23:22:19.547795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:25376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.999 [2024-11-28 23:22:19.547814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.999 [2024-11-28 23:22:19.552325] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.999 [2024-11-28 23:22:19.552355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.999 [2024-11-28 23:22:19.552374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.999 [2024-11-28 23:22:19.557912] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.999 [2024-11-28 23:22:19.557943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.999 [2024-11-28 23:22:19.557962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.999 [2024-11-28 23:22:19.563452] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.999 [2024-11-28 23:22:19.563498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.999 [2024-11-28 23:22:19.563521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.999 [2024-11-28 23:22:19.570710] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.999 [2024-11-28 23:22:19.570740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:7680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.999 [2024-11-28 23:22:19.570773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.999 [2024-11-28 23:22:19.577468] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.999 [2024-11-28 23:22:19.577514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:22976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.999 [2024-11-28 23:22:19.577532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.999 [2024-11-28 23:22:19.583574] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.999 [2024-11-28 23:22:19.583604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.999 [2024-11-28 23:22:19.583621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.999 [2024-11-28 23:22:19.590125] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.999 [2024-11-28 23:22:19.590156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:12096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.999 [2024-11-28 23:22:19.590188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.999 [2024-11-28 23:22:19.596608] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:15.999 [2024-11-28 23:22:19.596640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:25408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.999 [2024-11-28 23:22:19.596674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.260 [2024-11-28 23:22:19.603275] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.260 [2024-11-28 23:22:19.603309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.260 [2024-11-28 23:22:19.603347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.260 [2024-11-28 23:22:19.607711] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.260 [2024-11-28 23:22:19.607746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.260 [2024-11-28 23:22:19.607765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.260 [2024-11-28 23:22:19.611705] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.260 [2024-11-28 23:22:19.611736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:13568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.260 [2024-11-28 23:22:19.611754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.260 [2024-11-28 23:22:19.616001] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.260 [2024-11-28 23:22:19.616045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.260 [2024-11-28 23:22:19.616064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.260 [2024-11-28 23:22:19.621390] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.260 [2024-11-28 23:22:19.621428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:7104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.260 [2024-11-28 23:22:19.621447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.260 [2024-11-28 23:22:19.627101] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.260 [2024-11-28 23:22:19.627132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.260 [2024-11-28 23:22:19.627164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.260 [2024-11-28 23:22:19.633109] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.260 [2024-11-28 23:22:19.633139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.260 [2024-11-28 23:22:19.633156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.260 [2024-11-28 23:22:19.640609] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.260 [2024-11-28 23:22:19.640643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:3168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.260 [2024-11-28 23:22:19.640662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.260 [2024-11-28 23:22:19.647801] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.260 [2024-11-28 23:22:19.647849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:2688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.260 [2024-11-28 23:22:19.647867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.260 [2024-11-28 23:22:19.654486] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.260 [2024-11-28 23:22:19.654520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:12320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.260 [2024-11-28 23:22:19.654539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.260 [2024-11-28 23:22:19.660843] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.260 [2024-11-28 23:22:19.660874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.260 [2024-11-28 23:22:19.660892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.260 [2024-11-28 23:22:19.665877] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.260 [2024-11-28 23:22:19.665909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.260 [2024-11-28 23:22:19.665931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.260 [2024-11-28 23:22:19.671205] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.260 [2024-11-28 23:22:19.671244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:18464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.260 [2024-11-28 23:22:19.671277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.260 [2024-11-28 23:22:19.676735] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.260 [2024-11-28 23:22:19.676780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:13216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.260 [2024-11-28 23:22:19.676807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.260 [2024-11-28 23:22:19.682837] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.260 [2024-11-28 23:22:19.682884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:9504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.260 [2024-11-28 23:22:19.682902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.260 [2024-11-28 23:22:19.689938] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.260 [2024-11-28 23:22:19.689970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.260 [2024-11-28 23:22:19.689988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.260 [2024-11-28 23:22:19.696778] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.260 [2024-11-28 23:22:19.696810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:10656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.260 [2024-11-28 23:22:19.696846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.260 [2024-11-28 23:22:19.703411] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.260 [2024-11-28 23:22:19.703458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.260 [2024-11-28 23:22:19.703477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.260 [2024-11-28 23:22:19.709200] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.260 [2024-11-28 23:22:19.709247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:1504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.260 [2024-11-28 23:22:19.709264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.260 [2024-11-28 23:22:19.714878] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.260 [2024-11-28 23:22:19.714924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.260 [2024-11-28 23:22:19.714953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.260 [2024-11-28 23:22:19.719820] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.260 [2024-11-28 23:22:19.719850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:8704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.260 [2024-11-28 23:22:19.719888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.260 [2024-11-28 23:22:19.725339] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.260 [2024-11-28 23:22:19.725388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:10304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.260 [2024-11-28 23:22:19.725445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.261 [2024-11-28 23:22:19.731063] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.261 [2024-11-28 23:22:19.731093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:2880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.261 [2024-11-28 23:22:19.731124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.261 [2024-11-28 23:22:19.736809] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.261 [2024-11-28 23:22:19.736860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.261 [2024-11-28 23:22:19.736878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.261 [2024-11-28 23:22:19.742783] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.261 [2024-11-28 23:22:19.742830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.261 [2024-11-28 23:22:19.742847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.261 [2024-11-28 23:22:19.748245] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.261 [2024-11-28 23:22:19.748276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:14368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.261 [2024-11-28 23:22:19.748308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.261 [2024-11-28 23:22:19.753846] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.261 [2024-11-28 23:22:19.753876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.261 [2024-11-28 23:22:19.753908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.261 [2024-11-28 23:22:19.759189] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.261 [2024-11-28 23:22:19.759244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.261 [2024-11-28 23:22:19.759263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.261 [2024-11-28 23:22:19.763736] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.261 [2024-11-28 23:22:19.763767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.261 [2024-11-28 23:22:19.763788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.261 [2024-11-28 23:22:19.768739] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.261 [2024-11-28 23:22:19.768776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:14976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.261 [2024-11-28 23:22:19.768794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.261 [2024-11-28 23:22:19.774079] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.261 [2024-11-28 23:22:19.774111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:10560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.261 [2024-11-28 23:22:19.774129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.261 [2024-11-28 23:22:19.779155] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.261 [2024-11-28 23:22:19.779186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.261 [2024-11-28 23:22:19.779204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.261 [2024-11-28 23:22:19.785629] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.261 [2024-11-28 23:22:19.785661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.261 [2024-11-28 23:22:19.785698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.261 [2024-11-28 23:22:19.790164] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.261 [2024-11-28 23:22:19.790211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.261 [2024-11-28 23:22:19.790230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.261 [2024-11-28 23:22:19.794792] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.261 [2024-11-28 23:22:19.794823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:14272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.261 [2024-11-28 23:22:19.794840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.261 [2024-11-28 23:22:19.800741] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.261 [2024-11-28 23:22:19.800776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.261 [2024-11-28 23:22:19.800815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.261 [2024-11-28 23:22:19.806014] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.261 [2024-11-28 23:22:19.806045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:8416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.261 [2024-11-28 23:22:19.806064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.261 [2024-11-28 23:22:19.812263] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.261 [2024-11-28 23:22:19.812299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.261 [2024-11-28 23:22:19.812317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.261 [2024-11-28 23:22:19.817018] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.261 [2024-11-28 23:22:19.817049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.261 [2024-11-28 23:22:19.817082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.261 [2024-11-28 23:22:19.821793] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.261 [2024-11-28 23:22:19.821823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.261 [2024-11-28 23:22:19.821841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.261 [2024-11-28 23:22:19.826611] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.261 [2024-11-28 23:22:19.826642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:8576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.261 [2024-11-28 23:22:19.826659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.261 [2024-11-28 23:22:19.831563] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.261 [2024-11-28 23:22:19.831594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.261 [2024-11-28 23:22:19.831612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.261 [2024-11-28 23:22:19.836816] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.261 [2024-11-28 23:22:19.836846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.261 [2024-11-28 23:22:19.836863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.261 [2024-11-28 23:22:19.843111] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.261 [2024-11-28 23:22:19.843158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:5568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.261 [2024-11-28 23:22:19.843175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.261 [2024-11-28 23:22:19.850559] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.261 [2024-11-28 23:22:19.850591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:22688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.261 [2024-11-28 23:22:19.850610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.261 [2024-11-28 23:22:19.858139] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.261 [2024-11-28 23:22:19.858186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.261 [2024-11-28 23:22:19.858205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.521 [2024-11-28 23:22:19.865751] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.521 [2024-11-28 23:22:19.865784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.521 [2024-11-28 23:22:19.865824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.521 [2024-11-28 23:22:19.873552] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.521 [2024-11-28 23:22:19.873585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.521 [2024-11-28 23:22:19.873604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.521 [2024-11-28 23:22:19.880826] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.521 [2024-11-28 23:22:19.880859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.521 [2024-11-28 23:22:19.880877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.521 [2024-11-28 23:22:19.887624] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.521 [2024-11-28 23:22:19.887656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:1984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.521 [2024-11-28 23:22:19.887677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.521 [2024-11-28 23:22:19.892613] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.521 [2024-11-28 23:22:19.892645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.521 [2024-11-28 23:22:19.892663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.521 [2024-11-28 23:22:19.897488] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.521 [2024-11-28 23:22:19.897519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:12352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.521 [2024-11-28 23:22:19.897537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.521 [2024-11-28 23:22:19.902265] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.521 [2024-11-28 23:22:19.902297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.521 [2024-11-28 23:22:19.902315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.521 [2024-11-28 23:22:19.907304] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.521 [2024-11-28 23:22:19.907335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.521 [2024-11-28 23:22:19.907352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.521 [2024-11-28 23:22:19.914120] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.521 [2024-11-28 23:22:19.914154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.521 [2024-11-28 23:22:19.914173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.521 [2024-11-28 23:22:19.921765] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.521 [2024-11-28 23:22:19.921812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.521 [2024-11-28 23:22:19.921829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.522 [2024-11-28 23:22:19.928649] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.522 [2024-11-28 23:22:19.928692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:3200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.522 [2024-11-28 23:22:19.928725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.522 [2024-11-28 23:22:19.936172] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.522 [2024-11-28 23:22:19.936219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:12064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.522 [2024-11-28 23:22:19.936237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.522 [2024-11-28 23:22:19.942523] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.522 [2024-11-28 23:22:19.942554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:10784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.522 [2024-11-28 23:22:19.942572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.522 [2024-11-28 23:22:19.947643] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.522 [2024-11-28 23:22:19.947676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:25280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.522 [2024-11-28 23:22:19.947694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.522 [2024-11-28 23:22:19.953652] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.522 [2024-11-28 23:22:19.953684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:3808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.522 [2024-11-28 23:22:19.953702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.522 [2024-11-28 23:22:19.959320] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.522 [2024-11-28 23:22:19.959351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:11360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.522 [2024-11-28 23:22:19.959369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.522 [2024-11-28 23:22:19.965033] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.522 [2024-11-28 23:22:19.965065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.522 [2024-11-28 23:22:19.965083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.522 [2024-11-28 23:22:19.970833] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.522 [2024-11-28 23:22:19.970889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.522 [2024-11-28 23:22:19.970913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.522 [2024-11-28 23:22:19.976698] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.522 [2024-11-28 23:22:19.976744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:20608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.522 [2024-11-28 23:22:19.976761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.522 [2024-11-28 23:22:19.982176] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.522 [2024-11-28 23:22:19.982208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:4128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.522 [2024-11-28 23:22:19.982226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.522 [2024-11-28 23:22:19.987269] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.522 [2024-11-28 23:22:19.987301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:2816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.522 [2024-11-28 23:22:19.987318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.522 [2024-11-28 23:22:19.993424] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.522 [2024-11-28 23:22:19.993456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.522 [2024-11-28 23:22:19.993474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.522 [2024-11-28 23:22:20.000095] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.522 [2024-11-28 23:22:20.000128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.522 [2024-11-28 23:22:20.000146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.522 [2024-11-28 23:22:20.006426] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.522 [2024-11-28 23:22:20.006472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:2208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.522 [2024-11-28 23:22:20.006492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.522 [2024-11-28 23:22:20.011416] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.522 [2024-11-28 23:22:20.011469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:8768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.522 [2024-11-28 23:22:20.011508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.522 [2024-11-28 23:22:20.017614] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.522 [2024-11-28 23:22:20.017647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.522 [2024-11-28 23:22:20.017675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.522 [2024-11-28 23:22:20.023335] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.522 [2024-11-28 23:22:20.023379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.522 [2024-11-28 23:22:20.023442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.522 [2024-11-28 23:22:20.028732] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.522 [2024-11-28 23:22:20.028771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.522 [2024-11-28 23:22:20.028791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.522 [2024-11-28 23:22:20.032689] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.522 [2024-11-28 23:22:20.032737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:10560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.522 [2024-11-28 23:22:20.032771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.522 [2024-11-28 23:22:20.038941] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.522 [2024-11-28 23:22:20.038977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.522 [2024-11-28 23:22:20.038997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.522 [2024-11-28 23:22:20.045905] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.522 [2024-11-28 23:22:20.045943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:6016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.522 [2024-11-28 23:22:20.045973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.522 [2024-11-28 23:22:20.051834] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.522 [2024-11-28 23:22:20.051871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.522 [2024-11-28 23:22:20.051891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.522 [2024-11-28 23:22:20.057883] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.522 [2024-11-28 23:22:20.057918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:17888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.522 [2024-11-28 23:22:20.057944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.522 [2024-11-28 23:22:20.063696] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.522 [2024-11-28 23:22:20.063731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:12256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.522 [2024-11-28 23:22:20.063751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.522 [2024-11-28 23:22:20.069415] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.522 [2024-11-28 23:22:20.069463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:7968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.522 [2024-11-28 23:22:20.069483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.522 [2024-11-28 23:22:20.074365] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.522 [2024-11-28 23:22:20.074410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.522 [2024-11-28 23:22:20.074447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.522 [2024-11-28 23:22:20.079530] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.522 [2024-11-28 23:22:20.079561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:22592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.522 [2024-11-28 23:22:20.079584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.523 [2024-11-28 23:22:20.084984] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.523 [2024-11-28 23:22:20.085019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:22720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.523 [2024-11-28 23:22:20.085047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.523 [2024-11-28 23:22:20.091538] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.523 [2024-11-28 23:22:20.091570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.523 [2024-11-28 23:22:20.091587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.523 [2024-11-28 23:22:20.098869] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.523 [2024-11-28 23:22:20.098904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.523 [2024-11-28 23:22:20.098925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.523 [2024-11-28 23:22:20.106529] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.523 [2024-11-28 23:22:20.106561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:16928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.523 [2024-11-28 23:22:20.106587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.523 [2024-11-28 23:22:20.112161] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.523 [2024-11-28 23:22:20.112196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:11712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.523 [2024-11-28 23:22:20.112216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.523 [2024-11-28 23:22:20.117858] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.523 [2024-11-28 23:22:20.117893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:11520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.523 [2024-11-28 23:22:20.117913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.523 [2024-11-28 23:22:20.122975] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.523 [2024-11-28 23:22:20.123011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.523 [2024-11-28 23:22:20.123039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.782 [2024-11-28 23:22:20.128056] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.782 [2024-11-28 23:22:20.128093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:23392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.782 [2024-11-28 23:22:20.128115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.782 [2024-11-28 23:22:20.133320] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.782 [2024-11-28 23:22:20.133356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.782 [2024-11-28 23:22:20.133377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.782 [2024-11-28 23:22:20.139169] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.782 [2024-11-28 23:22:20.139205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.782 [2024-11-28 23:22:20.139225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.782 [2024-11-28 23:22:20.146418] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.782 [2024-11-28 23:22:20.146465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:15296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.782 [2024-11-28 23:22:20.146484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.783 [2024-11-28 23:22:20.153609] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.783 [2024-11-28 23:22:20.153641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.783 [2024-11-28 23:22:20.153660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.783 [2024-11-28 23:22:20.160967] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.783 [2024-11-28 23:22:20.161003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.783 [2024-11-28 23:22:20.161024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.783 [2024-11-28 23:22:20.167509] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.783 [2024-11-28 23:22:20.167541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.783 [2024-11-28 23:22:20.167559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.783 [2024-11-28 23:22:20.172352] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.783 [2024-11-28 23:22:20.172389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.783 [2024-11-28 23:22:20.172419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.783 [2024-11-28 23:22:20.177185] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.783 [2024-11-28 23:22:20.177223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:8832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.783 [2024-11-28 23:22:20.177244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.783 [2024-11-28 23:22:20.181288] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.783 [2024-11-28 23:22:20.181323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:19680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.783 [2024-11-28 23:22:20.181343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.783 [2024-11-28 23:22:20.185501] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.783 [2024-11-28 23:22:20.185532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.783 [2024-11-28 23:22:20.185550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.783 [2024-11-28 23:22:20.189833] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.783 [2024-11-28 23:22:20.189867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:22592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.783 [2024-11-28 23:22:20.189887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.783 [2024-11-28 23:22:20.194872] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.783 [2024-11-28 23:22:20.194906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:16896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.783 [2024-11-28 23:22:20.194926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.783 [2024-11-28 23:22:20.200760] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.783 [2024-11-28 23:22:20.200794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.783 [2024-11-28 23:22:20.200814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.783 [2024-11-28 23:22:20.204903] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.783 [2024-11-28 23:22:20.204937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:5792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.783 [2024-11-28 23:22:20.204957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.783 [2024-11-28 23:22:20.209847] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.783 [2024-11-28 23:22:20.209880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.783 [2024-11-28 23:22:20.209899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.783 [2024-11-28 23:22:20.214938] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.783 [2024-11-28 23:22:20.214973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:1248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.783 [2024-11-28 23:22:20.215000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.783 [2024-11-28 23:22:20.219992] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.783 [2024-11-28 23:22:20.220027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:6304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.783 [2024-11-28 23:22:20.220046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.783 [2024-11-28 23:22:20.225951] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.783 [2024-11-28 23:22:20.225987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.783 [2024-11-28 23:22:20.226006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.783 [2024-11-28 23:22:20.230282] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.783 [2024-11-28 23:22:20.230316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:5504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.783 [2024-11-28 23:22:20.230335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.783 [2024-11-28 23:22:20.235335] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.783 [2024-11-28 23:22:20.235369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:20704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.783 [2024-11-28 23:22:20.235388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.783 [2024-11-28 23:22:20.240311] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.783 [2024-11-28 23:22:20.240345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.783 [2024-11-28 23:22:20.240365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.783 [2024-11-28 23:22:20.245390] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.783 [2024-11-28 23:22:20.245446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:6560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.783 [2024-11-28 23:22:20.245462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.783 [2024-11-28 23:22:20.250416] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.783 [2024-11-28 23:22:20.250463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:23360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.783 [2024-11-28 23:22:20.250480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.783 [2024-11-28 23:22:20.256102] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.783 [2024-11-28 23:22:20.256136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:8704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.783 [2024-11-28 23:22:20.256156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.783 [2024-11-28 23:22:20.262608] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.783 [2024-11-28 23:22:20.262645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:21696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.783 [2024-11-28 23:22:20.262664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.783 [2024-11-28 23:22:20.268962] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.783 [2024-11-28 23:22:20.268998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.783 [2024-11-28 23:22:20.269018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.783 [2024-11-28 23:22:20.274530] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.783 [2024-11-28 23:22:20.274562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.783 [2024-11-28 23:22:20.274579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.783 [2024-11-28 23:22:20.279591] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.783 [2024-11-28 23:22:20.279625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:8736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.783 [2024-11-28 23:22:20.279645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.783 [2024-11-28 23:22:20.284133] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.783 [2024-11-28 23:22:20.284168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:12640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.783 [2024-11-28 23:22:20.284187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.783 [2024-11-28 23:22:20.289820] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.783 [2024-11-28 23:22:20.289855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:9216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.783 [2024-11-28 23:22:20.289875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.784 [2024-11-28 23:22:20.295681] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.784 [2024-11-28 23:22:20.295726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:21824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.784 [2024-11-28 23:22:20.295745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.784 [2024-11-28 23:22:20.301639] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.784 [2024-11-28 23:22:20.301687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:8512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.784 [2024-11-28 23:22:20.301708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.784 [2024-11-28 23:22:20.308709] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.784 [2024-11-28 23:22:20.308757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:21728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.784 [2024-11-28 23:22:20.308777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.784 [2024-11-28 23:22:20.316199] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.784 [2024-11-28 23:22:20.316234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:18816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.784 [2024-11-28 23:22:20.316254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.784 [2024-11-28 23:22:20.323196] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.784 [2024-11-28 23:22:20.323231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.784 [2024-11-28 23:22:20.323251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.784 [2024-11-28 23:22:20.329809] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.784 [2024-11-28 23:22:20.329845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:11616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.784 [2024-11-28 23:22:20.329866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.784 [2024-11-28 23:22:20.334778] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.784 [2024-11-28 23:22:20.334817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:15552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.784 [2024-11-28 23:22:20.334838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.784 [2024-11-28 23:22:20.338834] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.784 [2024-11-28 23:22:20.338868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:1312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.784 [2024-11-28 23:22:20.338888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.784 [2024-11-28 23:22:20.342674] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.784 [2024-11-28 23:22:20.342704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:23808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.784 [2024-11-28 23:22:20.342721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.784 [2024-11-28 23:22:20.346733] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.784 [2024-11-28 23:22:20.346767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:23168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.784 [2024-11-28 23:22:20.346787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.784 [2024-11-28 23:22:20.351764] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.784 [2024-11-28 23:22:20.351799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:8320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.784 [2024-11-28 23:22:20.351818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.784 [2024-11-28 23:22:20.356760] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.784 [2024-11-28 23:22:20.356794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.784 [2024-11-28 23:22:20.356824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.784 [2024-11-28 23:22:20.361656] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.784 [2024-11-28 23:22:20.361687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.784 [2024-11-28 23:22:20.361723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.784 [2024-11-28 23:22:20.366504] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.784 [2024-11-28 23:22:20.366535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.784 [2024-11-28 23:22:20.366552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.784 [2024-11-28 23:22:20.371444] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.784 [2024-11-28 23:22:20.371474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:11648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.784 [2024-11-28 23:22:20.371491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.784 [2024-11-28 23:22:20.376360] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.784 [2024-11-28 23:22:20.376402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:21728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.784 [2024-11-28 23:22:20.376439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.784 [2024-11-28 23:22:20.381265] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.784 [2024-11-28 23:22:20.381299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:2496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.784 [2024-11-28 23:22:20.381318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.784 [2024-11-28 23:22:20.386216] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2097190) 00:30:16.784 [2024-11-28 23:22:20.386253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:17632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.784 [2024-11-28 23:22:20.386275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:17.043 00:30:17.043 Latency(us) 00:30:17.043 [2024-11-28T22:22:20.649Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:17.043 [2024-11-28T22:22:20.649Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:30:17.043 nvme0n1 : 2.00 5931.09 741.39 0.00 0.00 2693.88 946.63 9709.04 00:30:17.043 [2024-11-28T22:22:20.649Z] =================================================================================================================== 00:30:17.043 [2024-11-28T22:22:20.649Z] Total : 5931.09 741.39 0.00 0.00 2693.88 946.63 9709.04 00:30:17.043 0 00:30:17.043 23:22:20 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:30:17.043 23:22:20 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:30:17.043 23:22:20 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:30:17.043 | .driver_specific 00:30:17.043 | .nvme_error 00:30:17.043 | .status_code 00:30:17.043 | .command_transient_transport_error' 00:30:17.043 23:22:20 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:30:17.301 23:22:20 -- host/digest.sh@71 -- # (( 382 > 0 )) 00:30:17.301 23:22:20 -- host/digest.sh@73 -- # killprocess 2574583 00:30:17.301 23:22:20 -- common/autotest_common.sh@936 -- # '[' -z 2574583 ']' 00:30:17.301 23:22:20 -- common/autotest_common.sh@940 -- # kill -0 2574583 00:30:17.301 23:22:20 -- common/autotest_common.sh@941 -- # uname 00:30:17.301 23:22:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:17.301 23:22:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2574583 00:30:17.301 23:22:20 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:17.301 23:22:20 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:17.301 23:22:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2574583' 00:30:17.301 killing process with pid 2574583 00:30:17.301 23:22:20 -- common/autotest_common.sh@955 -- # kill 2574583 00:30:17.301 Received shutdown signal, test time was about 2.000000 seconds 00:30:17.301 00:30:17.301 Latency(us) 00:30:17.301 [2024-11-28T22:22:20.907Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:17.301 [2024-11-28T22:22:20.907Z] =================================================================================================================== 00:30:17.301 [2024-11-28T22:22:20.907Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:17.301 23:22:20 -- common/autotest_common.sh@960 -- # wait 2574583 00:30:17.560 23:22:20 -- host/digest.sh@113 -- # run_bperf_err randwrite 4096 128 00:30:17.560 23:22:20 -- host/digest.sh@54 -- # local rw bs qd 00:30:17.560 23:22:20 -- host/digest.sh@56 -- # rw=randwrite 00:30:17.560 23:22:20 -- host/digest.sh@56 -- # bs=4096 00:30:17.560 23:22:20 -- host/digest.sh@56 -- # qd=128 00:30:17.560 23:22:20 -- host/digest.sh@58 -- # bperfpid=2575133 00:30:17.560 23:22:20 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:30:17.560 23:22:20 -- host/digest.sh@60 -- # waitforlisten 2575133 /var/tmp/bperf.sock 00:30:17.560 23:22:20 -- common/autotest_common.sh@829 -- # '[' -z 2575133 ']' 00:30:17.560 23:22:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:30:17.560 23:22:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:17.560 23:22:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:30:17.560 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:30:17.560 23:22:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:17.560 23:22:20 -- common/autotest_common.sh@10 -- # set +x 00:30:17.560 [2024-11-28 23:22:21.012861] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:17.560 [2024-11-28 23:22:21.012955] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2575133 ] 00:30:17.560 EAL: No free 2048 kB hugepages reported on node 1 00:30:17.560 [2024-11-28 23:22:21.077121] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:17.560 [2024-11-28 23:22:21.165281] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:18.496 23:22:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:18.496 23:22:22 -- common/autotest_common.sh@862 -- # return 0 00:30:18.496 23:22:22 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:18.496 23:22:22 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:18.754 23:22:22 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:30:18.754 23:22:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:18.754 23:22:22 -- common/autotest_common.sh@10 -- # set +x 00:30:18.754 23:22:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:18.754 23:22:22 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:18.754 23:22:22 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:19.012 nvme0n1 00:30:19.271 23:22:22 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:30:19.271 23:22:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:19.271 23:22:22 -- common/autotest_common.sh@10 -- # set +x 00:30:19.271 23:22:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:19.271 23:22:22 -- host/digest.sh@69 -- # bperf_py perform_tests 00:30:19.271 23:22:22 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:30:19.271 Running I/O for 2 seconds... 00:30:19.271 [2024-11-28 23:22:22.773945] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190eea00 00:30:19.271 [2024-11-28 23:22:22.775189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:19590 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.271 [2024-11-28 23:22:22.775233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0043 p:0 m:0 dnr:0 00:30:19.271 [2024-11-28 23:22:22.785678] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190ea680 00:30:19.271 [2024-11-28 23:22:22.786389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:12538 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.271 [2024-11-28 23:22:22.786441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0053 p:0 m:0 dnr:0 00:30:19.271 [2024-11-28 23:22:22.797286] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f31b8 00:30:19.271 [2024-11-28 23:22:22.797767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:17229 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.271 [2024-11-28 23:22:22.797797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0052 p:0 m:0 dnr:0 00:30:19.271 [2024-11-28 23:22:22.808807] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190e8d30 00:30:19.271 [2024-11-28 23:22:22.809224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:20358 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.271 [2024-11-28 23:22:22.809253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0051 p:0 m:0 dnr:0 00:30:19.271 [2024-11-28 23:22:22.820420] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190ebfd0 00:30:19.271 [2024-11-28 23:22:22.820787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:13935 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.271 [2024-11-28 23:22:22.820818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0050 p:0 m:0 dnr:0 00:30:19.271 [2024-11-28 23:22:22.831860] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f2d80 00:30:19.271 [2024-11-28 23:22:22.832222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:11882 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.271 [2024-11-28 23:22:22.832251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:004f p:0 m:0 dnr:0 00:30:19.271 [2024-11-28 23:22:22.843296] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190e3d08 00:30:19.271 [2024-11-28 23:22:22.843649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:9487 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.271 [2024-11-28 23:22:22.843678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:004e p:0 m:0 dnr:0 00:30:19.271 [2024-11-28 23:22:22.854644] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190e38d0 00:30:19.271 [2024-11-28 23:22:22.854907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:6744 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.271 [2024-11-28 23:22:22.854952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:004d p:0 m:0 dnr:0 00:30:19.271 [2024-11-28 23:22:22.865965] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f20d8 00:30:19.271 [2024-11-28 23:22:22.866279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:12633 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.271 [2024-11-28 23:22:22.866310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:004c p:0 m:0 dnr:0 00:30:19.529 [2024-11-28 23:22:22.877232] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190ed4e8 00:30:19.529 [2024-11-28 23:22:22.877565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:13640 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.529 [2024-11-28 23:22:22.877599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:004b p:0 m:0 dnr:0 00:30:19.529 [2024-11-28 23:22:22.890213] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f9f68 00:30:19.529 [2024-11-28 23:22:22.891290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:10432 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.529 [2024-11-28 23:22:22.891336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.529 [2024-11-28 23:22:22.900541] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190e5220 00:30:19.529 [2024-11-28 23:22:22.901635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:1067 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.529 [2024-11-28 23:22:22.901665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:30:19.529 [2024-11-28 23:22:22.911437] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190e1710 00:30:19.529 [2024-11-28 23:22:22.912963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:8991 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.529 [2024-11-28 23:22:22.912994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:30:19.529 [2024-11-28 23:22:22.922980] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190ec840 00:30:19.529 [2024-11-28 23:22:22.924203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:16280 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.529 [2024-11-28 23:22:22.924231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:30:19.529 [2024-11-28 23:22:22.933723] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f7970 00:30:19.529 [2024-11-28 23:22:22.934700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:15604 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.529 [2024-11-28 23:22:22.934730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:30:19.529 [2024-11-28 23:22:22.946799] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190e0a68 00:30:19.529 [2024-11-28 23:22:22.948339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:19326 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.530 [2024-11-28 23:22:22.948371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:30:19.530 [2024-11-28 23:22:22.958139] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190fb480 00:30:19.530 [2024-11-28 23:22:22.958885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:19593 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.530 [2024-11-28 23:22:22.958913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:30:19.530 [2024-11-28 23:22:22.969863] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f4b08 00:30:19.530 [2024-11-28 23:22:22.970848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:10705 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.530 [2024-11-28 23:22:22.970877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:19.530 [2024-11-28 23:22:22.981265] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190df118 00:30:19.530 [2024-11-28 23:22:22.982142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:9770 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.530 [2024-11-28 23:22:22.982171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:30:19.530 [2024-11-28 23:22:22.992700] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190ed920 00:30:19.530 [2024-11-28 23:22:22.993594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:17470 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.530 [2024-11-28 23:22:22.993639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:30:19.530 [2024-11-28 23:22:23.004157] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190fef90 00:30:19.530 [2024-11-28 23:22:23.004933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:3921 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.530 [2024-11-28 23:22:23.004979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:19.530 [2024-11-28 23:22:23.015493] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190e0a68 00:30:19.530 [2024-11-28 23:22:23.016221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:216 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.530 [2024-11-28 23:22:23.016265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:30:19.530 [2024-11-28 23:22:23.026932] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190df988 00:30:19.530 [2024-11-28 23:22:23.027662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:7381 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.530 [2024-11-28 23:22:23.027693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:30:19.530 [2024-11-28 23:22:23.038145] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190ed0b0 00:30:19.530 [2024-11-28 23:22:23.038857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:24009 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.530 [2024-11-28 23:22:23.038887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:30:19.530 [2024-11-28 23:22:23.049207] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190e0ea0 00:30:19.530 [2024-11-28 23:22:23.049954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:8224 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.530 [2024-11-28 23:22:23.049989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:30:19.530 [2024-11-28 23:22:23.060077] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f0bc0 00:30:19.530 [2024-11-28 23:22:23.061025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:19459 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.530 [2024-11-28 23:22:23.061057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:30:19.530 [2024-11-28 23:22:23.071361] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f2d80 00:30:19.530 [2024-11-28 23:22:23.072902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:12120 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.530 [2024-11-28 23:22:23.072933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:30:19.530 [2024-11-28 23:22:23.082160] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190e88f8 00:30:19.530 [2024-11-28 23:22:23.083194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:236 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.530 [2024-11-28 23:22:23.083223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0036 p:0 m:0 dnr:0 00:30:19.530 [2024-11-28 23:22:23.095116] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190e6738 00:30:19.530 [2024-11-28 23:22:23.096739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:4241 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.530 [2024-11-28 23:22:23.096770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:30:19.530 [2024-11-28 23:22:23.105023] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f1868 00:30:19.530 [2024-11-28 23:22:23.105960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:12054 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.530 [2024-11-28 23:22:23.105986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:30:19.530 [2024-11-28 23:22:23.116315] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190e6300 00:30:19.530 [2024-11-28 23:22:23.117777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:19458 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.530 [2024-11-28 23:22:23.117804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:30:19.530 [2024-11-28 23:22:23.127294] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190e49b0 00:30:19.530 [2024-11-28 23:22:23.128307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:20965 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.530 [2024-11-28 23:22:23.128336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:19.789 [2024-11-28 23:22:23.138905] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f5378 00:30:19.789 [2024-11-28 23:22:23.139834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:11564 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.789 [2024-11-28 23:22:23.139866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0040 p:0 m:0 dnr:0 00:30:19.789 [2024-11-28 23:22:23.150203] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190fd640 00:30:19.789 [2024-11-28 23:22:23.151270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:12360 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.789 [2024-11-28 23:22:23.151301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:003f p:0 m:0 dnr:0 00:30:19.789 [2024-11-28 23:22:23.161515] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190ed0b0 00:30:19.789 [2024-11-28 23:22:23.162541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:20245 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.789 [2024-11-28 23:22:23.162573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:003e p:0 m:0 dnr:0 00:30:19.789 [2024-11-28 23:22:23.172819] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190dfdc0 00:30:19.789 [2024-11-28 23:22:23.173855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:1633 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.789 [2024-11-28 23:22:23.173884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:003d p:0 m:0 dnr:0 00:30:19.789 [2024-11-28 23:22:23.184133] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190ee190 00:30:19.789 [2024-11-28 23:22:23.185195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:12140 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.789 [2024-11-28 23:22:23.185225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:003c p:0 m:0 dnr:0 00:30:19.789 [2024-11-28 23:22:23.195851] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190eee38 00:30:19.789 [2024-11-28 23:22:23.196065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:22078 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.789 [2024-11-28 23:22:23.196092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:003b p:0 m:0 dnr:0 00:30:19.789 [2024-11-28 23:22:23.207526] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f8a50 00:30:19.789 [2024-11-28 23:22:23.207892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:195 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.789 [2024-11-28 23:22:23.207948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:004b p:0 m:0 dnr:0 00:30:19.789 [2024-11-28 23:22:23.219016] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f6458 00:30:19.789 [2024-11-28 23:22:23.219308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:4990 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.789 [2024-11-28 23:22:23.219353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:30:19.789 [2024-11-28 23:22:23.230799] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190de8a8 00:30:19.789 [2024-11-28 23:22:23.232040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:21433 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.789 [2024-11-28 23:22:23.232082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:30:19.789 [2024-11-28 23:22:23.242568] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190ea248 00:30:19.789 [2024-11-28 23:22:23.243503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:13837 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.789 [2024-11-28 23:22:23.243532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:30:19.789 [2024-11-28 23:22:23.253977] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f6890 00:30:19.789 [2024-11-28 23:22:23.254784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:3885 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.789 [2024-11-28 23:22:23.254814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:30:19.789 [2024-11-28 23:22:23.264854] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190e4140 00:30:19.789 [2024-11-28 23:22:23.266625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:23497 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.789 [2024-11-28 23:22:23.266655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:30:19.789 [2024-11-28 23:22:23.276486] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f7970 00:30:19.789 [2024-11-28 23:22:23.277740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:22381 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.789 [2024-11-28 23:22:23.277769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:30:19.789 [2024-11-28 23:22:23.288042] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190fe2e8 00:30:19.789 [2024-11-28 23:22:23.289742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:23867 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.789 [2024-11-28 23:22:23.289772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:30:19.789 [2024-11-28 23:22:23.299168] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190ef6a8 00:30:19.789 [2024-11-28 23:22:23.300837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:1125 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.789 [2024-11-28 23:22:23.300867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:30:19.789 [2024-11-28 23:22:23.310328] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190ebfd0 00:30:19.789 [2024-11-28 23:22:23.312098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:20800 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.789 [2024-11-28 23:22:23.312128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:19.789 [2024-11-28 23:22:23.322221] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190e99d8 00:30:19.789 [2024-11-28 23:22:23.323249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:1746 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.789 [2024-11-28 23:22:23.323278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:30:19.789 [2024-11-28 23:22:23.333001] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190e1f80 00:30:19.789 [2024-11-28 23:22:23.334351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:16317 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.789 [2024-11-28 23:22:23.334389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:30:19.789 [2024-11-28 23:22:23.344725] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190ea248 00:30:19.789 [2024-11-28 23:22:23.345132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:16492 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.789 [2024-11-28 23:22:23.345163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0053 p:0 m:0 dnr:0 00:30:19.789 [2024-11-28 23:22:23.356559] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f4f40 00:30:19.789 [2024-11-28 23:22:23.357745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:16208 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.789 [2024-11-28 23:22:23.357775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:30:19.789 [2024-11-28 23:22:23.367859] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190eb760 00:30:19.789 [2024-11-28 23:22:23.369475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:10016 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.789 [2024-11-28 23:22:23.369505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:30:19.789 [2024-11-28 23:22:23.379563] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f7100 00:30:19.789 [2024-11-28 23:22:23.380950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:24059 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.789 [2024-11-28 23:22:23.380978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:30:19.790 [2024-11-28 23:22:23.391993] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f46d0 00:30:20.049 [2024-11-28 23:22:23.393990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:7989 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.049 [2024-11-28 23:22:23.394027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:30:20.049 [2024-11-28 23:22:23.403148] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190ec408 00:30:20.049 [2024-11-28 23:22:23.404022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15574 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.049 [2024-11-28 23:22:23.404053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:30:20.049 [2024-11-28 23:22:23.413994] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190fc560 00:30:20.049 [2024-11-28 23:22:23.415549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:24707 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.049 [2024-11-28 23:22:23.415580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:30:20.049 [2024-11-28 23:22:23.425669] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190edd58 00:30:20.049 [2024-11-28 23:22:23.427054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:3782 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.049 [2024-11-28 23:22:23.427096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:30:20.049 [2024-11-28 23:22:23.437924] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190fc128 00:30:20.049 [2024-11-28 23:22:23.438672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:18080 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.049 [2024-11-28 23:22:23.438717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:30:20.049 [2024-11-28 23:22:23.448002] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190ed4e8 00:30:20.049 [2024-11-28 23:22:23.449141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:10786 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.049 [2024-11-28 23:22:23.449167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:30:20.049 [2024-11-28 23:22:23.459324] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190ed4e8 00:30:20.049 [2024-11-28 23:22:23.460686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:5139 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.049 [2024-11-28 23:22:23.460713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:30:20.049 [2024-11-28 23:22:23.470527] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190ed4e8 00:30:20.049 [2024-11-28 23:22:23.471940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:18791 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.049 [2024-11-28 23:22:23.471967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:30:20.049 [2024-11-28 23:22:23.482447] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190e0ea0 00:30:20.049 [2024-11-28 23:22:23.484018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:1151 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.049 [2024-11-28 23:22:23.484048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:20.049 [2024-11-28 23:22:23.492939] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190ea248 00:30:20.049 [2024-11-28 23:22:23.493163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:18159 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.049 [2024-11-28 23:22:23.493189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:003a p:0 m:0 dnr:0 00:30:20.049 [2024-11-28 23:22:23.504833] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190fb048 00:30:20.049 [2024-11-28 23:22:23.505758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:15833 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.049 [2024-11-28 23:22:23.505787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:30:20.049 [2024-11-28 23:22:23.516791] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190eee38 00:30:20.049 [2024-11-28 23:22:23.517972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:16275 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.049 [2024-11-28 23:22:23.518001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:30:20.049 [2024-11-28 23:22:23.528742] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190eee38 00:30:20.049 [2024-11-28 23:22:23.529982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:4243 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.049 [2024-11-28 23:22:23.530011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:30:20.049 [2024-11-28 23:22:23.540679] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190eee38 00:30:20.049 [2024-11-28 23:22:23.541762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:13419 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.049 [2024-11-28 23:22:23.541807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:30:20.049 [2024-11-28 23:22:23.552718] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190eee38 00:30:20.049 [2024-11-28 23:22:23.553738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:7887 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.049 [2024-11-28 23:22:23.553767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:30:20.049 [2024-11-28 23:22:23.564790] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190eee38 00:30:20.049 [2024-11-28 23:22:23.565811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:17263 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.049 [2024-11-28 23:22:23.565854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:30:20.049 [2024-11-28 23:22:23.576819] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190eee38 00:30:20.049 [2024-11-28 23:22:23.577955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:23182 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.049 [2024-11-28 23:22:23.577985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:20.049 [2024-11-28 23:22:23.588748] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190eee38 00:30:20.049 [2024-11-28 23:22:23.589779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:15155 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.049 [2024-11-28 23:22:23.589823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:30:20.049 [2024-11-28 23:22:23.600755] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190eee38 00:30:20.049 [2024-11-28 23:22:23.601842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:16094 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.049 [2024-11-28 23:22:23.601884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:30:20.049 [2024-11-28 23:22:23.612767] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190eee38 00:30:20.049 [2024-11-28 23:22:23.614098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:2448 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.049 [2024-11-28 23:22:23.614128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:30:20.049 [2024-11-28 23:22:23.624709] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190eee38 00:30:20.049 [2024-11-28 23:22:23.625818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:17 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.049 [2024-11-28 23:22:23.625861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:30:20.049 [2024-11-28 23:22:23.636839] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190eee38 00:30:20.050 [2024-11-28 23:22:23.637950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:21846 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.050 [2024-11-28 23:22:23.637993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:30:20.050 [2024-11-28 23:22:23.648793] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190eee38 00:30:20.050 [2024-11-28 23:22:23.649964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:738 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.050 [2024-11-28 23:22:23.650000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:30:20.308 [2024-11-28 23:22:23.660760] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190eee38 00:30:20.308 [2024-11-28 23:22:23.661895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:21244 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.308 [2024-11-28 23:22:23.661925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:30:20.308 [2024-11-28 23:22:23.672528] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190eee38 00:30:20.308 [2024-11-28 23:22:23.673729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:8878 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.308 [2024-11-28 23:22:23.673760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:30:20.308 [2024-11-28 23:22:23.684470] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190eee38 00:30:20.309 [2024-11-28 23:22:23.685642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:19536 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.309 [2024-11-28 23:22:23.685671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:30:20.309 [2024-11-28 23:22:23.696113] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190eee38 00:30:20.309 [2024-11-28 23:22:23.697276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:21154 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.309 [2024-11-28 23:22:23.697320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:30:20.309 [2024-11-28 23:22:23.707991] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190eee38 00:30:20.309 [2024-11-28 23:22:23.709224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:24361 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.309 [2024-11-28 23:22:23.709252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:30:20.309 [2024-11-28 23:22:23.719808] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190eee38 00:30:20.309 [2024-11-28 23:22:23.721071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:5606 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.309 [2024-11-28 23:22:23.721098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:30:20.309 [2024-11-28 23:22:23.730669] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190e1b48 00:30:20.309 [2024-11-28 23:22:23.730944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:8977 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.309 [2024-11-28 23:22:23.730972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0036 p:0 m:0 dnr:0 00:30:20.309 [2024-11-28 23:22:23.742743] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190e27f0 00:30:20.309 [2024-11-28 23:22:23.743734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:18135 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.309 [2024-11-28 23:22:23.743765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0057 p:0 m:0 dnr:0 00:30:20.309 [2024-11-28 23:22:23.754632] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190e9e10 00:30:20.309 [2024-11-28 23:22:23.755234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:8700 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.309 [2024-11-28 23:22:23.755270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:30:20.309 [2024-11-28 23:22:23.766237] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f7970 00:30:20.309 [2024-11-28 23:22:23.766805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:18732 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.309 [2024-11-28 23:22:23.766833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:30:20.309 [2024-11-28 23:22:23.777568] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190dece0 00:30:20.309 [2024-11-28 23:22:23.778184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:13300 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.309 [2024-11-28 23:22:23.778212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:30:20.309 [2024-11-28 23:22:23.789031] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190eee38 00:30:20.309 [2024-11-28 23:22:23.789550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:5932 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.309 [2024-11-28 23:22:23.789581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:30:20.309 [2024-11-28 23:22:23.800370] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190e3060 00:30:20.309 [2024-11-28 23:22:23.800849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:8649 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.309 [2024-11-28 23:22:23.800877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:30:20.309 [2024-11-28 23:22:23.811637] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190dfdc0 00:30:20.309 [2024-11-28 23:22:23.812042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:12768 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.309 [2024-11-28 23:22:23.812071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:30:20.309 [2024-11-28 23:22:23.822699] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190e01f8 00:30:20.309 [2024-11-28 23:22:23.823089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:19142 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.309 [2024-11-28 23:22:23.823119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:30:20.309 [2024-11-28 23:22:23.833813] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f46d0 00:30:20.309 [2024-11-28 23:22:23.834163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:6203 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.309 [2024-11-28 23:22:23.834193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:20.309 [2024-11-28 23:22:23.844948] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f9f68 00:30:20.309 [2024-11-28 23:22:23.845300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:1369 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.309 [2024-11-28 23:22:23.845329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:30:20.309 [2024-11-28 23:22:23.855808] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190e3498 00:30:20.309 [2024-11-28 23:22:23.857197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:22867 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.309 [2024-11-28 23:22:23.857227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:30:20.309 [2024-11-28 23:22:23.868064] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190eaab8 00:30:20.309 [2024-11-28 23:22:23.869531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:23240 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.309 [2024-11-28 23:22:23.869561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:20.309 [2024-11-28 23:22:23.879471] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190e0630 00:30:20.309 [2024-11-28 23:22:23.880537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:21900 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.309 [2024-11-28 23:22:23.880566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:30:20.309 [2024-11-28 23:22:23.890819] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190ee190 00:30:20.309 [2024-11-28 23:22:23.891556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:19934 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.309 [2024-11-28 23:22:23.891584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:30:20.309 [2024-11-28 23:22:23.902205] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190de038 00:30:20.309 [2024-11-28 23:22:23.902964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:5832 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.309 [2024-11-28 23:22:23.902991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:30:20.568 [2024-11-28 23:22:23.913784] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190fda78 00:30:20.568 [2024-11-28 23:22:23.914432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:17571 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.568 [2024-11-28 23:22:23.914464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:30:20.568 [2024-11-28 23:22:23.925063] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190e23b8 00:30:20.568 [2024-11-28 23:22:23.925676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:5017 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.568 [2024-11-28 23:22:23.925708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:30:20.568 [2024-11-28 23:22:23.936362] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190e84c0 00:30:20.568 [2024-11-28 23:22:23.936941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:5376 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.568 [2024-11-28 23:22:23.936972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:30:20.568 [2024-11-28 23:22:23.947725] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190df118 00:30:20.568 [2024-11-28 23:22:23.948227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:6512 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.568 [2024-11-28 23:22:23.948258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:30:20.568 [2024-11-28 23:22:23.958320] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f5be8 00:30:20.568 [2024-11-28 23:22:23.959330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:5240 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.568 [2024-11-28 23:22:23.959362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:30:20.568 [2024-11-28 23:22:23.970043] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190fdeb0 00:30:20.568 [2024-11-28 23:22:23.970583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:10700 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.568 [2024-11-28 23:22:23.970614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:30:20.568 [2024-11-28 23:22:23.981142] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190e0ea0 00:30:20.568 [2024-11-28 23:22:23.981668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:9939 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.568 [2024-11-28 23:22:23.981699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:30:20.568 [2024-11-28 23:22:23.991929] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190dece0 00:30:20.568 [2024-11-28 23:22:23.992645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:2668 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.568 [2024-11-28 23:22:23.992676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:30:20.568 [2024-11-28 23:22:24.002990] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190ea248 00:30:20.568 [2024-11-28 23:22:24.004452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:3026 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.568 [2024-11-28 23:22:24.004482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:30:20.568 [2024-11-28 23:22:24.014615] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190e0630 00:30:20.568 [2024-11-28 23:22:24.015279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:4222 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.568 [2024-11-28 23:22:24.015323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:30:20.568 [2024-11-28 23:22:24.025563] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190e8d30 00:30:20.568 [2024-11-28 23:22:24.027073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:6109 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.568 [2024-11-28 23:22:24.027101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:30:20.568 [2024-11-28 23:22:24.036009] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190e38d0 00:30:20.568 [2024-11-28 23:22:24.036868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:23246 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.568 [2024-11-28 23:22:24.036899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:30:20.568 [2024-11-28 23:22:24.047478] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190ebb98 00:30:20.568 [2024-11-28 23:22:24.047864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:12209 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.568 [2024-11-28 23:22:24.047900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0036 p:0 m:0 dnr:0 00:30:20.568 [2024-11-28 23:22:24.061179] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f1ca0 00:30:20.568 [2024-11-28 23:22:24.062975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:11000 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.568 [2024-11-28 23:22:24.063006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:20.568 [2024-11-28 23:22:24.072307] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190e6738 00:30:20.568 [2024-11-28 23:22:24.073939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:25363 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.568 [2024-11-28 23:22:24.073969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.568 [2024-11-28 23:22:24.083569] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190e95a0 00:30:20.568 [2024-11-28 23:22:24.085164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:13720 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.568 [2024-11-28 23:22:24.085193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:30:20.568 [2024-11-28 23:22:24.094758] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f2510 00:30:20.568 [2024-11-28 23:22:24.096351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:6785 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.568 [2024-11-28 23:22:24.096404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:30:20.568 [2024-11-28 23:22:24.105904] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190fcdd0 00:30:20.568 [2024-11-28 23:22:24.107560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:18805 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.568 [2024-11-28 23:22:24.107591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:20.568 [2024-11-28 23:22:24.117207] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190e38d0 00:30:20.568 [2024-11-28 23:22:24.118088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:15324 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.568 [2024-11-28 23:22:24.118116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:30:20.568 [2024-11-28 23:22:24.127085] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f92c0 00:30:20.568 [2024-11-28 23:22:24.128131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:3513 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.568 [2024-11-28 23:22:24.128159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:30:20.568 [2024-11-28 23:22:24.138527] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f5be8 00:30:20.568 [2024-11-28 23:22:24.140059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:23072 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.568 [2024-11-28 23:22:24.140101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:30:20.568 [2024-11-28 23:22:24.150039] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190e95a0 00:30:20.568 [2024-11-28 23:22:24.151114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1821 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.568 [2024-11-28 23:22:24.151141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:20.568 [2024-11-28 23:22:24.161155] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f96f8 00:30:20.568 [2024-11-28 23:22:24.162508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:16396 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.568 [2024-11-28 23:22:24.162535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:30:20.568 [2024-11-28 23:22:24.172316] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190e4578 00:30:20.827 [2024-11-28 23:22:24.173632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:10262 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.827 [2024-11-28 23:22:24.173666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:004a p:0 m:0 dnr:0 00:30:20.827 [2024-11-28 23:22:24.185111] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f35f0 00:30:20.827 [2024-11-28 23:22:24.186590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:15834 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.827 [2024-11-28 23:22:24.186623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:30:20.827 [2024-11-28 23:22:24.196086] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190fd640 00:30:20.827 [2024-11-28 23:22:24.196992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:2059 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.827 [2024-11-28 23:22:24.197026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:30:20.827 [2024-11-28 23:22:24.206957] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f1430 00:30:20.827 [2024-11-28 23:22:24.208234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:6633 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.827 [2024-11-28 23:22:24.208265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:30:20.827 [2024-11-28 23:22:24.217695] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190eaef0 00:30:20.827 [2024-11-28 23:22:24.219090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:22911 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.827 [2024-11-28 23:22:24.219120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0049 p:0 m:0 dnr:0 00:30:20.827 [2024-11-28 23:22:24.229555] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190dfdc0 00:30:20.827 [2024-11-28 23:22:24.230434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:24687 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.827 [2024-11-28 23:22:24.230478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:30:20.827 [2024-11-28 23:22:24.241353] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f1868 00:30:20.827 [2024-11-28 23:22:24.242600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:6982 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.827 [2024-11-28 23:22:24.242631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:30:20.827 [2024-11-28 23:22:24.253549] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f6890 00:30:20.827 [2024-11-28 23:22:24.255038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:20008 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.827 [2024-11-28 23:22:24.255072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:30:20.827 [2024-11-28 23:22:24.264561] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190e3060 00:30:20.827 [2024-11-28 23:22:24.265458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:24757 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.827 [2024-11-28 23:22:24.265503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:30:20.827 [2024-11-28 23:22:24.275479] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190fef90 00:30:20.827 [2024-11-28 23:22:24.277166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:16906 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.827 [2024-11-28 23:22:24.277197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:30:20.827 [2024-11-28 23:22:24.287962] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190fd640 00:30:20.827 [2024-11-28 23:22:24.289616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:18634 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.827 [2024-11-28 23:22:24.289647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:30:20.827 [2024-11-28 23:22:24.297980] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f35f0 00:30:20.827 [2024-11-28 23:22:24.298863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:496 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.827 [2024-11-28 23:22:24.298892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:30:20.827 [2024-11-28 23:22:24.309211] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f35f0 00:30:20.827 [2024-11-28 23:22:24.310558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:105 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.827 [2024-11-28 23:22:24.310588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:30:20.827 [2024-11-28 23:22:24.320593] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f35f0 00:30:20.827 [2024-11-28 23:22:24.322026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:19019 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.827 [2024-11-28 23:22:24.322053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:20.827 [2024-11-28 23:22:24.331915] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f35f0 00:30:20.827 [2024-11-28 23:22:24.333400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:8064 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.828 [2024-11-28 23:22:24.333441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:30:20.828 [2024-11-28 23:22:24.342413] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f3a28 00:30:20.828 [2024-11-28 23:22:24.343332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:213 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.828 [2024-11-28 23:22:24.343368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:003d p:0 m:0 dnr:0 00:30:20.828 [2024-11-28 23:22:24.353589] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f35f0 00:30:20.828 [2024-11-28 23:22:24.354529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:7486 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.828 [2024-11-28 23:22:24.354559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:003c p:0 m:0 dnr:0 00:30:20.828 [2024-11-28 23:22:24.364919] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190fbcf0 00:30:20.828 [2024-11-28 23:22:24.366083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:14910 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.828 [2024-11-28 23:22:24.366113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:003b p:0 m:0 dnr:0 00:30:20.828 [2024-11-28 23:22:24.375971] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190ed0b0 00:30:20.828 [2024-11-28 23:22:24.377032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:14145 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.828 [2024-11-28 23:22:24.377076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:003a p:0 m:0 dnr:0 00:30:20.828 [2024-11-28 23:22:24.387059] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f7100 00:30:20.828 [2024-11-28 23:22:24.388078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:11997 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.828 [2024-11-28 23:22:24.388108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0039 p:0 m:0 dnr:0 00:30:20.828 [2024-11-28 23:22:24.398178] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f0bc0 00:30:20.828 [2024-11-28 23:22:24.399433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:12229 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.828 [2024-11-28 23:22:24.399463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0038 p:0 m:0 dnr:0 00:30:20.828 [2024-11-28 23:22:24.409643] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190eff18 00:30:20.828 [2024-11-28 23:22:24.410262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:23136 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.828 [2024-11-28 23:22:24.410303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:003a p:0 m:0 dnr:0 00:30:20.828 [2024-11-28 23:22:24.421535] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f6890 00:30:20.828 [2024-11-28 23:22:24.421911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:21206 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.828 [2024-11-28 23:22:24.421941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:30:21.086 [2024-11-28 23:22:24.432841] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190ea680 00:30:21.086 [2024-11-28 23:22:24.433143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:18045 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:21.086 [2024-11-28 23:22:24.433176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:30:21.086 [2024-11-28 23:22:24.444662] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190e6738 00:30:21.086 [2024-11-28 23:22:24.445182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:3711 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:21.086 [2024-11-28 23:22:24.445213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:30:21.086 [2024-11-28 23:22:24.455923] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f46d0 00:30:21.087 [2024-11-28 23:22:24.456355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:6304 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:21.087 [2024-11-28 23:22:24.456384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:30:21.087 [2024-11-28 23:22:24.467250] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190feb58 00:30:21.087 [2024-11-28 23:22:24.467647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:5626 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:21.087 [2024-11-28 23:22:24.467676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0057 p:0 m:0 dnr:0 00:30:21.087 [2024-11-28 23:22:24.478880] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190ea680 00:30:21.087 [2024-11-28 23:22:24.479734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:12956 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:21.087 [2024-11-28 23:22:24.479779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:30:21.087 [2024-11-28 23:22:24.490733] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190e1b48 00:30:21.087 [2024-11-28 23:22:24.491698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:12255 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:21.087 [2024-11-28 23:22:24.491743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:30:21.087 [2024-11-28 23:22:24.502436] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f2d80 00:30:21.087 [2024-11-28 23:22:24.503454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:8794 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:21.087 [2024-11-28 23:22:24.503499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:30:21.087 [2024-11-28 23:22:24.513977] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190fc128 00:30:21.087 [2024-11-28 23:22:24.514961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:17236 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:21.087 [2024-11-28 23:22:24.515004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:30:21.087 [2024-11-28 23:22:24.525570] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f0ff8 00:30:21.087 [2024-11-28 23:22:24.526603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:23693 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:21.087 [2024-11-28 23:22:24.526649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:30:21.087 [2024-11-28 23:22:24.537263] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190e6fa8 00:30:21.087 [2024-11-28 23:22:24.538237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:20547 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:21.087 [2024-11-28 23:22:24.538268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:30:21.087 [2024-11-28 23:22:24.548880] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190ebb98 00:30:21.087 [2024-11-28 23:22:24.549924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:2653 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:21.087 [2024-11-28 23:22:24.549954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:30:21.087 [2024-11-28 23:22:24.560330] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f0788 00:30:21.087 [2024-11-28 23:22:24.561826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:4737 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:21.087 [2024-11-28 23:22:24.561856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:30:21.087 [2024-11-28 23:22:24.571174] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190eb760 00:30:21.087 [2024-11-28 23:22:24.572058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:7704 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:21.087 [2024-11-28 23:22:24.572100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:003d p:0 m:0 dnr:0 00:30:21.087 [2024-11-28 23:22:24.582060] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190fac10 00:30:21.087 [2024-11-28 23:22:24.582438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:10241 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:21.087 [2024-11-28 23:22:24.582466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:002a p:0 m:0 dnr:0 00:30:21.087 [2024-11-28 23:22:24.593775] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190ed0b0 00:30:21.087 [2024-11-28 23:22:24.594882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:741 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:21.087 [2024-11-28 23:22:24.594925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:004b p:0 m:0 dnr:0 00:30:21.087 [2024-11-28 23:22:24.604886] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f6cc8 00:30:21.087 [2024-11-28 23:22:24.606258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:10759 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:21.087 [2024-11-28 23:22:24.606289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:004a p:0 m:0 dnr:0 00:30:21.087 [2024-11-28 23:22:24.616004] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190ddc00 00:30:21.087 [2024-11-28 23:22:24.616989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:19313 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:21.087 [2024-11-28 23:22:24.617020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0038 p:0 m:0 dnr:0 00:30:21.087 [2024-11-28 23:22:24.627282] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190e84c0 00:30:21.087 [2024-11-28 23:22:24.628247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:9560 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:21.087 [2024-11-28 23:22:24.628277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0037 p:0 m:0 dnr:0 00:30:21.087 [2024-11-28 23:22:24.638748] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f0bc0 00:30:21.087 [2024-11-28 23:22:24.639799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:11169 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:21.087 [2024-11-28 23:22:24.639835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0036 p:0 m:0 dnr:0 00:30:21.087 [2024-11-28 23:22:24.651208] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f2d80 00:30:21.087 [2024-11-28 23:22:24.652552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:16739 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:21.087 [2024-11-28 23:22:24.652583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:0057 p:0 m:0 dnr:0 00:30:21.087 [2024-11-28 23:22:24.662969] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190fac10 00:30:21.087 [2024-11-28 23:22:24.664034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:12607 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:21.087 [2024-11-28 23:22:24.664076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:30:21.087 [2024-11-28 23:22:24.675442] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190ef270 00:30:21.087 [2024-11-28 23:22:24.676987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2682 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:21.087 [2024-11-28 23:22:24.677017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:30:21.087 [2024-11-28 23:22:24.684853] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190ed0b0 00:30:21.087 [2024-11-28 23:22:24.686009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:6061 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:21.087 [2024-11-28 23:22:24.686039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:30:21.346 [2024-11-28 23:22:24.696533] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190e88f8 00:30:21.346 [2024-11-28 23:22:24.697390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:20219 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:21.346 [2024-11-28 23:22:24.697429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:30:21.346 [2024-11-28 23:22:24.707648] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190e84c0 00:30:21.346 [2024-11-28 23:22:24.708989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:8853 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:21.346 [2024-11-28 23:22:24.709019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0055 p:0 m:0 dnr:0 00:30:21.346 [2024-11-28 23:22:24.719399] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f0788 00:30:21.346 [2024-11-28 23:22:24.719934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:14215 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:21.346 [2024-11-28 23:22:24.719962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:30:21.346 [2024-11-28 23:22:24.731214] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f7100 00:30:21.346 [2024-11-28 23:22:24.732486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2968 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:21.346 [2024-11-28 23:22:24.732517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:30:21.346 [2024-11-28 23:22:24.742818] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190e3498 00:30:21.346 [2024-11-28 23:22:24.744027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:13866 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:21.346 [2024-11-28 23:22:24.744057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:30:21.346 [2024-11-28 23:22:24.754193] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f5be8 00:30:21.346 [2024-11-28 23:22:24.755600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:24315 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:21.346 [2024-11-28 23:22:24.755631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:30:21.346 [2024-11-28 23:22:24.766875] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c83f0) with pdu=0x2000190f0ff8 00:30:21.346 [2024-11-28 23:22:24.768142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:3219 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:21.346 [2024-11-28 23:22:24.768188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:30:21.346 00:30:21.346 Latency(us) 00:30:21.346 [2024-11-28T22:22:24.953Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:21.347 [2024-11-28T22:22:24.953Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:30:21.347 nvme0n1 : 2.00 22311.72 87.16 0.00 0.00 5730.54 2657.85 14757.74 00:30:21.347 [2024-11-28T22:22:24.953Z] =================================================================================================================== 00:30:21.347 [2024-11-28T22:22:24.953Z] Total : 22311.72 87.16 0.00 0.00 5730.54 2657.85 14757.74 00:30:21.347 0 00:30:21.347 23:22:24 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:30:21.347 23:22:24 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:30:21.347 23:22:24 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:30:21.347 23:22:24 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:30:21.347 | .driver_specific 00:30:21.347 | .nvme_error 00:30:21.347 | .status_code 00:30:21.347 | .command_transient_transport_error' 00:30:21.605 23:22:25 -- host/digest.sh@71 -- # (( 175 > 0 )) 00:30:21.605 23:22:25 -- host/digest.sh@73 -- # killprocess 2575133 00:30:21.605 23:22:25 -- common/autotest_common.sh@936 -- # '[' -z 2575133 ']' 00:30:21.605 23:22:25 -- common/autotest_common.sh@940 -- # kill -0 2575133 00:30:21.605 23:22:25 -- common/autotest_common.sh@941 -- # uname 00:30:21.605 23:22:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:21.605 23:22:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2575133 00:30:21.605 23:22:25 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:21.605 23:22:25 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:21.605 23:22:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2575133' 00:30:21.605 killing process with pid 2575133 00:30:21.605 23:22:25 -- common/autotest_common.sh@955 -- # kill 2575133 00:30:21.605 Received shutdown signal, test time was about 2.000000 seconds 00:30:21.605 00:30:21.605 Latency(us) 00:30:21.605 [2024-11-28T22:22:25.211Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:21.605 [2024-11-28T22:22:25.212Z] =================================================================================================================== 00:30:21.606 [2024-11-28T22:22:25.212Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:21.606 23:22:25 -- common/autotest_common.sh@960 -- # wait 2575133 00:30:21.863 23:22:25 -- host/digest.sh@114 -- # run_bperf_err randwrite 131072 16 00:30:21.863 23:22:25 -- host/digest.sh@54 -- # local rw bs qd 00:30:21.863 23:22:25 -- host/digest.sh@56 -- # rw=randwrite 00:30:21.863 23:22:25 -- host/digest.sh@56 -- # bs=131072 00:30:21.863 23:22:25 -- host/digest.sh@56 -- # qd=16 00:30:21.863 23:22:25 -- host/digest.sh@58 -- # bperfpid=2575566 00:30:21.863 23:22:25 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:30:21.863 23:22:25 -- host/digest.sh@60 -- # waitforlisten 2575566 /var/tmp/bperf.sock 00:30:21.863 23:22:25 -- common/autotest_common.sh@829 -- # '[' -z 2575566 ']' 00:30:21.863 23:22:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:30:21.863 23:22:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:21.863 23:22:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:30:21.863 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:30:21.863 23:22:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:21.863 23:22:25 -- common/autotest_common.sh@10 -- # set +x 00:30:21.863 [2024-11-28 23:22:25.348435] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:21.863 [2024-11-28 23:22:25.348515] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2575566 ] 00:30:21.863 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:21.863 Zero copy mechanism will not be used. 00:30:21.863 EAL: No free 2048 kB hugepages reported on node 1 00:30:21.863 [2024-11-28 23:22:25.411970] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:22.120 [2024-11-28 23:22:25.499107] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:23.051 23:22:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:23.051 23:22:26 -- common/autotest_common.sh@862 -- # return 0 00:30:23.051 23:22:26 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:23.051 23:22:26 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:23.051 23:22:26 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:30:23.051 23:22:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:23.051 23:22:26 -- common/autotest_common.sh@10 -- # set +x 00:30:23.310 23:22:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:23.310 23:22:26 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:23.310 23:22:26 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:23.567 nvme0n1 00:30:23.567 23:22:27 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:30:23.567 23:22:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:23.567 23:22:27 -- common/autotest_common.sh@10 -- # set +x 00:30:23.567 23:22:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:23.567 23:22:27 -- host/digest.sh@69 -- # bperf_py perform_tests 00:30:23.567 23:22:27 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:30:23.826 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:23.826 Zero copy mechanism will not be used. 00:30:23.826 Running I/O for 2 seconds... 00:30:23.826 [2024-11-28 23:22:27.227113] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:23.826 [2024-11-28 23:22:27.227452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:23.827 [2024-11-28 23:22:27.227491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:23.827 [2024-11-28 23:22:27.231768] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:23.827 [2024-11-28 23:22:27.232031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:23.827 [2024-11-28 23:22:27.232062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:23.827 [2024-11-28 23:22:27.236917] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:23.827 [2024-11-28 23:22:27.237109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:23.827 [2024-11-28 23:22:27.237139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:23.827 [2024-11-28 23:22:27.241929] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:23.827 [2024-11-28 23:22:27.242006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:23.827 [2024-11-28 23:22:27.242033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:23.827 [2024-11-28 23:22:27.247545] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:23.827 [2024-11-28 23:22:27.247705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:23.827 [2024-11-28 23:22:27.247735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:23.827 [2024-11-28 23:22:27.252858] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:23.827 [2024-11-28 23:22:27.252992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:23.827 [2024-11-28 23:22:27.253021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:23.827 [2024-11-28 23:22:27.257496] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:23.827 [2024-11-28 23:22:27.257652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:23.827 [2024-11-28 23:22:27.257681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:23.827 [2024-11-28 23:22:27.261851] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:23.827 [2024-11-28 23:22:27.261993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:23.827 [2024-11-28 23:22:27.262023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:23.827 [2024-11-28 23:22:27.266294] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:23.827 [2024-11-28 23:22:27.266451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:23.827 [2024-11-28 23:22:27.266480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:23.827 [2024-11-28 23:22:27.271639] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:23.827 [2024-11-28 23:22:27.271739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:23.827 [2024-11-28 23:22:27.271766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:23.827 [2024-11-28 23:22:27.276206] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:23.827 [2024-11-28 23:22:27.276338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:23.827 [2024-11-28 23:22:27.276373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:23.827 [2024-11-28 23:22:27.280581] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:23.827 [2024-11-28 23:22:27.280724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:23.827 [2024-11-28 23:22:27.280753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:23.827 [2024-11-28 23:22:27.285026] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:23.827 [2024-11-28 23:22:27.285101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:23.827 [2024-11-28 23:22:27.285126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:23.827 [2024-11-28 23:22:27.289517] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:23.827 [2024-11-28 23:22:27.289598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:23.827 [2024-11-28 23:22:27.289625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:23.827 [2024-11-28 23:22:27.293976] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:23.827 [2024-11-28 23:22:27.294125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:23.827 [2024-11-28 23:22:27.294154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:23.827 [2024-11-28 23:22:27.298336] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:23.827 [2024-11-28 23:22:27.298528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:23.827 [2024-11-28 23:22:27.298558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:23.827 [2024-11-28 23:22:27.302534] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:23.827 [2024-11-28 23:22:27.302669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:23.827 [2024-11-28 23:22:27.302697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:23.827 [2024-11-28 23:22:27.307287] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:23.827 [2024-11-28 23:22:27.307412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:23.827 [2024-11-28 23:22:27.307441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:23.827 [2024-11-28 23:22:27.312451] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:23.827 [2024-11-28 23:22:27.312614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:23.827 [2024-11-28 23:22:27.312642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:23.827 [2024-11-28 23:22:27.318207] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:23.827 [2024-11-28 23:22:27.318364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:23.827 [2024-11-28 23:22:27.318401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:23.827 [2024-11-28 23:22:27.323502] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:23.827 [2024-11-28 23:22:27.323623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:23.827 [2024-11-28 23:22:27.323651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:23.827 [2024-11-28 23:22:27.327713] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:23.827 [2024-11-28 23:22:27.327864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:23.827 [2024-11-28 23:22:27.327901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:23.827 [2024-11-28 23:22:27.332073] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:23.827 [2024-11-28 23:22:27.332265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:23.827 [2024-11-28 23:22:27.332294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:23.827 [2024-11-28 23:22:27.336429] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:23.827 [2024-11-28 23:22:27.336547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:23.827 [2024-11-28 23:22:27.336576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:23.827 [2024-11-28 23:22:27.340981] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:23.827 [2024-11-28 23:22:27.341134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:23.827 [2024-11-28 23:22:27.341162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:23.827 [2024-11-28 23:22:27.345351] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:23.827 [2024-11-28 23:22:27.345484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:23.827 [2024-11-28 23:22:27.345513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:23.827 [2024-11-28 23:22:27.349372] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:23.827 [2024-11-28 23:22:27.349538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:23.827 [2024-11-28 23:22:27.349567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:23.827 [2024-11-28 23:22:27.353306] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:23.827 [2024-11-28 23:22:27.353533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:32 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:23.828 [2024-11-28 23:22:27.353562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:23.828 [2024-11-28 23:22:27.358402] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:23.828 [2024-11-28 23:22:27.358548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:23.828 [2024-11-28 23:22:27.358576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:23.828 [2024-11-28 23:22:27.363826] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:23.828 [2024-11-28 23:22:27.364035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:23.828 [2024-11-28 23:22:27.364064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:23.828 [2024-11-28 23:22:27.369678] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:23.828 [2024-11-28 23:22:27.369885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:23.828 [2024-11-28 23:22:27.369914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:23.828 [2024-11-28 23:22:27.374897] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:23.828 [2024-11-28 23:22:27.375148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:23.828 [2024-11-28 23:22:27.375177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:23.828 [2024-11-28 23:22:27.379949] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:23.828 [2024-11-28 23:22:27.380087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:23.828 [2024-11-28 23:22:27.380116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:23.828 [2024-11-28 23:22:27.385165] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:23.828 [2024-11-28 23:22:27.385311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:23.828 [2024-11-28 23:22:27.385340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:23.828 [2024-11-28 23:22:27.390236] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:23.828 [2024-11-28 23:22:27.390359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:23.828 [2024-11-28 23:22:27.390403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:23.828 [2024-11-28 23:22:27.394731] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:23.828 [2024-11-28 23:22:27.394913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:23.828 [2024-11-28 23:22:27.394941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:23.828 [2024-11-28 23:22:27.399868] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:23.828 [2024-11-28 23:22:27.399995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:23.828 [2024-11-28 23:22:27.400029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:23.828 [2024-11-28 23:22:27.405588] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:23.828 [2024-11-28 23:22:27.405764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:23.828 [2024-11-28 23:22:27.405793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:23.828 [2024-11-28 23:22:27.411233] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:23.828 [2024-11-28 23:22:27.411374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:23.828 [2024-11-28 23:22:27.411422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:23.828 [2024-11-28 23:22:27.415692] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:23.828 [2024-11-28 23:22:27.415844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:23.828 [2024-11-28 23:22:27.415872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:23.828 [2024-11-28 23:22:27.419683] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:23.828 [2024-11-28 23:22:27.419838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:23.828 [2024-11-28 23:22:27.419867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:23.828 [2024-11-28 23:22:27.423940] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:23.828 [2024-11-28 23:22:27.424072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:23.828 [2024-11-28 23:22:27.424101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:23.828 [2024-11-28 23:22:27.427890] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:23.828 [2024-11-28 23:22:27.428071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:23.828 [2024-11-28 23:22:27.428103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.087 [2024-11-28 23:22:27.431913] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.087 [2024-11-28 23:22:27.432087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.087 [2024-11-28 23:22:27.432119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.087 [2024-11-28 23:22:27.436975] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.087 [2024-11-28 23:22:27.437165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.087 [2024-11-28 23:22:27.437196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.087 [2024-11-28 23:22:27.442051] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.087 [2024-11-28 23:22:27.442264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.087 [2024-11-28 23:22:27.442294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.087 [2024-11-28 23:22:27.447360] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.087 [2024-11-28 23:22:27.447476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.088 [2024-11-28 23:22:27.447506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.088 [2024-11-28 23:22:27.453155] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.088 [2024-11-28 23:22:27.453281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.088 [2024-11-28 23:22:27.453310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.088 [2024-11-28 23:22:27.459472] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.088 [2024-11-28 23:22:27.459599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.088 [2024-11-28 23:22:27.459628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.088 [2024-11-28 23:22:27.465485] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.088 [2024-11-28 23:22:27.465624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.088 [2024-11-28 23:22:27.465653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.088 [2024-11-28 23:22:27.471536] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.088 [2024-11-28 23:22:27.471714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.088 [2024-11-28 23:22:27.471742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.088 [2024-11-28 23:22:27.477690] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.088 [2024-11-28 23:22:27.477896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.088 [2024-11-28 23:22:27.477925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.088 [2024-11-28 23:22:27.484186] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.088 [2024-11-28 23:22:27.484409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.088 [2024-11-28 23:22:27.484439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.088 [2024-11-28 23:22:27.490362] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.088 [2024-11-28 23:22:27.490506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.088 [2024-11-28 23:22:27.490541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.088 [2024-11-28 23:22:27.496566] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.088 [2024-11-28 23:22:27.496855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.088 [2024-11-28 23:22:27.496884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.088 [2024-11-28 23:22:27.502797] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.088 [2024-11-28 23:22:27.503003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.088 [2024-11-28 23:22:27.503032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.088 [2024-11-28 23:22:27.508865] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.088 [2024-11-28 23:22:27.508995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.088 [2024-11-28 23:22:27.509023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.088 [2024-11-28 23:22:27.514990] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.088 [2024-11-28 23:22:27.515114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.088 [2024-11-28 23:22:27.515143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.088 [2024-11-28 23:22:27.520859] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.088 [2024-11-28 23:22:27.520976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.088 [2024-11-28 23:22:27.521004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.088 [2024-11-28 23:22:27.527141] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.088 [2024-11-28 23:22:27.527263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.088 [2024-11-28 23:22:27.527291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.088 [2024-11-28 23:22:27.533286] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.088 [2024-11-28 23:22:27.533481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.088 [2024-11-28 23:22:27.533510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.088 [2024-11-28 23:22:27.539336] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.088 [2024-11-28 23:22:27.539491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.088 [2024-11-28 23:22:27.539520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.088 [2024-11-28 23:22:27.545485] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.088 [2024-11-28 23:22:27.545648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.088 [2024-11-28 23:22:27.545678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.088 [2024-11-28 23:22:27.551709] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.088 [2024-11-28 23:22:27.551909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.088 [2024-11-28 23:22:27.551937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.088 [2024-11-28 23:22:27.557676] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.088 [2024-11-28 23:22:27.557881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.088 [2024-11-28 23:22:27.557911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.088 [2024-11-28 23:22:27.563529] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.088 [2024-11-28 23:22:27.563701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.088 [2024-11-28 23:22:27.563729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.088 [2024-11-28 23:22:27.569645] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.088 [2024-11-28 23:22:27.569820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.088 [2024-11-28 23:22:27.569864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.088 [2024-11-28 23:22:27.576075] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.088 [2024-11-28 23:22:27.576310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.088 [2024-11-28 23:22:27.576339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.088 [2024-11-28 23:22:27.582131] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.088 [2024-11-28 23:22:27.582386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.088 [2024-11-28 23:22:27.582422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.088 [2024-11-28 23:22:27.588459] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.088 [2024-11-28 23:22:27.588643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.088 [2024-11-28 23:22:27.588673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.088 [2024-11-28 23:22:27.594355] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.088 [2024-11-28 23:22:27.594572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.088 [2024-11-28 23:22:27.594601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.089 [2024-11-28 23:22:27.600669] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.089 [2024-11-28 23:22:27.600834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.089 [2024-11-28 23:22:27.600863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.089 [2024-11-28 23:22:27.606926] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.089 [2024-11-28 23:22:27.607114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.089 [2024-11-28 23:22:27.607142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.089 [2024-11-28 23:22:27.613096] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.089 [2024-11-28 23:22:27.613242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.089 [2024-11-28 23:22:27.613288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.089 [2024-11-28 23:22:27.619174] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.089 [2024-11-28 23:22:27.619364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.089 [2024-11-28 23:22:27.619405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.089 [2024-11-28 23:22:27.625109] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.089 [2024-11-28 23:22:27.625266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.089 [2024-11-28 23:22:27.625293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.089 [2024-11-28 23:22:27.631277] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.089 [2024-11-28 23:22:27.631442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.089 [2024-11-28 23:22:27.631471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.089 [2024-11-28 23:22:27.637013] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.089 [2024-11-28 23:22:27.637168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.089 [2024-11-28 23:22:27.637197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.089 [2024-11-28 23:22:27.642083] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.089 [2024-11-28 23:22:27.642251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.089 [2024-11-28 23:22:27.642279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.089 [2024-11-28 23:22:27.646914] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.089 [2024-11-28 23:22:27.647073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.089 [2024-11-28 23:22:27.647107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.089 [2024-11-28 23:22:27.651426] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.089 [2024-11-28 23:22:27.651588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.089 [2024-11-28 23:22:27.651616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.089 [2024-11-28 23:22:27.656629] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.089 [2024-11-28 23:22:27.656796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.089 [2024-11-28 23:22:27.656825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.089 [2024-11-28 23:22:27.661956] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.089 [2024-11-28 23:22:27.662185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.089 [2024-11-28 23:22:27.662213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.089 [2024-11-28 23:22:27.667821] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.089 [2024-11-28 23:22:27.667938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.089 [2024-11-28 23:22:27.667964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.089 [2024-11-28 23:22:27.672871] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.089 [2024-11-28 23:22:27.673091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.089 [2024-11-28 23:22:27.673119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.089 [2024-11-28 23:22:27.678112] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.089 [2024-11-28 23:22:27.678283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.089 [2024-11-28 23:22:27.678312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.089 [2024-11-28 23:22:27.683293] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.089 [2024-11-28 23:22:27.683464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.089 [2024-11-28 23:22:27.683492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.089 [2024-11-28 23:22:27.688617] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.089 [2024-11-28 23:22:27.688820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.089 [2024-11-28 23:22:27.688852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.348 [2024-11-28 23:22:27.693974] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.348 [2024-11-28 23:22:27.694132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.348 [2024-11-28 23:22:27.694164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.348 [2024-11-28 23:22:27.699067] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.348 [2024-11-28 23:22:27.699213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.348 [2024-11-28 23:22:27.699244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.348 [2024-11-28 23:22:27.704297] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.348 [2024-11-28 23:22:27.704477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.348 [2024-11-28 23:22:27.704507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.348 [2024-11-28 23:22:27.709463] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.349 [2024-11-28 23:22:27.709698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.349 [2024-11-28 23:22:27.709727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.349 [2024-11-28 23:22:27.714542] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.349 [2024-11-28 23:22:27.714708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.349 [2024-11-28 23:22:27.714736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.349 [2024-11-28 23:22:27.719948] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.349 [2024-11-28 23:22:27.720122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.349 [2024-11-28 23:22:27.720151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.349 [2024-11-28 23:22:27.725212] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.349 [2024-11-28 23:22:27.725382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.349 [2024-11-28 23:22:27.725421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.349 [2024-11-28 23:22:27.730303] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.349 [2024-11-28 23:22:27.730481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.349 [2024-11-28 23:22:27.730509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.349 [2024-11-28 23:22:27.735718] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.349 [2024-11-28 23:22:27.735919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:32 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.349 [2024-11-28 23:22:27.735948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.349 [2024-11-28 23:22:27.740872] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.349 [2024-11-28 23:22:27.740998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.349 [2024-11-28 23:22:27.741027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.349 [2024-11-28 23:22:27.746023] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.349 [2024-11-28 23:22:27.746207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.349 [2024-11-28 23:22:27.746235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.349 [2024-11-28 23:22:27.751449] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.349 [2024-11-28 23:22:27.751622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.349 [2024-11-28 23:22:27.751650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.349 [2024-11-28 23:22:27.756608] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.349 [2024-11-28 23:22:27.756809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.349 [2024-11-28 23:22:27.756837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.349 [2024-11-28 23:22:27.761906] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.349 [2024-11-28 23:22:27.762198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.349 [2024-11-28 23:22:27.762227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.349 [2024-11-28 23:22:27.767012] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.349 [2024-11-28 23:22:27.767259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.349 [2024-11-28 23:22:27.767288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.349 [2024-11-28 23:22:27.772230] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.349 [2024-11-28 23:22:27.772382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.349 [2024-11-28 23:22:27.772420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.349 [2024-11-28 23:22:27.777519] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.349 [2024-11-28 23:22:27.777796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.349 [2024-11-28 23:22:27.777825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.349 [2024-11-28 23:22:27.782585] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.349 [2024-11-28 23:22:27.782791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.349 [2024-11-28 23:22:27.782825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.349 [2024-11-28 23:22:27.787735] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.349 [2024-11-28 23:22:27.787885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.349 [2024-11-28 23:22:27.787913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.349 [2024-11-28 23:22:27.792788] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.349 [2024-11-28 23:22:27.792953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.349 [2024-11-28 23:22:27.792981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.349 [2024-11-28 23:22:27.797946] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.349 [2024-11-28 23:22:27.798094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.349 [2024-11-28 23:22:27.798132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.349 [2024-11-28 23:22:27.803093] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.349 [2024-11-28 23:22:27.803255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.349 [2024-11-28 23:22:27.803295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.349 [2024-11-28 23:22:27.808215] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.349 [2024-11-28 23:22:27.808367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.349 [2024-11-28 23:22:27.808416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.349 [2024-11-28 23:22:27.813383] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.349 [2024-11-28 23:22:27.813529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.349 [2024-11-28 23:22:27.813557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.349 [2024-11-28 23:22:27.818596] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.350 [2024-11-28 23:22:27.818752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.350 [2024-11-28 23:22:27.818780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.350 [2024-11-28 23:22:27.823654] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.350 [2024-11-28 23:22:27.823832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.350 [2024-11-28 23:22:27.823860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.350 [2024-11-28 23:22:27.828940] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.350 [2024-11-28 23:22:27.829165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.350 [2024-11-28 23:22:27.829193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.350 [2024-11-28 23:22:27.834076] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.350 [2024-11-28 23:22:27.834226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.350 [2024-11-28 23:22:27.834254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.350 [2024-11-28 23:22:27.839269] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.350 [2024-11-28 23:22:27.839478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.350 [2024-11-28 23:22:27.839507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.350 [2024-11-28 23:22:27.844417] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.350 [2024-11-28 23:22:27.844561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.350 [2024-11-28 23:22:27.844590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.350 [2024-11-28 23:22:27.849573] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.350 [2024-11-28 23:22:27.849700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.350 [2024-11-28 23:22:27.849727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.350 [2024-11-28 23:22:27.854216] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.350 [2024-11-28 23:22:27.854389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.350 [2024-11-28 23:22:27.854427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.350 [2024-11-28 23:22:27.859425] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.350 [2024-11-28 23:22:27.859669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.350 [2024-11-28 23:22:27.859697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.350 [2024-11-28 23:22:27.864475] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.350 [2024-11-28 23:22:27.864679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.350 [2024-11-28 23:22:27.864707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.350 [2024-11-28 23:22:27.869655] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.350 [2024-11-28 23:22:27.869800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.350 [2024-11-28 23:22:27.869834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.350 [2024-11-28 23:22:27.874836] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.350 [2024-11-28 23:22:27.874984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.350 [2024-11-28 23:22:27.875011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.350 [2024-11-28 23:22:27.879965] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.350 [2024-11-28 23:22:27.880071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.350 [2024-11-28 23:22:27.880097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.350 [2024-11-28 23:22:27.885123] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.350 [2024-11-28 23:22:27.885274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.350 [2024-11-28 23:22:27.885303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.350 [2024-11-28 23:22:27.890515] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.350 [2024-11-28 23:22:27.890688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.350 [2024-11-28 23:22:27.890724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.350 [2024-11-28 23:22:27.895622] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.350 [2024-11-28 23:22:27.895878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.350 [2024-11-28 23:22:27.895908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.350 [2024-11-28 23:22:27.900990] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.350 [2024-11-28 23:22:27.901170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.350 [2024-11-28 23:22:27.901197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.350 [2024-11-28 23:22:27.906371] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.350 [2024-11-28 23:22:27.906519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.350 [2024-11-28 23:22:27.906546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.350 [2024-11-28 23:22:27.912225] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.350 [2024-11-28 23:22:27.912391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.350 [2024-11-28 23:22:27.912425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.350 [2024-11-28 23:22:27.918361] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.350 [2024-11-28 23:22:27.918497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.350 [2024-11-28 23:22:27.918524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.350 [2024-11-28 23:22:27.924166] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.350 [2024-11-28 23:22:27.924359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.350 [2024-11-28 23:22:27.924386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.351 [2024-11-28 23:22:27.930019] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.351 [2024-11-28 23:22:27.930140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.351 [2024-11-28 23:22:27.930166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.351 [2024-11-28 23:22:27.936099] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.351 [2024-11-28 23:22:27.936241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.351 [2024-11-28 23:22:27.936268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.351 [2024-11-28 23:22:27.942281] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.351 [2024-11-28 23:22:27.942482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.351 [2024-11-28 23:22:27.942510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.351 [2024-11-28 23:22:27.947472] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.351 [2024-11-28 23:22:27.947667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.351 [2024-11-28 23:22:27.947694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.351 [2024-11-28 23:22:27.952105] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.351 [2024-11-28 23:22:27.952248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.351 [2024-11-28 23:22:27.952277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.611 [2024-11-28 23:22:27.957325] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.611 [2024-11-28 23:22:27.957500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.611 [2024-11-28 23:22:27.957529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.611 [2024-11-28 23:22:27.961987] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.611 [2024-11-28 23:22:27.962135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.611 [2024-11-28 23:22:27.962164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.611 [2024-11-28 23:22:27.966169] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.611 [2024-11-28 23:22:27.966281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.611 [2024-11-28 23:22:27.966309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.611 [2024-11-28 23:22:27.970430] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.611 [2024-11-28 23:22:27.970554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.611 [2024-11-28 23:22:27.970582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.611 [2024-11-28 23:22:27.974854] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.611 [2024-11-28 23:22:27.975000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.611 [2024-11-28 23:22:27.975028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.611 [2024-11-28 23:22:27.979109] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.611 [2024-11-28 23:22:27.979304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.611 [2024-11-28 23:22:27.979333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.611 [2024-11-28 23:22:27.984026] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.611 [2024-11-28 23:22:27.984167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.611 [2024-11-28 23:22:27.984195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.611 [2024-11-28 23:22:27.988442] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.611 [2024-11-28 23:22:27.988544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.611 [2024-11-28 23:22:27.988572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.611 [2024-11-28 23:22:27.992963] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.611 [2024-11-28 23:22:27.993074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.611 [2024-11-28 23:22:27.993101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.611 [2024-11-28 23:22:27.997363] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.611 [2024-11-28 23:22:27.997475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.611 [2024-11-28 23:22:27.997503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.611 [2024-11-28 23:22:28.001462] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.611 [2024-11-28 23:22:28.001564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.611 [2024-11-28 23:22:28.001597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.611 [2024-11-28 23:22:28.005531] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.611 [2024-11-28 23:22:28.005696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.611 [2024-11-28 23:22:28.005723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.611 [2024-11-28 23:22:28.009436] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.611 [2024-11-28 23:22:28.009609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.611 [2024-11-28 23:22:28.009636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.611 [2024-11-28 23:22:28.013380] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.611 [2024-11-28 23:22:28.013567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:32 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.611 [2024-11-28 23:22:28.013595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.611 [2024-11-28 23:22:28.017275] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.611 [2024-11-28 23:22:28.017434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.611 [2024-11-28 23:22:28.017461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.611 [2024-11-28 23:22:28.021173] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.611 [2024-11-28 23:22:28.021280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.611 [2024-11-28 23:22:28.021306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.611 [2024-11-28 23:22:28.025087] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.611 [2024-11-28 23:22:28.025261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.611 [2024-11-28 23:22:28.025288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.611 [2024-11-28 23:22:28.028961] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.611 [2024-11-28 23:22:28.029084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.611 [2024-11-28 23:22:28.029113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.611 [2024-11-28 23:22:28.032796] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.611 [2024-11-28 23:22:28.032891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.611 [2024-11-28 23:22:28.032918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.611 [2024-11-28 23:22:28.036788] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.611 [2024-11-28 23:22:28.036986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.612 [2024-11-28 23:22:28.037013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.612 [2024-11-28 23:22:28.040639] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.612 [2024-11-28 23:22:28.040823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.612 [2024-11-28 23:22:28.040852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.612 [2024-11-28 23:22:28.044687] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.612 [2024-11-28 23:22:28.044888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.612 [2024-11-28 23:22:28.044917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.612 [2024-11-28 23:22:28.048621] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.612 [2024-11-28 23:22:28.048771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.612 [2024-11-28 23:22:28.048798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.612 [2024-11-28 23:22:28.052748] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.612 [2024-11-28 23:22:28.052844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.612 [2024-11-28 23:22:28.052871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.612 [2024-11-28 23:22:28.056869] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.612 [2024-11-28 23:22:28.057051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.612 [2024-11-28 23:22:28.057078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.612 [2024-11-28 23:22:28.060742] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.612 [2024-11-28 23:22:28.060864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.612 [2024-11-28 23:22:28.060891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.612 [2024-11-28 23:22:28.064673] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.612 [2024-11-28 23:22:28.064771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.612 [2024-11-28 23:22:28.064798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.612 [2024-11-28 23:22:28.068952] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.612 [2024-11-28 23:22:28.069154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.612 [2024-11-28 23:22:28.069182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.612 [2024-11-28 23:22:28.073963] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.612 [2024-11-28 23:22:28.074212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.612 [2024-11-28 23:22:28.074243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.612 [2024-11-28 23:22:28.079237] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.612 [2024-11-28 23:22:28.079516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.612 [2024-11-28 23:22:28.079546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.612 [2024-11-28 23:22:28.085412] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.612 [2024-11-28 23:22:28.085626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.612 [2024-11-28 23:22:28.085654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.612 [2024-11-28 23:22:28.089762] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.612 [2024-11-28 23:22:28.089865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.612 [2024-11-28 23:22:28.089892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.612 [2024-11-28 23:22:28.093704] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.612 [2024-11-28 23:22:28.093880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.612 [2024-11-28 23:22:28.093907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.612 [2024-11-28 23:22:28.097589] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.612 [2024-11-28 23:22:28.097713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.612 [2024-11-28 23:22:28.097740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.612 [2024-11-28 23:22:28.101895] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.612 [2024-11-28 23:22:28.101988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.612 [2024-11-28 23:22:28.102015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.612 [2024-11-28 23:22:28.106472] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.612 [2024-11-28 23:22:28.106667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.612 [2024-11-28 23:22:28.106694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.612 [2024-11-28 23:22:28.110463] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.612 [2024-11-28 23:22:28.110610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.612 [2024-11-28 23:22:28.110644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.612 [2024-11-28 23:22:28.114439] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.612 [2024-11-28 23:22:28.114642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.612 [2024-11-28 23:22:28.114669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.612 [2024-11-28 23:22:28.118436] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.612 [2024-11-28 23:22:28.118604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.612 [2024-11-28 23:22:28.118632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.612 [2024-11-28 23:22:28.122325] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.612 [2024-11-28 23:22:28.122437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.612 [2024-11-28 23:22:28.122465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.612 [2024-11-28 23:22:28.126253] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.612 [2024-11-28 23:22:28.126437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.613 [2024-11-28 23:22:28.126464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.613 [2024-11-28 23:22:28.130176] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.613 [2024-11-28 23:22:28.130285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.613 [2024-11-28 23:22:28.130312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.613 [2024-11-28 23:22:28.134073] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.613 [2024-11-28 23:22:28.134165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.613 [2024-11-28 23:22:28.134191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.613 [2024-11-28 23:22:28.138114] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.613 [2024-11-28 23:22:28.138301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.613 [2024-11-28 23:22:28.138329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.613 [2024-11-28 23:22:28.142001] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.613 [2024-11-28 23:22:28.142166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.613 [2024-11-28 23:22:28.142193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.613 [2024-11-28 23:22:28.145994] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.613 [2024-11-28 23:22:28.146194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.613 [2024-11-28 23:22:28.146221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.613 [2024-11-28 23:22:28.149950] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.613 [2024-11-28 23:22:28.150101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.613 [2024-11-28 23:22:28.150128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.613 [2024-11-28 23:22:28.153820] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.613 [2024-11-28 23:22:28.153935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.613 [2024-11-28 23:22:28.153962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.613 [2024-11-28 23:22:28.157760] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.613 [2024-11-28 23:22:28.157928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.613 [2024-11-28 23:22:28.157955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.613 [2024-11-28 23:22:28.161604] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.613 [2024-11-28 23:22:28.161740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.613 [2024-11-28 23:22:28.161767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.613 [2024-11-28 23:22:28.165447] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.613 [2024-11-28 23:22:28.165545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.613 [2024-11-28 23:22:28.165572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.613 [2024-11-28 23:22:28.169452] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.613 [2024-11-28 23:22:28.169641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.613 [2024-11-28 23:22:28.169668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.613 [2024-11-28 23:22:28.173339] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.613 [2024-11-28 23:22:28.173538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.613 [2024-11-28 23:22:28.173566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.613 [2024-11-28 23:22:28.177328] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.613 [2024-11-28 23:22:28.177545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.613 [2024-11-28 23:22:28.177575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.613 [2024-11-28 23:22:28.181214] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.613 [2024-11-28 23:22:28.181377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.613 [2024-11-28 23:22:28.181413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.613 [2024-11-28 23:22:28.185077] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.613 [2024-11-28 23:22:28.185220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.613 [2024-11-28 23:22:28.185247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.613 [2024-11-28 23:22:28.189740] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.613 [2024-11-28 23:22:28.189870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.613 [2024-11-28 23:22:28.189897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.613 [2024-11-28 23:22:28.194860] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.613 [2024-11-28 23:22:28.195026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.613 [2024-11-28 23:22:28.195053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.613 [2024-11-28 23:22:28.200364] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.613 [2024-11-28 23:22:28.200605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.613 [2024-11-28 23:22:28.200635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.613 [2024-11-28 23:22:28.205958] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.613 [2024-11-28 23:22:28.206156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.613 [2024-11-28 23:22:28.206186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.613 [2024-11-28 23:22:28.210104] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.613 [2024-11-28 23:22:28.210255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.613 [2024-11-28 23:22:28.210282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.613 [2024-11-28 23:22:28.214391] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.613 [2024-11-28 23:22:28.214534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.614 [2024-11-28 23:22:28.214572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.873 [2024-11-28 23:22:28.218817] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.873 [2024-11-28 23:22:28.219029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.873 [2024-11-28 23:22:28.219064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.873 [2024-11-28 23:22:28.223225] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.873 [2024-11-28 23:22:28.223377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.873 [2024-11-28 23:22:28.223417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.873 [2024-11-28 23:22:28.227630] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.873 [2024-11-28 23:22:28.227794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.873 [2024-11-28 23:22:28.227822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.873 [2024-11-28 23:22:28.231977] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.873 [2024-11-28 23:22:28.232168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.873 [2024-11-28 23:22:28.232196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.873 [2024-11-28 23:22:28.236176] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.873 [2024-11-28 23:22:28.236341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.873 [2024-11-28 23:22:28.236369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.873 [2024-11-28 23:22:28.241012] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.873 [2024-11-28 23:22:28.241210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.873 [2024-11-28 23:22:28.241238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.874 [2024-11-28 23:22:28.245626] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.874 [2024-11-28 23:22:28.245748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.874 [2024-11-28 23:22:28.245776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.874 [2024-11-28 23:22:28.250173] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.874 [2024-11-28 23:22:28.250292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.874 [2024-11-28 23:22:28.250319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.874 [2024-11-28 23:22:28.255407] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.874 [2024-11-28 23:22:28.255558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.874 [2024-11-28 23:22:28.255585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.874 [2024-11-28 23:22:28.259819] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.874 [2024-11-28 23:22:28.259915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.874 [2024-11-28 23:22:28.259943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.874 [2024-11-28 23:22:28.264498] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.874 [2024-11-28 23:22:28.264575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.874 [2024-11-28 23:22:28.264602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.874 [2024-11-28 23:22:28.269100] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.874 [2024-11-28 23:22:28.269263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.874 [2024-11-28 23:22:28.269290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.874 [2024-11-28 23:22:28.273624] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.874 [2024-11-28 23:22:28.273758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.874 [2024-11-28 23:22:28.273786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.874 [2024-11-28 23:22:28.278538] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.874 [2024-11-28 23:22:28.278768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.874 [2024-11-28 23:22:28.278797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.874 [2024-11-28 23:22:28.283520] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.874 [2024-11-28 23:22:28.283634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.874 [2024-11-28 23:22:28.283662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.874 [2024-11-28 23:22:28.288175] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.874 [2024-11-28 23:22:28.288253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.874 [2024-11-28 23:22:28.288280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.874 [2024-11-28 23:22:28.292986] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.874 [2024-11-28 23:22:28.293131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.874 [2024-11-28 23:22:28.293158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.874 [2024-11-28 23:22:28.297529] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.874 [2024-11-28 23:22:28.297642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.874 [2024-11-28 23:22:28.297677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.874 [2024-11-28 23:22:28.301941] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.874 [2024-11-28 23:22:28.302014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.874 [2024-11-28 23:22:28.302042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.874 [2024-11-28 23:22:28.306578] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.874 [2024-11-28 23:22:28.306755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.874 [2024-11-28 23:22:28.306782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.874 [2024-11-28 23:22:28.311043] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.874 [2024-11-28 23:22:28.311211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.874 [2024-11-28 23:22:28.311239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.874 [2024-11-28 23:22:28.315607] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.874 [2024-11-28 23:22:28.315796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.874 [2024-11-28 23:22:28.315823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.874 [2024-11-28 23:22:28.320889] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.874 [2024-11-28 23:22:28.320994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.874 [2024-11-28 23:22:28.321020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.874 [2024-11-28 23:22:28.325331] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.874 [2024-11-28 23:22:28.325435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.874 [2024-11-28 23:22:28.325463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.874 [2024-11-28 23:22:28.329304] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.874 [2024-11-28 23:22:28.329488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.874 [2024-11-28 23:22:28.329516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.874 [2024-11-28 23:22:28.333223] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.874 [2024-11-28 23:22:28.333361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.874 [2024-11-28 23:22:28.333389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.874 [2024-11-28 23:22:28.337373] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.874 [2024-11-28 23:22:28.337561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.874 [2024-11-28 23:22:28.337588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.874 [2024-11-28 23:22:28.342433] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.874 [2024-11-28 23:22:28.342716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.875 [2024-11-28 23:22:28.342746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.875 [2024-11-28 23:22:28.347507] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.875 [2024-11-28 23:22:28.347740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.875 [2024-11-28 23:22:28.347770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.875 [2024-11-28 23:22:28.352964] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.875 [2024-11-28 23:22:28.353089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.875 [2024-11-28 23:22:28.353116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.875 [2024-11-28 23:22:28.358929] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.875 [2024-11-28 23:22:28.359069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.875 [2024-11-28 23:22:28.359097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.875 [2024-11-28 23:22:28.363905] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.875 [2024-11-28 23:22:28.364059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.875 [2024-11-28 23:22:28.364086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.875 [2024-11-28 23:22:28.368199] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.875 [2024-11-28 23:22:28.368377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.875 [2024-11-28 23:22:28.368417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.875 [2024-11-28 23:22:28.372221] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.875 [2024-11-28 23:22:28.372351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.875 [2024-11-28 23:22:28.372380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.875 [2024-11-28 23:22:28.377030] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.875 [2024-11-28 23:22:28.377115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.875 [2024-11-28 23:22:28.377141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.875 [2024-11-28 23:22:28.381711] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.875 [2024-11-28 23:22:28.381899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.875 [2024-11-28 23:22:28.381928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.875 [2024-11-28 23:22:28.385631] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.875 [2024-11-28 23:22:28.385819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.875 [2024-11-28 23:22:28.385847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.875 [2024-11-28 23:22:28.389667] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.875 [2024-11-28 23:22:28.389917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.875 [2024-11-28 23:22:28.389946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.875 [2024-11-28 23:22:28.394180] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.875 [2024-11-28 23:22:28.394376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.875 [2024-11-28 23:22:28.394414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.875 [2024-11-28 23:22:28.399169] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.875 [2024-11-28 23:22:28.399342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.875 [2024-11-28 23:22:28.399369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.875 [2024-11-28 23:22:28.404648] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.875 [2024-11-28 23:22:28.404790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.875 [2024-11-28 23:22:28.404817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.875 [2024-11-28 23:22:28.410249] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.875 [2024-11-28 23:22:28.410422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.875 [2024-11-28 23:22:28.410449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.875 [2024-11-28 23:22:28.414350] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.875 [2024-11-28 23:22:28.414537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.875 [2024-11-28 23:22:28.414566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.875 [2024-11-28 23:22:28.418355] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.875 [2024-11-28 23:22:28.418565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.875 [2024-11-28 23:22:28.418603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.875 [2024-11-28 23:22:28.422406] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.875 [2024-11-28 23:22:28.422548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.875 [2024-11-28 23:22:28.422576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.875 [2024-11-28 23:22:28.426832] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.875 [2024-11-28 23:22:28.426929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.875 [2024-11-28 23:22:28.426956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.875 [2024-11-28 23:22:28.431010] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.875 [2024-11-28 23:22:28.431188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.875 [2024-11-28 23:22:28.431216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.875 [2024-11-28 23:22:28.434930] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.875 [2024-11-28 23:22:28.435055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.875 [2024-11-28 23:22:28.435083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.875 [2024-11-28 23:22:28.438865] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.875 [2024-11-28 23:22:28.438971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.875 [2024-11-28 23:22:28.438997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.876 [2024-11-28 23:22:28.442913] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.876 [2024-11-28 23:22:28.443100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.876 [2024-11-28 23:22:28.443128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.876 [2024-11-28 23:22:28.446828] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.876 [2024-11-28 23:22:28.447003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.876 [2024-11-28 23:22:28.447030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.876 [2024-11-28 23:22:28.450828] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.876 [2024-11-28 23:22:28.451030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.876 [2024-11-28 23:22:28.451058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.876 [2024-11-28 23:22:28.454821] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.876 [2024-11-28 23:22:28.454982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.876 [2024-11-28 23:22:28.455010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.876 [2024-11-28 23:22:28.458799] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.876 [2024-11-28 23:22:28.458894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.876 [2024-11-28 23:22:28.458921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:24.876 [2024-11-28 23:22:28.462761] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.876 [2024-11-28 23:22:28.462932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.876 [2024-11-28 23:22:28.462960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:24.876 [2024-11-28 23:22:28.466711] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.876 [2024-11-28 23:22:28.466834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.876 [2024-11-28 23:22:28.466861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:24.876 [2024-11-28 23:22:28.470644] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.876 [2024-11-28 23:22:28.470736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.876 [2024-11-28 23:22:28.470763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:24.876 [2024-11-28 23:22:28.474652] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:24.876 [2024-11-28 23:22:28.474842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:24.876 [2024-11-28 23:22:28.474872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:25.136 [2024-11-28 23:22:28.478600] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.136 [2024-11-28 23:22:28.478776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.136 [2024-11-28 23:22:28.478805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:25.136 [2024-11-28 23:22:28.482611] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.136 [2024-11-28 23:22:28.482806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.136 [2024-11-28 23:22:28.482835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:25.136 [2024-11-28 23:22:28.486571] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.136 [2024-11-28 23:22:28.486737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.136 [2024-11-28 23:22:28.486766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:25.136 [2024-11-28 23:22:28.490493] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.136 [2024-11-28 23:22:28.490602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.136 [2024-11-28 23:22:28.490631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:25.136 [2024-11-28 23:22:28.494494] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.136 [2024-11-28 23:22:28.494669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.136 [2024-11-28 23:22:28.494698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:25.136 [2024-11-28 23:22:28.498390] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.136 [2024-11-28 23:22:28.498551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.136 [2024-11-28 23:22:28.498579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:25.136 [2024-11-28 23:22:28.502325] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.136 [2024-11-28 23:22:28.502427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.136 [2024-11-28 23:22:28.502455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:25.136 [2024-11-28 23:22:28.506340] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.136 [2024-11-28 23:22:28.506530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.136 [2024-11-28 23:22:28.506558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:25.136 [2024-11-28 23:22:28.510280] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.136 [2024-11-28 23:22:28.510467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.136 [2024-11-28 23:22:28.510495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:25.136 [2024-11-28 23:22:28.514283] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.136 [2024-11-28 23:22:28.514493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.136 [2024-11-28 23:22:28.514521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:25.136 [2024-11-28 23:22:28.518188] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.136 [2024-11-28 23:22:28.518345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.137 [2024-11-28 23:22:28.518372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:25.137 [2024-11-28 23:22:28.522101] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.137 [2024-11-28 23:22:28.522198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.137 [2024-11-28 23:22:28.522231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:25.137 [2024-11-28 23:22:28.526100] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.137 [2024-11-28 23:22:28.526277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.137 [2024-11-28 23:22:28.526305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:25.137 [2024-11-28 23:22:28.530151] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.137 [2024-11-28 23:22:28.530258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.137 [2024-11-28 23:22:28.530285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:25.137 [2024-11-28 23:22:28.534090] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.137 [2024-11-28 23:22:28.534184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.137 [2024-11-28 23:22:28.534212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:25.137 [2024-11-28 23:22:28.538138] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.137 [2024-11-28 23:22:28.538325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.137 [2024-11-28 23:22:28.538353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:25.137 [2024-11-28 23:22:28.542088] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.137 [2024-11-28 23:22:28.542266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.137 [2024-11-28 23:22:28.542293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:25.137 [2024-11-28 23:22:28.546084] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.137 [2024-11-28 23:22:28.546293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.137 [2024-11-28 23:22:28.546320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:25.137 [2024-11-28 23:22:28.549982] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.137 [2024-11-28 23:22:28.550156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.137 [2024-11-28 23:22:28.550183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:25.137 [2024-11-28 23:22:28.553897] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.137 [2024-11-28 23:22:28.553995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.137 [2024-11-28 23:22:28.554023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:25.137 [2024-11-28 23:22:28.557913] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.137 [2024-11-28 23:22:28.558084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.137 [2024-11-28 23:22:28.558111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:25.137 [2024-11-28 23:22:28.561886] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.137 [2024-11-28 23:22:28.562005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.137 [2024-11-28 23:22:28.562031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:25.137 [2024-11-28 23:22:28.565841] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.137 [2024-11-28 23:22:28.565946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.137 [2024-11-28 23:22:28.565973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:25.137 [2024-11-28 23:22:28.569862] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.137 [2024-11-28 23:22:28.570048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.137 [2024-11-28 23:22:28.570075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:25.137 [2024-11-28 23:22:28.573824] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.137 [2024-11-28 23:22:28.573967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.137 [2024-11-28 23:22:28.573995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:25.137 [2024-11-28 23:22:28.577839] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.137 [2024-11-28 23:22:28.578044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.137 [2024-11-28 23:22:28.578072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:25.137 [2024-11-28 23:22:28.581814] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.137 [2024-11-28 23:22:28.581957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.137 [2024-11-28 23:22:28.581984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:25.137 [2024-11-28 23:22:28.585707] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.137 [2024-11-28 23:22:28.585811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.137 [2024-11-28 23:22:28.585837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:25.137 [2024-11-28 23:22:28.589701] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.137 [2024-11-28 23:22:28.589876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.137 [2024-11-28 23:22:28.589909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:25.137 [2024-11-28 23:22:28.593698] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.137 [2024-11-28 23:22:28.593814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.137 [2024-11-28 23:22:28.593841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:25.137 [2024-11-28 23:22:28.597702] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.137 [2024-11-28 23:22:28.597801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.137 [2024-11-28 23:22:28.597828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:25.137 [2024-11-28 23:22:28.601760] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.137 [2024-11-28 23:22:28.601946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.137 [2024-11-28 23:22:28.601973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:25.138 [2024-11-28 23:22:28.605691] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.138 [2024-11-28 23:22:28.605860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.138 [2024-11-28 23:22:28.605887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:25.138 [2024-11-28 23:22:28.609700] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.138 [2024-11-28 23:22:28.609902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.138 [2024-11-28 23:22:28.609930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:25.138 [2024-11-28 23:22:28.613646] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.138 [2024-11-28 23:22:28.613791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.138 [2024-11-28 23:22:28.613819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:25.138 [2024-11-28 23:22:28.617630] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.138 [2024-11-28 23:22:28.617740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.138 [2024-11-28 23:22:28.617767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:25.138 [2024-11-28 23:22:28.621658] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.138 [2024-11-28 23:22:28.621828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.138 [2024-11-28 23:22:28.621855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:25.138 [2024-11-28 23:22:28.625583] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.138 [2024-11-28 23:22:28.625709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.138 [2024-11-28 23:22:28.625736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:25.138 [2024-11-28 23:22:28.629560] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.138 [2024-11-28 23:22:28.629671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.138 [2024-11-28 23:22:28.629699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:25.138 [2024-11-28 23:22:28.633553] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.138 [2024-11-28 23:22:28.633739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.138 [2024-11-28 23:22:28.633767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:25.138 [2024-11-28 23:22:28.637524] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.138 [2024-11-28 23:22:28.637669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.138 [2024-11-28 23:22:28.637697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:25.138 [2024-11-28 23:22:28.641549] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.138 [2024-11-28 23:22:28.641751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.138 [2024-11-28 23:22:28.641779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:25.138 [2024-11-28 23:22:28.645493] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.138 [2024-11-28 23:22:28.645653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.138 [2024-11-28 23:22:28.645681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:25.138 [2024-11-28 23:22:28.649422] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.138 [2024-11-28 23:22:28.649527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.138 [2024-11-28 23:22:28.649554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:25.138 [2024-11-28 23:22:28.653376] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.138 [2024-11-28 23:22:28.653557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.138 [2024-11-28 23:22:28.653585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:25.138 [2024-11-28 23:22:28.657308] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.138 [2024-11-28 23:22:28.657418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.138 [2024-11-28 23:22:28.657445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:25.138 [2024-11-28 23:22:28.661199] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.138 [2024-11-28 23:22:28.661294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.138 [2024-11-28 23:22:28.661321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:25.138 [2024-11-28 23:22:28.665215] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.138 [2024-11-28 23:22:28.665379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.138 [2024-11-28 23:22:28.665415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:25.138 [2024-11-28 23:22:28.669166] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.138 [2024-11-28 23:22:28.669344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.138 [2024-11-28 23:22:28.669371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:25.138 [2024-11-28 23:22:28.673220] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.138 [2024-11-28 23:22:28.673438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.138 [2024-11-28 23:22:28.673467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:25.138 [2024-11-28 23:22:28.677096] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.138 [2024-11-28 23:22:28.677252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.138 [2024-11-28 23:22:28.677279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:25.138 [2024-11-28 23:22:28.681048] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.138 [2024-11-28 23:22:28.681174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.138 [2024-11-28 23:22:28.681202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:25.138 [2024-11-28 23:22:28.685001] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.138 [2024-11-28 23:22:28.685178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.138 [2024-11-28 23:22:28.685205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:25.138 [2024-11-28 23:22:28.688987] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.139 [2024-11-28 23:22:28.689096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.139 [2024-11-28 23:22:28.689123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:25.139 [2024-11-28 23:22:28.692957] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.139 [2024-11-28 23:22:28.693054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.139 [2024-11-28 23:22:28.693096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:25.139 [2024-11-28 23:22:28.697033] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.139 [2024-11-28 23:22:28.697218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.139 [2024-11-28 23:22:28.697248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:25.139 [2024-11-28 23:22:28.700999] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.139 [2024-11-28 23:22:28.701169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.139 [2024-11-28 23:22:28.701199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:25.139 [2024-11-28 23:22:28.705018] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.139 [2024-11-28 23:22:28.705225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.139 [2024-11-28 23:22:28.705254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:25.139 [2024-11-28 23:22:28.708962] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.139 [2024-11-28 23:22:28.709118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.139 [2024-11-28 23:22:28.709147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:25.139 [2024-11-28 23:22:28.712938] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.139 [2024-11-28 23:22:28.713035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.139 [2024-11-28 23:22:28.713062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:25.139 [2024-11-28 23:22:28.716912] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.139 [2024-11-28 23:22:28.717085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.139 [2024-11-28 23:22:28.717114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:25.139 [2024-11-28 23:22:28.720808] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.139 [2024-11-28 23:22:28.720925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:64 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.139 [2024-11-28 23:22:28.720952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:25.139 [2024-11-28 23:22:28.724765] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.139 [2024-11-28 23:22:28.724880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.139 [2024-11-28 23:22:28.724910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:25.139 [2024-11-28 23:22:28.728801] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.139 [2024-11-28 23:22:28.728994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.139 [2024-11-28 23:22:28.729024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:25.139 [2024-11-28 23:22:28.732799] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.139 [2024-11-28 23:22:28.732964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.139 [2024-11-28 23:22:28.732992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:25.139 [2024-11-28 23:22:28.736971] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.139 [2024-11-28 23:22:28.737183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.139 [2024-11-28 23:22:28.737215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:25.399 [2024-11-28 23:22:28.740968] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.399 [2024-11-28 23:22:28.741131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.399 [2024-11-28 23:22:28.741163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:25.399 [2024-11-28 23:22:28.744904] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.399 [2024-11-28 23:22:28.745000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.399 [2024-11-28 23:22:28.745028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:25.400 [2024-11-28 23:22:28.748942] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.400 [2024-11-28 23:22:28.749122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.400 [2024-11-28 23:22:28.749154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:25.400 [2024-11-28 23:22:28.752870] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.400 [2024-11-28 23:22:28.752987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.400 [2024-11-28 23:22:28.753014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:25.400 [2024-11-28 23:22:28.756829] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.400 [2024-11-28 23:22:28.756945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.400 [2024-11-28 23:22:28.756972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:25.400 [2024-11-28 23:22:28.760832] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.400 [2024-11-28 23:22:28.761017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.400 [2024-11-28 23:22:28.761046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:25.400 [2024-11-28 23:22:28.764816] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.400 [2024-11-28 23:22:28.764985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.400 [2024-11-28 23:22:28.765014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:25.400 [2024-11-28 23:22:28.768812] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.400 [2024-11-28 23:22:28.769010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.400 [2024-11-28 23:22:28.769039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:25.400 [2024-11-28 23:22:28.772732] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.400 [2024-11-28 23:22:28.772894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.400 [2024-11-28 23:22:28.772924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:25.400 [2024-11-28 23:22:28.776834] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.400 [2024-11-28 23:22:28.776944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.400 [2024-11-28 23:22:28.776972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:25.400 [2024-11-28 23:22:28.780812] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.400 [2024-11-28 23:22:28.780982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.400 [2024-11-28 23:22:28.781011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:25.400 [2024-11-28 23:22:28.784751] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.400 [2024-11-28 23:22:28.784877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.400 [2024-11-28 23:22:28.784904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:25.400 [2024-11-28 23:22:28.788636] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.400 [2024-11-28 23:22:28.788741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.400 [2024-11-28 23:22:28.788768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:25.400 [2024-11-28 23:22:28.792661] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.400 [2024-11-28 23:22:28.792845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.400 [2024-11-28 23:22:28.792874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:25.400 [2024-11-28 23:22:28.796631] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.400 [2024-11-28 23:22:28.796801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.400 [2024-11-28 23:22:28.796835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:25.400 [2024-11-28 23:22:28.800586] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.400 [2024-11-28 23:22:28.800760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.400 [2024-11-28 23:22:28.800790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:25.400 [2024-11-28 23:22:28.805135] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.400 [2024-11-28 23:22:28.805333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.400 [2024-11-28 23:22:28.805360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:25.400 [2024-11-28 23:22:28.810286] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.400 [2024-11-28 23:22:28.810430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.400 [2024-11-28 23:22:28.810459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:25.400 [2024-11-28 23:22:28.816390] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.400 [2024-11-28 23:22:28.816510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.400 [2024-11-28 23:22:28.816537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:25.400 [2024-11-28 23:22:28.821690] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.400 [2024-11-28 23:22:28.821944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.400 [2024-11-28 23:22:28.821974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:25.400 [2024-11-28 23:22:28.826700] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.400 [2024-11-28 23:22:28.826854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.400 [2024-11-28 23:22:28.826882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:25.400 [2024-11-28 23:22:28.831756] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.400 [2024-11-28 23:22:28.831902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.400 [2024-11-28 23:22:28.831932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:25.400 [2024-11-28 23:22:28.837303] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.400 [2024-11-28 23:22:28.837517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.400 [2024-11-28 23:22:28.837546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:25.400 [2024-11-28 23:22:28.843187] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.401 [2024-11-28 23:22:28.843382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.401 [2024-11-28 23:22:28.843419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:25.401 [2024-11-28 23:22:28.848947] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.401 [2024-11-28 23:22:28.849022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.401 [2024-11-28 23:22:28.849049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:25.401 [2024-11-28 23:22:28.854993] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.401 [2024-11-28 23:22:28.855145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.401 [2024-11-28 23:22:28.855173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:25.401 [2024-11-28 23:22:28.861179] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.401 [2024-11-28 23:22:28.861322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.401 [2024-11-28 23:22:28.861351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:25.401 [2024-11-28 23:22:28.867276] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.401 [2024-11-28 23:22:28.867426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.401 [2024-11-28 23:22:28.867456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:25.401 [2024-11-28 23:22:28.873927] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.401 [2024-11-28 23:22:28.874297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.401 [2024-11-28 23:22:28.874327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:25.401 [2024-11-28 23:22:28.879583] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.401 [2024-11-28 23:22:28.879796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.401 [2024-11-28 23:22:28.879825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:25.401 [2024-11-28 23:22:28.884097] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.401 [2024-11-28 23:22:28.884268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.401 [2024-11-28 23:22:28.884297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:25.401 [2024-11-28 23:22:28.888009] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.401 [2024-11-28 23:22:28.888160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.401 [2024-11-28 23:22:28.888189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:25.401 [2024-11-28 23:22:28.891998] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.401 [2024-11-28 23:22:28.892140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.401 [2024-11-28 23:22:28.892169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:25.401 [2024-11-28 23:22:28.896145] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.401 [2024-11-28 23:22:28.896270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.401 [2024-11-28 23:22:28.896298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:25.401 [2024-11-28 23:22:28.900958] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.401 [2024-11-28 23:22:28.901050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.401 [2024-11-28 23:22:28.901077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:25.401 [2024-11-28 23:22:28.905830] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.401 [2024-11-28 23:22:28.906050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.401 [2024-11-28 23:22:28.906079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:25.401 [2024-11-28 23:22:28.911049] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.401 [2024-11-28 23:22:28.911255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.401 [2024-11-28 23:22:28.911285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:25.401 [2024-11-28 23:22:28.916634] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.401 [2024-11-28 23:22:28.916779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.401 [2024-11-28 23:22:28.916808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:25.401 [2024-11-28 23:22:28.920844] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.401 [2024-11-28 23:22:28.920960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.401 [2024-11-28 23:22:28.920989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:25.401 [2024-11-28 23:22:28.924814] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.401 [2024-11-28 23:22:28.924925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.401 [2024-11-28 23:22:28.924954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:25.401 [2024-11-28 23:22:28.928814] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.401 [2024-11-28 23:22:28.928974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.401 [2024-11-28 23:22:28.929004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:25.401 [2024-11-28 23:22:28.933736] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.401 [2024-11-28 23:22:28.933938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.401 [2024-11-28 23:22:28.933966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:25.401 [2024-11-28 23:22:28.938703] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.401 [2024-11-28 23:22:28.938870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.401 [2024-11-28 23:22:28.938899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:25.401 [2024-11-28 23:22:28.943767] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.401 [2024-11-28 23:22:28.943980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.401 [2024-11-28 23:22:28.944008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:25.401 [2024-11-28 23:22:28.949552] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.402 [2024-11-28 23:22:28.949796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.402 [2024-11-28 23:22:28.949824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:25.402 [2024-11-28 23:22:28.954116] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.402 [2024-11-28 23:22:28.954233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.402 [2024-11-28 23:22:28.954262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:25.402 [2024-11-28 23:22:28.958245] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.402 [2024-11-28 23:22:28.958439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.402 [2024-11-28 23:22:28.958468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:25.402 [2024-11-28 23:22:28.962804] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.402 [2024-11-28 23:22:28.962943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.402 [2024-11-28 23:22:28.962972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:25.402 [2024-11-28 23:22:28.967137] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.402 [2024-11-28 23:22:28.967272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.402 [2024-11-28 23:22:28.967300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:25.402 [2024-11-28 23:22:28.971754] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.402 [2024-11-28 23:22:28.971839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.402 [2024-11-28 23:22:28.971868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:25.402 [2024-11-28 23:22:28.976148] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.402 [2024-11-28 23:22:28.976316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.402 [2024-11-28 23:22:28.976344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:25.402 [2024-11-28 23:22:28.980884] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.402 [2024-11-28 23:22:28.981088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.402 [2024-11-28 23:22:28.981117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:25.402 [2024-11-28 23:22:28.985362] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.402 [2024-11-28 23:22:28.985549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.402 [2024-11-28 23:22:28.985578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:25.402 [2024-11-28 23:22:28.989587] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.402 [2024-11-28 23:22:28.989694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.402 [2024-11-28 23:22:28.989721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:25.402 [2024-11-28 23:22:28.993583] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.402 [2024-11-28 23:22:28.993754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.402 [2024-11-28 23:22:28.993783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:25.402 [2024-11-28 23:22:28.997721] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.402 [2024-11-28 23:22:28.997834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.402 [2024-11-28 23:22:28.997861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:25.402 [2024-11-28 23:22:29.002663] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.402 [2024-11-28 23:22:29.002750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.402 [2024-11-28 23:22:29.002781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:25.662 [2024-11-28 23:22:29.006983] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.662 [2024-11-28 23:22:29.007169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.662 [2024-11-28 23:22:29.007206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:25.662 [2024-11-28 23:22:29.010924] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.662 [2024-11-28 23:22:29.011105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.662 [2024-11-28 23:22:29.011136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:25.662 [2024-11-28 23:22:29.014945] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.662 [2024-11-28 23:22:29.015147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.662 [2024-11-28 23:22:29.015177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:25.662 [2024-11-28 23:22:29.018834] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.662 [2024-11-28 23:22:29.019010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.662 [2024-11-28 23:22:29.019039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:25.662 [2024-11-28 23:22:29.022769] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.662 [2024-11-28 23:22:29.022870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.662 [2024-11-28 23:22:29.022899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:25.662 [2024-11-28 23:22:29.026803] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.662 [2024-11-28 23:22:29.026982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.662 [2024-11-28 23:22:29.027011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:25.662 [2024-11-28 23:22:29.030698] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.662 [2024-11-28 23:22:29.030824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.662 [2024-11-28 23:22:29.030853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:25.662 [2024-11-28 23:22:29.034706] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.662 [2024-11-28 23:22:29.034811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.662 [2024-11-28 23:22:29.034839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:25.662 [2024-11-28 23:22:29.038700] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.662 [2024-11-28 23:22:29.038886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.662 [2024-11-28 23:22:29.038914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:25.662 [2024-11-28 23:22:29.042634] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.662 [2024-11-28 23:22:29.042806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.662 [2024-11-28 23:22:29.042835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:25.662 [2024-11-28 23:22:29.046669] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.662 [2024-11-28 23:22:29.046889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.662 [2024-11-28 23:22:29.046918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:25.662 [2024-11-28 23:22:29.050554] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.662 [2024-11-28 23:22:29.050733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.663 [2024-11-28 23:22:29.050762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:25.663 [2024-11-28 23:22:29.054458] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.663 [2024-11-28 23:22:29.054561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.663 [2024-11-28 23:22:29.054590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:25.663 [2024-11-28 23:22:29.058380] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.663 [2024-11-28 23:22:29.058560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.663 [2024-11-28 23:22:29.058588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:25.663 [2024-11-28 23:22:29.062259] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.663 [2024-11-28 23:22:29.062362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.663 [2024-11-28 23:22:29.062390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:25.663 [2024-11-28 23:22:29.066173] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.663 [2024-11-28 23:22:29.066276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.663 [2024-11-28 23:22:29.066304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:25.663 [2024-11-28 23:22:29.070199] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.663 [2024-11-28 23:22:29.070362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.663 [2024-11-28 23:22:29.070408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:25.663 [2024-11-28 23:22:29.074100] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.663 [2024-11-28 23:22:29.074275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.663 [2024-11-28 23:22:29.074304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:25.663 [2024-11-28 23:22:29.078065] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.663 [2024-11-28 23:22:29.078259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.663 [2024-11-28 23:22:29.078287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:25.663 [2024-11-28 23:22:29.081939] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.663 [2024-11-28 23:22:29.082088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.663 [2024-11-28 23:22:29.082117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:25.663 [2024-11-28 23:22:29.085790] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.663 [2024-11-28 23:22:29.085887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.663 [2024-11-28 23:22:29.085915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:25.663 [2024-11-28 23:22:29.089758] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.663 [2024-11-28 23:22:29.089930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.663 [2024-11-28 23:22:29.089958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:25.663 [2024-11-28 23:22:29.093665] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.663 [2024-11-28 23:22:29.093771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.663 [2024-11-28 23:22:29.093799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:25.663 [2024-11-28 23:22:29.097586] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.663 [2024-11-28 23:22:29.097689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.663 [2024-11-28 23:22:29.097717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:25.663 [2024-11-28 23:22:29.101603] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.663 [2024-11-28 23:22:29.101789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.663 [2024-11-28 23:22:29.101817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:25.663 [2024-11-28 23:22:29.105509] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.663 [2024-11-28 23:22:29.105701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.663 [2024-11-28 23:22:29.105730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:25.663 [2024-11-28 23:22:29.109424] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.663 [2024-11-28 23:22:29.109630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.663 [2024-11-28 23:22:29.109664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:25.663 [2024-11-28 23:22:29.113344] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.663 [2024-11-28 23:22:29.113494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.663 [2024-11-28 23:22:29.113523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:25.663 [2024-11-28 23:22:29.117214] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.663 [2024-11-28 23:22:29.117316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.663 [2024-11-28 23:22:29.117344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:25.663 [2024-11-28 23:22:29.121138] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.663 [2024-11-28 23:22:29.121304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.663 [2024-11-28 23:22:29.121333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:25.663 [2024-11-28 23:22:29.125056] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.663 [2024-11-28 23:22:29.125182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.663 [2024-11-28 23:22:29.125210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:25.663 [2024-11-28 23:22:29.128930] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.663 [2024-11-28 23:22:29.129034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.663 [2024-11-28 23:22:29.129062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:25.663 [2024-11-28 23:22:29.132903] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.663 [2024-11-28 23:22:29.133088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.663 [2024-11-28 23:22:29.133116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:25.663 [2024-11-28 23:22:29.136790] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.664 [2024-11-28 23:22:29.136932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.664 [2024-11-28 23:22:29.136960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:25.664 [2024-11-28 23:22:29.140776] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.664 [2024-11-28 23:22:29.140961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.664 [2024-11-28 23:22:29.140990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:25.664 [2024-11-28 23:22:29.144810] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.664 [2024-11-28 23:22:29.144958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.664 [2024-11-28 23:22:29.144986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:25.664 [2024-11-28 23:22:29.148708] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.664 [2024-11-28 23:22:29.148816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.664 [2024-11-28 23:22:29.148844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:25.664 [2024-11-28 23:22:29.153160] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.664 [2024-11-28 23:22:29.153341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.664 [2024-11-28 23:22:29.153370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:25.664 [2024-11-28 23:22:29.157042] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.664 [2024-11-28 23:22:29.157135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.664 [2024-11-28 23:22:29.157163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:25.664 [2024-11-28 23:22:29.160959] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.664 [2024-11-28 23:22:29.161056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.664 [2024-11-28 23:22:29.161085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:25.664 [2024-11-28 23:22:29.164976] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.664 [2024-11-28 23:22:29.165185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.664 [2024-11-28 23:22:29.165213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:25.664 [2024-11-28 23:22:29.168875] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.664 [2024-11-28 23:22:29.168967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.664 [2024-11-28 23:22:29.168996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:25.664 [2024-11-28 23:22:29.172798] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.664 [2024-11-28 23:22:29.172971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.664 [2024-11-28 23:22:29.173000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:25.664 [2024-11-28 23:22:29.176713] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.664 [2024-11-28 23:22:29.176859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.664 [2024-11-28 23:22:29.176888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:25.664 [2024-11-28 23:22:29.180585] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.664 [2024-11-28 23:22:29.180687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.664 [2024-11-28 23:22:29.180715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:25.664 [2024-11-28 23:22:29.184536] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.664 [2024-11-28 23:22:29.184707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.664 [2024-11-28 23:22:29.184736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:25.664 [2024-11-28 23:22:29.188500] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.664 [2024-11-28 23:22:29.188640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.664 [2024-11-28 23:22:29.188669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:25.664 [2024-11-28 23:22:29.192373] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.664 [2024-11-28 23:22:29.192527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.664 [2024-11-28 23:22:29.192556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:25.664 [2024-11-28 23:22:29.196355] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.664 [2024-11-28 23:22:29.196537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.664 [2024-11-28 23:22:29.196565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:25.664 [2024-11-28 23:22:29.200271] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.664 [2024-11-28 23:22:29.200390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.664 [2024-11-28 23:22:29.200425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:25.664 [2024-11-28 23:22:29.204193] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.664 [2024-11-28 23:22:29.204373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.664 [2024-11-28 23:22:29.204410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:25.664 [2024-11-28 23:22:29.208109] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.664 [2024-11-28 23:22:29.208264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.664 [2024-11-28 23:22:29.208292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:25.664 [2024-11-28 23:22:29.211959] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.664 [2024-11-28 23:22:29.212062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.664 [2024-11-28 23:22:29.212095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:25.664 [2024-11-28 23:22:29.215888] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.664 [2024-11-28 23:22:29.216061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.664 [2024-11-28 23:22:29.216099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:25.664 [2024-11-28 23:22:29.219705] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17c8590) with pdu=0x2000190fef90 00:30:25.664 [2024-11-28 23:22:29.219780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:25.665 [2024-11-28 23:22:29.219807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:25.665 00:30:25.665 Latency(us) 00:30:25.665 [2024-11-28T22:22:29.271Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:25.665 [2024-11-28T22:22:29.271Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:30:25.665 nvme0n1 : 2.00 6753.67 844.21 0.00 0.00 2362.75 1662.67 11359.57 00:30:25.665 [2024-11-28T22:22:29.271Z] =================================================================================================================== 00:30:25.665 [2024-11-28T22:22:29.271Z] Total : 6753.67 844.21 0.00 0.00 2362.75 1662.67 11359.57 00:30:25.665 0 00:30:25.665 23:22:29 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:30:25.665 23:22:29 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:30:25.665 23:22:29 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:30:25.665 23:22:29 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:30:25.665 | .driver_specific 00:30:25.665 | .nvme_error 00:30:25.665 | .status_code 00:30:25.665 | .command_transient_transport_error' 00:30:25.923 23:22:29 -- host/digest.sh@71 -- # (( 436 > 0 )) 00:30:25.923 23:22:29 -- host/digest.sh@73 -- # killprocess 2575566 00:30:25.923 23:22:29 -- common/autotest_common.sh@936 -- # '[' -z 2575566 ']' 00:30:25.923 23:22:29 -- common/autotest_common.sh@940 -- # kill -0 2575566 00:30:25.923 23:22:29 -- common/autotest_common.sh@941 -- # uname 00:30:25.923 23:22:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:25.923 23:22:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2575566 00:30:25.923 23:22:29 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:25.923 23:22:29 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:25.923 23:22:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2575566' 00:30:25.923 killing process with pid 2575566 00:30:25.923 23:22:29 -- common/autotest_common.sh@955 -- # kill 2575566 00:30:25.923 Received shutdown signal, test time was about 2.000000 seconds 00:30:25.923 00:30:25.923 Latency(us) 00:30:25.923 [2024-11-28T22:22:29.529Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:25.923 [2024-11-28T22:22:29.529Z] =================================================================================================================== 00:30:25.923 [2024-11-28T22:22:29.529Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:25.923 23:22:29 -- common/autotest_common.sh@960 -- # wait 2575566 00:30:26.182 23:22:29 -- host/digest.sh@115 -- # killprocess 2573879 00:30:26.182 23:22:29 -- common/autotest_common.sh@936 -- # '[' -z 2573879 ']' 00:30:26.182 23:22:29 -- common/autotest_common.sh@940 -- # kill -0 2573879 00:30:26.182 23:22:29 -- common/autotest_common.sh@941 -- # uname 00:30:26.182 23:22:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:26.182 23:22:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2573879 00:30:26.182 23:22:29 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:30:26.182 23:22:29 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:30:26.182 23:22:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2573879' 00:30:26.182 killing process with pid 2573879 00:30:26.182 23:22:29 -- common/autotest_common.sh@955 -- # kill 2573879 00:30:26.182 23:22:29 -- common/autotest_common.sh@960 -- # wait 2573879 00:30:26.441 00:30:26.441 real 0m18.478s 00:30:26.441 user 0m37.617s 00:30:26.441 sys 0m4.595s 00:30:26.441 23:22:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:26.441 23:22:30 -- common/autotest_common.sh@10 -- # set +x 00:30:26.441 ************************************ 00:30:26.441 END TEST nvmf_digest_error 00:30:26.441 ************************************ 00:30:26.441 23:22:30 -- host/digest.sh@138 -- # trap - SIGINT SIGTERM EXIT 00:30:26.441 23:22:30 -- host/digest.sh@139 -- # nvmftestfini 00:30:26.441 23:22:30 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:26.441 23:22:30 -- nvmf/common.sh@116 -- # sync 00:30:26.441 23:22:30 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:26.441 23:22:30 -- nvmf/common.sh@119 -- # set +e 00:30:26.441 23:22:30 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:26.441 23:22:30 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:26.441 rmmod nvme_tcp 00:30:26.699 rmmod nvme_fabrics 00:30:26.699 rmmod nvme_keyring 00:30:26.699 23:22:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:26.699 23:22:30 -- nvmf/common.sh@123 -- # set -e 00:30:26.699 23:22:30 -- nvmf/common.sh@124 -- # return 0 00:30:26.699 23:22:30 -- nvmf/common.sh@477 -- # '[' -n 2573879 ']' 00:30:26.699 23:22:30 -- nvmf/common.sh@478 -- # killprocess 2573879 00:30:26.699 23:22:30 -- common/autotest_common.sh@936 -- # '[' -z 2573879 ']' 00:30:26.699 23:22:30 -- common/autotest_common.sh@940 -- # kill -0 2573879 00:30:26.699 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2573879) - No such process 00:30:26.699 23:22:30 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2573879 is not found' 00:30:26.699 Process with pid 2573879 is not found 00:30:26.699 23:22:30 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:26.699 23:22:30 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:26.699 23:22:30 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:26.699 23:22:30 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:26.699 23:22:30 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:26.699 23:22:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:26.699 23:22:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:26.699 23:22:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:28.605 23:22:32 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:28.605 00:30:28.605 real 0m38.542s 00:30:28.605 user 1m9.704s 00:30:28.605 sys 0m10.471s 00:30:28.605 23:22:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:28.605 23:22:32 -- common/autotest_common.sh@10 -- # set +x 00:30:28.605 ************************************ 00:30:28.605 END TEST nvmf_digest 00:30:28.605 ************************************ 00:30:28.605 23:22:32 -- nvmf/nvmf.sh@110 -- # [[ 0 -eq 1 ]] 00:30:28.605 23:22:32 -- nvmf/nvmf.sh@115 -- # [[ 0 -eq 1 ]] 00:30:28.605 23:22:32 -- nvmf/nvmf.sh@120 -- # [[ phy == phy ]] 00:30:28.605 23:22:32 -- nvmf/nvmf.sh@122 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:30:28.605 23:22:32 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:28.605 23:22:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:28.605 23:22:32 -- common/autotest_common.sh@10 -- # set +x 00:30:28.605 ************************************ 00:30:28.605 START TEST nvmf_bdevperf 00:30:28.605 ************************************ 00:30:28.605 23:22:32 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:30:28.605 * Looking for test storage... 00:30:28.605 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:30:28.864 23:22:32 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:28.864 23:22:32 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:28.864 23:22:32 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:28.864 23:22:32 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:28.864 23:22:32 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:28.864 23:22:32 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:28.864 23:22:32 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:28.864 23:22:32 -- scripts/common.sh@335 -- # IFS=.-: 00:30:28.864 23:22:32 -- scripts/common.sh@335 -- # read -ra ver1 00:30:28.864 23:22:32 -- scripts/common.sh@336 -- # IFS=.-: 00:30:28.864 23:22:32 -- scripts/common.sh@336 -- # read -ra ver2 00:30:28.864 23:22:32 -- scripts/common.sh@337 -- # local 'op=<' 00:30:28.864 23:22:32 -- scripts/common.sh@339 -- # ver1_l=2 00:30:28.864 23:22:32 -- scripts/common.sh@340 -- # ver2_l=1 00:30:28.864 23:22:32 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:28.864 23:22:32 -- scripts/common.sh@343 -- # case "$op" in 00:30:28.864 23:22:32 -- scripts/common.sh@344 -- # : 1 00:30:28.864 23:22:32 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:28.864 23:22:32 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:28.864 23:22:32 -- scripts/common.sh@364 -- # decimal 1 00:30:28.864 23:22:32 -- scripts/common.sh@352 -- # local d=1 00:30:28.864 23:22:32 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:28.864 23:22:32 -- scripts/common.sh@354 -- # echo 1 00:30:28.864 23:22:32 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:28.864 23:22:32 -- scripts/common.sh@365 -- # decimal 2 00:30:28.864 23:22:32 -- scripts/common.sh@352 -- # local d=2 00:30:28.864 23:22:32 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:28.864 23:22:32 -- scripts/common.sh@354 -- # echo 2 00:30:28.864 23:22:32 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:28.864 23:22:32 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:28.864 23:22:32 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:28.864 23:22:32 -- scripts/common.sh@367 -- # return 0 00:30:28.864 23:22:32 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:28.864 23:22:32 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:28.864 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:28.864 --rc genhtml_branch_coverage=1 00:30:28.864 --rc genhtml_function_coverage=1 00:30:28.864 --rc genhtml_legend=1 00:30:28.864 --rc geninfo_all_blocks=1 00:30:28.864 --rc geninfo_unexecuted_blocks=1 00:30:28.864 00:30:28.864 ' 00:30:28.864 23:22:32 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:28.864 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:28.864 --rc genhtml_branch_coverage=1 00:30:28.864 --rc genhtml_function_coverage=1 00:30:28.864 --rc genhtml_legend=1 00:30:28.864 --rc geninfo_all_blocks=1 00:30:28.864 --rc geninfo_unexecuted_blocks=1 00:30:28.864 00:30:28.864 ' 00:30:28.864 23:22:32 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:28.864 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:28.864 --rc genhtml_branch_coverage=1 00:30:28.864 --rc genhtml_function_coverage=1 00:30:28.864 --rc genhtml_legend=1 00:30:28.864 --rc geninfo_all_blocks=1 00:30:28.864 --rc geninfo_unexecuted_blocks=1 00:30:28.864 00:30:28.864 ' 00:30:28.864 23:22:32 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:28.864 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:28.864 --rc genhtml_branch_coverage=1 00:30:28.864 --rc genhtml_function_coverage=1 00:30:28.864 --rc genhtml_legend=1 00:30:28.864 --rc geninfo_all_blocks=1 00:30:28.864 --rc geninfo_unexecuted_blocks=1 00:30:28.864 00:30:28.864 ' 00:30:28.865 23:22:32 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:28.865 23:22:32 -- nvmf/common.sh@7 -- # uname -s 00:30:28.865 23:22:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:28.865 23:22:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:28.865 23:22:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:28.865 23:22:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:28.865 23:22:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:28.865 23:22:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:28.865 23:22:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:28.865 23:22:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:28.865 23:22:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:28.865 23:22:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:28.865 23:22:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:28.865 23:22:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:28.865 23:22:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:28.865 23:22:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:28.865 23:22:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:28.865 23:22:32 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:28.865 23:22:32 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:28.865 23:22:32 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:28.865 23:22:32 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:28.865 23:22:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:28.865 23:22:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:28.865 23:22:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:28.865 23:22:32 -- paths/export.sh@5 -- # export PATH 00:30:28.865 23:22:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:28.865 23:22:32 -- nvmf/common.sh@46 -- # : 0 00:30:28.865 23:22:32 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:28.865 23:22:32 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:28.865 23:22:32 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:28.865 23:22:32 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:28.865 23:22:32 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:28.865 23:22:32 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:28.865 23:22:32 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:28.865 23:22:32 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:28.865 23:22:32 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:30:28.865 23:22:32 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:30:28.865 23:22:32 -- host/bdevperf.sh@24 -- # nvmftestinit 00:30:28.865 23:22:32 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:28.865 23:22:32 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:28.865 23:22:32 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:28.865 23:22:32 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:28.865 23:22:32 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:28.865 23:22:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:28.865 23:22:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:28.865 23:22:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:28.865 23:22:32 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:28.865 23:22:32 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:28.865 23:22:32 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:28.865 23:22:32 -- common/autotest_common.sh@10 -- # set +x 00:30:30.767 23:22:34 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:30.768 23:22:34 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:30.768 23:22:34 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:30.768 23:22:34 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:30.768 23:22:34 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:30.768 23:22:34 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:30.768 23:22:34 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:30.768 23:22:34 -- nvmf/common.sh@294 -- # net_devs=() 00:30:30.768 23:22:34 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:30.768 23:22:34 -- nvmf/common.sh@295 -- # e810=() 00:30:30.768 23:22:34 -- nvmf/common.sh@295 -- # local -ga e810 00:30:30.768 23:22:34 -- nvmf/common.sh@296 -- # x722=() 00:30:30.768 23:22:34 -- nvmf/common.sh@296 -- # local -ga x722 00:30:30.768 23:22:34 -- nvmf/common.sh@297 -- # mlx=() 00:30:30.768 23:22:34 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:30.768 23:22:34 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:30.768 23:22:34 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:30.768 23:22:34 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:30.768 23:22:34 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:30.768 23:22:34 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:30.768 23:22:34 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:30.768 23:22:34 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:30.768 23:22:34 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:30.768 23:22:34 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:30.768 23:22:34 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:30.768 23:22:34 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:30.768 23:22:34 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:30.768 23:22:34 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:30.768 23:22:34 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:30.768 23:22:34 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:30.768 23:22:34 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:30.768 23:22:34 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:30.768 23:22:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:30.768 23:22:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:30:30.768 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:30:30.768 23:22:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:30.768 23:22:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:30.768 23:22:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:30.768 23:22:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:30.768 23:22:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:30.768 23:22:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:30.768 23:22:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:30:30.768 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:30:30.768 23:22:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:30.768 23:22:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:30.768 23:22:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:30.768 23:22:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:30.768 23:22:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:30.768 23:22:34 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:30.768 23:22:34 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:30.768 23:22:34 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:30.768 23:22:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:30.768 23:22:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:30.768 23:22:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:30.768 23:22:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:30.768 23:22:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:30:30.768 Found net devices under 0000:0a:00.0: cvl_0_0 00:30:30.768 23:22:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:30.768 23:22:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:30.768 23:22:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:30.768 23:22:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:30.768 23:22:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:30.768 23:22:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:30:30.768 Found net devices under 0000:0a:00.1: cvl_0_1 00:30:30.768 23:22:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:30.768 23:22:34 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:30.768 23:22:34 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:30.768 23:22:34 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:30.768 23:22:34 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:30.768 23:22:34 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:30.768 23:22:34 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:30.768 23:22:34 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:30.768 23:22:34 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:30.768 23:22:34 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:30.768 23:22:34 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:30.768 23:22:34 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:30.768 23:22:34 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:30.768 23:22:34 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:30.768 23:22:34 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:30.768 23:22:34 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:30.768 23:22:34 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:30.768 23:22:34 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:31.027 23:22:34 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:31.027 23:22:34 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:31.027 23:22:34 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:31.027 23:22:34 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:31.027 23:22:34 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:31.027 23:22:34 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:31.027 23:22:34 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:31.027 23:22:34 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:31.027 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:31.027 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.240 ms 00:30:31.027 00:30:31.027 --- 10.0.0.2 ping statistics --- 00:30:31.027 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:31.027 rtt min/avg/max/mdev = 0.240/0.240/0.240/0.000 ms 00:30:31.027 23:22:34 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:31.027 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:31.027 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.126 ms 00:30:31.027 00:30:31.027 --- 10.0.0.1 ping statistics --- 00:30:31.027 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:31.027 rtt min/avg/max/mdev = 0.126/0.126/0.126/0.000 ms 00:30:31.028 23:22:34 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:31.028 23:22:34 -- nvmf/common.sh@410 -- # return 0 00:30:31.028 23:22:34 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:30:31.028 23:22:34 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:31.028 23:22:34 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:31.028 23:22:34 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:31.028 23:22:34 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:31.028 23:22:34 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:31.028 23:22:34 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:31.028 23:22:34 -- host/bdevperf.sh@25 -- # tgt_init 00:30:31.028 23:22:34 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:30:31.028 23:22:34 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:31.028 23:22:34 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:31.028 23:22:34 -- common/autotest_common.sh@10 -- # set +x 00:30:31.028 23:22:34 -- nvmf/common.sh@469 -- # nvmfpid=2578195 00:30:31.028 23:22:34 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:30:31.028 23:22:34 -- nvmf/common.sh@470 -- # waitforlisten 2578195 00:30:31.028 23:22:34 -- common/autotest_common.sh@829 -- # '[' -z 2578195 ']' 00:30:31.028 23:22:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:31.028 23:22:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:31.028 23:22:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:31.028 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:31.028 23:22:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:31.028 23:22:34 -- common/autotest_common.sh@10 -- # set +x 00:30:31.028 [2024-11-28 23:22:34.573791] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:31.028 [2024-11-28 23:22:34.573879] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:31.028 EAL: No free 2048 kB hugepages reported on node 1 00:30:31.286 [2024-11-28 23:22:34.644700] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:30:31.286 [2024-11-28 23:22:34.735178] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:31.286 [2024-11-28 23:22:34.735359] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:31.286 [2024-11-28 23:22:34.735390] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:31.286 [2024-11-28 23:22:34.735414] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:31.286 [2024-11-28 23:22:34.735534] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:30:31.286 [2024-11-28 23:22:34.735551] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:30:31.286 [2024-11-28 23:22:34.735554] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:32.219 23:22:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:32.219 23:22:35 -- common/autotest_common.sh@862 -- # return 0 00:30:32.219 23:22:35 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:32.219 23:22:35 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:32.219 23:22:35 -- common/autotest_common.sh@10 -- # set +x 00:30:32.219 23:22:35 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:32.219 23:22:35 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:30:32.219 23:22:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:32.219 23:22:35 -- common/autotest_common.sh@10 -- # set +x 00:30:32.219 [2024-11-28 23:22:35.594626] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:32.219 23:22:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:32.219 23:22:35 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:32.219 23:22:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:32.219 23:22:35 -- common/autotest_common.sh@10 -- # set +x 00:30:32.219 Malloc0 00:30:32.219 23:22:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:32.219 23:22:35 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:32.219 23:22:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:32.219 23:22:35 -- common/autotest_common.sh@10 -- # set +x 00:30:32.219 23:22:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:32.219 23:22:35 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:32.219 23:22:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:32.219 23:22:35 -- common/autotest_common.sh@10 -- # set +x 00:30:32.219 23:22:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:32.219 23:22:35 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:32.219 23:22:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:32.219 23:22:35 -- common/autotest_common.sh@10 -- # set +x 00:30:32.219 [2024-11-28 23:22:35.661186] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:32.219 23:22:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:32.219 23:22:35 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:30:32.219 23:22:35 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:30:32.219 23:22:35 -- nvmf/common.sh@520 -- # config=() 00:30:32.219 23:22:35 -- nvmf/common.sh@520 -- # local subsystem config 00:30:32.219 23:22:35 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:30:32.219 23:22:35 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:30:32.219 { 00:30:32.219 "params": { 00:30:32.219 "name": "Nvme$subsystem", 00:30:32.219 "trtype": "$TEST_TRANSPORT", 00:30:32.219 "traddr": "$NVMF_FIRST_TARGET_IP", 00:30:32.219 "adrfam": "ipv4", 00:30:32.219 "trsvcid": "$NVMF_PORT", 00:30:32.219 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:30:32.219 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:30:32.219 "hdgst": ${hdgst:-false}, 00:30:32.219 "ddgst": ${ddgst:-false} 00:30:32.219 }, 00:30:32.219 "method": "bdev_nvme_attach_controller" 00:30:32.219 } 00:30:32.219 EOF 00:30:32.219 )") 00:30:32.219 23:22:35 -- nvmf/common.sh@542 -- # cat 00:30:32.219 23:22:35 -- nvmf/common.sh@544 -- # jq . 00:30:32.219 23:22:35 -- nvmf/common.sh@545 -- # IFS=, 00:30:32.219 23:22:35 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:30:32.219 "params": { 00:30:32.219 "name": "Nvme1", 00:30:32.219 "trtype": "tcp", 00:30:32.219 "traddr": "10.0.0.2", 00:30:32.219 "adrfam": "ipv4", 00:30:32.219 "trsvcid": "4420", 00:30:32.219 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:30:32.219 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:30:32.219 "hdgst": false, 00:30:32.219 "ddgst": false 00:30:32.219 }, 00:30:32.219 "method": "bdev_nvme_attach_controller" 00:30:32.219 }' 00:30:32.219 [2024-11-28 23:22:35.705168] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:32.219 [2024-11-28 23:22:35.705237] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2578357 ] 00:30:32.219 EAL: No free 2048 kB hugepages reported on node 1 00:30:32.219 [2024-11-28 23:22:35.766314] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:32.477 [2024-11-28 23:22:35.852986] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:32.477 Running I/O for 1 seconds... 00:30:33.851 00:30:33.851 Latency(us) 00:30:33.851 [2024-11-28T22:22:37.457Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:33.851 [2024-11-28T22:22:37.457Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:30:33.851 Verification LBA range: start 0x0 length 0x4000 00:30:33.851 Nvme1n1 : 1.01 12716.39 49.67 0.00 0.00 10019.69 1152.95 16796.63 00:30:33.851 [2024-11-28T22:22:37.457Z] =================================================================================================================== 00:30:33.851 [2024-11-28T22:22:37.457Z] Total : 12716.39 49.67 0.00 0.00 10019.69 1152.95 16796.63 00:30:33.851 23:22:37 -- host/bdevperf.sh@30 -- # bdevperfpid=2578508 00:30:33.851 23:22:37 -- host/bdevperf.sh@32 -- # sleep 3 00:30:33.851 23:22:37 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:30:33.851 23:22:37 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:30:33.851 23:22:37 -- nvmf/common.sh@520 -- # config=() 00:30:33.851 23:22:37 -- nvmf/common.sh@520 -- # local subsystem config 00:30:33.851 23:22:37 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:30:33.851 23:22:37 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:30:33.851 { 00:30:33.851 "params": { 00:30:33.851 "name": "Nvme$subsystem", 00:30:33.851 "trtype": "$TEST_TRANSPORT", 00:30:33.851 "traddr": "$NVMF_FIRST_TARGET_IP", 00:30:33.851 "adrfam": "ipv4", 00:30:33.851 "trsvcid": "$NVMF_PORT", 00:30:33.851 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:30:33.851 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:30:33.851 "hdgst": ${hdgst:-false}, 00:30:33.851 "ddgst": ${ddgst:-false} 00:30:33.851 }, 00:30:33.851 "method": "bdev_nvme_attach_controller" 00:30:33.851 } 00:30:33.851 EOF 00:30:33.851 )") 00:30:33.851 23:22:37 -- nvmf/common.sh@542 -- # cat 00:30:33.851 23:22:37 -- nvmf/common.sh@544 -- # jq . 00:30:33.851 23:22:37 -- nvmf/common.sh@545 -- # IFS=, 00:30:33.851 23:22:37 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:30:33.851 "params": { 00:30:33.851 "name": "Nvme1", 00:30:33.851 "trtype": "tcp", 00:30:33.851 "traddr": "10.0.0.2", 00:30:33.851 "adrfam": "ipv4", 00:30:33.851 "trsvcid": "4420", 00:30:33.851 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:30:33.851 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:30:33.851 "hdgst": false, 00:30:33.851 "ddgst": false 00:30:33.851 }, 00:30:33.851 "method": "bdev_nvme_attach_controller" 00:30:33.851 }' 00:30:33.851 [2024-11-28 23:22:37.333139] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:33.851 [2024-11-28 23:22:37.333229] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2578508 ] 00:30:33.851 EAL: No free 2048 kB hugepages reported on node 1 00:30:33.851 [2024-11-28 23:22:37.394187] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:34.110 [2024-11-28 23:22:37.479554] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:34.368 Running I/O for 15 seconds... 00:30:36.903 23:22:40 -- host/bdevperf.sh@33 -- # kill -9 2578195 00:30:36.903 23:22:40 -- host/bdevperf.sh@35 -- # sleep 3 00:30:36.903 [2024-11-28 23:22:40.304364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:123712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.903 [2024-11-28 23:22:40.304448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.903 [2024-11-28 23:22:40.304480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:123720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.903 [2024-11-28 23:22:40.304499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.903 [2024-11-28 23:22:40.304527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:123736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.903 [2024-11-28 23:22:40.304543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.903 [2024-11-28 23:22:40.304562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:123752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.903 [2024-11-28 23:22:40.304578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.903 [2024-11-28 23:22:40.304593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:123760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.903 [2024-11-28 23:22:40.304610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.903 [2024-11-28 23:22:40.304627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:123768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.903 [2024-11-28 23:22:40.304642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.903 [2024-11-28 23:22:40.304660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:123128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.903 [2024-11-28 23:22:40.304676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.903 [2024-11-28 23:22:40.304691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:123136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.903 [2024-11-28 23:22:40.304725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.903 [2024-11-28 23:22:40.304744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:123152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.903 [2024-11-28 23:22:40.304761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.903 [2024-11-28 23:22:40.304781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:123160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.903 [2024-11-28 23:22:40.304798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.903 [2024-11-28 23:22:40.304816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:123168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.903 [2024-11-28 23:22:40.304834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.903 [2024-11-28 23:22:40.304853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:123176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.903 [2024-11-28 23:22:40.304869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.903 [2024-11-28 23:22:40.304888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:123184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.903 [2024-11-28 23:22:40.304904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.903 [2024-11-28 23:22:40.304921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:123192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.903 [2024-11-28 23:22:40.304937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.903 [2024-11-28 23:22:40.304953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:123776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.903 [2024-11-28 23:22:40.304973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.903 [2024-11-28 23:22:40.304991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:123784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.903 [2024-11-28 23:22:40.305007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.903 [2024-11-28 23:22:40.305024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:123792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.903 [2024-11-28 23:22:40.305039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.903 [2024-11-28 23:22:40.305056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:123808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.903 [2024-11-28 23:22:40.305071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.903 [2024-11-28 23:22:40.305088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:123848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.903 [2024-11-28 23:22:40.305104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.903 [2024-11-28 23:22:40.305121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:123856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.903 [2024-11-28 23:22:40.305136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.903 [2024-11-28 23:22:40.305153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:123864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.903 [2024-11-28 23:22:40.305168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.903 [2024-11-28 23:22:40.305185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:123888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.903 [2024-11-28 23:22:40.305200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.903 [2024-11-28 23:22:40.305216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:123200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.903 [2024-11-28 23:22:40.305231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.903 [2024-11-28 23:22:40.305248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:123216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.903 [2024-11-28 23:22:40.305263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.903 [2024-11-28 23:22:40.305280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:123240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.903 [2024-11-28 23:22:40.305295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.903 [2024-11-28 23:22:40.305312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:123256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.903 [2024-11-28 23:22:40.305327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.903 [2024-11-28 23:22:40.305344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:123288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.903 [2024-11-28 23:22:40.305360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.903 [2024-11-28 23:22:40.305381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:123296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.903 [2024-11-28 23:22:40.305404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.903 [2024-11-28 23:22:40.305424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:123304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.903 [2024-11-28 23:22:40.305454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.903 [2024-11-28 23:22:40.305471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:123312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.903 [2024-11-28 23:22:40.305485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.903 [2024-11-28 23:22:40.305500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:123904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.903 [2024-11-28 23:22:40.305514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.903 [2024-11-28 23:22:40.305530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:123912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.903 [2024-11-28 23:22:40.305544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.903 [2024-11-28 23:22:40.305559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:123920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.903 [2024-11-28 23:22:40.305573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.903 [2024-11-28 23:22:40.305588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:123928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.904 [2024-11-28 23:22:40.305602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.904 [2024-11-28 23:22:40.305617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:123936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.904 [2024-11-28 23:22:40.305633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.904 [2024-11-28 23:22:40.305649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:123320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.904 [2024-11-28 23:22:40.305663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.904 [2024-11-28 23:22:40.305695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:123360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.904 [2024-11-28 23:22:40.305711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.904 [2024-11-28 23:22:40.305728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:123376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.904 [2024-11-28 23:22:40.305743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.904 [2024-11-28 23:22:40.305761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:123384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.904 [2024-11-28 23:22:40.305776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.904 [2024-11-28 23:22:40.305794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:123408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.904 [2024-11-28 23:22:40.305814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.904 [2024-11-28 23:22:40.305832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:123416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.904 [2024-11-28 23:22:40.305847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.904 [2024-11-28 23:22:40.305864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:123432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.904 [2024-11-28 23:22:40.305880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.904 [2024-11-28 23:22:40.305897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:123440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.904 [2024-11-28 23:22:40.305912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.904 [2024-11-28 23:22:40.305929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:123968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.904 [2024-11-28 23:22:40.305944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.904 [2024-11-28 23:22:40.305961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:123992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.904 [2024-11-28 23:22:40.305976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.904 [2024-11-28 23:22:40.305994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:124000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:36.904 [2024-11-28 23:22:40.306009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.904 [2024-11-28 23:22:40.306026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:124008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:36.904 [2024-11-28 23:22:40.306041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.904 [2024-11-28 23:22:40.306059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:124016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:36.904 [2024-11-28 23:22:40.306074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.904 [2024-11-28 23:22:40.306091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:123448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.904 [2024-11-28 23:22:40.306106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.904 [2024-11-28 23:22:40.306124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:123456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.904 [2024-11-28 23:22:40.306139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.904 [2024-11-28 23:22:40.306156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:123464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.904 [2024-11-28 23:22:40.306171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.904 [2024-11-28 23:22:40.306188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:123488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.904 [2024-11-28 23:22:40.306203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.904 [2024-11-28 23:22:40.306224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:123496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.904 [2024-11-28 23:22:40.306240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.904 [2024-11-28 23:22:40.306257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:123512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.904 [2024-11-28 23:22:40.306272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.904 [2024-11-28 23:22:40.306289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:123544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.904 [2024-11-28 23:22:40.306305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.904 [2024-11-28 23:22:40.306323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:123552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.904 [2024-11-28 23:22:40.306338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.904 [2024-11-28 23:22:40.306354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:124024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:36.904 [2024-11-28 23:22:40.306369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.904 [2024-11-28 23:22:40.306386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:124032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.904 [2024-11-28 23:22:40.306411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.904 [2024-11-28 23:22:40.306430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:124040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.904 [2024-11-28 23:22:40.306459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.904 [2024-11-28 23:22:40.306474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:124048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:36.904 [2024-11-28 23:22:40.306487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.904 [2024-11-28 23:22:40.306502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:124056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:36.904 [2024-11-28 23:22:40.306516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.904 [2024-11-28 23:22:40.306531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:124064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:36.904 [2024-11-28 23:22:40.306544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.904 [2024-11-28 23:22:40.306575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:124072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.904 [2024-11-28 23:22:40.306589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.904 [2024-11-28 23:22:40.306605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:124080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:36.904 [2024-11-28 23:22:40.306619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.904 [2024-11-28 23:22:40.306634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:124088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.904 [2024-11-28 23:22:40.306647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.904 [2024-11-28 23:22:40.306667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:124096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.904 [2024-11-28 23:22:40.306699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.904 [2024-11-28 23:22:40.306717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:124104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:36.904 [2024-11-28 23:22:40.306733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.904 [2024-11-28 23:22:40.306750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:124112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:36.904 [2024-11-28 23:22:40.306766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.904 [2024-11-28 23:22:40.306783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:124120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.904 [2024-11-28 23:22:40.306798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.904 [2024-11-28 23:22:40.306815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:124128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.904 [2024-11-28 23:22:40.306830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.904 [2024-11-28 23:22:40.306847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:124136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.904 [2024-11-28 23:22:40.306863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.904 [2024-11-28 23:22:40.306880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:124144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.904 [2024-11-28 23:22:40.306895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.904 [2024-11-28 23:22:40.306912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:123568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.904 [2024-11-28 23:22:40.306927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.905 [2024-11-28 23:22:40.306944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:123584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.905 [2024-11-28 23:22:40.306959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.905 [2024-11-28 23:22:40.306976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:123600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.905 [2024-11-28 23:22:40.306991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.905 [2024-11-28 23:22:40.307009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:123624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.905 [2024-11-28 23:22:40.307024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.905 [2024-11-28 23:22:40.307041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:123632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.905 [2024-11-28 23:22:40.307057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.905 [2024-11-28 23:22:40.307074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:123648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.905 [2024-11-28 23:22:40.307093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.905 [2024-11-28 23:22:40.307111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:123664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.905 [2024-11-28 23:22:40.307126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.905 [2024-11-28 23:22:40.307144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:123688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.905 [2024-11-28 23:22:40.307159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.905 [2024-11-28 23:22:40.307175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:124152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.905 [2024-11-28 23:22:40.307190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.905 [2024-11-28 23:22:40.307207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:124160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:36.905 [2024-11-28 23:22:40.307222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.905 [2024-11-28 23:22:40.307239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:124168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.905 [2024-11-28 23:22:40.307254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.905 [2024-11-28 23:22:40.307271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:124176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.905 [2024-11-28 23:22:40.307286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.905 [2024-11-28 23:22:40.307304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:124184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:36.905 [2024-11-28 23:22:40.307320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.905 [2024-11-28 23:22:40.307337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:124192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.905 [2024-11-28 23:22:40.307353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.905 [2024-11-28 23:22:40.307370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:124200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.905 [2024-11-28 23:22:40.307385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.905 [2024-11-28 23:22:40.307410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:124208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.905 [2024-11-28 23:22:40.307427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.905 [2024-11-28 23:22:40.307459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:124216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:36.905 [2024-11-28 23:22:40.307473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.905 [2024-11-28 23:22:40.307488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:124224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.905 [2024-11-28 23:22:40.307502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.905 [2024-11-28 23:22:40.307524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:124232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.905 [2024-11-28 23:22:40.307539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.905 [2024-11-28 23:22:40.307554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:124240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:36.905 [2024-11-28 23:22:40.307568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.905 [2024-11-28 23:22:40.307583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:124248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:36.905 [2024-11-28 23:22:40.307597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.905 [2024-11-28 23:22:40.307612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:124256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.905 [2024-11-28 23:22:40.307626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.905 [2024-11-28 23:22:40.307641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:124264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:36.905 [2024-11-28 23:22:40.307673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.905 [2024-11-28 23:22:40.307689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:123704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.905 [2024-11-28 23:22:40.307703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.905 [2024-11-28 23:22:40.307735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:123728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.905 [2024-11-28 23:22:40.307751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.905 [2024-11-28 23:22:40.307768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:123744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.905 [2024-11-28 23:22:40.307784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.905 [2024-11-28 23:22:40.307801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:123800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.905 [2024-11-28 23:22:40.307817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.905 [2024-11-28 23:22:40.307835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:123816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.905 [2024-11-28 23:22:40.307852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.905 [2024-11-28 23:22:40.307869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:123824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.905 [2024-11-28 23:22:40.307885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.905 [2024-11-28 23:22:40.307902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:123832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.905 [2024-11-28 23:22:40.307918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.905 [2024-11-28 23:22:40.307935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:123840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.905 [2024-11-28 23:22:40.307955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.905 [2024-11-28 23:22:40.307973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:124272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.905 [2024-11-28 23:22:40.307988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.905 [2024-11-28 23:22:40.308006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:124280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:36.905 [2024-11-28 23:22:40.308022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.905 [2024-11-28 23:22:40.308039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:124288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.905 [2024-11-28 23:22:40.308055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.905 [2024-11-28 23:22:40.308073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:124296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:36.905 [2024-11-28 23:22:40.308088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.905 [2024-11-28 23:22:40.308106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:124304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.905 [2024-11-28 23:22:40.308122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.905 [2024-11-28 23:22:40.308139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:124312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.905 [2024-11-28 23:22:40.308155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.905 [2024-11-28 23:22:40.308172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:124320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:36.905 [2024-11-28 23:22:40.308188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.905 [2024-11-28 23:22:40.308205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:124328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:36.905 [2024-11-28 23:22:40.308220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.905 [2024-11-28 23:22:40.308238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:124336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.905 [2024-11-28 23:22:40.308253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.905 [2024-11-28 23:22:40.308270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:124344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:36.905 [2024-11-28 23:22:40.308286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.906 [2024-11-28 23:22:40.308303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:124352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.906 [2024-11-28 23:22:40.308319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.906 [2024-11-28 23:22:40.308336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:124360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.906 [2024-11-28 23:22:40.308358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.906 [2024-11-28 23:22:40.308380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:124368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.906 [2024-11-28 23:22:40.308405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.906 [2024-11-28 23:22:40.308425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:124376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.906 [2024-11-28 23:22:40.308456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.906 [2024-11-28 23:22:40.308472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:124384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.906 [2024-11-28 23:22:40.308486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.906 [2024-11-28 23:22:40.308501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:124392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:36.906 [2024-11-28 23:22:40.308514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.906 [2024-11-28 23:22:40.308529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:124400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.906 [2024-11-28 23:22:40.308542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.906 [2024-11-28 23:22:40.308557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:123872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.906 [2024-11-28 23:22:40.308570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.906 [2024-11-28 23:22:40.308585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:123880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.906 [2024-11-28 23:22:40.308598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.906 [2024-11-28 23:22:40.308613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:123896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.906 [2024-11-28 23:22:40.308627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.906 [2024-11-28 23:22:40.308641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:123944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.906 [2024-11-28 23:22:40.308656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.906 [2024-11-28 23:22:40.308690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:123952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.906 [2024-11-28 23:22:40.308707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.906 [2024-11-28 23:22:40.308725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:123960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.906 [2024-11-28 23:22:40.308740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.906 [2024-11-28 23:22:40.308757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:123976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.906 [2024-11-28 23:22:40.308773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.906 [2024-11-28 23:22:40.308790] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x100c900 is same with the state(5) to be set 00:30:36.906 [2024-11-28 23:22:40.308813] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:30:36.906 [2024-11-28 23:22:40.308827] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:30:36.906 [2024-11-28 23:22:40.308840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:123984 len:8 PRP1 0x0 PRP2 0x0 00:30:36.906 [2024-11-28 23:22:40.308855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:36.906 [2024-11-28 23:22:40.308918] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x100c900 was disconnected and freed. reset controller. 00:30:36.906 [2024-11-28 23:22:40.311334] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:36.906 [2024-11-28 23:22:40.311420] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:36.906 [2024-11-28 23:22:40.311949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-28 23:22:40.312125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-28 23:22:40.312151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:36.906 [2024-11-28 23:22:40.312169] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:36.906 [2024-11-28 23:22:40.312313] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:36.906 [2024-11-28 23:22:40.312438] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:36.906 [2024-11-28 23:22:40.312478] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:36.906 [2024-11-28 23:22:40.312495] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:36.906 [2024-11-28 23:22:40.315014] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:36.906 [2024-11-28 23:22:40.324266] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:36.906 [2024-11-28 23:22:40.324614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-28 23:22:40.324759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-28 23:22:40.324791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:36.906 [2024-11-28 23:22:40.324811] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:36.906 [2024-11-28 23:22:40.324997] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:36.906 [2024-11-28 23:22:40.325185] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:36.906 [2024-11-28 23:22:40.325210] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:36.906 [2024-11-28 23:22:40.325227] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:36.906 [2024-11-28 23:22:40.327498] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:36.906 [2024-11-28 23:22:40.336691] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:36.906 [2024-11-28 23:22:40.337062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-28 23:22:40.337346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-28 23:22:40.337407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:36.906 [2024-11-28 23:22:40.337429] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:36.906 [2024-11-28 23:22:40.337602] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:36.906 [2024-11-28 23:22:40.337736] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:36.906 [2024-11-28 23:22:40.337760] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:36.906 [2024-11-28 23:22:40.337777] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:36.906 [2024-11-28 23:22:40.340212] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:36.906 [2024-11-28 23:22:40.349214] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:36.906 [2024-11-28 23:22:40.349563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-28 23:22:40.349680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-28 23:22:40.349725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:36.906 [2024-11-28 23:22:40.349742] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:36.906 [2024-11-28 23:22:40.349900] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:36.906 [2024-11-28 23:22:40.350053] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:36.906 [2024-11-28 23:22:40.350077] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:36.906 [2024-11-28 23:22:40.350093] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:36.906 [2024-11-28 23:22:40.352372] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:36.906 [2024-11-28 23:22:40.361901] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:36.906 [2024-11-28 23:22:40.362340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-28 23:22:40.362489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-28 23:22:40.362518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:36.906 [2024-11-28 23:22:40.362536] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:36.906 [2024-11-28 23:22:40.362720] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:36.906 [2024-11-28 23:22:40.362872] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:36.906 [2024-11-28 23:22:40.362896] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:36.906 [2024-11-28 23:22:40.362912] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:36.906 [2024-11-28 23:22:40.365213] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:36.906 [2024-11-28 23:22:40.374461] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:36.906 [2024-11-28 23:22:40.374826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-28 23:22:40.375053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-28 23:22:40.375111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:36.907 [2024-11-28 23:22:40.375130] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:36.907 [2024-11-28 23:22:40.375313] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:36.907 [2024-11-28 23:22:40.375509] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:36.907 [2024-11-28 23:22:40.375534] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:36.907 [2024-11-28 23:22:40.375550] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:36.907 [2024-11-28 23:22:40.377855] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:36.907 [2024-11-28 23:22:40.387009] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:36.907 [2024-11-28 23:22:40.387353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-28 23:22:40.387481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-28 23:22:40.387512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:36.907 [2024-11-28 23:22:40.387540] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:36.907 [2024-11-28 23:22:40.387688] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:36.907 [2024-11-28 23:22:40.387840] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:36.907 [2024-11-28 23:22:40.387868] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:36.907 [2024-11-28 23:22:40.387885] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:36.907 [2024-11-28 23:22:40.390080] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:36.907 [2024-11-28 23:22:40.399576] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:36.907 [2024-11-28 23:22:40.399953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-28 23:22:40.400157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-28 23:22:40.400206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:36.907 [2024-11-28 23:22:40.400224] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:36.907 [2024-11-28 23:22:40.400372] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:36.907 [2024-11-28 23:22:40.400633] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:36.907 [2024-11-28 23:22:40.400657] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:36.907 [2024-11-28 23:22:40.400674] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:36.907 [2024-11-28 23:22:40.403298] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:36.907 [2024-11-28 23:22:40.412167] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:36.907 [2024-11-28 23:22:40.412499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-28 23:22:40.412645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-28 23:22:40.412672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:36.907 [2024-11-28 23:22:40.412689] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:36.907 [2024-11-28 23:22:40.412855] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:36.907 [2024-11-28 23:22:40.413054] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:36.907 [2024-11-28 23:22:40.413080] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:36.907 [2024-11-28 23:22:40.413095] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:36.907 [2024-11-28 23:22:40.415250] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:36.907 [2024-11-28 23:22:40.424667] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:36.907 [2024-11-28 23:22:40.424884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-28 23:22:40.424996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-28 23:22:40.425025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:36.907 [2024-11-28 23:22:40.425042] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:36.907 [2024-11-28 23:22:40.425230] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:36.907 [2024-11-28 23:22:40.425466] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:36.907 [2024-11-28 23:22:40.425489] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:36.907 [2024-11-28 23:22:40.425504] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:36.907 [2024-11-28 23:22:40.427584] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:36.907 [2024-11-28 23:22:40.437504] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:36.907 [2024-11-28 23:22:40.437794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-28 23:22:40.437937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-28 23:22:40.437966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:36.907 [2024-11-28 23:22:40.437998] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:36.907 [2024-11-28 23:22:40.438184] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:36.907 [2024-11-28 23:22:40.438353] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:36.907 [2024-11-28 23:22:40.438378] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:36.907 [2024-11-28 23:22:40.438404] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:36.907 [2024-11-28 23:22:40.440853] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:36.907 [2024-11-28 23:22:40.449995] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:36.907 [2024-11-28 23:22:40.450294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-28 23:22:40.450448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-28 23:22:40.450476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:36.907 [2024-11-28 23:22:40.450493] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:36.907 [2024-11-28 23:22:40.450627] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:36.907 [2024-11-28 23:22:40.450808] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:36.907 [2024-11-28 23:22:40.450832] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:36.907 [2024-11-28 23:22:40.450854] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:36.907 [2024-11-28 23:22:40.453234] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:36.907 [2024-11-28 23:22:40.462468] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:36.907 [2024-11-28 23:22:40.462742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-28 23:22:40.462858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-28 23:22:40.462888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:36.907 [2024-11-28 23:22:40.462907] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:36.907 [2024-11-28 23:22:40.463055] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:36.907 [2024-11-28 23:22:40.463207] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:36.907 [2024-11-28 23:22:40.463231] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:36.907 [2024-11-28 23:22:40.463248] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:36.907 [2024-11-28 23:22:40.465720] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:36.907 [2024-11-28 23:22:40.474983] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:36.907 [2024-11-28 23:22:40.475298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-28 23:22:40.475453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-28 23:22:40.475482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:36.908 [2024-11-28 23:22:40.475499] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:36.908 [2024-11-28 23:22:40.475648] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:36.908 [2024-11-28 23:22:40.475868] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:36.908 [2024-11-28 23:22:40.475893] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:36.908 [2024-11-28 23:22:40.475909] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:36.908 [2024-11-28 23:22:40.478066] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:36.908 [2024-11-28 23:22:40.487574] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:36.908 [2024-11-28 23:22:40.487912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-28 23:22:40.488071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-28 23:22:40.488101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:36.908 [2024-11-28 23:22:40.488120] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:36.908 [2024-11-28 23:22:40.488268] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:36.908 [2024-11-28 23:22:40.488478] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:36.908 [2024-11-28 23:22:40.488501] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:36.908 [2024-11-28 23:22:40.488516] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:36.908 [2024-11-28 23:22:40.490905] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:36.908 [2024-11-28 23:22:40.500152] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:36.908 [2024-11-28 23:22:40.500449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-28 23:22:40.500539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-28 23:22:40.500567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:36.908 [2024-11-28 23:22:40.500585] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:36.908 [2024-11-28 23:22:40.500758] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:36.908 [2024-11-28 23:22:40.500982] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:36.908 [2024-11-28 23:22:40.501006] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:36.908 [2024-11-28 23:22:40.501022] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:36.908 [2024-11-28 23:22:40.503587] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.167 [2024-11-28 23:22:40.512812] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.167 [2024-11-28 23:22:40.513131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.167 [2024-11-28 23:22:40.513263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.167 [2024-11-28 23:22:40.513292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.167 [2024-11-28 23:22:40.513311] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.167 [2024-11-28 23:22:40.513526] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.167 [2024-11-28 23:22:40.513661] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.167 [2024-11-28 23:22:40.513685] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.167 [2024-11-28 23:22:40.513701] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.167 [2024-11-28 23:22:40.516142] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.167 [2024-11-28 23:22:40.525336] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.167 [2024-11-28 23:22:40.525625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.167 [2024-11-28 23:22:40.525865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.167 [2024-11-28 23:22:40.525916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.167 [2024-11-28 23:22:40.525935] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.167 [2024-11-28 23:22:40.526154] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.167 [2024-11-28 23:22:40.526342] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.167 [2024-11-28 23:22:40.526366] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.167 [2024-11-28 23:22:40.526382] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.167 [2024-11-28 23:22:40.528755] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.167 [2024-11-28 23:22:40.538177] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.167 [2024-11-28 23:22:40.538464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.167 [2024-11-28 23:22:40.538607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.168 [2024-11-28 23:22:40.538635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.168 [2024-11-28 23:22:40.538652] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.168 [2024-11-28 23:22:40.538853] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.168 [2024-11-28 23:22:40.539024] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.168 [2024-11-28 23:22:40.539048] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.168 [2024-11-28 23:22:40.539064] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.168 [2024-11-28 23:22:40.541496] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.168 [2024-11-28 23:22:40.550998] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.168 [2024-11-28 23:22:40.551290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.168 [2024-11-28 23:22:40.551411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.168 [2024-11-28 23:22:40.551457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.168 [2024-11-28 23:22:40.551485] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.168 [2024-11-28 23:22:40.551619] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.168 [2024-11-28 23:22:40.551843] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.168 [2024-11-28 23:22:40.551868] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.168 [2024-11-28 23:22:40.551884] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.168 [2024-11-28 23:22:40.554288] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.168 [2024-11-28 23:22:40.563401] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.168 [2024-11-28 23:22:40.563737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.168 [2024-11-28 23:22:40.563870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.168 [2024-11-28 23:22:40.563900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.168 [2024-11-28 23:22:40.563918] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.168 [2024-11-28 23:22:40.564085] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.168 [2024-11-28 23:22:40.564255] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.168 [2024-11-28 23:22:40.564279] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.168 [2024-11-28 23:22:40.564295] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.168 [2024-11-28 23:22:40.566723] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.168 [2024-11-28 23:22:40.576045] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.168 [2024-11-28 23:22:40.576325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.168 [2024-11-28 23:22:40.576449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.168 [2024-11-28 23:22:40.576482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.168 [2024-11-28 23:22:40.576500] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.168 [2024-11-28 23:22:40.576650] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.168 [2024-11-28 23:22:40.576783] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.168 [2024-11-28 23:22:40.576807] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.168 [2024-11-28 23:22:40.576823] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.168 [2024-11-28 23:22:40.579168] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.168 [2024-11-28 23:22:40.588448] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.168 [2024-11-28 23:22:40.588738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.168 [2024-11-28 23:22:40.588900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.168 [2024-11-28 23:22:40.588930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.168 [2024-11-28 23:22:40.588949] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.168 [2024-11-28 23:22:40.589080] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.168 [2024-11-28 23:22:40.589267] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.168 [2024-11-28 23:22:40.589291] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.168 [2024-11-28 23:22:40.589307] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.168 [2024-11-28 23:22:40.591739] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.168 [2024-11-28 23:22:40.600978] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.168 [2024-11-28 23:22:40.601300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.168 [2024-11-28 23:22:40.601438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.168 [2024-11-28 23:22:40.601470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.168 [2024-11-28 23:22:40.601489] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.168 [2024-11-28 23:22:40.601657] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.168 [2024-11-28 23:22:40.601826] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.168 [2024-11-28 23:22:40.601850] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.168 [2024-11-28 23:22:40.601874] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.168 [2024-11-28 23:22:40.604226] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.168 [2024-11-28 23:22:40.613546] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.168 [2024-11-28 23:22:40.613873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.168 [2024-11-28 23:22:40.613996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.168 [2024-11-28 23:22:40.614025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.168 [2024-11-28 23:22:40.614050] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.168 [2024-11-28 23:22:40.614181] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.168 [2024-11-28 23:22:40.614333] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.168 [2024-11-28 23:22:40.614357] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.168 [2024-11-28 23:22:40.614373] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.168 [2024-11-28 23:22:40.616465] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.168 [2024-11-28 23:22:40.626250] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.168 [2024-11-28 23:22:40.626556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.168 [2024-11-28 23:22:40.626685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.168 [2024-11-28 23:22:40.626714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.168 [2024-11-28 23:22:40.626732] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.168 [2024-11-28 23:22:40.626917] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.168 [2024-11-28 23:22:40.627086] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.168 [2024-11-28 23:22:40.627111] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.168 [2024-11-28 23:22:40.627127] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.168 [2024-11-28 23:22:40.629523] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.168 [2024-11-28 23:22:40.638859] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.168 [2024-11-28 23:22:40.639275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.168 [2024-11-28 23:22:40.639415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.168 [2024-11-28 23:22:40.639441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.168 [2024-11-28 23:22:40.639458] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.168 [2024-11-28 23:22:40.639636] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.168 [2024-11-28 23:22:40.639827] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.168 [2024-11-28 23:22:40.639851] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.168 [2024-11-28 23:22:40.639868] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.168 [2024-11-28 23:22:40.642080] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.168 [2024-11-28 23:22:40.651405] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.168 [2024-11-28 23:22:40.651757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.168 [2024-11-28 23:22:40.651886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.168 [2024-11-28 23:22:40.651916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.168 [2024-11-28 23:22:40.651946] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.169 [2024-11-28 23:22:40.652121] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.169 [2024-11-28 23:22:40.652327] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.169 [2024-11-28 23:22:40.652351] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.169 [2024-11-28 23:22:40.652368] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.169 [2024-11-28 23:22:40.654657] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.169 [2024-11-28 23:22:40.663984] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.169 [2024-11-28 23:22:40.664302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.169 [2024-11-28 23:22:40.664460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.169 [2024-11-28 23:22:40.664491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.169 [2024-11-28 23:22:40.664510] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.169 [2024-11-28 23:22:40.664694] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.169 [2024-11-28 23:22:40.664847] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.169 [2024-11-28 23:22:40.664871] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.169 [2024-11-28 23:22:40.664887] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.169 [2024-11-28 23:22:40.667166] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.169 [2024-11-28 23:22:40.676766] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.169 [2024-11-28 23:22:40.677067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.169 [2024-11-28 23:22:40.677195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.169 [2024-11-28 23:22:40.677224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.169 [2024-11-28 23:22:40.677242] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.169 [2024-11-28 23:22:40.677437] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.169 [2024-11-28 23:22:40.677662] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.169 [2024-11-28 23:22:40.677686] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.169 [2024-11-28 23:22:40.677702] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.169 [2024-11-28 23:22:40.680052] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.169 [2024-11-28 23:22:40.689257] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.169 [2024-11-28 23:22:40.689603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.169 [2024-11-28 23:22:40.689727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.169 [2024-11-28 23:22:40.689757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.169 [2024-11-28 23:22:40.689776] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.169 [2024-11-28 23:22:40.689969] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.169 [2024-11-28 23:22:40.690144] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.169 [2024-11-28 23:22:40.690169] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.169 [2024-11-28 23:22:40.690186] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.169 [2024-11-28 23:22:40.692600] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.169 [2024-11-28 23:22:40.701938] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.169 [2024-11-28 23:22:40.702255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.169 [2024-11-28 23:22:40.702387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.169 [2024-11-28 23:22:40.702425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.169 [2024-11-28 23:22:40.702444] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.169 [2024-11-28 23:22:40.702592] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.169 [2024-11-28 23:22:40.702780] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.169 [2024-11-28 23:22:40.702804] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.169 [2024-11-28 23:22:40.702820] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.169 [2024-11-28 23:22:40.705226] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.169 [2024-11-28 23:22:40.714493] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.169 [2024-11-28 23:22:40.714808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.169 [2024-11-28 23:22:40.714916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.169 [2024-11-28 23:22:40.714947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.169 [2024-11-28 23:22:40.714966] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.169 [2024-11-28 23:22:40.715168] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.169 [2024-11-28 23:22:40.715337] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.169 [2024-11-28 23:22:40.715362] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.169 [2024-11-28 23:22:40.715378] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.169 [2024-11-28 23:22:40.717647] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.169 [2024-11-28 23:22:40.727095] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.169 [2024-11-28 23:22:40.727399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.169 [2024-11-28 23:22:40.727544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.169 [2024-11-28 23:22:40.727574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.169 [2024-11-28 23:22:40.727593] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.169 [2024-11-28 23:22:40.727759] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.169 [2024-11-28 23:22:40.727929] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.169 [2024-11-28 23:22:40.727959] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.169 [2024-11-28 23:22:40.727976] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.169 [2024-11-28 23:22:40.730219] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.169 [2024-11-28 23:22:40.739599] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.169 [2024-11-28 23:22:40.739914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.169 [2024-11-28 23:22:40.740020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.169 [2024-11-28 23:22:40.740051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.169 [2024-11-28 23:22:40.740070] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.169 [2024-11-28 23:22:40.740236] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.169 [2024-11-28 23:22:40.740416] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.169 [2024-11-28 23:22:40.740442] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.169 [2024-11-28 23:22:40.740459] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.169 [2024-11-28 23:22:40.742828] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.169 [2024-11-28 23:22:40.752370] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.169 [2024-11-28 23:22:40.752696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.169 [2024-11-28 23:22:40.752850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.169 [2024-11-28 23:22:40.752880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.169 [2024-11-28 23:22:40.752899] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.169 [2024-11-28 23:22:40.753029] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.169 [2024-11-28 23:22:40.753218] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.169 [2024-11-28 23:22:40.753242] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.169 [2024-11-28 23:22:40.753258] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.169 [2024-11-28 23:22:40.755637] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.169 [2024-11-28 23:22:40.764875] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.169 [2024-11-28 23:22:40.765209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.169 [2024-11-28 23:22:40.765314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.169 [2024-11-28 23:22:40.765345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.169 [2024-11-28 23:22:40.765363] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.169 [2024-11-28 23:22:40.765591] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.169 [2024-11-28 23:22:40.765745] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.169 [2024-11-28 23:22:40.765769] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.169 [2024-11-28 23:22:40.765791] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.170 [2024-11-28 23:22:40.768143] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.429 [2024-11-28 23:22:40.777526] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.429 [2024-11-28 23:22:40.777818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.429 [2024-11-28 23:22:40.777925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.429 [2024-11-28 23:22:40.777956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.429 [2024-11-28 23:22:40.777975] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.429 [2024-11-28 23:22:40.778105] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.429 [2024-11-28 23:22:40.778312] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.429 [2024-11-28 23:22:40.778336] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.430 [2024-11-28 23:22:40.778352] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.430 [2024-11-28 23:22:40.780649] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.430 [2024-11-28 23:22:40.790212] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.430 [2024-11-28 23:22:40.790533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.430 [2024-11-28 23:22:40.790629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.430 [2024-11-28 23:22:40.790657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.430 [2024-11-28 23:22:40.790674] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.430 [2024-11-28 23:22:40.790864] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.430 [2024-11-28 23:22:40.791053] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.430 [2024-11-28 23:22:40.791077] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.430 [2024-11-28 23:22:40.791093] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.430 [2024-11-28 23:22:40.793301] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.430 [2024-11-28 23:22:40.802697] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.430 [2024-11-28 23:22:40.803063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.430 [2024-11-28 23:22:40.803217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.430 [2024-11-28 23:22:40.803245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.430 [2024-11-28 23:22:40.803263] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.430 [2024-11-28 23:22:40.803456] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.430 [2024-11-28 23:22:40.803609] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.430 [2024-11-28 23:22:40.803633] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.430 [2024-11-28 23:22:40.803648] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.430 [2024-11-28 23:22:40.806021] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.430 [2024-11-28 23:22:40.815306] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.430 [2024-11-28 23:22:40.815596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.430 [2024-11-28 23:22:40.815695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.430 [2024-11-28 23:22:40.815725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.430 [2024-11-28 23:22:40.815744] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.430 [2024-11-28 23:22:40.815874] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.430 [2024-11-28 23:22:40.816027] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.430 [2024-11-28 23:22:40.816051] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.430 [2024-11-28 23:22:40.816067] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.430 [2024-11-28 23:22:40.818316] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.430 [2024-11-28 23:22:40.827751] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.430 [2024-11-28 23:22:40.828047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.430 [2024-11-28 23:22:40.828178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.430 [2024-11-28 23:22:40.828207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.430 [2024-11-28 23:22:40.828226] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.430 [2024-11-28 23:22:40.828375] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.430 [2024-11-28 23:22:40.828520] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.430 [2024-11-28 23:22:40.828545] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.430 [2024-11-28 23:22:40.828562] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.430 [2024-11-28 23:22:40.830837] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.430 [2024-11-28 23:22:40.840498] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.430 [2024-11-28 23:22:40.840774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.430 [2024-11-28 23:22:40.840951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.430 [2024-11-28 23:22:40.840980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.430 [2024-11-28 23:22:40.840998] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.430 [2024-11-28 23:22:40.841164] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.430 [2024-11-28 23:22:40.841281] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.430 [2024-11-28 23:22:40.841304] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.430 [2024-11-28 23:22:40.841321] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.430 [2024-11-28 23:22:40.843668] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.430 [2024-11-28 23:22:40.852853] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.430 [2024-11-28 23:22:40.853168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.430 [2024-11-28 23:22:40.853265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.430 [2024-11-28 23:22:40.853297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.430 [2024-11-28 23:22:40.853316] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.430 [2024-11-28 23:22:40.853476] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.430 [2024-11-28 23:22:40.853575] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.430 [2024-11-28 23:22:40.853599] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.430 [2024-11-28 23:22:40.853615] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.430 [2024-11-28 23:22:40.856056] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.430 [2024-11-28 23:22:40.865522] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.430 [2024-11-28 23:22:40.865828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.430 [2024-11-28 23:22:40.865956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.430 [2024-11-28 23:22:40.865986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.430 [2024-11-28 23:22:40.866005] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.430 [2024-11-28 23:22:40.866189] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.430 [2024-11-28 23:22:40.866341] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.430 [2024-11-28 23:22:40.866365] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.430 [2024-11-28 23:22:40.866381] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.430 [2024-11-28 23:22:40.868670] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.430 [2024-11-28 23:22:40.878098] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.430 [2024-11-28 23:22:40.878467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.430 [2024-11-28 23:22:40.878592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.430 [2024-11-28 23:22:40.878633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.430 [2024-11-28 23:22:40.878649] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.430 [2024-11-28 23:22:40.878794] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.430 [2024-11-28 23:22:40.879003] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.430 [2024-11-28 23:22:40.879035] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.430 [2024-11-28 23:22:40.879051] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.430 [2024-11-28 23:22:40.881465] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.430 [2024-11-28 23:22:40.890782] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.430 [2024-11-28 23:22:40.891118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.430 [2024-11-28 23:22:40.891253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.430 [2024-11-28 23:22:40.891283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.430 [2024-11-28 23:22:40.891303] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.430 [2024-11-28 23:22:40.891427] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.430 [2024-11-28 23:22:40.891598] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.430 [2024-11-28 23:22:40.891622] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.430 [2024-11-28 23:22:40.891638] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.430 [2024-11-28 23:22:40.894061] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.430 [2024-11-28 23:22:40.903343] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.431 [2024-11-28 23:22:40.903675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.431 [2024-11-28 23:22:40.903779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.431 [2024-11-28 23:22:40.903820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.431 [2024-11-28 23:22:40.903836] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.431 [2024-11-28 23:22:40.904008] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.431 [2024-11-28 23:22:40.904181] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.431 [2024-11-28 23:22:40.904206] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.431 [2024-11-28 23:22:40.904222] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.431 [2024-11-28 23:22:40.906376] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.431 [2024-11-28 23:22:40.915979] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.431 [2024-11-28 23:22:40.916297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.431 [2024-11-28 23:22:40.916428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.431 [2024-11-28 23:22:40.916459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.431 [2024-11-28 23:22:40.916478] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.431 [2024-11-28 23:22:40.916679] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.431 [2024-11-28 23:22:40.916867] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.431 [2024-11-28 23:22:40.916891] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.431 [2024-11-28 23:22:40.916907] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.431 [2024-11-28 23:22:40.919204] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.431 [2024-11-28 23:22:40.928302] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.431 [2024-11-28 23:22:40.928597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.431 [2024-11-28 23:22:40.928766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.431 [2024-11-28 23:22:40.928800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.431 [2024-11-28 23:22:40.928820] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.431 [2024-11-28 23:22:40.928969] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.431 [2024-11-28 23:22:40.929121] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.431 [2024-11-28 23:22:40.929145] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.431 [2024-11-28 23:22:40.929163] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.431 [2024-11-28 23:22:40.931617] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.431 [2024-11-28 23:22:40.940872] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.431 [2024-11-28 23:22:40.941185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.431 [2024-11-28 23:22:40.941336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.431 [2024-11-28 23:22:40.941362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.431 [2024-11-28 23:22:40.941378] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.431 [2024-11-28 23:22:40.941581] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.431 [2024-11-28 23:22:40.941752] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.431 [2024-11-28 23:22:40.941776] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.431 [2024-11-28 23:22:40.941792] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.431 [2024-11-28 23:22:40.943985] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.431 [2024-11-28 23:22:40.953494] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.431 [2024-11-28 23:22:40.953783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.431 [2024-11-28 23:22:40.953927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.431 [2024-11-28 23:22:40.953969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.431 [2024-11-28 23:22:40.953986] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.431 [2024-11-28 23:22:40.954210] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.431 [2024-11-28 23:22:40.954440] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.431 [2024-11-28 23:22:40.954466] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.431 [2024-11-28 23:22:40.954482] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.431 [2024-11-28 23:22:40.956867] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.431 [2024-11-28 23:22:40.966074] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.431 [2024-11-28 23:22:40.966326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.431 [2024-11-28 23:22:40.966488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.431 [2024-11-28 23:22:40.966518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.431 [2024-11-28 23:22:40.966542] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.431 [2024-11-28 23:22:40.966690] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.431 [2024-11-28 23:22:40.966788] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.431 [2024-11-28 23:22:40.966812] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.431 [2024-11-28 23:22:40.966828] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.431 [2024-11-28 23:22:40.969107] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.431 [2024-11-28 23:22:40.978678] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.431 [2024-11-28 23:22:40.978978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.431 [2024-11-28 23:22:40.979083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.431 [2024-11-28 23:22:40.979112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.431 [2024-11-28 23:22:40.979130] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.431 [2024-11-28 23:22:40.979314] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.431 [2024-11-28 23:22:40.979516] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.431 [2024-11-28 23:22:40.979542] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.431 [2024-11-28 23:22:40.979559] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.431 [2024-11-28 23:22:40.981807] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.431 [2024-11-28 23:22:40.991408] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.431 [2024-11-28 23:22:40.991736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.431 [2024-11-28 23:22:40.991887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.431 [2024-11-28 23:22:40.991916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.431 [2024-11-28 23:22:40.991935] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.431 [2024-11-28 23:22:40.992115] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.431 [2024-11-28 23:22:40.992302] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.431 [2024-11-28 23:22:40.992328] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.431 [2024-11-28 23:22:40.992344] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.431 [2024-11-28 23:22:40.994546] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.431 [2024-11-28 23:22:41.004017] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.431 [2024-11-28 23:22:41.004330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.431 [2024-11-28 23:22:41.004467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.431 [2024-11-28 23:22:41.004498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.431 [2024-11-28 23:22:41.004517] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.431 [2024-11-28 23:22:41.004636] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.431 [2024-11-28 23:22:41.004806] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.431 [2024-11-28 23:22:41.004830] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.431 [2024-11-28 23:22:41.004846] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.431 [2024-11-28 23:22:41.007077] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.431 [2024-11-28 23:22:41.016643] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.431 [2024-11-28 23:22:41.016939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.431 [2024-11-28 23:22:41.017100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.431 [2024-11-28 23:22:41.017131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.432 [2024-11-28 23:22:41.017150] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.432 [2024-11-28 23:22:41.017335] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.432 [2024-11-28 23:22:41.017537] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.432 [2024-11-28 23:22:41.017564] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.432 [2024-11-28 23:22:41.017581] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.432 [2024-11-28 23:22:41.019935] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.432 [2024-11-28 23:22:41.029039] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.432 [2024-11-28 23:22:41.029295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.432 [2024-11-28 23:22:41.029434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.432 [2024-11-28 23:22:41.029464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.432 [2024-11-28 23:22:41.029483] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.432 [2024-11-28 23:22:41.029615] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.432 [2024-11-28 23:22:41.029785] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.432 [2024-11-28 23:22:41.029810] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.432 [2024-11-28 23:22:41.029827] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.432 [2024-11-28 23:22:41.032075] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.692 [2024-11-28 23:22:41.041741] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.692 [2024-11-28 23:22:41.042075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.692 [2024-11-28 23:22:41.042233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.692 [2024-11-28 23:22:41.042263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.692 [2024-11-28 23:22:41.042281] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.692 [2024-11-28 23:22:41.042485] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.692 [2024-11-28 23:22:41.042625] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.692 [2024-11-28 23:22:41.042649] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.692 [2024-11-28 23:22:41.042665] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.692 [2024-11-28 23:22:41.045001] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.692 [2024-11-28 23:22:41.054269] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.692 [2024-11-28 23:22:41.054593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.692 [2024-11-28 23:22:41.054720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.692 [2024-11-28 23:22:41.054749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.692 [2024-11-28 23:22:41.054767] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.692 [2024-11-28 23:22:41.054951] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.692 [2024-11-28 23:22:41.055103] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.692 [2024-11-28 23:22:41.055129] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.692 [2024-11-28 23:22:41.055145] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.692 [2024-11-28 23:22:41.057269] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.692 [2024-11-28 23:22:41.066892] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.692 [2024-11-28 23:22:41.067201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.692 [2024-11-28 23:22:41.067309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.692 [2024-11-28 23:22:41.067337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.692 [2024-11-28 23:22:41.067355] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.692 [2024-11-28 23:22:41.067535] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.692 [2024-11-28 23:22:41.067705] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.692 [2024-11-28 23:22:41.067730] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.692 [2024-11-28 23:22:41.067747] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.692 [2024-11-28 23:22:41.069902] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.692 [2024-11-28 23:22:41.079401] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.692 [2024-11-28 23:22:41.079673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.692 [2024-11-28 23:22:41.079845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.692 [2024-11-28 23:22:41.079874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.692 [2024-11-28 23:22:41.079891] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.692 [2024-11-28 23:22:41.080023] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.692 [2024-11-28 23:22:41.080230] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.692 [2024-11-28 23:22:41.080262] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.692 [2024-11-28 23:22:41.080280] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.692 [2024-11-28 23:22:41.082553] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.692 [2024-11-28 23:22:41.092173] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.692 [2024-11-28 23:22:41.092486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.692 [2024-11-28 23:22:41.092621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.692 [2024-11-28 23:22:41.092650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.692 [2024-11-28 23:22:41.092669] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.692 [2024-11-28 23:22:41.092853] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.692 [2024-11-28 23:22:41.093024] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.692 [2024-11-28 23:22:41.093049] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.692 [2024-11-28 23:22:41.093065] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.692 [2024-11-28 23:22:41.095464] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.692 [2024-11-28 23:22:41.104778] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.692 [2024-11-28 23:22:41.105116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.692 [2024-11-28 23:22:41.105245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.692 [2024-11-28 23:22:41.105276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.692 [2024-11-28 23:22:41.105295] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.692 [2024-11-28 23:22:41.105389] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.692 [2024-11-28 23:22:41.105537] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.692 [2024-11-28 23:22:41.105561] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.692 [2024-11-28 23:22:41.105577] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.692 [2024-11-28 23:22:41.107967] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.692 [2024-11-28 23:22:41.117303] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.692 [2024-11-28 23:22:41.117630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.692 [2024-11-28 23:22:41.117753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.692 [2024-11-28 23:22:41.117785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.692 [2024-11-28 23:22:41.117804] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.692 [2024-11-28 23:22:41.117953] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.692 [2024-11-28 23:22:41.118122] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.692 [2024-11-28 23:22:41.118148] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.692 [2024-11-28 23:22:41.118172] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.692 [2024-11-28 23:22:41.120387] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.692 [2024-11-28 23:22:41.129827] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.692 [2024-11-28 23:22:41.130153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.692 [2024-11-28 23:22:41.130252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.692 [2024-11-28 23:22:41.130281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.692 [2024-11-28 23:22:41.130300] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.692 [2024-11-28 23:22:41.130463] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.692 [2024-11-28 23:22:41.130634] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.692 [2024-11-28 23:22:41.130660] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.692 [2024-11-28 23:22:41.130677] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.692 [2024-11-28 23:22:41.133068] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.692 [2024-11-28 23:22:41.142480] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.692 [2024-11-28 23:22:41.142823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.692 [2024-11-28 23:22:41.142977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.692 [2024-11-28 23:22:41.143006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.692 [2024-11-28 23:22:41.143024] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.692 [2024-11-28 23:22:41.143154] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.692 [2024-11-28 23:22:41.143323] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.692 [2024-11-28 23:22:41.143346] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.692 [2024-11-28 23:22:41.143362] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.692 [2024-11-28 23:22:41.145673] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.692 [2024-11-28 23:22:41.155053] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.692 [2024-11-28 23:22:41.155360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.692 [2024-11-28 23:22:41.155505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.692 [2024-11-28 23:22:41.155536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.692 [2024-11-28 23:22:41.155555] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.692 [2024-11-28 23:22:41.155686] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.692 [2024-11-28 23:22:41.155873] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.692 [2024-11-28 23:22:41.155898] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.692 [2024-11-28 23:22:41.155915] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.692 [2024-11-28 23:22:41.158343] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.692 [2024-11-28 23:22:41.167491] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.692 [2024-11-28 23:22:41.167764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.692 [2024-11-28 23:22:41.167942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.692 [2024-11-28 23:22:41.167969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.692 [2024-11-28 23:22:41.167986] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.692 [2024-11-28 23:22:41.168131] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.692 [2024-11-28 23:22:41.168353] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.692 [2024-11-28 23:22:41.168379] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.692 [2024-11-28 23:22:41.168409] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.692 [2024-11-28 23:22:41.170607] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.692 [2024-11-28 23:22:41.180082] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.692 [2024-11-28 23:22:41.180419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.692 [2024-11-28 23:22:41.180625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.692 [2024-11-28 23:22:41.180685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.692 [2024-11-28 23:22:41.180704] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.692 [2024-11-28 23:22:41.180853] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.692 [2024-11-28 23:22:41.181005] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.692 [2024-11-28 23:22:41.181030] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.692 [2024-11-28 23:22:41.181047] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.692 [2024-11-28 23:22:41.183313] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.692 [2024-11-28 23:22:41.192584] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.692 [2024-11-28 23:22:41.192920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.692 [2024-11-28 23:22:41.193075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.692 [2024-11-28 23:22:41.193103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.692 [2024-11-28 23:22:41.193121] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.692 [2024-11-28 23:22:41.193341] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.693 [2024-11-28 23:22:41.193507] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.693 [2024-11-28 23:22:41.193533] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.693 [2024-11-28 23:22:41.193551] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.693 [2024-11-28 23:22:41.195815] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.693 [2024-11-28 23:22:41.205158] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.693 [2024-11-28 23:22:41.205519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.693 [2024-11-28 23:22:41.205677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.693 [2024-11-28 23:22:41.205707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.693 [2024-11-28 23:22:41.205726] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.693 [2024-11-28 23:22:41.205892] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.693 [2024-11-28 23:22:41.206062] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.693 [2024-11-28 23:22:41.206088] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.693 [2024-11-28 23:22:41.206104] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.693 [2024-11-28 23:22:41.208469] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.693 [2024-11-28 23:22:41.217706] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.693 [2024-11-28 23:22:41.218002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.693 [2024-11-28 23:22:41.218126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.693 [2024-11-28 23:22:41.218155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.693 [2024-11-28 23:22:41.218174] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.693 [2024-11-28 23:22:41.218286] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.693 [2024-11-28 23:22:41.218450] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.693 [2024-11-28 23:22:41.218476] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.693 [2024-11-28 23:22:41.218492] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.693 [2024-11-28 23:22:41.220907] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.693 [2024-11-28 23:22:41.230247] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.693 [2024-11-28 23:22:41.230609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.693 [2024-11-28 23:22:41.230742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.693 [2024-11-28 23:22:41.230772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.693 [2024-11-28 23:22:41.230790] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.693 [2024-11-28 23:22:41.230991] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.693 [2024-11-28 23:22:41.231144] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.693 [2024-11-28 23:22:41.231168] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.693 [2024-11-28 23:22:41.231185] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.693 [2024-11-28 23:22:41.233535] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.693 [2024-11-28 23:22:41.242792] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.693 [2024-11-28 23:22:41.243071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.693 [2024-11-28 23:22:41.243208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.693 [2024-11-28 23:22:41.243238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.693 [2024-11-28 23:22:41.243257] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.693 [2024-11-28 23:22:41.243387] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.693 [2024-11-28 23:22:41.243570] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.693 [2024-11-28 23:22:41.243595] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.693 [2024-11-28 23:22:41.243611] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.693 [2024-11-28 23:22:41.245854] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.693 [2024-11-28 23:22:41.255265] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.693 [2024-11-28 23:22:41.255559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.693 [2024-11-28 23:22:41.255694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.693 [2024-11-28 23:22:41.255724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.693 [2024-11-28 23:22:41.255743] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.693 [2024-11-28 23:22:41.255927] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.693 [2024-11-28 23:22:41.256080] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.693 [2024-11-28 23:22:41.256105] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.693 [2024-11-28 23:22:41.256122] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.693 [2024-11-28 23:22:41.258511] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.693 [2024-11-28 23:22:41.267997] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.693 [2024-11-28 23:22:41.268383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.693 [2024-11-28 23:22:41.268525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.693 [2024-11-28 23:22:41.268555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.693 [2024-11-28 23:22:41.268574] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.693 [2024-11-28 23:22:41.268775] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.693 [2024-11-28 23:22:41.268944] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.693 [2024-11-28 23:22:41.268968] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.693 [2024-11-28 23:22:41.268985] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.693 [2024-11-28 23:22:41.271441] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.693 [2024-11-28 23:22:41.280817] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.693 [2024-11-28 23:22:41.281130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.693 [2024-11-28 23:22:41.281267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.693 [2024-11-28 23:22:41.281296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.693 [2024-11-28 23:22:41.281320] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.693 [2024-11-28 23:22:41.281519] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.693 [2024-11-28 23:22:41.281690] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.693 [2024-11-28 23:22:41.281715] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.693 [2024-11-28 23:22:41.281731] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.693 [2024-11-28 23:22:41.284176] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.693 [2024-11-28 23:22:41.293483] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.693 [2024-11-28 23:22:41.293781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.693 [2024-11-28 23:22:41.293919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.693 [2024-11-28 23:22:41.293948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.693 [2024-11-28 23:22:41.293967] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.693 [2024-11-28 23:22:41.294115] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.693 [2024-11-28 23:22:41.294231] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.693 [2024-11-28 23:22:41.294255] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.693 [2024-11-28 23:22:41.294271] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.952 [2024-11-28 23:22:41.296422] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.952 [2024-11-28 23:22:41.306225] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.952 [2024-11-28 23:22:41.306539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.952 [2024-11-28 23:22:41.306671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.952 [2024-11-28 23:22:41.306699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.952 [2024-11-28 23:22:41.306717] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.952 [2024-11-28 23:22:41.306854] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.952 [2024-11-28 23:22:41.307043] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.952 [2024-11-28 23:22:41.307068] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.952 [2024-11-28 23:22:41.307084] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.952 [2024-11-28 23:22:41.309239] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.952 [2024-11-28 23:22:41.318760] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.952 [2024-11-28 23:22:41.319125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.952 [2024-11-28 23:22:41.319267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.952 [2024-11-28 23:22:41.319296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.952 [2024-11-28 23:22:41.319315] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.952 [2024-11-28 23:22:41.319461] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.952 [2024-11-28 23:22:41.319656] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.952 [2024-11-28 23:22:41.319680] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.952 [2024-11-28 23:22:41.319697] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.952 [2024-11-28 23:22:41.322076] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.952 [2024-11-28 23:22:41.331261] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.952 [2024-11-28 23:22:41.331561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.952 [2024-11-28 23:22:41.331689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.952 [2024-11-28 23:22:41.331719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.952 [2024-11-28 23:22:41.331737] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.952 [2024-11-28 23:22:41.331903] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.952 [2024-11-28 23:22:41.332091] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.952 [2024-11-28 23:22:41.332116] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.952 [2024-11-28 23:22:41.332132] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.952 [2024-11-28 23:22:41.334587] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.952 [2024-11-28 23:22:41.343924] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.952 [2024-11-28 23:22:41.344239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.952 [2024-11-28 23:22:41.344374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.952 [2024-11-28 23:22:41.344414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.952 [2024-11-28 23:22:41.344434] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.952 [2024-11-28 23:22:41.344566] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.952 [2024-11-28 23:22:41.344753] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.952 [2024-11-28 23:22:41.344778] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.952 [2024-11-28 23:22:41.344794] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.952 [2024-11-28 23:22:41.346823] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.952 [2024-11-28 23:22:41.356373] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.952 [2024-11-28 23:22:41.356718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.952 [2024-11-28 23:22:41.356876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.952 [2024-11-28 23:22:41.356905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.952 [2024-11-28 23:22:41.356924] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.952 [2024-11-28 23:22:41.357144] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.952 [2024-11-28 23:22:41.357319] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.952 [2024-11-28 23:22:41.357344] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.952 [2024-11-28 23:22:41.357361] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.952 [2024-11-28 23:22:41.359743] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.952 [2024-11-28 23:22:41.368985] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.953 [2024-11-28 23:22:41.369309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.953 [2024-11-28 23:22:41.369494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.953 [2024-11-28 23:22:41.369522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.953 [2024-11-28 23:22:41.369540] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.953 [2024-11-28 23:22:41.369701] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.953 [2024-11-28 23:22:41.369944] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.953 [2024-11-28 23:22:41.369970] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.953 [2024-11-28 23:22:41.369987] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.953 [2024-11-28 23:22:41.372161] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.953 [2024-11-28 23:22:41.381560] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.953 [2024-11-28 23:22:41.381875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.953 [2024-11-28 23:22:41.381984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.953 [2024-11-28 23:22:41.382014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.953 [2024-11-28 23:22:41.382033] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.953 [2024-11-28 23:22:41.382181] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.953 [2024-11-28 23:22:41.382368] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.953 [2024-11-28 23:22:41.382404] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.953 [2024-11-28 23:22:41.382424] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.953 [2024-11-28 23:22:41.384695] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.953 [2024-11-28 23:22:41.394127] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.953 [2024-11-28 23:22:41.394473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.953 [2024-11-28 23:22:41.394638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.953 [2024-11-28 23:22:41.394667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.953 [2024-11-28 23:22:41.394685] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.953 [2024-11-28 23:22:41.394833] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.953 [2024-11-28 23:22:41.394967] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.953 [2024-11-28 23:22:41.394996] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.953 [2024-11-28 23:22:41.395012] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.953 [2024-11-28 23:22:41.397275] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.953 [2024-11-28 23:22:41.406576] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.953 [2024-11-28 23:22:41.406903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.953 [2024-11-28 23:22:41.407037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.953 [2024-11-28 23:22:41.407068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.953 [2024-11-28 23:22:41.407087] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.953 [2024-11-28 23:22:41.407236] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.953 [2024-11-28 23:22:41.407388] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.953 [2024-11-28 23:22:41.407425] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.953 [2024-11-28 23:22:41.407441] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.953 [2024-11-28 23:22:41.409722] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.953 [2024-11-28 23:22:41.419026] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.953 [2024-11-28 23:22:41.419341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.953 [2024-11-28 23:22:41.419509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.953 [2024-11-28 23:22:41.419541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.953 [2024-11-28 23:22:41.419560] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.953 [2024-11-28 23:22:41.419690] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.953 [2024-11-28 23:22:41.419859] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.953 [2024-11-28 23:22:41.419884] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.953 [2024-11-28 23:22:41.419901] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.953 [2024-11-28 23:22:41.422187] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.953 [2024-11-28 23:22:41.431617] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.953 [2024-11-28 23:22:41.431932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.953 [2024-11-28 23:22:41.432087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.953 [2024-11-28 23:22:41.432117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.953 [2024-11-28 23:22:41.432136] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.953 [2024-11-28 23:22:41.432285] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.953 [2024-11-28 23:22:41.432486] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.953 [2024-11-28 23:22:41.432533] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.953 [2024-11-28 23:22:41.432557] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.953 [2024-11-28 23:22:41.435091] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.953 [2024-11-28 23:22:41.444107] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.953 [2024-11-28 23:22:41.444453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.953 [2024-11-28 23:22:41.444613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.953 [2024-11-28 23:22:41.444641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.953 [2024-11-28 23:22:41.444659] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.953 [2024-11-28 23:22:41.444772] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.953 [2024-11-28 23:22:41.444959] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.953 [2024-11-28 23:22:41.444983] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.953 [2024-11-28 23:22:41.444999] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.953 [2024-11-28 23:22:41.447192] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.953 [2024-11-28 23:22:41.456802] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.953 [2024-11-28 23:22:41.457139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.953 [2024-11-28 23:22:41.457296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.953 [2024-11-28 23:22:41.457327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.953 [2024-11-28 23:22:41.457346] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.953 [2024-11-28 23:22:41.457525] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.953 [2024-11-28 23:22:41.457678] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.953 [2024-11-28 23:22:41.457703] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.953 [2024-11-28 23:22:41.457721] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.953 [2024-11-28 23:22:41.459946] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.953 [2024-11-28 23:22:41.469412] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.953 [2024-11-28 23:22:41.469735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.953 [2024-11-28 23:22:41.469903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.953 [2024-11-28 23:22:41.469933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.953 [2024-11-28 23:22:41.469953] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.953 [2024-11-28 23:22:41.470119] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.953 [2024-11-28 23:22:41.470252] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.953 [2024-11-28 23:22:41.470275] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.953 [2024-11-28 23:22:41.470291] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.953 [2024-11-28 23:22:41.472640] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.953 [2024-11-28 23:22:41.481910] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.953 [2024-11-28 23:22:41.482185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.953 [2024-11-28 23:22:41.482308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.953 [2024-11-28 23:22:41.482339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.953 [2024-11-28 23:22:41.482358] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.953 [2024-11-28 23:22:41.482526] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.954 [2024-11-28 23:22:41.482710] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.954 [2024-11-28 23:22:41.482737] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.954 [2024-11-28 23:22:41.482754] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.954 [2024-11-28 23:22:41.485094] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.954 [2024-11-28 23:22:41.494268] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.954 [2024-11-28 23:22:41.494558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.954 [2024-11-28 23:22:41.494687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.954 [2024-11-28 23:22:41.494715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.954 [2024-11-28 23:22:41.494732] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.954 [2024-11-28 23:22:41.494882] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.954 [2024-11-28 23:22:41.495051] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.954 [2024-11-28 23:22:41.495074] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.954 [2024-11-28 23:22:41.495089] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.954 [2024-11-28 23:22:41.497262] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.954 [2024-11-28 23:22:41.506519] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.954 [2024-11-28 23:22:41.506852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.954 [2024-11-28 23:22:41.507004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.954 [2024-11-28 23:22:41.507033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.954 [2024-11-28 23:22:41.507050] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.954 [2024-11-28 23:22:41.507230] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.954 [2024-11-28 23:22:41.507359] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.954 [2024-11-28 23:22:41.507379] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.954 [2024-11-28 23:22:41.507403] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.954 [2024-11-28 23:22:41.509792] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.954 [2024-11-28 23:22:41.519073] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.954 [2024-11-28 23:22:41.519432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.954 [2024-11-28 23:22:41.519592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.954 [2024-11-28 23:22:41.519644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.954 [2024-11-28 23:22:41.519663] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.954 [2024-11-28 23:22:41.519829] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.954 [2024-11-28 23:22:41.519963] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.954 [2024-11-28 23:22:41.519987] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.954 [2024-11-28 23:22:41.520002] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.954 [2024-11-28 23:22:41.522365] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.954 [2024-11-28 23:22:41.531727] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.954 [2024-11-28 23:22:41.532082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.954 [2024-11-28 23:22:41.532214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.954 [2024-11-28 23:22:41.532245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.954 [2024-11-28 23:22:41.532265] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.954 [2024-11-28 23:22:41.532460] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.954 [2024-11-28 23:22:41.532604] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.954 [2024-11-28 23:22:41.532626] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.954 [2024-11-28 23:22:41.532640] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.954 [2024-11-28 23:22:41.535073] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:37.954 [2024-11-28 23:22:41.544334] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:37.954 [2024-11-28 23:22:41.544681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.954 [2024-11-28 23:22:41.544864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.954 [2024-11-28 23:22:41.544892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:37.954 [2024-11-28 23:22:41.544910] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:37.954 [2024-11-28 23:22:41.545082] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:37.954 [2024-11-28 23:22:41.545257] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.954 [2024-11-28 23:22:41.545280] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.954 [2024-11-28 23:22:41.545296] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.954 [2024-11-28 23:22:41.547528] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.213 [2024-11-28 23:22:41.556951] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.213 [2024-11-28 23:22:41.557341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.213 [2024-11-28 23:22:41.557493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.213 [2024-11-28 23:22:41.557521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.213 [2024-11-28 23:22:41.557538] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.213 [2024-11-28 23:22:41.557702] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.213 [2024-11-28 23:22:41.557901] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.213 [2024-11-28 23:22:41.557926] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.213 [2024-11-28 23:22:41.557942] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.213 [2024-11-28 23:22:41.560295] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.213 [2024-11-28 23:22:41.569634] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.213 [2024-11-28 23:22:41.569983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.213 [2024-11-28 23:22:41.570136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.213 [2024-11-28 23:22:41.570166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.213 [2024-11-28 23:22:41.570185] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.213 [2024-11-28 23:22:41.570333] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.213 [2024-11-28 23:22:41.570470] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.213 [2024-11-28 23:22:41.570493] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.213 [2024-11-28 23:22:41.570508] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.213 [2024-11-28 23:22:41.572798] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.213 [2024-11-28 23:22:41.582047] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.213 [2024-11-28 23:22:41.582374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.213 [2024-11-28 23:22:41.582507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.213 [2024-11-28 23:22:41.582537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.213 [2024-11-28 23:22:41.582556] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.213 [2024-11-28 23:22:41.582739] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.214 [2024-11-28 23:22:41.582910] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.214 [2024-11-28 23:22:41.582936] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.214 [2024-11-28 23:22:41.582953] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.214 [2024-11-28 23:22:41.585159] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.214 [2024-11-28 23:22:41.594657] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.214 [2024-11-28 23:22:41.594997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.214 [2024-11-28 23:22:41.595138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.214 [2024-11-28 23:22:41.595170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.214 [2024-11-28 23:22:41.595187] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.214 [2024-11-28 23:22:41.595351] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.214 [2024-11-28 23:22:41.595475] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.214 [2024-11-28 23:22:41.595500] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.214 [2024-11-28 23:22:41.595517] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.214 [2024-11-28 23:22:41.597761] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.214 [2024-11-28 23:22:41.607365] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.214 [2024-11-28 23:22:41.607758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.214 [2024-11-28 23:22:41.607921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.214 [2024-11-28 23:22:41.607966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.214 [2024-11-28 23:22:41.607985] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.214 [2024-11-28 23:22:41.608150] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.214 [2024-11-28 23:22:41.608390] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.214 [2024-11-28 23:22:41.608440] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.214 [2024-11-28 23:22:41.608457] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.214 [2024-11-28 23:22:41.610845] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.214 [2024-11-28 23:22:41.619970] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.214 [2024-11-28 23:22:41.620227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.214 [2024-11-28 23:22:41.620385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.214 [2024-11-28 23:22:41.620424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.214 [2024-11-28 23:22:41.620450] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.214 [2024-11-28 23:22:41.620652] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.214 [2024-11-28 23:22:41.620788] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.214 [2024-11-28 23:22:41.620814] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.214 [2024-11-28 23:22:41.620830] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.214 [2024-11-28 23:22:41.623256] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.214 [2024-11-28 23:22:41.632678] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.214 [2024-11-28 23:22:41.632988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.214 [2024-11-28 23:22:41.633141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.214 [2024-11-28 23:22:41.633172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.214 [2024-11-28 23:22:41.633198] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.214 [2024-11-28 23:22:41.633412] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.214 [2024-11-28 23:22:41.633573] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.214 [2024-11-28 23:22:41.633598] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.214 [2024-11-28 23:22:41.633615] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.214 [2024-11-28 23:22:41.635859] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.214 [2024-11-28 23:22:41.645209] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.214 [2024-11-28 23:22:41.645543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.214 [2024-11-28 23:22:41.645655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.214 [2024-11-28 23:22:41.645685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.214 [2024-11-28 23:22:41.645703] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.214 [2024-11-28 23:22:41.645871] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.214 [2024-11-28 23:22:41.646040] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.214 [2024-11-28 23:22:41.646065] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.214 [2024-11-28 23:22:41.646082] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.214 [2024-11-28 23:22:41.648366] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.214 [2024-11-28 23:22:41.657794] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.214 [2024-11-28 23:22:41.658130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.214 [2024-11-28 23:22:41.658296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.214 [2024-11-28 23:22:41.658322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.214 [2024-11-28 23:22:41.658339] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.214 [2024-11-28 23:22:41.658541] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.214 [2024-11-28 23:22:41.658668] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.214 [2024-11-28 23:22:41.658687] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.214 [2024-11-28 23:22:41.658716] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.214 [2024-11-28 23:22:41.660890] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.214 [2024-11-28 23:22:41.670252] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.214 [2024-11-28 23:22:41.670579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.214 [2024-11-28 23:22:41.670704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.214 [2024-11-28 23:22:41.670734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.214 [2024-11-28 23:22:41.670753] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.214 [2024-11-28 23:22:41.670908] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.214 [2024-11-28 23:22:41.671113] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.214 [2024-11-28 23:22:41.671137] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.214 [2024-11-28 23:22:41.671154] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.214 [2024-11-28 23:22:41.673536] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.214 [2024-11-28 23:22:41.682798] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.214 [2024-11-28 23:22:41.683070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.214 [2024-11-28 23:22:41.683229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.214 [2024-11-28 23:22:41.683260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.214 [2024-11-28 23:22:41.683279] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.214 [2024-11-28 23:22:41.683459] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.214 [2024-11-28 23:22:41.683629] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.214 [2024-11-28 23:22:41.683654] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.214 [2024-11-28 23:22:41.683672] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.214 [2024-11-28 23:22:41.685793] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.214 [2024-11-28 23:22:41.695261] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.214 [2024-11-28 23:22:41.695554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.214 [2024-11-28 23:22:41.695720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.214 [2024-11-28 23:22:41.695747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.214 [2024-11-28 23:22:41.695764] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.214 [2024-11-28 23:22:41.695925] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.214 [2024-11-28 23:22:41.696128] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.214 [2024-11-28 23:22:41.696154] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.214 [2024-11-28 23:22:41.696171] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.214 [2024-11-28 23:22:41.698538] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.215 [2024-11-28 23:22:41.708000] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.215 [2024-11-28 23:22:41.708388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.215 [2024-11-28 23:22:41.708660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.215 [2024-11-28 23:22:41.708710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.215 [2024-11-28 23:22:41.708729] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.215 [2024-11-28 23:22:41.708859] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.215 [2024-11-28 23:22:41.709052] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.215 [2024-11-28 23:22:41.709077] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.215 [2024-11-28 23:22:41.709094] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.215 [2024-11-28 23:22:41.711376] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.215 [2024-11-28 23:22:41.720483] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.215 [2024-11-28 23:22:41.720790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.215 [2024-11-28 23:22:41.720964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.215 [2024-11-28 23:22:41.720992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.215 [2024-11-28 23:22:41.721009] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.215 [2024-11-28 23:22:41.721156] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.215 [2024-11-28 23:22:41.721361] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.215 [2024-11-28 23:22:41.721386] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.215 [2024-11-28 23:22:41.721418] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.215 [2024-11-28 23:22:41.723612] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.215 [2024-11-28 23:22:41.733115] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.215 [2024-11-28 23:22:41.733411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.215 [2024-11-28 23:22:41.733533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.215 [2024-11-28 23:22:41.733564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.215 [2024-11-28 23:22:41.733582] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.215 [2024-11-28 23:22:41.733731] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.215 [2024-11-28 23:22:41.733936] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.215 [2024-11-28 23:22:41.733962] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.215 [2024-11-28 23:22:41.733979] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.215 [2024-11-28 23:22:41.736486] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.215 [2024-11-28 23:22:41.745847] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.215 [2024-11-28 23:22:41.746173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.215 [2024-11-28 23:22:41.746303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.215 [2024-11-28 23:22:41.746337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.215 [2024-11-28 23:22:41.746355] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.215 [2024-11-28 23:22:41.746513] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.215 [2024-11-28 23:22:41.746665] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.215 [2024-11-28 23:22:41.746695] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.215 [2024-11-28 23:22:41.746712] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.215 [2024-11-28 23:22:41.749064] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.215 [2024-11-28 23:22:41.758470] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.215 [2024-11-28 23:22:41.758793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.215 [2024-11-28 23:22:41.758988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.215 [2024-11-28 23:22:41.759051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.215 [2024-11-28 23:22:41.759070] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.215 [2024-11-28 23:22:41.759236] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.215 [2024-11-28 23:22:41.759420] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.215 [2024-11-28 23:22:41.759447] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.215 [2024-11-28 23:22:41.759464] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.215 [2024-11-28 23:22:41.761906] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.215 [2024-11-28 23:22:41.771240] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.215 [2024-11-28 23:22:41.771572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.215 [2024-11-28 23:22:41.771820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.215 [2024-11-28 23:22:41.771878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.215 [2024-11-28 23:22:41.771896] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.215 [2024-11-28 23:22:41.772063] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.215 [2024-11-28 23:22:41.772196] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.215 [2024-11-28 23:22:41.772220] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.215 [2024-11-28 23:22:41.772236] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.215 [2024-11-28 23:22:41.774458] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.215 [2024-11-28 23:22:41.783686] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.215 [2024-11-28 23:22:41.784006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.215 [2024-11-28 23:22:41.784180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.215 [2024-11-28 23:22:41.784206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.215 [2024-11-28 23:22:41.784222] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.215 [2024-11-28 23:22:41.784383] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.215 [2024-11-28 23:22:41.784600] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.215 [2024-11-28 23:22:41.784621] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.215 [2024-11-28 23:22:41.784639] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.215 [2024-11-28 23:22:41.787016] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.215 [2024-11-28 23:22:41.796210] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.215 [2024-11-28 23:22:41.796506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.215 [2024-11-28 23:22:41.796633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.215 [2024-11-28 23:22:41.796662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.215 [2024-11-28 23:22:41.796679] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.215 [2024-11-28 23:22:41.796793] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.215 [2024-11-28 23:22:41.796974] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.215 [2024-11-28 23:22:41.796998] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.215 [2024-11-28 23:22:41.797014] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.215 [2024-11-28 23:22:41.799351] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.215 [2024-11-28 23:22:41.808869] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.215 [2024-11-28 23:22:41.809179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.215 [2024-11-28 23:22:41.809336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.215 [2024-11-28 23:22:41.809368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.215 [2024-11-28 23:22:41.809387] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.215 [2024-11-28 23:22:41.809586] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.215 [2024-11-28 23:22:41.809757] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.215 [2024-11-28 23:22:41.809782] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.215 [2024-11-28 23:22:41.809799] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.215 [2024-11-28 23:22:41.812118] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.475 [2024-11-28 23:22:41.821597] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.475 [2024-11-28 23:22:41.821948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.475 [2024-11-28 23:22:41.822143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.475 [2024-11-28 23:22:41.822174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.475 [2024-11-28 23:22:41.822194] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.475 [2024-11-28 23:22:41.822343] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.475 [2024-11-28 23:22:41.822526] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.475 [2024-11-28 23:22:41.822552] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.475 [2024-11-28 23:22:41.822569] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.475 [2024-11-28 23:22:41.824816] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.475 [2024-11-28 23:22:41.834134] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.475 [2024-11-28 23:22:41.834439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.475 [2024-11-28 23:22:41.834572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.475 [2024-11-28 23:22:41.834602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.475 [2024-11-28 23:22:41.834621] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.475 [2024-11-28 23:22:41.834787] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.475 [2024-11-28 23:22:41.834939] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.475 [2024-11-28 23:22:41.834964] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.475 [2024-11-28 23:22:41.834982] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.475 [2024-11-28 23:22:41.837150] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.475 [2024-11-28 23:22:41.846787] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.475 [2024-11-28 23:22:41.847070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.475 [2024-11-28 23:22:41.847176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.475 [2024-11-28 23:22:41.847201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.475 [2024-11-28 23:22:41.847217] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.475 [2024-11-28 23:22:41.847383] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.476 [2024-11-28 23:22:41.847599] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.476 [2024-11-28 23:22:41.847625] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.476 [2024-11-28 23:22:41.847642] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.476 [2024-11-28 23:22:41.849956] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.476 [2024-11-28 23:22:41.859173] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.476 [2024-11-28 23:22:41.859473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.476 [2024-11-28 23:22:41.859636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.476 [2024-11-28 23:22:41.859667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.476 [2024-11-28 23:22:41.859686] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.476 [2024-11-28 23:22:41.859889] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.476 [2024-11-28 23:22:41.860041] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.476 [2024-11-28 23:22:41.860067] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.476 [2024-11-28 23:22:41.860084] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.476 [2024-11-28 23:22:41.862554] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.476 [2024-11-28 23:22:41.871436] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.476 [2024-11-28 23:22:41.871738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.476 [2024-11-28 23:22:41.871939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.476 [2024-11-28 23:22:41.872000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.476 [2024-11-28 23:22:41.872019] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.476 [2024-11-28 23:22:41.872186] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.476 [2024-11-28 23:22:41.872355] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.476 [2024-11-28 23:22:41.872381] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.476 [2024-11-28 23:22:41.872410] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.476 [2024-11-28 23:22:41.874801] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.476 [2024-11-28 23:22:41.883868] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.476 [2024-11-28 23:22:41.884186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.476 [2024-11-28 23:22:41.884293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.476 [2024-11-28 23:22:41.884323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.476 [2024-11-28 23:22:41.884342] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.476 [2024-11-28 23:22:41.884523] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.476 [2024-11-28 23:22:41.884728] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.476 [2024-11-28 23:22:41.884754] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.476 [2024-11-28 23:22:41.884770] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.476 [2024-11-28 23:22:41.887285] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.476 [2024-11-28 23:22:41.896552] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.476 [2024-11-28 23:22:41.896838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.476 [2024-11-28 23:22:41.897069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.476 [2024-11-28 23:22:41.897137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.476 [2024-11-28 23:22:41.897157] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.476 [2024-11-28 23:22:41.897324] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.476 [2024-11-28 23:22:41.897489] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.476 [2024-11-28 23:22:41.897516] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.476 [2024-11-28 23:22:41.897532] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.476 [2024-11-28 23:22:41.899956] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.476 [2024-11-28 23:22:41.909051] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.476 [2024-11-28 23:22:41.909331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.476 [2024-11-28 23:22:41.909493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.476 [2024-11-28 23:22:41.909543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.476 [2024-11-28 23:22:41.909563] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.476 [2024-11-28 23:22:41.909712] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.476 [2024-11-28 23:22:41.909863] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.476 [2024-11-28 23:22:41.909888] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.476 [2024-11-28 23:22:41.909905] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.476 [2024-11-28 23:22:41.912293] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.476 [2024-11-28 23:22:41.921613] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.476 [2024-11-28 23:22:41.921994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.476 [2024-11-28 23:22:41.922113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.476 [2024-11-28 23:22:41.922154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.476 [2024-11-28 23:22:41.922171] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.476 [2024-11-28 23:22:41.922354] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.476 [2024-11-28 23:22:41.922609] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.476 [2024-11-28 23:22:41.922634] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.476 [2024-11-28 23:22:41.922650] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.476 [2024-11-28 23:22:41.924929] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.476 [2024-11-28 23:22:41.934261] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.476 [2024-11-28 23:22:41.934590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.476 [2024-11-28 23:22:41.934724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.476 [2024-11-28 23:22:41.934754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.476 [2024-11-28 23:22:41.934774] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.476 [2024-11-28 23:22:41.934923] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.476 [2024-11-28 23:22:41.935074] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.476 [2024-11-28 23:22:41.935097] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.476 [2024-11-28 23:22:41.935114] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.476 [2024-11-28 23:22:41.937289] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.476 [2024-11-28 23:22:41.946940] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.476 [2024-11-28 23:22:41.947253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.476 [2024-11-28 23:22:41.947385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.476 [2024-11-28 23:22:41.947423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.476 [2024-11-28 23:22:41.947446] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.476 [2024-11-28 23:22:41.947624] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.476 [2024-11-28 23:22:41.947854] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.476 [2024-11-28 23:22:41.947880] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.476 [2024-11-28 23:22:41.947897] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.476 [2024-11-28 23:22:41.950142] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.476 [2024-11-28 23:22:41.959586] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.476 [2024-11-28 23:22:41.959960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.476 [2024-11-28 23:22:41.960132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.476 [2024-11-28 23:22:41.960160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.476 [2024-11-28 23:22:41.960177] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.476 [2024-11-28 23:22:41.960323] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.476 [2024-11-28 23:22:41.960518] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.476 [2024-11-28 23:22:41.960542] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.476 [2024-11-28 23:22:41.960560] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.476 [2024-11-28 23:22:41.962983] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.476 [2024-11-28 23:22:41.972009] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.477 [2024-11-28 23:22:41.972356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.477 [2024-11-28 23:22:41.972569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.477 [2024-11-28 23:22:41.972598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.477 [2024-11-28 23:22:41.972615] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.477 [2024-11-28 23:22:41.972753] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.477 [2024-11-28 23:22:41.972940] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.477 [2024-11-28 23:22:41.972966] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.477 [2024-11-28 23:22:41.972983] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.477 [2024-11-28 23:22:41.975355] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.477 [2024-11-28 23:22:41.984718] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.477 [2024-11-28 23:22:41.985044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.477 [2024-11-28 23:22:41.985202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.477 [2024-11-28 23:22:41.985232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.477 [2024-11-28 23:22:41.985251] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.477 [2024-11-28 23:22:41.985434] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.477 [2024-11-28 23:22:41.985606] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.477 [2024-11-28 23:22:41.985630] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.477 [2024-11-28 23:22:41.985647] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.477 [2024-11-28 23:22:41.988008] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.477 [2024-11-28 23:22:41.997380] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.477 [2024-11-28 23:22:41.997693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.477 [2024-11-28 23:22:41.997846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.477 [2024-11-28 23:22:41.997872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.477 [2024-11-28 23:22:41.997889] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.477 [2024-11-28 23:22:41.998083] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.477 [2024-11-28 23:22:41.998217] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.477 [2024-11-28 23:22:41.998241] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.477 [2024-11-28 23:22:41.998258] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.477 [2024-11-28 23:22:42.000601] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.477 [2024-11-28 23:22:42.009904] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.477 [2024-11-28 23:22:42.010248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.477 [2024-11-28 23:22:42.010355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.477 [2024-11-28 23:22:42.010385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.477 [2024-11-28 23:22:42.010415] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.477 [2024-11-28 23:22:42.010547] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.477 [2024-11-28 23:22:42.010682] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.477 [2024-11-28 23:22:42.010705] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.477 [2024-11-28 23:22:42.010722] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.477 [2024-11-28 23:22:42.013018] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.477 [2024-11-28 23:22:42.022437] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.477 [2024-11-28 23:22:42.022762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.477 [2024-11-28 23:22:42.022969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.477 [2024-11-28 23:22:42.023016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.477 [2024-11-28 23:22:42.023035] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.477 [2024-11-28 23:22:42.023200] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.477 [2024-11-28 23:22:42.023407] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.477 [2024-11-28 23:22:42.023433] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.477 [2024-11-28 23:22:42.023450] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.477 [2024-11-28 23:22:42.025738] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.477 [2024-11-28 23:22:42.035248] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.477 [2024-11-28 23:22:42.035570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.477 [2024-11-28 23:22:42.035695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.477 [2024-11-28 23:22:42.035766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.477 [2024-11-28 23:22:42.035785] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.477 [2024-11-28 23:22:42.035933] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.477 [2024-11-28 23:22:42.036085] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.477 [2024-11-28 23:22:42.036109] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.477 [2024-11-28 23:22:42.036125] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.477 [2024-11-28 23:22:42.038666] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.477 [2024-11-28 23:22:42.047625] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.477 [2024-11-28 23:22:42.047935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.477 [2024-11-28 23:22:42.048091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.477 [2024-11-28 23:22:42.048121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.477 [2024-11-28 23:22:42.048140] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.477 [2024-11-28 23:22:42.048305] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.477 [2024-11-28 23:22:42.048489] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.477 [2024-11-28 23:22:42.048515] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.477 [2024-11-28 23:22:42.048531] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.477 [2024-11-28 23:22:42.050829] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.477 [2024-11-28 23:22:42.060123] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.477 [2024-11-28 23:22:42.060415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.477 [2024-11-28 23:22:42.060515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.477 [2024-11-28 23:22:42.060545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.477 [2024-11-28 23:22:42.060564] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.477 [2024-11-28 23:22:42.060694] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.477 [2024-11-28 23:22:42.060882] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.477 [2024-11-28 23:22:42.060912] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.477 [2024-11-28 23:22:42.060930] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.477 [2024-11-28 23:22:42.063303] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.477 [2024-11-28 23:22:42.072699] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.477 [2024-11-28 23:22:42.073014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.477 [2024-11-28 23:22:42.073145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.477 [2024-11-28 23:22:42.073176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.477 [2024-11-28 23:22:42.073195] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.477 [2024-11-28 23:22:42.073379] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.477 [2024-11-28 23:22:42.073578] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.477 [2024-11-28 23:22:42.073603] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.477 [2024-11-28 23:22:42.073619] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.477 [2024-11-28 23:22:42.075904] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.737 [2024-11-28 23:22:42.085283] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.737 [2024-11-28 23:22:42.085601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.737 [2024-11-28 23:22:42.085724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.737 [2024-11-28 23:22:42.085751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.737 [2024-11-28 23:22:42.085767] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.737 [2024-11-28 23:22:42.085930] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.737 [2024-11-28 23:22:42.086149] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.737 [2024-11-28 23:22:42.086174] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.737 [2024-11-28 23:22:42.086190] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.737 [2024-11-28 23:22:42.088423] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.737 [2024-11-28 23:22:42.097842] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.737 [2024-11-28 23:22:42.098158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.737 [2024-11-28 23:22:42.098288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.737 [2024-11-28 23:22:42.098317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.737 [2024-11-28 23:22:42.098336] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.737 [2024-11-28 23:22:42.098532] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.737 [2024-11-28 23:22:42.098722] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.737 [2024-11-28 23:22:42.098747] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.737 [2024-11-28 23:22:42.098769] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.737 [2024-11-28 23:22:42.101103] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.737 [2024-11-28 23:22:42.110429] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.737 [2024-11-28 23:22:42.110719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.737 [2024-11-28 23:22:42.110840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.737 [2024-11-28 23:22:42.110870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.737 [2024-11-28 23:22:42.110888] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.737 [2024-11-28 23:22:42.111037] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.737 [2024-11-28 23:22:42.111172] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.737 [2024-11-28 23:22:42.111196] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.737 [2024-11-28 23:22:42.111212] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.737 [2024-11-28 23:22:42.113644] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.737 [2024-11-28 23:22:42.122876] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.737 [2024-11-28 23:22:42.123207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.737 [2024-11-28 23:22:42.123367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.737 [2024-11-28 23:22:42.123404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.737 [2024-11-28 23:22:42.123426] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.737 [2024-11-28 23:22:42.123592] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.737 [2024-11-28 23:22:42.123726] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.737 [2024-11-28 23:22:42.123750] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.737 [2024-11-28 23:22:42.123766] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.737 [2024-11-28 23:22:42.126044] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.737 [2024-11-28 23:22:42.135445] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.737 [2024-11-28 23:22:42.135780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.737 [2024-11-28 23:22:42.135918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.737 [2024-11-28 23:22:42.135947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.737 [2024-11-28 23:22:42.135966] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.737 [2024-11-28 23:22:42.136132] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.737 [2024-11-28 23:22:42.136302] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.737 [2024-11-28 23:22:42.136326] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.737 [2024-11-28 23:22:42.136343] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.737 [2024-11-28 23:22:42.138524] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.737 [2024-11-28 23:22:42.148048] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.737 [2024-11-28 23:22:42.148329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.737 [2024-11-28 23:22:42.148475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.737 [2024-11-28 23:22:42.148503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.737 [2024-11-28 23:22:42.148520] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.737 [2024-11-28 23:22:42.148654] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.737 [2024-11-28 23:22:42.148853] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.737 [2024-11-28 23:22:42.148878] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.737 [2024-11-28 23:22:42.148894] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.737 [2024-11-28 23:22:42.151141] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.737 [2024-11-28 23:22:42.160562] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.737 [2024-11-28 23:22:42.160886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.737 [2024-11-28 23:22:42.161039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.737 [2024-11-28 23:22:42.161066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.737 [2024-11-28 23:22:42.161099] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.737 [2024-11-28 23:22:42.161284] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.737 [2024-11-28 23:22:42.161448] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.737 [2024-11-28 23:22:42.161474] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.737 [2024-11-28 23:22:42.161491] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.737 [2024-11-28 23:22:42.163822] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.737 [2024-11-28 23:22:42.172946] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.737 [2024-11-28 23:22:42.173278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.737 [2024-11-28 23:22:42.173438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.737 [2024-11-28 23:22:42.173468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.737 [2024-11-28 23:22:42.173487] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.737 [2024-11-28 23:22:42.173671] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.737 [2024-11-28 23:22:42.173823] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.737 [2024-11-28 23:22:42.173847] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.737 [2024-11-28 23:22:42.173863] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.737 [2024-11-28 23:22:42.176053] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.737 [2024-11-28 23:22:42.185492] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.737 [2024-11-28 23:22:42.185827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.737 [2024-11-28 23:22:42.186019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.738 [2024-11-28 23:22:42.186076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.738 [2024-11-28 23:22:42.186095] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.738 [2024-11-28 23:22:42.186261] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.738 [2024-11-28 23:22:42.186461] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.738 [2024-11-28 23:22:42.186486] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.738 [2024-11-28 23:22:42.186502] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.738 [2024-11-28 23:22:42.188888] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.738 [2024-11-28 23:22:42.197958] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.738 [2024-11-28 23:22:42.198285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.738 [2024-11-28 23:22:42.198444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.738 [2024-11-28 23:22:42.198473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.738 [2024-11-28 23:22:42.198490] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.738 [2024-11-28 23:22:42.198697] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.738 [2024-11-28 23:22:42.198841] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.738 [2024-11-28 23:22:42.198866] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.738 [2024-11-28 23:22:42.198882] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.738 [2024-11-28 23:22:42.201144] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.738 [2024-11-28 23:22:42.210589] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.738 [2024-11-28 23:22:42.211008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.738 [2024-11-28 23:22:42.211158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.738 [2024-11-28 23:22:42.211187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.738 [2024-11-28 23:22:42.211206] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.738 [2024-11-28 23:22:42.211437] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.738 [2024-11-28 23:22:42.211626] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.738 [2024-11-28 23:22:42.211651] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.738 [2024-11-28 23:22:42.211667] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.738 [2024-11-28 23:22:42.213980] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.738 [2024-11-28 23:22:42.223116] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.738 [2024-11-28 23:22:42.223404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.738 [2024-11-28 23:22:42.223536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.738 [2024-11-28 23:22:42.223565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.738 [2024-11-28 23:22:42.223584] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.738 [2024-11-28 23:22:42.223768] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.738 [2024-11-28 23:22:42.223939] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.738 [2024-11-28 23:22:42.223963] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.738 [2024-11-28 23:22:42.223980] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.738 [2024-11-28 23:22:42.226369] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.738 [2024-11-28 23:22:42.235782] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.738 [2024-11-28 23:22:42.236134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.738 [2024-11-28 23:22:42.236264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.738 [2024-11-28 23:22:42.236293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.738 [2024-11-28 23:22:42.236311] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.738 [2024-11-28 23:22:42.236452] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.738 [2024-11-28 23:22:42.236623] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.738 [2024-11-28 23:22:42.236647] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.738 [2024-11-28 23:22:42.236664] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.738 [2024-11-28 23:22:42.239031] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.738 [2024-11-28 23:22:42.248173] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.738 [2024-11-28 23:22:42.248526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.738 [2024-11-28 23:22:42.248658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.738 [2024-11-28 23:22:42.248684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.738 [2024-11-28 23:22:42.248701] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.738 [2024-11-28 23:22:42.248869] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.738 [2024-11-28 23:22:42.249058] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.738 [2024-11-28 23:22:42.249081] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.738 [2024-11-28 23:22:42.249098] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.738 [2024-11-28 23:22:42.251325] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.738 [2024-11-28 23:22:42.260752] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.738 [2024-11-28 23:22:42.261027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.738 [2024-11-28 23:22:42.261161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.738 [2024-11-28 23:22:42.261195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.738 [2024-11-28 23:22:42.261214] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.738 [2024-11-28 23:22:42.261410] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.738 [2024-11-28 23:22:42.261635] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.738 [2024-11-28 23:22:42.261660] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.738 [2024-11-28 23:22:42.261676] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.738 [2024-11-28 23:22:42.263955] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.738 [2024-11-28 23:22:42.273211] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.738 [2024-11-28 23:22:42.273545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.738 [2024-11-28 23:22:42.273715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.738 [2024-11-28 23:22:42.273741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.738 [2024-11-28 23:22:42.273758] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.738 [2024-11-28 23:22:42.273948] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.738 [2024-11-28 23:22:42.274119] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.738 [2024-11-28 23:22:42.274144] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.738 [2024-11-28 23:22:42.274160] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.738 [2024-11-28 23:22:42.276557] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.738 [2024-11-28 23:22:42.285726] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.738 [2024-11-28 23:22:42.286072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.738 [2024-11-28 23:22:42.286220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.738 [2024-11-28 23:22:42.286249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.738 [2024-11-28 23:22:42.286267] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.738 [2024-11-28 23:22:42.286464] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.738 [2024-11-28 23:22:42.286653] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.738 [2024-11-28 23:22:42.286678] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.738 [2024-11-28 23:22:42.286695] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.738 [2024-11-28 23:22:42.289168] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.738 [2024-11-28 23:22:42.298275] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.738 [2024-11-28 23:22:42.298603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.738 [2024-11-28 23:22:42.298727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.738 [2024-11-28 23:22:42.298756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.738 [2024-11-28 23:22:42.298780] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.738 [2024-11-28 23:22:42.298929] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.738 [2024-11-28 23:22:42.299063] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.739 [2024-11-28 23:22:42.299087] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.739 [2024-11-28 23:22:42.299104] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.739 [2024-11-28 23:22:42.301480] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.739 [2024-11-28 23:22:42.310824] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.739 [2024-11-28 23:22:42.311138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.739 [2024-11-28 23:22:42.311268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.739 [2024-11-28 23:22:42.311298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.739 [2024-11-28 23:22:42.311316] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.739 [2024-11-28 23:22:42.311493] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.739 [2024-11-28 23:22:42.311645] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.739 [2024-11-28 23:22:42.311670] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.739 [2024-11-28 23:22:42.311686] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.739 [2024-11-28 23:22:42.314035] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.739 [2024-11-28 23:22:42.323308] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.739 [2024-11-28 23:22:42.323604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.739 [2024-11-28 23:22:42.323747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.739 [2024-11-28 23:22:42.323776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.739 [2024-11-28 23:22:42.323795] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.739 [2024-11-28 23:22:42.323943] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.739 [2024-11-28 23:22:42.324078] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.739 [2024-11-28 23:22:42.324102] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.739 [2024-11-28 23:22:42.324118] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.739 [2024-11-28 23:22:42.326403] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.739 [2024-11-28 23:22:42.335738] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.739 [2024-11-28 23:22:42.336071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.739 [2024-11-28 23:22:42.336226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.739 [2024-11-28 23:22:42.336256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.739 [2024-11-28 23:22:42.336274] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.739 [2024-11-28 23:22:42.336439] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.739 [2024-11-28 23:22:42.336610] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.739 [2024-11-28 23:22:42.336634] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.739 [2024-11-28 23:22:42.336651] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.739 [2024-11-28 23:22:42.338873] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.997 [2024-11-28 23:22:42.348225] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.997 [2024-11-28 23:22:42.348512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.997 [2024-11-28 23:22:42.348617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.997 [2024-11-28 23:22:42.348647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.997 [2024-11-28 23:22:42.348666] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.997 [2024-11-28 23:22:42.348885] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.997 [2024-11-28 23:22:42.349038] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.997 [2024-11-28 23:22:42.349062] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.997 [2024-11-28 23:22:42.349078] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.997 [2024-11-28 23:22:42.351323] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.997 [2024-11-28 23:22:42.360772] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.997 [2024-11-28 23:22:42.361079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.997 [2024-11-28 23:22:42.361234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.997 [2024-11-28 23:22:42.361263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.997 [2024-11-28 23:22:42.361282] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.997 [2024-11-28 23:22:42.361568] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.998 [2024-11-28 23:22:42.361705] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.998 [2024-11-28 23:22:42.361729] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.998 [2024-11-28 23:22:42.361745] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.998 [2024-11-28 23:22:42.364077] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.998 [2024-11-28 23:22:42.373310] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.998 [2024-11-28 23:22:42.373687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.998 [2024-11-28 23:22:42.373818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.998 [2024-11-28 23:22:42.373848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.998 [2024-11-28 23:22:42.373866] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.998 [2024-11-28 23:22:42.374015] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.998 [2024-11-28 23:22:42.374172] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.998 [2024-11-28 23:22:42.374197] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.998 [2024-11-28 23:22:42.374213] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.998 [2024-11-28 23:22:42.376449] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.998 [2024-11-28 23:22:42.385802] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.998 [2024-11-28 23:22:42.386115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.998 [2024-11-28 23:22:42.386272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.998 [2024-11-28 23:22:42.386301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.998 [2024-11-28 23:22:42.386320] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.998 [2024-11-28 23:22:42.386524] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.998 [2024-11-28 23:22:42.386646] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.998 [2024-11-28 23:22:42.386667] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.998 [2024-11-28 23:22:42.386700] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.998 [2024-11-28 23:22:42.389078] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.998 [2024-11-28 23:22:42.398242] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.998 [2024-11-28 23:22:42.398551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.998 [2024-11-28 23:22:42.398653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.998 [2024-11-28 23:22:42.398697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.998 [2024-11-28 23:22:42.398716] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.998 [2024-11-28 23:22:42.398918] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.998 [2024-11-28 23:22:42.399088] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.998 [2024-11-28 23:22:42.399112] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.998 [2024-11-28 23:22:42.399128] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.998 [2024-11-28 23:22:42.401286] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.998 [2024-11-28 23:22:42.410913] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.998 [2024-11-28 23:22:42.411194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.998 [2024-11-28 23:22:42.411304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.998 [2024-11-28 23:22:42.411336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.998 [2024-11-28 23:22:42.411355] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.998 [2024-11-28 23:22:42.411506] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.998 [2024-11-28 23:22:42.411660] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.998 [2024-11-28 23:22:42.411704] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.998 [2024-11-28 23:22:42.411718] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.998 [2024-11-28 23:22:42.414130] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.998 [2024-11-28 23:22:42.423608] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.998 [2024-11-28 23:22:42.423917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.998 [2024-11-28 23:22:42.424074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.998 [2024-11-28 23:22:42.424104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.998 [2024-11-28 23:22:42.424122] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.998 [2024-11-28 23:22:42.424306] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.998 [2024-11-28 23:22:42.424524] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.998 [2024-11-28 23:22:42.424546] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.998 [2024-11-28 23:22:42.424560] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.998 [2024-11-28 23:22:42.426884] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.998 [2024-11-28 23:22:42.436115] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.998 [2024-11-28 23:22:42.436432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.998 [2024-11-28 23:22:42.436561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.998 [2024-11-28 23:22:42.436591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.998 [2024-11-28 23:22:42.436610] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.998 [2024-11-28 23:22:42.436812] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.998 [2024-11-28 23:22:42.436929] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.998 [2024-11-28 23:22:42.436954] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.998 [2024-11-28 23:22:42.436972] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.998 [2024-11-28 23:22:42.439339] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.998 [2024-11-28 23:22:42.448557] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.998 [2024-11-28 23:22:42.448881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.998 [2024-11-28 23:22:42.449016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.998 [2024-11-28 23:22:42.449046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.998 [2024-11-28 23:22:42.449065] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.998 [2024-11-28 23:22:42.449213] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.998 [2024-11-28 23:22:42.449365] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.998 [2024-11-28 23:22:42.449390] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.998 [2024-11-28 23:22:42.449423] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.998 [2024-11-28 23:22:42.451796] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.998 [2024-11-28 23:22:42.461111] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.998 [2024-11-28 23:22:42.461473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.998 [2024-11-28 23:22:42.461560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.998 [2024-11-28 23:22:42.461586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.998 [2024-11-28 23:22:42.461602] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.998 [2024-11-28 23:22:42.461720] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.998 [2024-11-28 23:22:42.461903] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.998 [2024-11-28 23:22:42.461928] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.998 [2024-11-28 23:22:42.461957] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.998 [2024-11-28 23:22:42.464205] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.998 [2024-11-28 23:22:42.473783] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.998 [2024-11-28 23:22:42.474096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.998 [2024-11-28 23:22:42.474254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.998 [2024-11-28 23:22:42.474281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.998 [2024-11-28 23:22:42.474298] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.998 [2024-11-28 23:22:42.474473] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.998 [2024-11-28 23:22:42.474627] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.998 [2024-11-28 23:22:42.474649] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.998 [2024-11-28 23:22:42.474664] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.998 [2024-11-28 23:22:42.477221] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.998 [2024-11-28 23:22:42.486355] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.998 [2024-11-28 23:22:42.486616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.998 [2024-11-28 23:22:42.486737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.998 [2024-11-28 23:22:42.486763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.998 [2024-11-28 23:22:42.486780] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.998 [2024-11-28 23:22:42.486991] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.998 [2024-11-28 23:22:42.487107] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.998 [2024-11-28 23:22:42.487131] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.998 [2024-11-28 23:22:42.487147] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.998 [2024-11-28 23:22:42.489355] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.998 [2024-11-28 23:22:42.498833] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.998 [2024-11-28 23:22:42.499166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.998 [2024-11-28 23:22:42.499324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.998 [2024-11-28 23:22:42.499354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.998 [2024-11-28 23:22:42.499372] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.998 [2024-11-28 23:22:42.499556] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.998 [2024-11-28 23:22:42.499730] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.998 [2024-11-28 23:22:42.499754] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.998 [2024-11-28 23:22:42.499771] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.998 [2024-11-28 23:22:42.502087] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.998 [2024-11-28 23:22:42.511355] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.998 [2024-11-28 23:22:42.511712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.998 [2024-11-28 23:22:42.511814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.998 [2024-11-28 23:22:42.511842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.998 [2024-11-28 23:22:42.511860] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.998 [2024-11-28 23:22:42.511972] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.998 [2024-11-28 23:22:42.512160] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.998 [2024-11-28 23:22:42.512184] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.998 [2024-11-28 23:22:42.512201] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.998 [2024-11-28 23:22:42.514644] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.998 [2024-11-28 23:22:42.524068] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.998 [2024-11-28 23:22:42.524357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.998 [2024-11-28 23:22:42.524484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.998 [2024-11-28 23:22:42.524514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.998 [2024-11-28 23:22:42.524533] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.998 [2024-11-28 23:22:42.524626] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.998 [2024-11-28 23:22:42.524779] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.998 [2024-11-28 23:22:42.524803] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.998 [2024-11-28 23:22:42.524819] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.998 [2024-11-28 23:22:42.527023] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.998 [2024-11-28 23:22:42.536591] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.998 [2024-11-28 23:22:42.536938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.998 [2024-11-28 23:22:42.537053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.998 [2024-11-28 23:22:42.537081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.998 [2024-11-28 23:22:42.537099] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.998 [2024-11-28 23:22:42.537265] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.998 [2024-11-28 23:22:42.537428] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.998 [2024-11-28 23:22:42.537454] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.998 [2024-11-28 23:22:42.537470] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.998 [2024-11-28 23:22:42.539674] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.998 [2024-11-28 23:22:42.549329] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.998 [2024-11-28 23:22:42.549595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.998 [2024-11-28 23:22:42.549753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.998 [2024-11-28 23:22:42.549782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.998 [2024-11-28 23:22:42.549800] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.998 [2024-11-28 23:22:42.549966] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.998 [2024-11-28 23:22:42.550136] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.998 [2024-11-28 23:22:42.550160] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.998 [2024-11-28 23:22:42.550177] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.998 [2024-11-28 23:22:42.552529] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.998 [2024-11-28 23:22:42.561923] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.998 [2024-11-28 23:22:42.562291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.998 [2024-11-28 23:22:42.562457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.998 [2024-11-28 23:22:42.562486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.998 [2024-11-28 23:22:42.562503] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.998 [2024-11-28 23:22:42.562683] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.998 [2024-11-28 23:22:42.562844] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.998 [2024-11-28 23:22:42.562868] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.998 [2024-11-28 23:22:42.562884] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.998 [2024-11-28 23:22:42.565322] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.998 [2024-11-28 23:22:42.574618] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.998 [2024-11-28 23:22:42.574928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.998 [2024-11-28 23:22:42.575088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.998 [2024-11-28 23:22:42.575118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.998 [2024-11-28 23:22:42.575137] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.998 [2024-11-28 23:22:42.575339] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.998 [2024-11-28 23:22:42.575525] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.998 [2024-11-28 23:22:42.575548] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.998 [2024-11-28 23:22:42.575563] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.998 [2024-11-28 23:22:42.577936] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.998 [2024-11-28 23:22:42.587285] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.998 [2024-11-28 23:22:42.587550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.998 [2024-11-28 23:22:42.587657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.998 [2024-11-28 23:22:42.587687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.999 [2024-11-28 23:22:42.587706] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.999 [2024-11-28 23:22:42.587836] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.999 [2024-11-28 23:22:42.588007] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.999 [2024-11-28 23:22:42.588031] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.999 [2024-11-28 23:22:42.588047] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:38.999 [2024-11-28 23:22:42.590458] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:38.999 [2024-11-28 23:22:42.599848] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:38.999 [2024-11-28 23:22:42.600199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.999 [2024-11-28 23:22:42.600335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.999 [2024-11-28 23:22:42.600365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:38.999 [2024-11-28 23:22:42.600384] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:38.999 [2024-11-28 23:22:42.600600] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:38.999 [2024-11-28 23:22:42.600771] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:38.999 [2024-11-28 23:22:42.600795] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:38.999 [2024-11-28 23:22:42.600811] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.257 [2024-11-28 23:22:42.603051] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.257 [2024-11-28 23:22:42.612490] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.257 [2024-11-28 23:22:42.612803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 23:22:42.612986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 23:22:42.613034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.257 [2024-11-28 23:22:42.613059] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.257 [2024-11-28 23:22:42.613226] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.257 [2024-11-28 23:22:42.613378] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.257 [2024-11-28 23:22:42.613414] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.257 [2024-11-28 23:22:42.613432] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.257 [2024-11-28 23:22:42.615785] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.257 [2024-11-28 23:22:42.625277] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.257 [2024-11-28 23:22:42.625601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 23:22:42.625740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 23:22:42.625770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.257 [2024-11-28 23:22:42.625789] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.257 [2024-11-28 23:22:42.625991] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.257 [2024-11-28 23:22:42.626197] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.257 [2024-11-28 23:22:42.626221] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.258 [2024-11-28 23:22:42.626237] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.258 [2024-11-28 23:22:42.628576] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.258 [2024-11-28 23:22:42.638001] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.258 [2024-11-28 23:22:42.638275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 23:22:42.638443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 23:22:42.638473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.258 [2024-11-28 23:22:42.638492] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.258 [2024-11-28 23:22:42.638658] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.258 [2024-11-28 23:22:42.638820] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.258 [2024-11-28 23:22:42.638844] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.258 [2024-11-28 23:22:42.638860] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.258 [2024-11-28 23:22:42.641136] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.258 [2024-11-28 23:22:42.650747] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.258 [2024-11-28 23:22:42.651078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 23:22:42.651221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 23:22:42.651252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.258 [2024-11-28 23:22:42.651270] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.258 [2024-11-28 23:22:42.651489] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.258 [2024-11-28 23:22:42.651661] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.258 [2024-11-28 23:22:42.651695] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.258 [2024-11-28 23:22:42.651710] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.258 [2024-11-28 23:22:42.654042] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.258 [2024-11-28 23:22:42.663190] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.258 [2024-11-28 23:22:42.663504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 23:22:42.663671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 23:22:42.663700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.258 [2024-11-28 23:22:42.663719] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.258 [2024-11-28 23:22:42.663869] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.258 [2024-11-28 23:22:42.664057] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.258 [2024-11-28 23:22:42.664080] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.258 [2024-11-28 23:22:42.664096] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.258 [2024-11-28 23:22:42.666588] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.258 [2024-11-28 23:22:42.675880] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.258 [2024-11-28 23:22:42.676158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 23:22:42.676337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 23:22:42.676363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.258 [2024-11-28 23:22:42.676380] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.258 [2024-11-28 23:22:42.676536] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.258 [2024-11-28 23:22:42.676691] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.258 [2024-11-28 23:22:42.676726] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.258 [2024-11-28 23:22:42.676742] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.258 [2024-11-28 23:22:42.678874] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.258 [2024-11-28 23:22:42.688369] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.258 [2024-11-28 23:22:42.688697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 23:22:42.688831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 23:22:42.688861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.258 [2024-11-28 23:22:42.688880] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.258 [2024-11-28 23:22:42.689046] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.258 [2024-11-28 23:22:42.689258] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.258 [2024-11-28 23:22:42.689282] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.258 [2024-11-28 23:22:42.689298] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.258 [2024-11-28 23:22:42.691622] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.258 [2024-11-28 23:22:42.700986] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.258 [2024-11-28 23:22:42.701337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 23:22:42.701514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 23:22:42.701545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.258 [2024-11-28 23:22:42.701564] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.258 [2024-11-28 23:22:42.701731] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.258 [2024-11-28 23:22:42.701955] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.258 [2024-11-28 23:22:42.701980] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.258 [2024-11-28 23:22:42.701997] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.258 [2024-11-28 23:22:42.704426] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.258 [2024-11-28 23:22:42.713551] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.258 [2024-11-28 23:22:42.713898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 23:22:42.714096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 23:22:42.714144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.258 [2024-11-28 23:22:42.714163] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.258 [2024-11-28 23:22:42.714347] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.258 [2024-11-28 23:22:42.714471] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.258 [2024-11-28 23:22:42.714497] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.258 [2024-11-28 23:22:42.714513] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.258 [2024-11-28 23:22:42.716509] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.258 [2024-11-28 23:22:42.726165] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.258 [2024-11-28 23:22:42.726478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 23:22:42.726577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 23:22:42.726607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.258 [2024-11-28 23:22:42.726625] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.258 [2024-11-28 23:22:42.726809] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.258 [2024-11-28 23:22:42.726997] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.258 [2024-11-28 23:22:42.727027] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.258 [2024-11-28 23:22:42.727044] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.258 [2024-11-28 23:22:42.729369] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.258 [2024-11-28 23:22:42.738650] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.258 [2024-11-28 23:22:42.739031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 23:22:42.739167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 23:22:42.739193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.259 [2024-11-28 23:22:42.739211] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.259 [2024-11-28 23:22:42.739389] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.259 [2024-11-28 23:22:42.739571] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.259 [2024-11-28 23:22:42.739595] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.259 [2024-11-28 23:22:42.739611] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.259 [2024-11-28 23:22:42.742063] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.259 [2024-11-28 23:22:42.751232] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.259 [2024-11-28 23:22:42.751532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 23:22:42.751652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 23:22:42.751689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.259 [2024-11-28 23:22:42.751705] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.259 [2024-11-28 23:22:42.751892] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.259 [2024-11-28 23:22:42.752051] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.259 [2024-11-28 23:22:42.752075] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.259 [2024-11-28 23:22:42.752091] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.259 [2024-11-28 23:22:42.754452] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.259 [2024-11-28 23:22:42.763711] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.259 [2024-11-28 23:22:42.764012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 23:22:42.764145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 23:22:42.764174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.259 [2024-11-28 23:22:42.764193] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.259 [2024-11-28 23:22:42.764323] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.259 [2024-11-28 23:22:42.764487] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.259 [2024-11-28 23:22:42.764512] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.259 [2024-11-28 23:22:42.764534] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.259 [2024-11-28 23:22:42.766777] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.259 [2024-11-28 23:22:42.775996] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.259 [2024-11-28 23:22:42.776280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 23:22:42.776438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 23:22:42.776468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.259 [2024-11-28 23:22:42.776486] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.259 [2024-11-28 23:22:42.776670] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.259 [2024-11-28 23:22:42.776857] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.259 [2024-11-28 23:22:42.776881] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.259 [2024-11-28 23:22:42.776898] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.259 [2024-11-28 23:22:42.779191] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.259 [2024-11-28 23:22:42.788718] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.259 [2024-11-28 23:22:42.788955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 23:22:42.789106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 23:22:42.789135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.259 [2024-11-28 23:22:42.789154] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.259 [2024-11-28 23:22:42.789355] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.259 [2024-11-28 23:22:42.789556] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.259 [2024-11-28 23:22:42.789581] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.259 [2024-11-28 23:22:42.789598] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.259 [2024-11-28 23:22:42.792055] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.259 [2024-11-28 23:22:42.801351] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.259 [2024-11-28 23:22:42.801697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 23:22:42.801884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 23:22:42.801933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.259 [2024-11-28 23:22:42.801952] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.259 [2024-11-28 23:22:42.802118] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.259 [2024-11-28 23:22:42.802270] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.259 [2024-11-28 23:22:42.802294] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.259 [2024-11-28 23:22:42.802310] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.259 [2024-11-28 23:22:42.804625] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.259 [2024-11-28 23:22:42.813633] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.259 [2024-11-28 23:22:42.814005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 23:22:42.814156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 23:22:42.814185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.259 [2024-11-28 23:22:42.814204] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.259 [2024-11-28 23:22:42.814316] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.259 [2024-11-28 23:22:42.814498] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.259 [2024-11-28 23:22:42.814524] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.259 [2024-11-28 23:22:42.814541] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.259 [2024-11-28 23:22:42.817108] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.259 [2024-11-28 23:22:42.826068] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.259 [2024-11-28 23:22:42.826383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 23:22:42.826550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 23:22:42.826581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.259 [2024-11-28 23:22:42.826601] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.259 [2024-11-28 23:22:42.826749] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.259 [2024-11-28 23:22:42.826972] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.259 [2024-11-28 23:22:42.826997] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.259 [2024-11-28 23:22:42.827013] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.259 [2024-11-28 23:22:42.829485] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.259 [2024-11-28 23:22:42.838586] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.259 [2024-11-28 23:22:42.838882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 23:22:42.839041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 23:22:42.839070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.259 [2024-11-28 23:22:42.839088] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.259 [2024-11-28 23:22:42.839291] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.259 [2024-11-28 23:22:42.839526] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.259 [2024-11-28 23:22:42.839552] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.259 [2024-11-28 23:22:42.839568] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.259 [2024-11-28 23:22:42.841794] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.259 [2024-11-28 23:22:42.851243] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.259 [2024-11-28 23:22:42.851567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 23:22:42.851720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 23:22:42.851767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.259 [2024-11-28 23:22:42.851786] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.259 [2024-11-28 23:22:42.851934] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.260 [2024-11-28 23:22:42.852104] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.260 [2024-11-28 23:22:42.852127] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.260 [2024-11-28 23:22:42.852144] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.260 [2024-11-28 23:22:42.854316] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.519 [2024-11-28 23:22:42.863734] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.519 [2024-11-28 23:22:42.863984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.519 [2024-11-28 23:22:42.864116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.519 [2024-11-28 23:22:42.864145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.519 [2024-11-28 23:22:42.864164] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.519 [2024-11-28 23:22:42.864312] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.519 [2024-11-28 23:22:42.864526] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.519 [2024-11-28 23:22:42.864551] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.519 [2024-11-28 23:22:42.864568] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.519 [2024-11-28 23:22:42.867136] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.519 [2024-11-28 23:22:42.876328] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.519 [2024-11-28 23:22:42.876611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.519 [2024-11-28 23:22:42.876738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.519 [2024-11-28 23:22:42.876767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.519 [2024-11-28 23:22:42.876786] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.519 [2024-11-28 23:22:42.876934] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.519 [2024-11-28 23:22:42.877086] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.519 [2024-11-28 23:22:42.877110] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.519 [2024-11-28 23:22:42.877126] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.519 [2024-11-28 23:22:42.879524] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.519 [2024-11-28 23:22:42.888951] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.519 [2024-11-28 23:22:42.889265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.519 [2024-11-28 23:22:42.889422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.519 [2024-11-28 23:22:42.889452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.519 [2024-11-28 23:22:42.889471] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.519 [2024-11-28 23:22:42.889637] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.519 [2024-11-28 23:22:42.889772] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.519 [2024-11-28 23:22:42.889795] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.519 [2024-11-28 23:22:42.889811] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.519 [2024-11-28 23:22:42.892400] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.519 [2024-11-28 23:22:42.901512] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.519 [2024-11-28 23:22:42.901929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.519 [2024-11-28 23:22:42.902082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.519 [2024-11-28 23:22:42.902111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.519 [2024-11-28 23:22:42.902129] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.519 [2024-11-28 23:22:42.902241] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.519 [2024-11-28 23:22:42.902440] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.519 [2024-11-28 23:22:42.902465] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.519 [2024-11-28 23:22:42.902481] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.519 [2024-11-28 23:22:42.904883] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.519 [2024-11-28 23:22:42.914030] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.519 [2024-11-28 23:22:42.914460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.519 [2024-11-28 23:22:42.914616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.519 [2024-11-28 23:22:42.914645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.519 [2024-11-28 23:22:42.914664] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.519 [2024-11-28 23:22:42.914866] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.519 [2024-11-28 23:22:42.915001] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.519 [2024-11-28 23:22:42.915027] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.519 [2024-11-28 23:22:42.915043] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.519 [2024-11-28 23:22:42.917477] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.519 [2024-11-28 23:22:42.926513] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.519 [2024-11-28 23:22:42.926869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.519 [2024-11-28 23:22:42.926975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.519 [2024-11-28 23:22:42.927032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.519 [2024-11-28 23:22:42.927050] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.519 [2024-11-28 23:22:42.927220] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.519 [2024-11-28 23:22:42.927406] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.519 [2024-11-28 23:22:42.927440] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.519 [2024-11-28 23:22:42.927456] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.519 [2024-11-28 23:22:42.929795] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.519 [2024-11-28 23:22:42.939105] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.519 [2024-11-28 23:22:42.939455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.519 [2024-11-28 23:22:42.939558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.519 [2024-11-28 23:22:42.939583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.519 [2024-11-28 23:22:42.939599] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.519 [2024-11-28 23:22:42.939759] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.519 [2024-11-28 23:22:42.939927] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.519 [2024-11-28 23:22:42.939951] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.519 [2024-11-28 23:22:42.939967] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.519 [2024-11-28 23:22:42.942196] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.519 [2024-11-28 23:22:42.951767] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.519 [2024-11-28 23:22:42.952075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.519 [2024-11-28 23:22:42.952235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.519 [2024-11-28 23:22:42.952266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.519 [2024-11-28 23:22:42.952285] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.519 [2024-11-28 23:22:42.952502] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.519 [2024-11-28 23:22:42.952636] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.519 [2024-11-28 23:22:42.952661] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.519 [2024-11-28 23:22:42.952677] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.519 [2024-11-28 23:22:42.955172] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.519 [2024-11-28 23:22:42.964290] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.519 [2024-11-28 23:22:42.964605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.519 [2024-11-28 23:22:42.964757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.519 [2024-11-28 23:22:42.964785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.519 [2024-11-28 23:22:42.964807] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.519 [2024-11-28 23:22:42.965006] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.519 [2024-11-28 23:22:42.965193] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.520 [2024-11-28 23:22:42.965218] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.520 [2024-11-28 23:22:42.965235] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.520 [2024-11-28 23:22:42.967456] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.520 [2024-11-28 23:22:42.976892] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.520 [2024-11-28 23:22:42.977211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.520 [2024-11-28 23:22:42.977338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.520 [2024-11-28 23:22:42.977366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.520 [2024-11-28 23:22:42.977385] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.520 [2024-11-28 23:22:42.977601] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.520 [2024-11-28 23:22:42.977770] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.520 [2024-11-28 23:22:42.977796] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.520 [2024-11-28 23:22:42.977812] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.520 [2024-11-28 23:22:42.980218] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.520 [2024-11-28 23:22:42.989378] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.520 [2024-11-28 23:22:42.989726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.520 [2024-11-28 23:22:42.989854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.520 [2024-11-28 23:22:42.989882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.520 [2024-11-28 23:22:42.989901] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.520 [2024-11-28 23:22:42.990032] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.520 [2024-11-28 23:22:42.990219] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.520 [2024-11-28 23:22:42.990245] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.520 [2024-11-28 23:22:42.990261] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.520 [2024-11-28 23:22:42.992427] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.520 [2024-11-28 23:22:43.001931] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.520 [2024-11-28 23:22:43.002230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.520 [2024-11-28 23:22:43.002388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.520 [2024-11-28 23:22:43.002432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.520 [2024-11-28 23:22:43.002452] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.520 [2024-11-28 23:22:43.002627] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.520 [2024-11-28 23:22:43.002814] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.520 [2024-11-28 23:22:43.002839] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.520 [2024-11-28 23:22:43.002856] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.520 [2024-11-28 23:22:43.005120] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.520 [2024-11-28 23:22:43.014469] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.520 [2024-11-28 23:22:43.014703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.520 [2024-11-28 23:22:43.014834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.520 [2024-11-28 23:22:43.014864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.520 [2024-11-28 23:22:43.014883] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.520 [2024-11-28 23:22:43.015086] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.520 [2024-11-28 23:22:43.015273] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.520 [2024-11-28 23:22:43.015298] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.520 [2024-11-28 23:22:43.015315] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.520 [2024-11-28 23:22:43.017700] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.520 [2024-11-28 23:22:43.026909] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.520 [2024-11-28 23:22:43.027224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.520 [2024-11-28 23:22:43.027332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.520 [2024-11-28 23:22:43.027361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.520 [2024-11-28 23:22:43.027379] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.520 [2024-11-28 23:22:43.027521] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.520 [2024-11-28 23:22:43.027691] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.520 [2024-11-28 23:22:43.027715] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.520 [2024-11-28 23:22:43.027731] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.520 [2024-11-28 23:22:43.030151] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.520 [2024-11-28 23:22:43.039478] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.520 [2024-11-28 23:22:43.039784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.520 [2024-11-28 23:22:43.039890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.520 [2024-11-28 23:22:43.039919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.520 [2024-11-28 23:22:43.039938] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.520 [2024-11-28 23:22:43.040122] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.520 [2024-11-28 23:22:43.040299] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.520 [2024-11-28 23:22:43.040325] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.520 [2024-11-28 23:22:43.040342] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.520 [2024-11-28 23:22:43.042764] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.520 [2024-11-28 23:22:43.051965] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.520 [2024-11-28 23:22:43.052226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.520 [2024-11-28 23:22:43.052372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.520 [2024-11-28 23:22:43.052409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.520 [2024-11-28 23:22:43.052429] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.520 [2024-11-28 23:22:43.052617] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.520 [2024-11-28 23:22:43.052800] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.520 [2024-11-28 23:22:43.052825] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.520 [2024-11-28 23:22:43.052842] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.520 [2024-11-28 23:22:43.055178] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.520 [2024-11-28 23:22:43.064483] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.520 [2024-11-28 23:22:43.064831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.520 [2024-11-28 23:22:43.064996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.520 [2024-11-28 23:22:43.065024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.520 [2024-11-28 23:22:43.065041] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.520 [2024-11-28 23:22:43.065210] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.520 [2024-11-28 23:22:43.065344] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.520 [2024-11-28 23:22:43.065369] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.520 [2024-11-28 23:22:43.065386] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.520 [2024-11-28 23:22:43.067901] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.520 [2024-11-28 23:22:43.077048] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.520 [2024-11-28 23:22:43.077323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.520 [2024-11-28 23:22:43.077533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.520 [2024-11-28 23:22:43.077564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.520 [2024-11-28 23:22:43.077583] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.520 [2024-11-28 23:22:43.077768] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.520 [2024-11-28 23:22:43.077919] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.520 [2024-11-28 23:22:43.077950] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.520 [2024-11-28 23:22:43.077967] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.521 [2024-11-28 23:22:43.080102] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.521 [2024-11-28 23:22:43.089739] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.521 [2024-11-28 23:22:43.090128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.521 [2024-11-28 23:22:43.090304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.521 [2024-11-28 23:22:43.090335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.521 [2024-11-28 23:22:43.090353] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.521 [2024-11-28 23:22:43.090534] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.521 [2024-11-28 23:22:43.090723] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.521 [2024-11-28 23:22:43.090748] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.521 [2024-11-28 23:22:43.090765] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.521 [2024-11-28 23:22:43.093061] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.521 [2024-11-28 23:22:43.102180] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.521 [2024-11-28 23:22:43.102504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.521 [2024-11-28 23:22:43.102606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.521 [2024-11-28 23:22:43.102635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.521 [2024-11-28 23:22:43.102653] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.521 [2024-11-28 23:22:43.102838] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.521 [2024-11-28 23:22:43.103043] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.521 [2024-11-28 23:22:43.103068] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.521 [2024-11-28 23:22:43.103085] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.521 [2024-11-28 23:22:43.105413] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.521 [2024-11-28 23:22:43.114767] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.521 [2024-11-28 23:22:43.115129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.521 [2024-11-28 23:22:43.115261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.521 [2024-11-28 23:22:43.115292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.521 [2024-11-28 23:22:43.115311] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.521 [2024-11-28 23:22:43.115473] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.521 [2024-11-28 23:22:43.115679] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.521 [2024-11-28 23:22:43.115705] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.521 [2024-11-28 23:22:43.115727] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.521 [2024-11-28 23:22:43.118116] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.780 [2024-11-28 23:22:43.127404] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.780 [2024-11-28 23:22:43.127658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.780 [2024-11-28 23:22:43.127844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.780 [2024-11-28 23:22:43.127872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.780 [2024-11-28 23:22:43.127889] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.780 [2024-11-28 23:22:43.128064] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.780 [2024-11-28 23:22:43.128249] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.780 [2024-11-28 23:22:43.128275] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.780 [2024-11-28 23:22:43.128291] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.780 [2024-11-28 23:22:43.130695] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.780 [2024-11-28 23:22:43.139968] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.780 [2024-11-28 23:22:43.140235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.780 [2024-11-28 23:22:43.140330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.780 [2024-11-28 23:22:43.140361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.780 [2024-11-28 23:22:43.140380] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.780 [2024-11-28 23:22:43.140526] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.780 [2024-11-28 23:22:43.140696] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.780 [2024-11-28 23:22:43.140720] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.780 [2024-11-28 23:22:43.140736] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.780 [2024-11-28 23:22:43.142981] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.780 [2024-11-28 23:22:43.152622] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.780 [2024-11-28 23:22:43.152958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.780 [2024-11-28 23:22:43.153117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.780 [2024-11-28 23:22:43.153145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.780 [2024-11-28 23:22:43.153164] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.780 [2024-11-28 23:22:43.153312] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.780 [2024-11-28 23:22:43.153495] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.780 [2024-11-28 23:22:43.153520] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.781 [2024-11-28 23:22:43.153536] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.781 [2024-11-28 23:22:43.155588] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.781 [2024-11-28 23:22:43.165224] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.781 [2024-11-28 23:22:43.165490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.781 [2024-11-28 23:22:43.165617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.781 [2024-11-28 23:22:43.165666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.781 [2024-11-28 23:22:43.165685] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.781 [2024-11-28 23:22:43.165835] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.781 [2024-11-28 23:22:43.165986] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.781 [2024-11-28 23:22:43.166011] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.781 [2024-11-28 23:22:43.166028] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.781 [2024-11-28 23:22:43.168326] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.781 [2024-11-28 23:22:43.177944] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.781 [2024-11-28 23:22:43.178291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.781 [2024-11-28 23:22:43.178420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.781 [2024-11-28 23:22:43.178450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.781 [2024-11-28 23:22:43.178469] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.781 [2024-11-28 23:22:43.178601] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.781 [2024-11-28 23:22:43.178774] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.781 [2024-11-28 23:22:43.178813] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.781 [2024-11-28 23:22:43.178829] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.781 [2024-11-28 23:22:43.181272] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.781 [2024-11-28 23:22:43.190529] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.781 [2024-11-28 23:22:43.190874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.781 [2024-11-28 23:22:43.191123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.781 [2024-11-28 23:22:43.191181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.781 [2024-11-28 23:22:43.191200] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.781 [2024-11-28 23:22:43.191368] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.781 [2024-11-28 23:22:43.191567] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.781 [2024-11-28 23:22:43.191594] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.781 [2024-11-28 23:22:43.191611] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.781 [2024-11-28 23:22:43.193999] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.781 [2024-11-28 23:22:43.203181] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.781 [2024-11-28 23:22:43.203542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.781 [2024-11-28 23:22:43.203648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.781 [2024-11-28 23:22:43.203677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.781 [2024-11-28 23:22:43.203696] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.781 [2024-11-28 23:22:43.203808] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.781 [2024-11-28 23:22:43.203959] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.781 [2024-11-28 23:22:43.203982] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.781 [2024-11-28 23:22:43.203998] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.781 [2024-11-28 23:22:43.206300] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.781 [2024-11-28 23:22:43.215705] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.781 [2024-11-28 23:22:43.216002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.781 [2024-11-28 23:22:43.216137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.781 [2024-11-28 23:22:43.216169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.781 [2024-11-28 23:22:43.216188] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.781 [2024-11-28 23:22:43.216356] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.781 [2024-11-28 23:22:43.216520] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.781 [2024-11-28 23:22:43.216546] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.781 [2024-11-28 23:22:43.216563] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.781 [2024-11-28 23:22:43.218771] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.781 [2024-11-28 23:22:43.228373] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.781 [2024-11-28 23:22:43.228718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.781 [2024-11-28 23:22:43.228897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.781 [2024-11-28 23:22:43.228944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.781 [2024-11-28 23:22:43.228963] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.781 [2024-11-28 23:22:43.229148] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.781 [2024-11-28 23:22:43.229335] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.781 [2024-11-28 23:22:43.229360] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.781 [2024-11-28 23:22:43.229377] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.781 [2024-11-28 23:22:43.231830] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.781 [2024-11-28 23:22:43.240883] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.781 [2024-11-28 23:22:43.241253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.781 [2024-11-28 23:22:43.241458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.781 [2024-11-28 23:22:43.241485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.781 [2024-11-28 23:22:43.241503] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.781 [2024-11-28 23:22:43.241684] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.781 [2024-11-28 23:22:43.241849] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.781 [2024-11-28 23:22:43.241874] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.781 [2024-11-28 23:22:43.241890] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.781 [2024-11-28 23:22:43.244317] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.781 [2024-11-28 23:22:43.253583] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.781 [2024-11-28 23:22:43.253977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.781 [2024-11-28 23:22:43.254101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.781 [2024-11-28 23:22:43.254131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.781 [2024-11-28 23:22:43.254151] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.781 [2024-11-28 23:22:43.254335] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.781 [2024-11-28 23:22:43.254500] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.781 [2024-11-28 23:22:43.254524] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.781 [2024-11-28 23:22:43.254540] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.781 [2024-11-28 23:22:43.256944] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.781 [2024-11-28 23:22:43.266221] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.781 [2024-11-28 23:22:43.266528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.781 [2024-11-28 23:22:43.266660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.781 [2024-11-28 23:22:43.266691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.781 [2024-11-28 23:22:43.266710] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.781 [2024-11-28 23:22:43.266841] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.781 [2024-11-28 23:22:43.266974] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.781 [2024-11-28 23:22:43.266998] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.781 [2024-11-28 23:22:43.267014] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.781 [2024-11-28 23:22:43.269501] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.781 [2024-11-28 23:22:43.278878] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.781 [2024-11-28 23:22:43.279259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.781 [2024-11-28 23:22:43.279435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.781 [2024-11-28 23:22:43.279472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.781 [2024-11-28 23:22:43.279492] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.781 [2024-11-28 23:22:43.279677] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.781 [2024-11-28 23:22:43.279842] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.781 [2024-11-28 23:22:43.279868] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.781 [2024-11-28 23:22:43.279885] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.781 [2024-11-28 23:22:43.282291] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.782 [2024-11-28 23:22:43.291424] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.782 [2024-11-28 23:22:43.291724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.782 [2024-11-28 23:22:43.291852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.782 [2024-11-28 23:22:43.291880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.782 [2024-11-28 23:22:43.291898] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.782 [2024-11-28 23:22:43.292084] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.782 [2024-11-28 23:22:43.292271] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.782 [2024-11-28 23:22:43.292296] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.782 [2024-11-28 23:22:43.292312] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.782 [2024-11-28 23:22:43.294710] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.782 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 2578195 Killed "${NVMF_APP[@]}" "$@" 00:30:39.782 23:22:43 -- host/bdevperf.sh@36 -- # tgt_init 00:30:39.782 23:22:43 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:30:39.782 23:22:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:39.782 23:22:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:39.782 23:22:43 -- common/autotest_common.sh@10 -- # set +x 00:30:39.782 [2024-11-28 23:22:43.303967] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.782 [2024-11-28 23:22:43.304300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.782 [2024-11-28 23:22:43.304455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.782 [2024-11-28 23:22:43.304493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.782 [2024-11-28 23:22:43.304512] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.782 [2024-11-28 23:22:43.304661] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.782 [2024-11-28 23:22:43.304776] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.782 [2024-11-28 23:22:43.304799] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.782 [2024-11-28 23:22:43.304815] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.782 23:22:43 -- nvmf/common.sh@469 -- # nvmfpid=2579194 00:30:39.782 23:22:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:30:39.782 23:22:43 -- nvmf/common.sh@470 -- # waitforlisten 2579194 00:30:39.782 23:22:43 -- common/autotest_common.sh@829 -- # '[' -z 2579194 ']' 00:30:39.782 [2024-11-28 23:22:43.307096] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.782 23:22:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:39.782 23:22:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:39.782 23:22:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:39.782 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:39.782 23:22:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:39.782 23:22:43 -- common/autotest_common.sh@10 -- # set +x 00:30:39.782 [2024-11-28 23:22:43.316488] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.782 [2024-11-28 23:22:43.316803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.782 [2024-11-28 23:22:43.316926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.782 [2024-11-28 23:22:43.316952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.782 [2024-11-28 23:22:43.316970] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.782 [2024-11-28 23:22:43.317128] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.782 [2024-11-28 23:22:43.317280] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.782 [2024-11-28 23:22:43.317304] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.782 [2024-11-28 23:22:43.317321] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.782 [2024-11-28 23:22:43.319821] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.782 [2024-11-28 23:22:43.329002] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.782 [2024-11-28 23:22:43.329281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.782 [2024-11-28 23:22:43.329400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.782 [2024-11-28 23:22:43.329432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.782 [2024-11-28 23:22:43.329451] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.782 [2024-11-28 23:22:43.329582] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.782 [2024-11-28 23:22:43.329788] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.782 [2024-11-28 23:22:43.329812] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.782 [2024-11-28 23:22:43.329828] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.782 [2024-11-28 23:22:43.332182] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.782 [2024-11-28 23:22:43.341506] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.782 [2024-11-28 23:22:43.341723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.782 [2024-11-28 23:22:43.341881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.782 [2024-11-28 23:22:43.341910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.782 [2024-11-28 23:22:43.341928] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.782 [2024-11-28 23:22:43.342114] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.782 [2024-11-28 23:22:43.342272] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.782 [2024-11-28 23:22:43.342298] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.782 [2024-11-28 23:22:43.342314] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.782 [2024-11-28 23:22:43.344680] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.782 [2024-11-28 23:22:43.350675] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:39.782 [2024-11-28 23:22:43.350743] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:39.782 [2024-11-28 23:22:43.354161] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.782 [2024-11-28 23:22:43.354463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.782 [2024-11-28 23:22:43.354630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.782 [2024-11-28 23:22:43.354656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.782 [2024-11-28 23:22:43.354674] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.782 [2024-11-28 23:22:43.354882] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.782 [2024-11-28 23:22:43.355089] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.782 [2024-11-28 23:22:43.355113] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.782 [2024-11-28 23:22:43.355130] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.782 [2024-11-28 23:22:43.357526] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.782 [2024-11-28 23:22:43.366771] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.782 [2024-11-28 23:22:43.367087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.782 [2024-11-28 23:22:43.367236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.782 [2024-11-28 23:22:43.367263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.782 [2024-11-28 23:22:43.367279] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.782 [2024-11-28 23:22:43.367446] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.782 [2024-11-28 23:22:43.367579] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.782 [2024-11-28 23:22:43.367600] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.782 [2024-11-28 23:22:43.367614] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.782 [2024-11-28 23:22:43.370023] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:39.782 [2024-11-28 23:22:43.379265] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:39.782 [2024-11-28 23:22:43.379561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.782 [2024-11-28 23:22:43.379694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.782 [2024-11-28 23:22:43.379724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:39.782 [2024-11-28 23:22:43.379742] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:39.782 [2024-11-28 23:22:43.379931] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:39.782 [2024-11-28 23:22:43.380119] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:39.782 [2024-11-28 23:22:43.380144] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:39.782 [2024-11-28 23:22:43.380160] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:39.782 [2024-11-28 23:22:43.382331] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.042 EAL: No free 2048 kB hugepages reported on node 1 00:30:40.042 [2024-11-28 23:22:43.391900] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.042 [2024-11-28 23:22:43.392211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.042 [2024-11-28 23:22:43.392350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.042 [2024-11-28 23:22:43.392391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.042 [2024-11-28 23:22:43.392420] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.042 [2024-11-28 23:22:43.392603] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.042 [2024-11-28 23:22:43.392775] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.042 [2024-11-28 23:22:43.392800] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.042 [2024-11-28 23:22:43.392817] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.042 [2024-11-28 23:22:43.395107] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.042 [2024-11-28 23:22:43.404499] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.042 [2024-11-28 23:22:43.404774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.042 [2024-11-28 23:22:43.404877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.042 [2024-11-28 23:22:43.404909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.042 [2024-11-28 23:22:43.404928] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.042 [2024-11-28 23:22:43.405130] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.042 [2024-11-28 23:22:43.405318] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.042 [2024-11-28 23:22:43.405342] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.042 [2024-11-28 23:22:43.405358] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.042 [2024-11-28 23:22:43.407654] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.042 [2024-11-28 23:22:43.417461] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.042 [2024-11-28 23:22:43.417764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.042 [2024-11-28 23:22:43.417921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.042 [2024-11-28 23:22:43.417950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.042 [2024-11-28 23:22:43.417970] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.042 [2024-11-28 23:22:43.418106] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.042 [2024-11-28 23:22:43.418312] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.042 [2024-11-28 23:22:43.418336] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.042 [2024-11-28 23:22:43.418352] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.042 [2024-11-28 23:22:43.420471] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:30:40.042 [2024-11-28 23:22:43.420592] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.042 [2024-11-28 23:22:43.429944] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.042 [2024-11-28 23:22:43.430372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.042 [2024-11-28 23:22:43.430524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.042 [2024-11-28 23:22:43.430552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.043 [2024-11-28 23:22:43.430572] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.043 [2024-11-28 23:22:43.430747] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.043 [2024-11-28 23:22:43.430940] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.043 [2024-11-28 23:22:43.430965] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.043 [2024-11-28 23:22:43.430983] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.043 [2024-11-28 23:22:43.433170] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.043 [2024-11-28 23:22:43.442561] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.043 [2024-11-28 23:22:43.442887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.043 [2024-11-28 23:22:43.443058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.043 [2024-11-28 23:22:43.443089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.043 [2024-11-28 23:22:43.443109] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.043 [2024-11-28 23:22:43.443279] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.043 [2024-11-28 23:22:43.443455] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.043 [2024-11-28 23:22:43.443477] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.043 [2024-11-28 23:22:43.443492] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.043 [2024-11-28 23:22:43.445660] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.043 [2024-11-28 23:22:43.455163] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.043 [2024-11-28 23:22:43.455609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.043 [2024-11-28 23:22:43.455753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.043 [2024-11-28 23:22:43.455783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.043 [2024-11-28 23:22:43.455801] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.043 [2024-11-28 23:22:43.455932] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.043 [2024-11-28 23:22:43.456098] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.043 [2024-11-28 23:22:43.456123] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.043 [2024-11-28 23:22:43.456140] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.043 [2024-11-28 23:22:43.458401] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.043 [2024-11-28 23:22:43.467581] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.043 [2024-11-28 23:22:43.467927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.043 [2024-11-28 23:22:43.468065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.043 [2024-11-28 23:22:43.468091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.043 [2024-11-28 23:22:43.468109] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.043 [2024-11-28 23:22:43.468309] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.043 [2024-11-28 23:22:43.468524] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.043 [2024-11-28 23:22:43.468546] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.043 [2024-11-28 23:22:43.468560] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.043 [2024-11-28 23:22:43.470757] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.043 [2024-11-28 23:22:43.480071] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.043 [2024-11-28 23:22:43.480494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.043 [2024-11-28 23:22:43.480634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.043 [2024-11-28 23:22:43.480662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.043 [2024-11-28 23:22:43.480682] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.043 [2024-11-28 23:22:43.480873] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.043 [2024-11-28 23:22:43.481029] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.043 [2024-11-28 23:22:43.481053] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.043 [2024-11-28 23:22:43.481072] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.043 [2024-11-28 23:22:43.483465] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.043 [2024-11-28 23:22:43.492794] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.043 [2024-11-28 23:22:43.493100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.043 [2024-11-28 23:22:43.493250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.043 [2024-11-28 23:22:43.493279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.043 [2024-11-28 23:22:43.493298] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.043 [2024-11-28 23:22:43.493454] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.043 [2024-11-28 23:22:43.493621] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.043 [2024-11-28 23:22:43.493651] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.043 [2024-11-28 23:22:43.493667] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.043 [2024-11-28 23:22:43.496159] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.043 [2024-11-28 23:22:43.505494] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.043 [2024-11-28 23:22:43.505786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.043 [2024-11-28 23:22:43.505919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.043 [2024-11-28 23:22:43.505949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.043 [2024-11-28 23:22:43.505969] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.043 [2024-11-28 23:22:43.506153] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.043 [2024-11-28 23:22:43.506360] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.043 [2024-11-28 23:22:43.506406] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.043 [2024-11-28 23:22:43.506440] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.043 [2024-11-28 23:22:43.508798] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.043 [2024-11-28 23:22:43.511305] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:40.043 [2024-11-28 23:22:43.511461] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:40.043 [2024-11-28 23:22:43.511484] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:40.043 [2024-11-28 23:22:43.511500] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:40.043 [2024-11-28 23:22:43.511555] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:30:40.043 [2024-11-28 23:22:43.511600] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:30:40.043 [2024-11-28 23:22:43.511603] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:40.043 [2024-11-28 23:22:43.517824] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.043 [2024-11-28 23:22:43.518161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.043 [2024-11-28 23:22:43.518347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.043 [2024-11-28 23:22:43.518384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.043 [2024-11-28 23:22:43.518411] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.043 [2024-11-28 23:22:43.518632] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.043 [2024-11-28 23:22:43.518789] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.043 [2024-11-28 23:22:43.518811] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.043 [2024-11-28 23:22:43.518826] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.043 [2024-11-28 23:22:43.520770] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.043 [2024-11-28 23:22:43.530091] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.043 [2024-11-28 23:22:43.530568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.043 [2024-11-28 23:22:43.530690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.043 [2024-11-28 23:22:43.530718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.043 [2024-11-28 23:22:43.530739] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.043 [2024-11-28 23:22:43.530897] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.043 [2024-11-28 23:22:43.531105] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.043 [2024-11-28 23:22:43.531127] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.043 [2024-11-28 23:22:43.531143] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.044 [2024-11-28 23:22:43.533087] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.044 [2024-11-28 23:22:43.542353] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.044 [2024-11-28 23:22:43.542898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.044 [2024-11-28 23:22:43.543006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.044 [2024-11-28 23:22:43.543034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.044 [2024-11-28 23:22:43.543054] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.044 [2024-11-28 23:22:43.543245] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.044 [2024-11-28 23:22:43.543424] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.044 [2024-11-28 23:22:43.543448] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.044 [2024-11-28 23:22:43.543464] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.044 [2024-11-28 23:22:43.545542] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.044 [2024-11-28 23:22:43.554859] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.044 [2024-11-28 23:22:43.555279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.044 [2024-11-28 23:22:43.555412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.044 [2024-11-28 23:22:43.555453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.044 [2024-11-28 23:22:43.555473] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.044 [2024-11-28 23:22:43.555615] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.044 [2024-11-28 23:22:43.555854] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.044 [2024-11-28 23:22:43.555876] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.044 [2024-11-28 23:22:43.555891] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.044 [2024-11-28 23:22:43.557911] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.044 [2024-11-28 23:22:43.567146] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.044 [2024-11-28 23:22:43.567513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.044 [2024-11-28 23:22:43.567601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.044 [2024-11-28 23:22:43.567628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.044 [2024-11-28 23:22:43.567655] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.044 [2024-11-28 23:22:43.567810] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.044 [2024-11-28 23:22:43.567975] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.044 [2024-11-28 23:22:43.567997] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.044 [2024-11-28 23:22:43.568011] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.044 [2024-11-28 23:22:43.570043] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.044 [2024-11-28 23:22:43.579557] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.044 [2024-11-28 23:22:43.580034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.044 [2024-11-28 23:22:43.580143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.044 [2024-11-28 23:22:43.580169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.044 [2024-11-28 23:22:43.580188] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.044 [2024-11-28 23:22:43.580337] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.044 [2024-11-28 23:22:43.580520] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.044 [2024-11-28 23:22:43.580544] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.044 [2024-11-28 23:22:43.580561] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.044 [2024-11-28 23:22:43.582582] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.044 [2024-11-28 23:22:43.592050] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.044 [2024-11-28 23:22:43.592526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.044 [2024-11-28 23:22:43.592665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.044 [2024-11-28 23:22:43.592702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.044 [2024-11-28 23:22:43.592721] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.044 [2024-11-28 23:22:43.592841] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.044 [2024-11-28 23:22:43.593052] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.044 [2024-11-28 23:22:43.593074] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.044 [2024-11-28 23:22:43.593090] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.044 [2024-11-28 23:22:43.595239] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.044 [2024-11-28 23:22:43.604494] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.044 [2024-11-28 23:22:43.604809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.044 [2024-11-28 23:22:43.604940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.044 [2024-11-28 23:22:43.604968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.044 [2024-11-28 23:22:43.604985] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.044 [2024-11-28 23:22:43.605180] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.044 [2024-11-28 23:22:43.605352] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.044 [2024-11-28 23:22:43.605373] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.044 [2024-11-28 23:22:43.605413] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.044 [2024-11-28 23:22:43.607338] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.044 [2024-11-28 23:22:43.616868] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.044 [2024-11-28 23:22:43.617210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.044 [2024-11-28 23:22:43.617305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.044 [2024-11-28 23:22:43.617331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.044 [2024-11-28 23:22:43.617348] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.044 [2024-11-28 23:22:43.617554] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.044 [2024-11-28 23:22:43.617704] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.044 [2024-11-28 23:22:43.617729] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.044 [2024-11-28 23:22:43.617743] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.044 [2024-11-28 23:22:43.619721] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.044 [2024-11-28 23:22:43.628944] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.044 [2024-11-28 23:22:43.629236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.044 [2024-11-28 23:22:43.629367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.044 [2024-11-28 23:22:43.629402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.044 [2024-11-28 23:22:43.629422] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.044 [2024-11-28 23:22:43.629597] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.044 [2024-11-28 23:22:43.629792] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.044 [2024-11-28 23:22:43.629815] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.044 [2024-11-28 23:22:43.629829] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.044 [2024-11-28 23:22:43.631682] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.044 [2024-11-28 23:22:43.641351] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.044 [2024-11-28 23:22:43.641670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.044 [2024-11-28 23:22:43.641767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.044 [2024-11-28 23:22:43.641793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.044 [2024-11-28 23:22:43.641810] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.044 [2024-11-28 23:22:43.641994] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.044 [2024-11-28 23:22:43.642136] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.044 [2024-11-28 23:22:43.642159] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.044 [2024-11-28 23:22:43.642175] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.044 [2024-11-28 23:22:43.644048] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.304 [2024-11-28 23:22:43.653773] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.304 [2024-11-28 23:22:43.654032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 23:22:43.654169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 23:22:43.654198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.304 [2024-11-28 23:22:43.654215] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.304 [2024-11-28 23:22:43.654406] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.304 [2024-11-28 23:22:43.654558] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.304 [2024-11-28 23:22:43.654581] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.304 [2024-11-28 23:22:43.654597] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.304 [2024-11-28 23:22:43.656673] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.304 [2024-11-28 23:22:43.665907] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.304 [2024-11-28 23:22:43.666221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 23:22:43.666349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 23:22:43.666376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.304 [2024-11-28 23:22:43.666400] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.304 [2024-11-28 23:22:43.666553] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.304 [2024-11-28 23:22:43.666733] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.304 [2024-11-28 23:22:43.666755] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.304 [2024-11-28 23:22:43.666770] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.304 [2024-11-28 23:22:43.668787] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.304 [2024-11-28 23:22:43.678228] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.304 [2024-11-28 23:22:43.678511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 23:22:43.678633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 23:22:43.678668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.304 [2024-11-28 23:22:43.678685] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.304 [2024-11-28 23:22:43.678851] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.304 [2024-11-28 23:22:43.679027] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.304 [2024-11-28 23:22:43.679054] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.304 [2024-11-28 23:22:43.679069] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.304 [2024-11-28 23:22:43.681211] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.304 [2024-11-28 23:22:43.690737] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.304 [2024-11-28 23:22:43.691001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 23:22:43.691126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 23:22:43.691155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.304 [2024-11-28 23:22:43.691172] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.304 [2024-11-28 23:22:43.691290] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.304 [2024-11-28 23:22:43.691463] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.304 [2024-11-28 23:22:43.691484] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.304 [2024-11-28 23:22:43.691499] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.304 [2024-11-28 23:22:43.693594] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.304 [2024-11-28 23:22:43.702890] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.304 [2024-11-28 23:22:43.703257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 23:22:43.703358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 23:22:43.703383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.304 [2024-11-28 23:22:43.703409] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.304 [2024-11-28 23:22:43.703544] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.304 [2024-11-28 23:22:43.703723] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.304 [2024-11-28 23:22:43.703744] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.304 [2024-11-28 23:22:43.703757] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.304 [2024-11-28 23:22:43.705876] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.304 [2024-11-28 23:22:43.715310] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.304 [2024-11-28 23:22:43.715565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 23:22:43.715725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 23:22:43.715752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.304 [2024-11-28 23:22:43.715769] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.304 [2024-11-28 23:22:43.715968] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.304 [2024-11-28 23:22:43.716143] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.304 [2024-11-28 23:22:43.716166] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.304 [2024-11-28 23:22:43.716185] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.304 [2024-11-28 23:22:43.718165] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.304 [2024-11-28 23:22:43.727527] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.304 [2024-11-28 23:22:43.727819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 23:22:43.727931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 23:22:43.727957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.304 [2024-11-28 23:22:43.727975] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.304 [2024-11-28 23:22:43.728125] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.304 [2024-11-28 23:22:43.728302] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.304 [2024-11-28 23:22:43.728325] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.304 [2024-11-28 23:22:43.728339] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.304 [2024-11-28 23:22:43.730423] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.304 [2024-11-28 23:22:43.739789] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.304 [2024-11-28 23:22:43.740011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 23:22:43.740145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 23:22:43.740172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.305 [2024-11-28 23:22:43.740190] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.305 [2024-11-28 23:22:43.740356] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.305 [2024-11-28 23:22:43.740531] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.305 [2024-11-28 23:22:43.740554] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.305 [2024-11-28 23:22:43.740568] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.305 [2024-11-28 23:22:43.742502] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.305 [2024-11-28 23:22:43.752153] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.305 [2024-11-28 23:22:43.752510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 23:22:43.752661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 23:22:43.752689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.305 [2024-11-28 23:22:43.752706] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.305 [2024-11-28 23:22:43.752824] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.305 [2024-11-28 23:22:43.753017] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.305 [2024-11-28 23:22:43.753039] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.305 [2024-11-28 23:22:43.753053] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.305 [2024-11-28 23:22:43.754945] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.305 [2024-11-28 23:22:43.764351] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.305 [2024-11-28 23:22:43.764623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 23:22:43.764746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 23:22:43.764774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.305 [2024-11-28 23:22:43.764791] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.305 [2024-11-28 23:22:43.764925] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.305 [2024-11-28 23:22:43.765089] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.305 [2024-11-28 23:22:43.765111] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.305 [2024-11-28 23:22:43.765124] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.305 [2024-11-28 23:22:43.767196] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.305 [2024-11-28 23:22:43.776544] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.305 [2024-11-28 23:22:43.776789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 23:22:43.776913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 23:22:43.776941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.305 [2024-11-28 23:22:43.776958] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.305 [2024-11-28 23:22:43.777108] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.305 [2024-11-28 23:22:43.777272] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.305 [2024-11-28 23:22:43.777293] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.305 [2024-11-28 23:22:43.777307] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.305 [2024-11-28 23:22:43.779380] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.305 [2024-11-28 23:22:43.788803] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.305 [2024-11-28 23:22:43.789128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 23:22:43.789230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 23:22:43.789257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.305 [2024-11-28 23:22:43.789273] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.305 [2024-11-28 23:22:43.789467] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.305 [2024-11-28 23:22:43.789631] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.305 [2024-11-28 23:22:43.789652] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.305 [2024-11-28 23:22:43.789667] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.305 [2024-11-28 23:22:43.791577] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.305 [2024-11-28 23:22:43.801155] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.305 [2024-11-28 23:22:43.801459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 23:22:43.801581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 23:22:43.801607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.305 [2024-11-28 23:22:43.801625] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.305 [2024-11-28 23:22:43.801822] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.305 [2024-11-28 23:22:43.801966] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.305 [2024-11-28 23:22:43.801989] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.305 [2024-11-28 23:22:43.802003] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.305 [2024-11-28 23:22:43.804037] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.305 [2024-11-28 23:22:43.813325] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.305 [2024-11-28 23:22:43.813642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 23:22:43.813737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 23:22:43.813764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.305 [2024-11-28 23:22:43.813781] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.305 [2024-11-28 23:22:43.813931] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.305 [2024-11-28 23:22:43.814079] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.305 [2024-11-28 23:22:43.814101] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.305 [2024-11-28 23:22:43.814115] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.305 [2024-11-28 23:22:43.816226] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.305 [2024-11-28 23:22:43.825655] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.305 [2024-11-28 23:22:43.826004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 23:22:43.826087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 23:22:43.826113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.305 [2024-11-28 23:22:43.826129] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.305 [2024-11-28 23:22:43.826312] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.305 [2024-11-28 23:22:43.826456] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.305 [2024-11-28 23:22:43.826479] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.305 [2024-11-28 23:22:43.826494] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.305 [2024-11-28 23:22:43.828593] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.305 [2024-11-28 23:22:43.837979] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.305 [2024-11-28 23:22:43.838263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 23:22:43.838368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 23:22:43.838407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.305 [2024-11-28 23:22:43.838435] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.305 [2024-11-28 23:22:43.838605] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.305 [2024-11-28 23:22:43.838759] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.305 [2024-11-28 23:22:43.838782] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.305 [2024-11-28 23:22:43.838797] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.305 [2024-11-28 23:22:43.840961] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.305 [2024-11-28 23:22:43.850290] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.305 [2024-11-28 23:22:43.850588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 23:22:43.850715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 23:22:43.850744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.305 [2024-11-28 23:22:43.850762] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.305 [2024-11-28 23:22:43.850912] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.306 [2024-11-28 23:22:43.851079] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.306 [2024-11-28 23:22:43.851102] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.306 [2024-11-28 23:22:43.851117] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.306 [2024-11-28 23:22:43.853111] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.306 [2024-11-28 23:22:43.862483] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.306 [2024-11-28 23:22:43.862770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-28 23:22:43.862911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-28 23:22:43.862938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.306 [2024-11-28 23:22:43.862955] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.306 [2024-11-28 23:22:43.863105] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.306 [2024-11-28 23:22:43.863312] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.306 [2024-11-28 23:22:43.863333] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.306 [2024-11-28 23:22:43.863347] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.306 [2024-11-28 23:22:43.865423] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.306 [2024-11-28 23:22:43.874680] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.306 [2024-11-28 23:22:43.875053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-28 23:22:43.875175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-28 23:22:43.875206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.306 [2024-11-28 23:22:43.875223] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.306 [2024-11-28 23:22:43.875389] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.306 [2024-11-28 23:22:43.875507] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.306 [2024-11-28 23:22:43.875528] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.306 [2024-11-28 23:22:43.875542] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.306 [2024-11-28 23:22:43.877499] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.306 [2024-11-28 23:22:43.887094] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.306 [2024-11-28 23:22:43.887385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-28 23:22:43.887497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-28 23:22:43.887524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.306 [2024-11-28 23:22:43.887541] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.306 [2024-11-28 23:22:43.887658] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.306 [2024-11-28 23:22:43.887808] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.306 [2024-11-28 23:22:43.887830] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.306 [2024-11-28 23:22:43.887843] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.306 [2024-11-28 23:22:43.889770] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.306 [2024-11-28 23:22:43.899499] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.306 [2024-11-28 23:22:43.899794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-28 23:22:43.899895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-28 23:22:43.899923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.306 [2024-11-28 23:22:43.899940] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.306 [2024-11-28 23:22:43.900106] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.306 [2024-11-28 23:22:43.900267] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.306 [2024-11-28 23:22:43.900290] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.306 [2024-11-28 23:22:43.900304] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.306 [2024-11-28 23:22:43.902250] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.565 [2024-11-28 23:22:43.911852] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.565 [2024-11-28 23:22:43.912159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.565 [2024-11-28 23:22:43.912249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.565 [2024-11-28 23:22:43.912276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.565 [2024-11-28 23:22:43.912298] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.565 [2024-11-28 23:22:43.912491] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.565 [2024-11-28 23:22:43.912629] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.565 [2024-11-28 23:22:43.912658] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.565 [2024-11-28 23:22:43.912673] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.565 [2024-11-28 23:22:43.914839] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.565 [2024-11-28 23:22:43.924291] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.565 [2024-11-28 23:22:43.924622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.565 [2024-11-28 23:22:43.924746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.565 [2024-11-28 23:22:43.924774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.565 [2024-11-28 23:22:43.924791] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.565 [2024-11-28 23:22:43.924893] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.565 [2024-11-28 23:22:43.925055] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.565 [2024-11-28 23:22:43.925076] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.565 [2024-11-28 23:22:43.925089] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.565 [2024-11-28 23:22:43.927144] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.565 [2024-11-28 23:22:43.936438] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.565 [2024-11-28 23:22:43.936702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.565 [2024-11-28 23:22:43.936819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.565 [2024-11-28 23:22:43.936845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.565 [2024-11-28 23:22:43.936862] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.565 [2024-11-28 23:22:43.937011] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.565 [2024-11-28 23:22:43.937219] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.565 [2024-11-28 23:22:43.937240] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.565 [2024-11-28 23:22:43.937254] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.565 [2024-11-28 23:22:43.939316] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.565 [2024-11-28 23:22:43.948687] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.565 [2024-11-28 23:22:43.948992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.565 [2024-11-28 23:22:43.949109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.565 [2024-11-28 23:22:43.949135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.565 [2024-11-28 23:22:43.949152] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.565 [2024-11-28 23:22:43.949289] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.565 [2024-11-28 23:22:43.949420] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.565 [2024-11-28 23:22:43.949442] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.565 [2024-11-28 23:22:43.949457] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.565 [2024-11-28 23:22:43.951571] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.565 [2024-11-28 23:22:43.961036] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.565 [2024-11-28 23:22:43.961282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.565 [2024-11-28 23:22:43.961373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.565 [2024-11-28 23:22:43.961407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.565 [2024-11-28 23:22:43.961425] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.565 [2024-11-28 23:22:43.961576] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.565 [2024-11-28 23:22:43.961744] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.565 [2024-11-28 23:22:43.961765] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.565 [2024-11-28 23:22:43.961779] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.565 [2024-11-28 23:22:43.963813] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.565 [2024-11-28 23:22:43.973214] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.565 [2024-11-28 23:22:43.973511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.565 [2024-11-28 23:22:43.973612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.566 [2024-11-28 23:22:43.973638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.566 [2024-11-28 23:22:43.973655] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.566 [2024-11-28 23:22:43.973804] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.566 [2024-11-28 23:22:43.973987] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.566 [2024-11-28 23:22:43.974008] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.566 [2024-11-28 23:22:43.974023] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.566 [2024-11-28 23:22:43.976015] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.566 [2024-11-28 23:22:43.985508] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.566 [2024-11-28 23:22:43.985855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.566 [2024-11-28 23:22:43.985980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.566 [2024-11-28 23:22:43.986007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.566 [2024-11-28 23:22:43.986024] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.566 [2024-11-28 23:22:43.986157] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.566 [2024-11-28 23:22:43.986356] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.566 [2024-11-28 23:22:43.986401] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.566 [2024-11-28 23:22:43.986418] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.566 [2024-11-28 23:22:43.988556] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.566 [2024-11-28 23:22:43.997840] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.566 [2024-11-28 23:22:43.998147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.566 [2024-11-28 23:22:43.998266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.566 [2024-11-28 23:22:43.998293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.566 [2024-11-28 23:22:43.998310] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.566 [2024-11-28 23:22:43.998469] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.566 [2024-11-28 23:22:43.998635] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.566 [2024-11-28 23:22:43.998656] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.566 [2024-11-28 23:22:43.998671] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.566 [2024-11-28 23:22:44.000565] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.566 [2024-11-28 23:22:44.010128] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.566 [2024-11-28 23:22:44.010491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.566 [2024-11-28 23:22:44.010640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.566 [2024-11-28 23:22:44.010668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.566 [2024-11-28 23:22:44.010686] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.566 [2024-11-28 23:22:44.010787] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.566 [2024-11-28 23:22:44.010984] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.566 [2024-11-28 23:22:44.011005] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.566 [2024-11-28 23:22:44.011019] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.566 [2024-11-28 23:22:44.013026] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.566 [2024-11-28 23:22:44.022296] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.566 [2024-11-28 23:22:44.022567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.566 [2024-11-28 23:22:44.022689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.566 [2024-11-28 23:22:44.022716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.566 [2024-11-28 23:22:44.022733] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.566 [2024-11-28 23:22:44.022835] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.566 [2024-11-28 23:22:44.023014] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.566 [2024-11-28 23:22:44.023040] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.566 [2024-11-28 23:22:44.023055] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.566 [2024-11-28 23:22:44.025182] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.566 [2024-11-28 23:22:44.034556] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.566 [2024-11-28 23:22:44.034915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.566 [2024-11-28 23:22:44.035001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.566 [2024-11-28 23:22:44.035027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.566 [2024-11-28 23:22:44.035044] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.566 [2024-11-28 23:22:44.035161] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.566 [2024-11-28 23:22:44.035280] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.566 [2024-11-28 23:22:44.035317] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.566 [2024-11-28 23:22:44.035331] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.566 [2024-11-28 23:22:44.037532] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.566 [2024-11-28 23:22:44.046849] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.566 [2024-11-28 23:22:44.047165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.566 [2024-11-28 23:22:44.047284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.566 [2024-11-28 23:22:44.047311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.566 [2024-11-28 23:22:44.047328] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.566 [2024-11-28 23:22:44.047454] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.566 [2024-11-28 23:22:44.047638] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.566 [2024-11-28 23:22:44.047660] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.566 [2024-11-28 23:22:44.047675] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.566 [2024-11-28 23:22:44.049743] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.566 [2024-11-28 23:22:44.059332] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.566 [2024-11-28 23:22:44.059552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.566 [2024-11-28 23:22:44.059668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.566 [2024-11-28 23:22:44.059694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.566 [2024-11-28 23:22:44.059711] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.566 [2024-11-28 23:22:44.059844] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.566 [2024-11-28 23:22:44.060055] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.566 [2024-11-28 23:22:44.060076] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.566 [2024-11-28 23:22:44.060095] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.566 [2024-11-28 23:22:44.062132] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.566 [2024-11-28 23:22:44.071334] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.566 [2024-11-28 23:22:44.071672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.566 [2024-11-28 23:22:44.071795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.566 [2024-11-28 23:22:44.071821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.566 [2024-11-28 23:22:44.071840] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.566 [2024-11-28 23:22:44.072006] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.566 [2024-11-28 23:22:44.072212] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.566 [2024-11-28 23:22:44.072233] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.566 [2024-11-28 23:22:44.072246] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.566 [2024-11-28 23:22:44.074249] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.566 [2024-11-28 23:22:44.083537] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.566 [2024-11-28 23:22:44.083840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.566 [2024-11-28 23:22:44.083987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.566 [2024-11-28 23:22:44.084014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.566 [2024-11-28 23:22:44.084030] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.566 [2024-11-28 23:22:44.084180] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.567 [2024-11-28 23:22:44.084346] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.567 [2024-11-28 23:22:44.084366] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.567 [2024-11-28 23:22:44.084404] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.567 [2024-11-28 23:22:44.086293] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.567 [2024-11-28 23:22:44.095829] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.567 [2024-11-28 23:22:44.096102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-28 23:22:44.096188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-28 23:22:44.096215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.567 [2024-11-28 23:22:44.096232] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.567 [2024-11-28 23:22:44.096349] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.567 [2024-11-28 23:22:44.096513] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.567 [2024-11-28 23:22:44.096536] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.567 [2024-11-28 23:22:44.096550] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.567 [2024-11-28 23:22:44.098636] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.567 [2024-11-28 23:22:44.108144] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.567 [2024-11-28 23:22:44.108509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-28 23:22:44.108635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-28 23:22:44.108662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.567 [2024-11-28 23:22:44.108678] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.567 [2024-11-28 23:22:44.108796] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.567 [2024-11-28 23:22:44.108976] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.567 [2024-11-28 23:22:44.108998] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.567 [2024-11-28 23:22:44.109012] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.567 [2024-11-28 23:22:44.111016] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.567 [2024-11-28 23:22:44.120420] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.567 [2024-11-28 23:22:44.120694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-28 23:22:44.120810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-28 23:22:44.120838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.567 [2024-11-28 23:22:44.120855] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.567 [2024-11-28 23:22:44.121034] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.567 [2024-11-28 23:22:44.121226] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.567 [2024-11-28 23:22:44.121247] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.567 [2024-11-28 23:22:44.121261] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.567 [2024-11-28 23:22:44.123400] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.567 [2024-11-28 23:22:44.132703] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.567 [2024-11-28 23:22:44.132923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-28 23:22:44.133075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-28 23:22:44.133101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.567 [2024-11-28 23:22:44.133118] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.567 [2024-11-28 23:22:44.133251] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.567 [2024-11-28 23:22:44.133475] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.567 [2024-11-28 23:22:44.133498] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.567 [2024-11-28 23:22:44.133514] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.567 [2024-11-28 23:22:44.135790] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.567 [2024-11-28 23:22:44.144855] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.567 [2024-11-28 23:22:44.145163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-28 23:22:44.145276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-28 23:22:44.145303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.567 [2024-11-28 23:22:44.145320] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.567 [2024-11-28 23:22:44.145495] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.567 [2024-11-28 23:22:44.145660] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.567 [2024-11-28 23:22:44.145696] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.567 [2024-11-28 23:22:44.145710] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.567 [2024-11-28 23:22:44.147847] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.567 [2024-11-28 23:22:44.157205] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.567 [2024-11-28 23:22:44.157533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-28 23:22:44.157625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-28 23:22:44.157652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.567 [2024-11-28 23:22:44.157668] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.567 [2024-11-28 23:22:44.157775] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.567 [2024-11-28 23:22:44.157926] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.567 [2024-11-28 23:22:44.157947] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.567 [2024-11-28 23:22:44.157960] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.567 [2024-11-28 23:22:44.160060] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.850 [2024-11-28 23:22:44.169482] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.850 [2024-11-28 23:22:44.169722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.850 [2024-11-28 23:22:44.169839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.850 [2024-11-28 23:22:44.169866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.851 [2024-11-28 23:22:44.169883] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.851 [2024-11-28 23:22:44.170032] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.851 [2024-11-28 23:22:44.170197] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.851 [2024-11-28 23:22:44.170218] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.851 [2024-11-28 23:22:44.170232] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.851 [2024-11-28 23:22:44.172451] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.851 [2024-11-28 23:22:44.181755] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.851 [2024-11-28 23:22:44.182072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.851 [2024-11-28 23:22:44.182176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.851 [2024-11-28 23:22:44.182204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.851 [2024-11-28 23:22:44.182222] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.851 [2024-11-28 23:22:44.182355] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.851 [2024-11-28 23:22:44.182501] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.851 [2024-11-28 23:22:44.182524] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.851 [2024-11-28 23:22:44.182538] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.851 [2024-11-28 23:22:44.184664] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.851 [2024-11-28 23:22:44.194016] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.851 [2024-11-28 23:22:44.194338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.851 [2024-11-28 23:22:44.194433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.851 [2024-11-28 23:22:44.194461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.851 [2024-11-28 23:22:44.194478] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.851 [2024-11-28 23:22:44.194579] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.851 [2024-11-28 23:22:44.194775] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.851 [2024-11-28 23:22:44.194796] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.851 [2024-11-28 23:22:44.194810] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.851 [2024-11-28 23:22:44.196940] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.851 [2024-11-28 23:22:44.206239] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.851 [2024-11-28 23:22:44.206574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.851 [2024-11-28 23:22:44.206669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.851 [2024-11-28 23:22:44.206696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.851 [2024-11-28 23:22:44.206713] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.851 [2024-11-28 23:22:44.206830] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.851 [2024-11-28 23:22:44.206995] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.851 [2024-11-28 23:22:44.207016] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.851 [2024-11-28 23:22:44.207030] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.851 [2024-11-28 23:22:44.209194] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.851 [2024-11-28 23:22:44.218499] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.851 [2024-11-28 23:22:44.218792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.851 [2024-11-28 23:22:44.218921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.851 [2024-11-28 23:22:44.218952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.851 [2024-11-28 23:22:44.218971] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.851 [2024-11-28 23:22:44.219153] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.851 [2024-11-28 23:22:44.219316] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.851 [2024-11-28 23:22:44.219337] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.851 [2024-11-28 23:22:44.219351] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.851 [2024-11-28 23:22:44.221411] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.851 [2024-11-28 23:22:44.230782] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.851 [2024-11-28 23:22:44.231103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.851 [2024-11-28 23:22:44.231220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.851 [2024-11-28 23:22:44.231248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.851 [2024-11-28 23:22:44.231265] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.851 [2024-11-28 23:22:44.231418] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.851 [2024-11-28 23:22:44.231586] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.851 [2024-11-28 23:22:44.231608] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.851 [2024-11-28 23:22:44.231622] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.851 [2024-11-28 23:22:44.233452] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.851 [2024-11-28 23:22:44.243045] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.851 [2024-11-28 23:22:44.243412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.851 [2024-11-28 23:22:44.243514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.851 [2024-11-28 23:22:44.243546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.851 [2024-11-28 23:22:44.243563] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.851 [2024-11-28 23:22:44.243712] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.851 [2024-11-28 23:22:44.243910] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.851 [2024-11-28 23:22:44.243932] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.851 [2024-11-28 23:22:44.243945] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.851 [2024-11-28 23:22:44.245887] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.851 [2024-11-28 23:22:44.255317] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.851 [2024-11-28 23:22:44.255634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.851 [2024-11-28 23:22:44.255747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.851 [2024-11-28 23:22:44.255773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.851 [2024-11-28 23:22:44.255796] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.851 [2024-11-28 23:22:44.255979] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.851 [2024-11-28 23:22:44.256144] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.851 [2024-11-28 23:22:44.256165] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.851 [2024-11-28 23:22:44.256179] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.851 [2024-11-28 23:22:44.258093] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.851 [2024-11-28 23:22:44.267410] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.851 [2024-11-28 23:22:44.267735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.851 [2024-11-28 23:22:44.267854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.851 [2024-11-28 23:22:44.267881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.851 [2024-11-28 23:22:44.267899] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.851 [2024-11-28 23:22:44.268049] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.851 [2024-11-28 23:22:44.268233] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.851 [2024-11-28 23:22:44.268254] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.851 [2024-11-28 23:22:44.268268] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.851 [2024-11-28 23:22:44.270365] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.851 [2024-11-28 23:22:44.279637] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.851 [2024-11-28 23:22:44.279998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.851 [2024-11-28 23:22:44.280091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.851 [2024-11-28 23:22:44.280117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.851 [2024-11-28 23:22:44.280134] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.851 [2024-11-28 23:22:44.280316] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.851 [2024-11-28 23:22:44.280520] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.851 [2024-11-28 23:22:44.280543] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.852 [2024-11-28 23:22:44.280557] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.852 [2024-11-28 23:22:44.282481] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.852 [2024-11-28 23:22:44.292041] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.852 [2024-11-28 23:22:44.292318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.852 [2024-11-28 23:22:44.292446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.852 [2024-11-28 23:22:44.292474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.852 [2024-11-28 23:22:44.292491] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.852 [2024-11-28 23:22:44.292647] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.852 [2024-11-28 23:22:44.292843] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.852 [2024-11-28 23:22:44.292865] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.852 [2024-11-28 23:22:44.292879] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.852 [2024-11-28 23:22:44.295249] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.852 23:22:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:40.852 23:22:44 -- common/autotest_common.sh@862 -- # return 0 00:30:40.852 23:22:44 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:40.852 23:22:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:40.852 23:22:44 -- common/autotest_common.sh@10 -- # set +x 00:30:40.852 [2024-11-28 23:22:44.304438] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.852 [2024-11-28 23:22:44.304833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.852 [2024-11-28 23:22:44.304984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.852 [2024-11-28 23:22:44.305010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.852 [2024-11-28 23:22:44.305027] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.852 [2024-11-28 23:22:44.305225] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.852 [2024-11-28 23:22:44.305389] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.852 [2024-11-28 23:22:44.305433] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.852 [2024-11-28 23:22:44.305448] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.852 [2024-11-28 23:22:44.307363] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.852 [2024-11-28 23:22:44.316581] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.852 [2024-11-28 23:22:44.316896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.852 [2024-11-28 23:22:44.317015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.852 [2024-11-28 23:22:44.317041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.852 [2024-11-28 23:22:44.317058] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.852 [2024-11-28 23:22:44.317191] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.852 [2024-11-28 23:22:44.317372] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.852 [2024-11-28 23:22:44.317427] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.852 [2024-11-28 23:22:44.317443] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.852 [2024-11-28 23:22:44.319666] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.852 23:22:44 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:40.852 23:22:44 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:30:40.852 23:22:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:40.852 23:22:44 -- common/autotest_common.sh@10 -- # set +x 00:30:40.852 [2024-11-28 23:22:44.326702] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:40.852 [2024-11-28 23:22:44.328586] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.852 [2024-11-28 23:22:44.328873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.852 [2024-11-28 23:22:44.329019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.852 [2024-11-28 23:22:44.329046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.852 [2024-11-28 23:22:44.329063] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.852 [2024-11-28 23:22:44.329260] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.852 [2024-11-28 23:22:44.329451] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.852 [2024-11-28 23:22:44.329474] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.852 [2024-11-28 23:22:44.329489] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.852 [2024-11-28 23:22:44.331506] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.852 23:22:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:40.852 23:22:44 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:40.852 23:22:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:40.852 23:22:44 -- common/autotest_common.sh@10 -- # set +x 00:30:40.852 [2024-11-28 23:22:44.340946] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.852 [2024-11-28 23:22:44.341146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.852 [2024-11-28 23:22:44.341298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.852 [2024-11-28 23:22:44.341325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.852 [2024-11-28 23:22:44.341342] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.852 [2024-11-28 23:22:44.341499] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.852 [2024-11-28 23:22:44.341637] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.852 [2024-11-28 23:22:44.341659] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.852 [2024-11-28 23:22:44.341703] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.852 [2024-11-28 23:22:44.343720] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.852 [2024-11-28 23:22:44.353153] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.852 [2024-11-28 23:22:44.353510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.852 [2024-11-28 23:22:44.353608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.852 [2024-11-28 23:22:44.353635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.852 [2024-11-28 23:22:44.353652] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.852 [2024-11-28 23:22:44.353802] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.852 [2024-11-28 23:22:44.353972] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.852 [2024-11-28 23:22:44.353993] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.852 [2024-11-28 23:22:44.354008] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.852 [2024-11-28 23:22:44.356224] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.852 [2024-11-28 23:22:44.365528] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.852 [2024-11-28 23:22:44.365962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.852 [2024-11-28 23:22:44.366087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.852 [2024-11-28 23:22:44.366114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.852 [2024-11-28 23:22:44.366134] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.852 [2024-11-28 23:22:44.366275] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.852 [2024-11-28 23:22:44.366470] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.852 [2024-11-28 23:22:44.366493] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.852 [2024-11-28 23:22:44.366510] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.852 [2024-11-28 23:22:44.368688] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.852 Malloc0 00:30:40.852 23:22:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:40.852 23:22:44 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:40.852 23:22:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:40.852 23:22:44 -- common/autotest_common.sh@10 -- # set +x 00:30:40.852 [2024-11-28 23:22:44.377923] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.852 [2024-11-28 23:22:44.378189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.852 [2024-11-28 23:22:44.378290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.852 [2024-11-28 23:22:44.378317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.852 [2024-11-28 23:22:44.378334] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.852 [2024-11-28 23:22:44.378464] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.852 [2024-11-28 23:22:44.378602] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.852 [2024-11-28 23:22:44.378624] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.852 [2024-11-28 23:22:44.378639] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.852 23:22:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:40.852 23:22:44 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:40.853 [2024-11-28 23:22:44.380825] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.853 23:22:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:40.853 23:22:44 -- common/autotest_common.sh@10 -- # set +x 00:30:40.853 23:22:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:40.853 23:22:44 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:40.853 23:22:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:40.853 23:22:44 -- common/autotest_common.sh@10 -- # set +x 00:30:40.853 [2024-11-28 23:22:44.390375] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.853 [2024-11-28 23:22:44.390658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.853 [2024-11-28 23:22:44.390809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.853 [2024-11-28 23:22:44.390836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfed870 with addr=10.0.0.2, port=4420 00:30:40.853 [2024-11-28 23:22:44.390853] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfed870 is same with the state(5) to be set 00:30:40.853 [2024-11-28 23:22:44.390994] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfed870 (9): Bad file descriptor 00:30:40.853 [2024-11-28 23:22:44.391142] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.853 [2024-11-28 23:22:44.391163] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.853 [2024-11-28 23:22:44.391177] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.853 [2024-11-28 23:22:44.392598] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:40.853 [2024-11-28 23:22:44.393220] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.853 23:22:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:40.853 23:22:44 -- host/bdevperf.sh@38 -- # wait 2578508 00:30:40.853 [2024-11-28 23:22:44.402709] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.153 [2024-11-28 23:22:44.518214] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:30:49.276 00:30:49.276 Latency(us) 00:30:49.276 [2024-11-28T22:22:52.882Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:49.276 [2024-11-28T22:22:52.882Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:30:49.276 Verification LBA range: start 0x0 length 0x4000 00:30:49.276 Nvme1n1 : 15.01 9237.72 36.08 16162.65 0.00 5024.50 770.65 20971.52 00:30:49.276 [2024-11-28T22:22:52.882Z] =================================================================================================================== 00:30:49.276 [2024-11-28T22:22:52.882Z] Total : 9237.72 36.08 16162.65 0.00 5024.50 770.65 20971.52 00:30:49.534 23:22:53 -- host/bdevperf.sh@39 -- # sync 00:30:49.534 23:22:53 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:30:49.534 23:22:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:49.534 23:22:53 -- common/autotest_common.sh@10 -- # set +x 00:30:49.534 23:22:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:49.534 23:22:53 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:30:49.534 23:22:53 -- host/bdevperf.sh@44 -- # nvmftestfini 00:30:49.534 23:22:53 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:49.534 23:22:53 -- nvmf/common.sh@116 -- # sync 00:30:49.534 23:22:53 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:49.534 23:22:53 -- nvmf/common.sh@119 -- # set +e 00:30:49.534 23:22:53 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:49.534 23:22:53 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:49.534 rmmod nvme_tcp 00:30:49.534 rmmod nvme_fabrics 00:30:49.534 rmmod nvme_keyring 00:30:49.534 23:22:53 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:49.534 23:22:53 -- nvmf/common.sh@123 -- # set -e 00:30:49.534 23:22:53 -- nvmf/common.sh@124 -- # return 0 00:30:49.534 23:22:53 -- nvmf/common.sh@477 -- # '[' -n 2579194 ']' 00:30:49.534 23:22:53 -- nvmf/common.sh@478 -- # killprocess 2579194 00:30:49.534 23:22:53 -- common/autotest_common.sh@936 -- # '[' -z 2579194 ']' 00:30:49.534 23:22:53 -- common/autotest_common.sh@940 -- # kill -0 2579194 00:30:49.534 23:22:53 -- common/autotest_common.sh@941 -- # uname 00:30:49.534 23:22:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:49.534 23:22:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2579194 00:30:49.792 23:22:53 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:49.792 23:22:53 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:49.792 23:22:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2579194' 00:30:49.792 killing process with pid 2579194 00:30:49.792 23:22:53 -- common/autotest_common.sh@955 -- # kill 2579194 00:30:49.792 23:22:53 -- common/autotest_common.sh@960 -- # wait 2579194 00:30:50.051 23:22:53 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:50.051 23:22:53 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:50.051 23:22:53 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:50.051 23:22:53 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:50.051 23:22:53 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:50.051 23:22:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:50.051 23:22:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:50.051 23:22:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:51.959 23:22:55 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:51.959 00:30:51.959 real 0m23.296s 00:30:51.959 user 1m2.663s 00:30:51.959 sys 0m4.275s 00:30:51.959 23:22:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:51.959 23:22:55 -- common/autotest_common.sh@10 -- # set +x 00:30:51.959 ************************************ 00:30:51.959 END TEST nvmf_bdevperf 00:30:51.959 ************************************ 00:30:51.959 23:22:55 -- nvmf/nvmf.sh@124 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:30:51.959 23:22:55 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:51.959 23:22:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:51.959 23:22:55 -- common/autotest_common.sh@10 -- # set +x 00:30:51.959 ************************************ 00:30:51.959 START TEST nvmf_target_disconnect 00:30:51.959 ************************************ 00:30:51.959 23:22:55 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:30:51.959 * Looking for test storage... 00:30:51.959 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:30:51.959 23:22:55 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:51.959 23:22:55 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:51.959 23:22:55 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:52.218 23:22:55 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:52.218 23:22:55 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:52.218 23:22:55 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:52.218 23:22:55 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:52.218 23:22:55 -- scripts/common.sh@335 -- # IFS=.-: 00:30:52.218 23:22:55 -- scripts/common.sh@335 -- # read -ra ver1 00:30:52.218 23:22:55 -- scripts/common.sh@336 -- # IFS=.-: 00:30:52.218 23:22:55 -- scripts/common.sh@336 -- # read -ra ver2 00:30:52.218 23:22:55 -- scripts/common.sh@337 -- # local 'op=<' 00:30:52.218 23:22:55 -- scripts/common.sh@339 -- # ver1_l=2 00:30:52.218 23:22:55 -- scripts/common.sh@340 -- # ver2_l=1 00:30:52.218 23:22:55 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:52.218 23:22:55 -- scripts/common.sh@343 -- # case "$op" in 00:30:52.218 23:22:55 -- scripts/common.sh@344 -- # : 1 00:30:52.218 23:22:55 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:52.218 23:22:55 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:52.218 23:22:55 -- scripts/common.sh@364 -- # decimal 1 00:30:52.218 23:22:55 -- scripts/common.sh@352 -- # local d=1 00:30:52.218 23:22:55 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:52.218 23:22:55 -- scripts/common.sh@354 -- # echo 1 00:30:52.218 23:22:55 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:52.218 23:22:55 -- scripts/common.sh@365 -- # decimal 2 00:30:52.218 23:22:55 -- scripts/common.sh@352 -- # local d=2 00:30:52.218 23:22:55 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:52.218 23:22:55 -- scripts/common.sh@354 -- # echo 2 00:30:52.218 23:22:55 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:52.218 23:22:55 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:52.218 23:22:55 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:52.218 23:22:55 -- scripts/common.sh@367 -- # return 0 00:30:52.218 23:22:55 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:52.218 23:22:55 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:52.218 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:52.218 --rc genhtml_branch_coverage=1 00:30:52.218 --rc genhtml_function_coverage=1 00:30:52.218 --rc genhtml_legend=1 00:30:52.218 --rc geninfo_all_blocks=1 00:30:52.218 --rc geninfo_unexecuted_blocks=1 00:30:52.218 00:30:52.218 ' 00:30:52.218 23:22:55 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:52.218 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:52.218 --rc genhtml_branch_coverage=1 00:30:52.218 --rc genhtml_function_coverage=1 00:30:52.218 --rc genhtml_legend=1 00:30:52.218 --rc geninfo_all_blocks=1 00:30:52.218 --rc geninfo_unexecuted_blocks=1 00:30:52.218 00:30:52.218 ' 00:30:52.218 23:22:55 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:52.218 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:52.218 --rc genhtml_branch_coverage=1 00:30:52.218 --rc genhtml_function_coverage=1 00:30:52.218 --rc genhtml_legend=1 00:30:52.218 --rc geninfo_all_blocks=1 00:30:52.218 --rc geninfo_unexecuted_blocks=1 00:30:52.218 00:30:52.218 ' 00:30:52.218 23:22:55 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:52.219 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:52.219 --rc genhtml_branch_coverage=1 00:30:52.219 --rc genhtml_function_coverage=1 00:30:52.219 --rc genhtml_legend=1 00:30:52.219 --rc geninfo_all_blocks=1 00:30:52.219 --rc geninfo_unexecuted_blocks=1 00:30:52.219 00:30:52.219 ' 00:30:52.219 23:22:55 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:52.219 23:22:55 -- nvmf/common.sh@7 -- # uname -s 00:30:52.219 23:22:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:52.219 23:22:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:52.219 23:22:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:52.219 23:22:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:52.219 23:22:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:52.219 23:22:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:52.219 23:22:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:52.219 23:22:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:52.219 23:22:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:52.219 23:22:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:52.219 23:22:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:52.219 23:22:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:52.219 23:22:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:52.219 23:22:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:52.219 23:22:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:52.219 23:22:55 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:52.219 23:22:55 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:52.219 23:22:55 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:52.219 23:22:55 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:52.219 23:22:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:52.219 23:22:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:52.219 23:22:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:52.219 23:22:55 -- paths/export.sh@5 -- # export PATH 00:30:52.219 23:22:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:52.219 23:22:55 -- nvmf/common.sh@46 -- # : 0 00:30:52.219 23:22:55 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:52.219 23:22:55 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:52.219 23:22:55 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:52.219 23:22:55 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:52.219 23:22:55 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:52.219 23:22:55 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:52.219 23:22:55 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:52.219 23:22:55 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:52.219 23:22:55 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:30:52.219 23:22:55 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:30:52.219 23:22:55 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:30:52.219 23:22:55 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:30:52.219 23:22:55 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:52.219 23:22:55 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:52.219 23:22:55 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:52.219 23:22:55 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:52.219 23:22:55 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:52.219 23:22:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:52.219 23:22:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:52.219 23:22:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:52.219 23:22:55 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:52.219 23:22:55 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:52.219 23:22:55 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:52.219 23:22:55 -- common/autotest_common.sh@10 -- # set +x 00:30:54.125 23:22:57 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:54.125 23:22:57 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:54.125 23:22:57 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:54.125 23:22:57 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:54.125 23:22:57 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:54.125 23:22:57 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:54.125 23:22:57 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:54.125 23:22:57 -- nvmf/common.sh@294 -- # net_devs=() 00:30:54.125 23:22:57 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:54.125 23:22:57 -- nvmf/common.sh@295 -- # e810=() 00:30:54.125 23:22:57 -- nvmf/common.sh@295 -- # local -ga e810 00:30:54.125 23:22:57 -- nvmf/common.sh@296 -- # x722=() 00:30:54.125 23:22:57 -- nvmf/common.sh@296 -- # local -ga x722 00:30:54.126 23:22:57 -- nvmf/common.sh@297 -- # mlx=() 00:30:54.126 23:22:57 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:54.126 23:22:57 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:54.126 23:22:57 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:54.126 23:22:57 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:54.126 23:22:57 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:54.126 23:22:57 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:54.126 23:22:57 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:54.126 23:22:57 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:54.126 23:22:57 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:54.126 23:22:57 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:54.126 23:22:57 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:54.126 23:22:57 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:54.126 23:22:57 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:54.126 23:22:57 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:54.126 23:22:57 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:54.126 23:22:57 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:54.126 23:22:57 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:54.126 23:22:57 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:54.126 23:22:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:54.126 23:22:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:30:54.126 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:30:54.126 23:22:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:54.126 23:22:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:54.126 23:22:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:54.126 23:22:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:54.126 23:22:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:54.126 23:22:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:54.126 23:22:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:30:54.126 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:30:54.126 23:22:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:54.126 23:22:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:54.126 23:22:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:54.126 23:22:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:54.126 23:22:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:54.126 23:22:57 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:54.126 23:22:57 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:54.126 23:22:57 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:54.126 23:22:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:54.126 23:22:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:54.126 23:22:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:54.126 23:22:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:54.126 23:22:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:30:54.126 Found net devices under 0000:0a:00.0: cvl_0_0 00:30:54.126 23:22:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:54.126 23:22:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:54.126 23:22:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:54.126 23:22:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:54.386 23:22:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:54.386 23:22:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:30:54.386 Found net devices under 0000:0a:00.1: cvl_0_1 00:30:54.386 23:22:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:54.386 23:22:57 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:54.386 23:22:57 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:54.386 23:22:57 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:54.386 23:22:57 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:54.386 23:22:57 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:54.386 23:22:57 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:54.386 23:22:57 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:54.386 23:22:57 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:54.386 23:22:57 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:54.386 23:22:57 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:54.386 23:22:57 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:54.386 23:22:57 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:54.386 23:22:57 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:54.386 23:22:57 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:54.386 23:22:57 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:54.386 23:22:57 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:54.386 23:22:57 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:54.386 23:22:57 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:54.386 23:22:57 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:54.386 23:22:57 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:54.386 23:22:57 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:54.386 23:22:57 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:54.386 23:22:57 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:54.386 23:22:57 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:54.386 23:22:57 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:54.386 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:54.386 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.231 ms 00:30:54.386 00:30:54.386 --- 10.0.0.2 ping statistics --- 00:30:54.386 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:54.386 rtt min/avg/max/mdev = 0.231/0.231/0.231/0.000 ms 00:30:54.386 23:22:57 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:54.386 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:54.386 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.076 ms 00:30:54.387 00:30:54.387 --- 10.0.0.1 ping statistics --- 00:30:54.387 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:54.387 rtt min/avg/max/mdev = 0.076/0.076/0.076/0.000 ms 00:30:54.387 23:22:57 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:54.387 23:22:57 -- nvmf/common.sh@410 -- # return 0 00:30:54.387 23:22:57 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:30:54.387 23:22:57 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:54.387 23:22:57 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:54.387 23:22:57 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:54.387 23:22:57 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:54.387 23:22:57 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:54.387 23:22:57 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:54.387 23:22:57 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:30:54.387 23:22:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:54.387 23:22:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:54.387 23:22:57 -- common/autotest_common.sh@10 -- # set +x 00:30:54.387 ************************************ 00:30:54.387 START TEST nvmf_target_disconnect_tc1 00:30:54.387 ************************************ 00:30:54.387 23:22:57 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc1 00:30:54.387 23:22:57 -- host/target_disconnect.sh@32 -- # set +e 00:30:54.387 23:22:57 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:30:54.387 EAL: No free 2048 kB hugepages reported on node 1 00:30:54.387 [2024-11-28 23:22:57.981219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:54.387 [2024-11-28 23:22:57.981445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:54.387 [2024-11-28 23:22:57.981477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5aedf0 with addr=10.0.0.2, port=4420 00:30:54.387 [2024-11-28 23:22:57.981512] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:30:54.387 [2024-11-28 23:22:57.981535] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:30:54.387 [2024-11-28 23:22:57.981551] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:30:54.387 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:30:54.387 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:30:54.387 Initializing NVMe Controllers 00:30:54.387 23:22:57 -- host/target_disconnect.sh@33 -- # trap - ERR 00:30:54.387 23:22:57 -- host/target_disconnect.sh@33 -- # print_backtrace 00:30:54.387 23:22:57 -- common/autotest_common.sh@1142 -- # [[ hxBET =~ e ]] 00:30:54.387 23:22:57 -- common/autotest_common.sh@1142 -- # return 0 00:30:54.387 23:22:57 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:30:54.387 23:22:57 -- host/target_disconnect.sh@41 -- # set -e 00:30:54.387 00:30:54.387 real 0m0.096s 00:30:54.387 user 0m0.032s 00:30:54.387 sys 0m0.062s 00:30:54.646 23:22:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:54.646 23:22:57 -- common/autotest_common.sh@10 -- # set +x 00:30:54.646 ************************************ 00:30:54.646 END TEST nvmf_target_disconnect_tc1 00:30:54.646 ************************************ 00:30:54.646 23:22:58 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:30:54.646 23:22:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:54.646 23:22:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:54.646 23:22:58 -- common/autotest_common.sh@10 -- # set +x 00:30:54.646 ************************************ 00:30:54.646 START TEST nvmf_target_disconnect_tc2 00:30:54.646 ************************************ 00:30:54.646 23:22:58 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc2 00:30:54.646 23:22:58 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:30:54.646 23:22:58 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:30:54.646 23:22:58 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:54.646 23:22:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:54.646 23:22:58 -- common/autotest_common.sh@10 -- # set +x 00:30:54.646 23:22:58 -- nvmf/common.sh@469 -- # nvmfpid=2582397 00:30:54.646 23:22:58 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:30:54.646 23:22:58 -- nvmf/common.sh@470 -- # waitforlisten 2582397 00:30:54.646 23:22:58 -- common/autotest_common.sh@829 -- # '[' -z 2582397 ']' 00:30:54.646 23:22:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:54.646 23:22:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:54.646 23:22:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:54.646 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:54.646 23:22:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:54.646 23:22:58 -- common/autotest_common.sh@10 -- # set +x 00:30:54.646 [2024-11-28 23:22:58.070500] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:54.646 [2024-11-28 23:22:58.070573] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:54.646 EAL: No free 2048 kB hugepages reported on node 1 00:30:54.646 [2024-11-28 23:22:58.143307] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:54.646 [2024-11-28 23:22:58.238414] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:54.646 [2024-11-28 23:22:58.238585] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:54.646 [2024-11-28 23:22:58.238607] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:54.646 [2024-11-28 23:22:58.238623] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:54.646 [2024-11-28 23:22:58.238707] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:30:54.646 [2024-11-28 23:22:58.238765] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:30:54.646 [2024-11-28 23:22:58.238826] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:30:54.646 [2024-11-28 23:22:58.238829] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:30:55.582 23:22:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:55.582 23:22:59 -- common/autotest_common.sh@862 -- # return 0 00:30:55.582 23:22:59 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:55.582 23:22:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:55.582 23:22:59 -- common/autotest_common.sh@10 -- # set +x 00:30:55.582 23:22:59 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:55.582 23:22:59 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:55.582 23:22:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:55.582 23:22:59 -- common/autotest_common.sh@10 -- # set +x 00:30:55.582 Malloc0 00:30:55.582 23:22:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:55.582 23:22:59 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:30:55.582 23:22:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:55.582 23:22:59 -- common/autotest_common.sh@10 -- # set +x 00:30:55.582 [2024-11-28 23:22:59.073658] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:55.582 23:22:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:55.582 23:22:59 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:55.582 23:22:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:55.582 23:22:59 -- common/autotest_common.sh@10 -- # set +x 00:30:55.582 23:22:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:55.582 23:22:59 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:55.582 23:22:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:55.582 23:22:59 -- common/autotest_common.sh@10 -- # set +x 00:30:55.582 23:22:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:55.582 23:22:59 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:55.583 23:22:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:55.583 23:22:59 -- common/autotest_common.sh@10 -- # set +x 00:30:55.583 [2024-11-28 23:22:59.101932] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:55.583 23:22:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:55.583 23:22:59 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:30:55.583 23:22:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:55.583 23:22:59 -- common/autotest_common.sh@10 -- # set +x 00:30:55.583 23:22:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:55.583 23:22:59 -- host/target_disconnect.sh@50 -- # reconnectpid=2582554 00:30:55.583 23:22:59 -- host/target_disconnect.sh@52 -- # sleep 2 00:30:55.583 23:22:59 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:30:55.583 EAL: No free 2048 kB hugepages reported on node 1 00:30:58.136 23:23:01 -- host/target_disconnect.sh@53 -- # kill -9 2582397 00:30:58.136 23:23:01 -- host/target_disconnect.sh@55 -- # sleep 2 00:30:58.136 Read completed with error (sct=0, sc=8) 00:30:58.136 starting I/O failed 00:30:58.136 Read completed with error (sct=0, sc=8) 00:30:58.136 starting I/O failed 00:30:58.136 Read completed with error (sct=0, sc=8) 00:30:58.136 starting I/O failed 00:30:58.136 Write completed with error (sct=0, sc=8) 00:30:58.136 starting I/O failed 00:30:58.136 Read completed with error (sct=0, sc=8) 00:30:58.136 starting I/O failed 00:30:58.136 Read completed with error (sct=0, sc=8) 00:30:58.136 starting I/O failed 00:30:58.136 Read completed with error (sct=0, sc=8) 00:30:58.136 starting I/O failed 00:30:58.136 Write completed with error (sct=0, sc=8) 00:30:58.136 starting I/O failed 00:30:58.136 Read completed with error (sct=0, sc=8) 00:30:58.136 starting I/O failed 00:30:58.136 Write completed with error (sct=0, sc=8) 00:30:58.136 starting I/O failed 00:30:58.136 Read completed with error (sct=0, sc=8) 00:30:58.136 starting I/O failed 00:30:58.136 Write completed with error (sct=0, sc=8) 00:30:58.136 starting I/O failed 00:30:58.136 Write completed with error (sct=0, sc=8) 00:30:58.136 starting I/O failed 00:30:58.136 Read completed with error (sct=0, sc=8) 00:30:58.136 starting I/O failed 00:30:58.136 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Write completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Write completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Write completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Write completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Write completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Write completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Write completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 [2024-11-28 23:23:01.127922] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Write completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Write completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Write completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Write completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Write completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Write completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Write completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Write completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 [2024-11-28 23:23:01.128276] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Write completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Write completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Write completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Write completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Write completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Write completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Write completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Write completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Write completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Read completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 Write completed with error (sct=0, sc=8) 00:30:58.137 starting I/O failed 00:30:58.137 [2024-11-28 23:23:01.128627] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:58.137 [2024-11-28 23:23:01.128868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.128976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.129003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.137 qpair failed and we were unable to recover it. 00:30:58.137 [2024-11-28 23:23:01.129190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.129331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.129356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.137 qpair failed and we were unable to recover it. 00:30:58.137 [2024-11-28 23:23:01.129493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.129598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.129626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.137 qpair failed and we were unable to recover it. 00:30:58.137 [2024-11-28 23:23:01.129764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.129845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.129869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.137 qpair failed and we were unable to recover it. 00:30:58.137 [2024-11-28 23:23:01.130001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.130162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.130190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.137 qpair failed and we were unable to recover it. 00:30:58.137 [2024-11-28 23:23:01.130289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.130414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.130450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.137 qpair failed and we were unable to recover it. 00:30:58.137 [2024-11-28 23:23:01.130574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.130679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.130706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.137 qpair failed and we were unable to recover it. 00:30:58.137 [2024-11-28 23:23:01.130811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.130937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.130965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.137 qpair failed and we were unable to recover it. 00:30:58.137 [2024-11-28 23:23:01.131162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.131286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.131314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.137 qpair failed and we were unable to recover it. 00:30:58.137 [2024-11-28 23:23:01.131468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.131567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.131594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.137 qpair failed and we were unable to recover it. 00:30:58.137 [2024-11-28 23:23:01.131746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.131836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.131861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.137 qpair failed and we were unable to recover it. 00:30:58.137 [2024-11-28 23:23:01.132006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.132135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.132163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.137 qpair failed and we were unable to recover it. 00:30:58.137 [2024-11-28 23:23:01.132315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.132402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.132435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.137 qpair failed and we were unable to recover it. 00:30:58.137 [2024-11-28 23:23:01.132572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.132708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.132738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.137 qpair failed and we were unable to recover it. 00:30:58.137 [2024-11-28 23:23:01.132912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.133086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.133114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.137 qpair failed and we were unable to recover it. 00:30:58.137 [2024-11-28 23:23:01.133242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.133337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.133365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.137 qpair failed and we were unable to recover it. 00:30:58.137 [2024-11-28 23:23:01.133482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.133602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.133628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.137 qpair failed and we were unable to recover it. 00:30:58.137 [2024-11-28 23:23:01.133786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.133876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.133903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.137 qpair failed and we were unable to recover it. 00:30:58.137 [2024-11-28 23:23:01.134054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.134176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.134203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.137 qpair failed and we were unable to recover it. 00:30:58.137 [2024-11-28 23:23:01.134320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.134449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.134476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.137 qpair failed and we were unable to recover it. 00:30:58.137 [2024-11-28 23:23:01.134567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.134700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.134727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.137 qpair failed and we were unable to recover it. 00:30:58.137 [2024-11-28 23:23:01.134848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.134967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.134995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.137 qpair failed and we were unable to recover it. 00:30:58.137 [2024-11-28 23:23:01.135091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.135174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.135199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.137 qpair failed and we were unable to recover it. 00:30:58.137 [2024-11-28 23:23:01.135318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.135449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.135476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.137 qpair failed and we were unable to recover it. 00:30:58.137 [2024-11-28 23:23:01.135600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.135734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.135763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.137 qpair failed and we were unable to recover it. 00:30:58.137 [2024-11-28 23:23:01.135850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.135970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.135996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.137 qpair failed and we were unable to recover it. 00:30:58.137 [2024-11-28 23:23:01.136098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.136213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.136241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.137 qpair failed and we were unable to recover it. 00:30:58.137 [2024-11-28 23:23:01.136400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.136559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.136586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.137 qpair failed and we were unable to recover it. 00:30:58.137 [2024-11-28 23:23:01.136712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.136829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.136856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.137 qpair failed and we were unable to recover it. 00:30:58.137 [2024-11-28 23:23:01.136980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.137098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.137126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.137 qpair failed and we were unable to recover it. 00:30:58.137 [2024-11-28 23:23:01.137275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.137401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.137429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.137 qpair failed and we were unable to recover it. 00:30:58.137 [2024-11-28 23:23:01.137557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.137656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.137699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.137 qpair failed and we were unable to recover it. 00:30:58.137 [2024-11-28 23:23:01.137803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.138085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.138128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.137 qpair failed and we were unable to recover it. 00:30:58.137 [2024-11-28 23:23:01.138302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.137 [2024-11-28 23:23:01.138400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.138428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.138573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.138670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.138699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.138847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.138976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.139003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.139127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.139212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.139238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.139342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.139478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.139506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.139662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.139827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.139874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.139999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.140116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.140143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.140240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.140361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.140401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.140546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.140683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.140711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.140895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.141021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.141048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.141172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.141293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.141321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.141433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.141585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.141612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.141742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.141895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.141923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.142035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.142181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.142208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.142357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.142564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.142592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.142741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.142856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.142883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.143001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.143117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.143144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.143234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.143356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.143385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.143555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.143677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.143705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.143853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.143942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.143970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.144060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.144178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.144206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.144326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.144441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.144474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.144624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.144772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.144800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.144922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.145035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.145063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.145185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.145305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.145332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.145464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.145577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.145604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.145727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.145844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.145872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.145965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.146087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.146113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.146228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.146322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.146349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.146468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.146614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.146642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.146800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.146920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.146948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.147042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.147154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.147184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.147304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.147410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.147439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.147587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.147735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.147763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.147883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.148002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.148030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.148152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.148266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.148293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.148413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.148527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.148553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.148666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.148783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.148811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.148901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.149021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.149047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.149146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.149309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.149337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.149422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.149539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.149566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.149687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.149782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.149811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.149930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.150054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.150081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.150173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.150256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.150281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.150407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.150547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.150574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.150691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.150809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.150836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.150951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.151047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.151072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.151170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.151283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.151309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.151429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.151575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.151603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.151726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.151819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.151844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.151963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.152080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.152108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.152228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.152373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.152406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.152515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.152630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.152657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.152781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.152922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.138 [2024-11-28 23:23:01.152949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.138 qpair failed and we were unable to recover it. 00:30:58.138 [2024-11-28 23:23:01.153069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.153152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.153179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.139 qpair failed and we were unable to recover it. 00:30:58.139 [2024-11-28 23:23:01.153268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.153421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.153449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.139 qpair failed and we were unable to recover it. 00:30:58.139 [2024-11-28 23:23:01.153562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.153676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.153703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.139 qpair failed and we were unable to recover it. 00:30:58.139 [2024-11-28 23:23:01.153800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.153909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.153935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.139 qpair failed and we were unable to recover it. 00:30:58.139 [2024-11-28 23:23:01.154056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.154151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.154178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.139 qpair failed and we were unable to recover it. 00:30:58.139 [2024-11-28 23:23:01.154308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.154421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.154449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.139 qpair failed and we were unable to recover it. 00:30:58.139 [2024-11-28 23:23:01.154594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.154710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.154738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.139 qpair failed and we were unable to recover it. 00:30:58.139 [2024-11-28 23:23:01.154857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.154967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.154994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.139 qpair failed and we were unable to recover it. 00:30:58.139 [2024-11-28 23:23:01.155132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.155251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.155279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.139 qpair failed and we were unable to recover it. 00:30:58.139 [2024-11-28 23:23:01.155372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.155473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.155500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.139 qpair failed and we were unable to recover it. 00:30:58.139 [2024-11-28 23:23:01.155623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.155734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.155759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.139 qpair failed and we were unable to recover it. 00:30:58.139 [2024-11-28 23:23:01.155844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.155989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.156016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.139 qpair failed and we were unable to recover it. 00:30:58.139 [2024-11-28 23:23:01.156164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.156254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.156281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.139 qpair failed and we were unable to recover it. 00:30:58.139 [2024-11-28 23:23:01.156403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.156522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.156548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.139 qpair failed and we were unable to recover it. 00:30:58.139 [2024-11-28 23:23:01.156643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.156733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.156759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.139 qpair failed and we were unable to recover it. 00:30:58.139 [2024-11-28 23:23:01.156875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.156995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.157022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.139 qpair failed and we were unable to recover it. 00:30:58.139 [2024-11-28 23:23:01.157168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.157284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.157311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.139 qpair failed and we were unable to recover it. 00:30:58.139 [2024-11-28 23:23:01.157430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.157551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.157578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.139 qpair failed and we were unable to recover it. 00:30:58.139 [2024-11-28 23:23:01.157669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.157813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.157840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.139 qpair failed and we were unable to recover it. 00:30:58.139 [2024-11-28 23:23:01.157943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.158053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.158080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.139 qpair failed and we were unable to recover it. 00:30:58.139 [2024-11-28 23:23:01.158170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.158296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.158324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.139 qpair failed and we were unable to recover it. 00:30:58.139 [2024-11-28 23:23:01.158420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.158529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.158555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.139 qpair failed and we were unable to recover it. 00:30:58.139 [2024-11-28 23:23:01.158712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.158833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.158860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.139 qpair failed and we were unable to recover it. 00:30:58.139 [2024-11-28 23:23:01.158948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.159062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.159088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.139 qpair failed and we were unable to recover it. 00:30:58.139 [2024-11-28 23:23:01.159203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.159346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.159373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.139 qpair failed and we were unable to recover it. 00:30:58.139 [2024-11-28 23:23:01.159519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.159663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.159691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.139 qpair failed and we were unable to recover it. 00:30:58.139 [2024-11-28 23:23:01.159781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.159896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.159921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.139 qpair failed and we were unable to recover it. 00:30:58.139 [2024-11-28 23:23:01.160002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.160118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.160143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.139 qpair failed and we were unable to recover it. 00:30:58.139 [2024-11-28 23:23:01.160243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.160350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.160374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.139 qpair failed and we were unable to recover it. 00:30:58.139 [2024-11-28 23:23:01.160476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.160595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.160621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.139 qpair failed and we were unable to recover it. 00:30:58.139 [2024-11-28 23:23:01.160739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.160850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.160878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.139 qpair failed and we were unable to recover it. 00:30:58.139 [2024-11-28 23:23:01.161026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.161151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.161178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.139 qpair failed and we were unable to recover it. 00:30:58.139 [2024-11-28 23:23:01.161322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.161448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.161476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.139 qpair failed and we were unable to recover it. 00:30:58.139 [2024-11-28 23:23:01.161599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.161685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.161711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.139 qpair failed and we were unable to recover it. 00:30:58.139 [2024-11-28 23:23:01.161835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.161950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.161978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.139 qpair failed and we were unable to recover it. 00:30:58.139 [2024-11-28 23:23:01.162101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.162247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.162275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.139 qpair failed and we were unable to recover it. 00:30:58.139 [2024-11-28 23:23:01.162368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.162462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.162487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.139 qpair failed and we were unable to recover it. 00:30:58.139 [2024-11-28 23:23:01.162633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.162752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.162780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.139 qpair failed and we were unable to recover it. 00:30:58.139 [2024-11-28 23:23:01.162927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.163021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.163049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.139 qpair failed and we were unable to recover it. 00:30:58.139 [2024-11-28 23:23:01.163202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.163348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.163375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.139 qpair failed and we were unable to recover it. 00:30:58.139 [2024-11-28 23:23:01.163476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.163612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.163658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.139 qpair failed and we were unable to recover it. 00:30:58.139 [2024-11-28 23:23:01.163782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.163926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.163954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.139 qpair failed and we were unable to recover it. 00:30:58.139 [2024-11-28 23:23:01.164033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.164152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.164177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.139 qpair failed and we were unable to recover it. 00:30:58.139 [2024-11-28 23:23:01.164299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.164406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.164432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.139 qpair failed and we were unable to recover it. 00:30:58.139 [2024-11-28 23:23:01.164556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.164644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.164672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.139 qpair failed and we were unable to recover it. 00:30:58.139 [2024-11-28 23:23:01.164835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.164975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.165004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.139 qpair failed and we were unable to recover it. 00:30:58.139 [2024-11-28 23:23:01.165091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.165204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.165230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.139 qpair failed and we were unable to recover it. 00:30:58.139 [2024-11-28 23:23:01.165347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.165499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.139 [2024-11-28 23:23:01.165527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.165626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.165753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.165783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.165924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.166069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.166096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.166217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.166329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.166357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.166461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.166583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.166609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.166733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.166842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.166869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.167023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.167143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.167171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.167288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.167428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.167457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.167579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.167722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.167749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.167842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.167929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.167955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.168080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.168222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.168249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.168370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.168464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.168490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.168612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.168692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.168717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.168839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.168957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.168984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.169132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.169221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.169249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.169334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.169453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.169479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.169599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.169716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.169742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.169829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.169974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.170001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.170092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.170176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.170201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.170349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.170448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.170474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.170567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.170683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.170711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.170849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.171017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.171050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.171203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.171323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.171350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.171492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.171653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.171684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.171783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.171912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.171942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.172078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.172196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.172240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.172359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.172482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.172510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.172608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.172726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.172753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.172884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.173010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.173041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.173197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.173300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.173325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.173455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.173540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.173584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.173707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.173851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.173881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.174012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.174108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.174138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.174291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.174427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.174470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.174568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.174652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.174678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.174798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.174885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.174910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.175056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.175177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.175205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.175307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.175448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.175475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.175570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.175653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.175679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.175768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.175888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.175914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.176002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.176147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.176174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.176313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.176462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.176495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.176617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.176759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.176786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.176877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.176985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.177010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.177154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.177312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.177342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.177479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.177598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.177625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.177784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.177941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.177969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.178118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.178216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.178247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.178355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.178481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.178508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.178625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.178757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.178784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.178906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.179045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.179077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.179240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.179401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.179447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.179543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.179701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.179731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.179859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.180011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.180040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.180168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.180305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.180332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.140 qpair failed and we were unable to recover it. 00:30:58.140 [2024-11-28 23:23:01.180453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.140 [2024-11-28 23:23:01.180577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.180605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.180716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.180900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.180927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.181064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.181200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.181230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.181371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.181506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.181534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.181625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.181709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.181735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.181848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.181933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.181959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.182105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.182235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.182265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.182436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.182547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.182573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.182685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.182832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.182859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.182977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.183091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.183117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.183244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.183384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.183418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.183505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.183654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.183681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.183797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.183928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.183958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.184112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.184253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.184280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.184404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.184526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.184553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.184698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.184801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.184833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.184992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.185078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.185106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.185287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.185428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.185456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.185573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.185728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.185758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.185866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.185998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.186025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.186142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.186253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.186280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.186391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.186494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.186520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.186640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.186765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.186795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.186964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.187087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.187115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.187224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.187368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.187402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.187530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.187646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.187673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.187754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.187897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.187924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.188039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.188169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.188199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.188290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.188420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.188446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.188528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.188646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.188673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.188767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.188879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.188904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.189019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.189131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.189175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.189279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.189364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.189390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.189500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.189643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.189670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.189762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.189881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.189907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.190050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.190168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.190195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.190317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.190459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.190487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.190588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.190697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.190728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.190852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.190942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.190969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.191091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.191167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.191192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.191304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.191420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.191449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.191564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.191709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.191736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.191848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.191990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.192017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.192099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.192209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.192249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.192381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.192487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.192515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.192651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.192783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.192813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.192901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.193062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.193092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.193205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.193323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.193350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.193523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.193622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.193652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.193776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.193894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.193924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.194065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.194184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.141 [2024-11-28 23:23:01.194211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.141 qpair failed and we were unable to recover it. 00:30:58.141 [2024-11-28 23:23:01.194294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.194435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.194463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.194555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.194659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.194702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.194827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.194946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.194973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.195064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.195207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.195234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.195371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.195508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.195535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.195631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.195740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.195765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.195937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.196063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.196094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.196224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.196315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.196361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.196462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.196581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.196606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.196697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.196802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.196829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.196987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.197115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.197143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.197229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.197346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.197371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.197499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.197655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.197685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.197787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.197882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.197912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.198047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.198201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.198228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.198349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.198522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.198553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.198686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.198849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.198879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.199024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.199167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.199195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.199367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.199524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.199553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.199693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.199806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.199833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.199912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.200028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.200053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.200202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.200368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.200407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.200542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.200637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.200666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.200751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.200856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.200883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.201000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.201138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.201165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.201296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.201409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.201437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.201566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.201684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.201711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.201808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.201959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.201990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.202087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.202191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.202221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.202368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.202469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.202495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.202613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.202692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.202719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.202845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.202961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.202990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.203107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.203256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.203283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.203373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.203494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.203520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.203601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.203716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.203742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.203861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.203975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.204002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.204086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.204210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.204237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.204371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.204500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.204531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.204674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.204818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.204844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.204989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.205103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.205129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.205247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.205335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.205362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.205491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.205637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.205663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.205756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.205834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.205860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.206006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.206163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.206192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.206308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.206423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.206450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.206576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.206660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.206687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.206828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.206949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.206979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.207120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.207243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.207269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.207384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.207499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.207528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.207625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.207713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.207743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.207907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.208048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.208089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.208191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.208312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.208341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.208501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.208610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.208639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.208772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.208886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.208912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.209034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.209170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.209196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.209286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.209398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.142 [2024-11-28 23:23:01.209425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.142 qpair failed and we were unable to recover it. 00:30:58.142 [2024-11-28 23:23:01.209572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.209693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.209718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.209831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.209953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.209982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.210081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.210184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.210213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.210313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.210431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.210460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.210615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.210758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.210785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.210953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.211047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.211076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.211236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.211360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.211386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.211516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.211666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.211693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.211801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.211922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.211948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.212068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.212180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.212206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.212290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.212404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.212430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.212542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.212683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.212712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.212837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.212954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.212981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.213112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.213238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.213281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.213401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.213507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.213537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.213671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.213822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.213849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.213954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.214085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.214114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.214289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.214406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.214433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.214581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.214698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.214724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.214871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.214982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.215011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.215098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.215224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.215253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.215390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.215509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.215535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.215643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.215785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.215834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.215928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.216040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.216085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.216193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.216309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.216335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.216447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.216555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.216581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.216698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.216843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.216869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.216991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.217102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.217128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.217257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.217402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.217429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.217508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.217615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.217659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.217767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.217883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.217909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.218016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.218160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.218186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.218328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.218459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.218489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.218656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.218733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.218759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.218869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.218979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.219005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.219150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.219253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.219294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.219413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.219553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.219580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.219693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.219802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.219828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.219971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.220107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.220137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.220232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.220374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.220406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.220553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.220706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.220735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.220863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.221023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.221049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.221161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.221271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.221298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.221414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.221544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.221573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.221674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.221792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.221820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.221960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.222049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.222076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.222237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.222408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.222438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.222594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.222732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.222758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.222843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.222924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.222950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.223100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.223218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.223245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.223408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.223575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.223602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.223723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.223843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.223870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.223962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.224073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.224100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.224177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.224351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.224380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.224532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.224642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.143 [2024-11-28 23:23:01.224669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.143 qpair failed and we were unable to recover it. 00:30:58.143 [2024-11-28 23:23:01.224793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.224889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.224915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.225055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.225206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.225232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.225356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.225443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.225470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.225568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.225676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.225702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.225803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.225954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.225983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.226122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.226245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.226271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.226359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.226541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.226572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.226697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.226815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.226844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.226961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.227106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.227132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.227267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.227427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.227457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.227586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.227686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.227715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.227816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.227959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.227986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.228156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.228258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.228287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.228405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.228556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.228583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.228680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.228823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.228849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.228962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.229146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.229188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.229307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.229386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.229419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.229567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.229654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.229680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.229798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.229883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.229931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.230032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.230205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.230232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.230380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.230501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.230528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.230616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.230732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.230758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.230881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.230963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.230989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.231139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.231227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.231254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.231377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.231508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.231537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.231658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.231834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.231861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.231968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.232111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.232137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.232223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.232341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.232367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.232497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.232583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.232626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.232790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.232880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.232906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.233023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.233133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.233159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.233304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.233430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.233461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.233630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.233749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.233775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.233867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.233975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.234001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.234114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.234234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.234264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.234378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.234483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.234510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.234635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.234771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.234801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.234956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.235113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.235143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.235282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.235400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.235426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.235575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.235695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.235721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.235852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.236010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.236039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.236142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.236258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.236285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.236462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.236581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.236607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.236691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.236813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.236839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.236937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.237050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.237077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.237156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.237258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.237287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.237449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.237601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.237630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.237774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.237888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.237913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.238006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.238121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.238151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.238237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.238383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.238417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.238532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.238652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.238678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.144 qpair failed and we were unable to recover it. 00:30:58.144 [2024-11-28 23:23:01.238803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.144 [2024-11-28 23:23:01.238957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.238985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.239110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.239239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.239268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.239443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.239592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.239618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.239738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.239866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.239894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.240048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.240177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.240205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.240334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.240454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.240481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.240582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.240668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.240697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.240850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.240963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.240989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.241080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.241165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.241195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.241315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.241493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.241520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.241599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.241695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.241722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.241832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.241973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.241999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.242084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.242197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.242222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.242347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.242469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.242499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.242636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.242781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.242807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.242936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.243024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.243050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.243189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.243292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.243322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.243424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.243516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.243541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.243623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.243753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.243782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.243878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.244000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.244029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.244171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.244287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.244313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.244425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.244569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.244596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.244684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.244800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.244827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.244968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.245108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.245135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.245285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.245424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.245454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.245622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.245734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.245761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.245910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.246056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.246083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.246239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.246324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.246350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.246482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.246616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.246659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.246783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.246928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.246954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.247099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.247235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.247264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.247419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.247550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.247592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.247717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.247808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.247836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.247953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.248115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.248145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.248240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.248343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.248372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.248490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.248613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.248640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.248774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.248928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.248957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.249085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.249218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.249246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.249387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.249510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.249536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.249678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.249808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.249838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.249964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.250125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.250154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.250253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.250344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.250372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.250474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.250642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.250670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.250803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.250933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.250962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.251134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.251298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.251327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.251466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.251562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.251591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.251765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.251911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.251945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.252091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.252232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.252259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.252403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.252531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.252561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.252693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.252825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.252851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.252995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.253113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.253139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.253285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.253415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.253449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.253574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.253716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.253745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.253897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.254007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.254033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.254160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.254294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.254322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.145 qpair failed and we were unable to recover it. 00:30:58.145 [2024-11-28 23:23:01.254452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.145 [2024-11-28 23:23:01.254545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.254575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.146 qpair failed and we were unable to recover it. 00:30:58.146 [2024-11-28 23:23:01.254734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.254853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.254879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.146 qpair failed and we were unable to recover it. 00:30:58.146 [2024-11-28 23:23:01.255017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.255175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.255204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.146 qpair failed and we were unable to recover it. 00:30:58.146 [2024-11-28 23:23:01.255334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.255471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.255501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.146 qpair failed and we were unable to recover it. 00:30:58.146 [2024-11-28 23:23:01.255665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.255776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.255807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.146 qpair failed and we were unable to recover it. 00:30:58.146 [2024-11-28 23:23:01.255919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.256004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.256030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.146 qpair failed and we were unable to recover it. 00:30:58.146 [2024-11-28 23:23:01.256146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.256246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.256275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.146 qpair failed and we were unable to recover it. 00:30:58.146 [2024-11-28 23:23:01.256407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.256497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.256523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.146 qpair failed and we were unable to recover it. 00:30:58.146 [2024-11-28 23:23:01.256634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.256798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.256826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.146 qpair failed and we were unable to recover it. 00:30:58.146 [2024-11-28 23:23:01.256957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.257074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.257104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.146 qpair failed and we were unable to recover it. 00:30:58.146 [2024-11-28 23:23:01.257257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.257351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.257378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.146 qpair failed and we were unable to recover it. 00:30:58.146 [2024-11-28 23:23:01.257493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.257628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.257657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.146 qpair failed and we were unable to recover it. 00:30:58.146 [2024-11-28 23:23:01.257791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.257924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.257953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.146 qpair failed and we were unable to recover it. 00:30:58.146 [2024-11-28 23:23:01.258069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.258214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.258240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.146 qpair failed and we were unable to recover it. 00:30:58.146 [2024-11-28 23:23:01.258333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.258532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.258558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.146 qpair failed and we were unable to recover it. 00:30:58.146 [2024-11-28 23:23:01.258681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.258767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.258794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.146 qpair failed and we were unable to recover it. 00:30:58.146 [2024-11-28 23:23:01.258944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.259051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.259078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.146 qpair failed and we were unable to recover it. 00:30:58.146 [2024-11-28 23:23:01.259162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.259244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.259271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.146 qpair failed and we were unable to recover it. 00:30:58.146 [2024-11-28 23:23:01.259383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.259489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.259515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.146 qpair failed and we were unable to recover it. 00:30:58.146 [2024-11-28 23:23:01.260089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.260262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.260293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.146 qpair failed and we were unable to recover it. 00:30:58.146 [2024-11-28 23:23:01.260424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.260601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.260628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.146 qpair failed and we were unable to recover it. 00:30:58.146 [2024-11-28 23:23:01.260759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.260884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.260913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.146 qpair failed and we were unable to recover it. 00:30:58.146 [2024-11-28 23:23:01.261074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.261197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.261223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.146 qpair failed and we were unable to recover it. 00:30:58.146 [2024-11-28 23:23:01.261369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.261523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.261553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.146 qpair failed and we were unable to recover it. 00:30:58.146 [2024-11-28 23:23:01.261707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.261835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.261864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.146 qpair failed and we were unable to recover it. 00:30:58.146 [2024-11-28 23:23:01.262033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.262119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.262146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.146 qpair failed and we were unable to recover it. 00:30:58.146 [2024-11-28 23:23:01.262284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.262416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.262453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.146 qpair failed and we were unable to recover it. 00:30:58.146 [2024-11-28 23:23:01.262582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.262728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.262758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.146 qpair failed and we were unable to recover it. 00:30:58.146 [2024-11-28 23:23:01.262855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.262995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.263022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.146 qpair failed and we were unable to recover it. 00:30:58.146 [2024-11-28 23:23:01.263116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.263191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.263218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.146 qpair failed and we were unable to recover it. 00:30:58.146 [2024-11-28 23:23:01.263335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.263605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.263635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.146 qpair failed and we were unable to recover it. 00:30:58.146 [2024-11-28 23:23:01.263787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.263942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.263969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.146 qpair failed and we were unable to recover it. 00:30:58.146 [2024-11-28 23:23:01.264081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.264207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.264236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.146 qpair failed and we were unable to recover it. 00:30:58.146 [2024-11-28 23:23:01.264377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.264547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.264576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.146 qpair failed and we were unable to recover it. 00:30:58.146 [2024-11-28 23:23:01.264725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.264870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.264897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.146 qpair failed and we were unable to recover it. 00:30:58.146 [2024-11-28 23:23:01.265047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.265210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.265239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.146 qpair failed and we were unable to recover it. 00:30:58.146 [2024-11-28 23:23:01.265350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.265501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.265531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.146 qpair failed and we were unable to recover it. 00:30:58.146 [2024-11-28 23:23:01.265665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.265799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.265826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.146 qpair failed and we were unable to recover it. 00:30:58.146 [2024-11-28 23:23:01.265957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.266054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.266084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.146 qpair failed and we were unable to recover it. 00:30:58.146 [2024-11-28 23:23:01.266187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.266271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.266299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.146 qpair failed and we were unable to recover it. 00:30:58.146 [2024-11-28 23:23:01.266459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.266542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.146 [2024-11-28 23:23:01.266568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.146 qpair failed and we were unable to recover it. 00:30:58.147 [2024-11-28 23:23:01.266667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.266821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.266850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.147 qpair failed and we were unable to recover it. 00:30:58.147 [2024-11-28 23:23:01.266970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.267093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.267122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.147 qpair failed and we were unable to recover it. 00:30:58.147 [2024-11-28 23:23:01.267259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.267382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.267414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.147 qpair failed and we were unable to recover it. 00:30:58.147 [2024-11-28 23:23:01.267533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.267660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.267689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.147 qpair failed and we were unable to recover it. 00:30:58.147 [2024-11-28 23:23:01.267816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.267979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.268009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.147 qpair failed and we were unable to recover it. 00:30:58.147 [2024-11-28 23:23:01.268150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.268281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.268307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.147 qpair failed and we were unable to recover it. 00:30:58.147 [2024-11-28 23:23:01.268450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.268577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.268604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.147 qpair failed and we were unable to recover it. 00:30:58.147 [2024-11-28 23:23:01.268747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.268884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.268913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.147 qpair failed and we were unable to recover it. 00:30:58.147 [2024-11-28 23:23:01.269073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.269187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.269214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.147 qpair failed and we were unable to recover it. 00:30:58.147 [2024-11-28 23:23:01.269343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.269437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.269463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.147 qpair failed and we were unable to recover it. 00:30:58.147 [2024-11-28 23:23:01.269561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.269709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.269734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.147 qpair failed and we were unable to recover it. 00:30:58.147 [2024-11-28 23:23:01.269831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.269915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.269941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.147 qpair failed and we were unable to recover it. 00:30:58.147 [2024-11-28 23:23:01.270083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.270211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.270246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.147 qpair failed and we were unable to recover it. 00:30:58.147 [2024-11-28 23:23:01.270429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.270536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.270565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.147 qpair failed and we were unable to recover it. 00:30:58.147 [2024-11-28 23:23:01.270695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.270781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.270811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.147 qpair failed and we were unable to recover it. 00:30:58.147 [2024-11-28 23:23:01.270931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.271041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.271072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.147 qpair failed and we were unable to recover it. 00:30:58.147 [2024-11-28 23:23:01.271195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.271318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.271347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.147 qpair failed and we were unable to recover it. 00:30:58.147 [2024-11-28 23:23:01.271495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.271620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.271646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.147 qpair failed and we were unable to recover it. 00:30:58.147 [2024-11-28 23:23:01.271788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.271942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.271972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.147 qpair failed and we were unable to recover it. 00:30:58.147 [2024-11-28 23:23:01.272101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.272230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.272259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.147 qpair failed and we were unable to recover it. 00:30:58.147 [2024-11-28 23:23:01.272471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.272609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.272638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.147 qpair failed and we were unable to recover it. 00:30:58.147 [2024-11-28 23:23:01.272779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.272930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.272959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.147 qpair failed and we were unable to recover it. 00:30:58.147 [2024-11-28 23:23:01.273064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.273213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.273243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.147 qpair failed and we were unable to recover it. 00:30:58.147 [2024-11-28 23:23:01.273385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.273523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.273549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.147 qpair failed and we were unable to recover it. 00:30:58.147 [2024-11-28 23:23:01.273685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.273791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.273822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.147 qpair failed and we were unable to recover it. 00:30:58.147 [2024-11-28 23:23:01.273917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.274011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.274040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.147 qpair failed and we were unable to recover it. 00:30:58.147 [2024-11-28 23:23:01.274202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.274344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.274370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.147 qpair failed and we were unable to recover it. 00:30:58.147 [2024-11-28 23:23:01.274548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.274644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.274684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.147 qpair failed and we were unable to recover it. 00:30:58.147 [2024-11-28 23:23:01.274815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.274914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.274944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.147 qpair failed and we were unable to recover it. 00:30:58.147 [2024-11-28 23:23:01.275055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.275157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.275183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.147 qpair failed and we were unable to recover it. 00:30:58.147 [2024-11-28 23:23:01.275316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.275479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.275506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.147 qpair failed and we were unable to recover it. 00:30:58.147 [2024-11-28 23:23:01.275591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.275731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.275761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.147 qpair failed and we were unable to recover it. 00:30:58.147 [2024-11-28 23:23:01.275863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.275948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.275975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.147 qpair failed and we were unable to recover it. 00:30:58.147 [2024-11-28 23:23:01.276066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.276172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.276202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.147 qpair failed and we were unable to recover it. 00:30:58.147 [2024-11-28 23:23:01.276340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.276469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.276496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.147 qpair failed and we were unable to recover it. 00:30:58.147 [2024-11-28 23:23:01.276622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.276713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.276740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.147 qpair failed and we were unable to recover it. 00:30:58.147 [2024-11-28 23:23:01.276839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.276935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.276964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.147 qpair failed and we were unable to recover it. 00:30:58.147 [2024-11-28 23:23:01.277096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.277228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.277257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.147 qpair failed and we were unable to recover it. 00:30:58.147 [2024-11-28 23:23:01.277429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.277595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.277625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.147 qpair failed and we were unable to recover it. 00:30:58.147 [2024-11-28 23:23:01.277794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.277879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.277905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.147 qpair failed and we were unable to recover it. 00:30:58.147 [2024-11-28 23:23:01.278063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.278206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.278233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.147 qpair failed and we were unable to recover it. 00:30:58.147 [2024-11-28 23:23:01.278355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.278502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.278529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.147 qpair failed and we were unable to recover it. 00:30:58.147 [2024-11-28 23:23:01.278705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.278840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.278869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.147 qpair failed and we were unable to recover it. 00:30:58.147 [2024-11-28 23:23:01.278997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.279100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.279129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.147 qpair failed and we were unable to recover it. 00:30:58.147 [2024-11-28 23:23:01.279265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.279382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.279419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.147 qpair failed and we were unable to recover it. 00:30:58.147 [2024-11-28 23:23:01.279601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.279770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.147 [2024-11-28 23:23:01.279800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.147 qpair failed and we were unable to recover it. 00:30:58.147 [2024-11-28 23:23:01.279931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.280099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.280126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.280221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.280361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.280388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.280544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.280644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.280677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.280814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.280970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.280999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.281121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.281208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.281235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.281326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.281447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.281474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.281623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.281774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.281803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.281922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.282044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.282071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.282189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.282315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.282344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.282488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.282613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.282647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.282753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.282866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.282894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.283025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.283148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.283177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.283279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.283363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.283400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.283546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.283672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.283699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.283831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.283961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.284011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.284105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.284221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.284247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.284360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.284498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.284524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.284673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.284811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.284841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.284947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.285050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.285080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.285195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.285281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.285309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.285474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.285611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.285637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.285783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.285873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.285902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.286077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.286184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.286211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.286317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.286441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.286471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.286626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.286815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.286842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.286989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.287108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.287135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.287230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.287355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.287406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.287554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.287716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.287746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.287875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.287991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.288018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.288132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.288208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.288253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.288461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.288595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.288624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.288770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.288912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.288939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.289065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.289192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.289221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.289344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.289480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.289509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.289625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.289730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.289756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.289895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.289993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.290023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.290144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.290268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.290298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.290464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.290582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.290608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.290733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.290870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.290913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.291007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.291089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.291115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.291230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.291344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.291371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.291475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.291585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.291610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.291719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.291814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.291844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.291986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.292075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.292101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.292233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.292358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.292388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.292492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.292620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.292659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.292809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.292920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.292946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.293108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.293307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.293336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.293510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.293651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.293677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.148 qpair failed and we were unable to recover it. 00:30:58.148 [2024-11-28 23:23:01.293814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.148 [2024-11-28 23:23:01.293928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.293955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.149 qpair failed and we were unable to recover it. 00:30:58.149 [2024-11-28 23:23:01.294145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.294267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.294295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.149 qpair failed and we were unable to recover it. 00:30:58.149 [2024-11-28 23:23:01.294441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.294531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.294560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.149 qpair failed and we were unable to recover it. 00:30:58.149 [2024-11-28 23:23:01.294680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.294836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.294863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.149 qpair failed and we were unable to recover it. 00:30:58.149 [2024-11-28 23:23:01.294997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.295095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.295125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.149 qpair failed and we were unable to recover it. 00:30:58.149 [2024-11-28 23:23:01.295247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.295372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.295411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.149 qpair failed and we were unable to recover it. 00:30:58.149 [2024-11-28 23:23:01.295537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.295645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.295671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.149 qpair failed and we were unable to recover it. 00:30:58.149 [2024-11-28 23:23:01.295798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.295943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.295972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.149 qpair failed and we were unable to recover it. 00:30:58.149 [2024-11-28 23:23:01.296107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.296230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.296259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.149 qpair failed and we were unable to recover it. 00:30:58.149 [2024-11-28 23:23:01.296404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.296564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.296607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.149 qpair failed and we were unable to recover it. 00:30:58.149 [2024-11-28 23:23:01.296730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.296829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.296860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.149 qpair failed and we were unable to recover it. 00:30:58.149 [2024-11-28 23:23:01.297018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.297147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.297196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.149 qpair failed and we were unable to recover it. 00:30:58.149 [2024-11-28 23:23:01.297348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.297454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.297481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.149 qpair failed and we were unable to recover it. 00:30:58.149 [2024-11-28 23:23:01.297643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.297734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.297763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.149 qpair failed and we were unable to recover it. 00:30:58.149 [2024-11-28 23:23:01.297935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.298030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.298056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.149 qpair failed and we were unable to recover it. 00:30:58.149 [2024-11-28 23:23:01.298176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.298256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.298282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.149 qpair failed and we were unable to recover it. 00:30:58.149 [2024-11-28 23:23:01.298432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.298589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.298618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.149 qpair failed and we were unable to recover it. 00:30:58.149 [2024-11-28 23:23:01.298741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.298861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.298890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.149 qpair failed and we were unable to recover it. 00:30:58.149 [2024-11-28 23:23:01.299033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.299121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.299147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.149 qpair failed and we were unable to recover it. 00:30:58.149 [2024-11-28 23:23:01.299244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.299370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.299403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.149 qpair failed and we were unable to recover it. 00:30:58.149 [2024-11-28 23:23:01.299539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.299688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.299717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.149 qpair failed and we were unable to recover it. 00:30:58.149 [2024-11-28 23:23:01.299858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.299978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.300007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.149 qpair failed and we were unable to recover it. 00:30:58.149 [2024-11-28 23:23:01.300173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.300286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.300312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.149 qpair failed and we were unable to recover it. 00:30:58.149 [2024-11-28 23:23:01.300408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.300546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.300576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.149 qpair failed and we were unable to recover it. 00:30:58.149 [2024-11-28 23:23:01.300715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.300856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.300882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.149 qpair failed and we were unable to recover it. 00:30:58.149 [2024-11-28 23:23:01.301012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.301143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.301172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.149 qpair failed and we were unable to recover it. 00:30:58.149 [2024-11-28 23:23:01.301267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.301402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.301443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.149 qpair failed and we were unable to recover it. 00:30:58.149 [2024-11-28 23:23:01.301555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.301637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.301671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.149 qpair failed and we were unable to recover it. 00:30:58.149 [2024-11-28 23:23:01.301793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.301903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.301933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.149 qpair failed and we were unable to recover it. 00:30:58.149 [2024-11-28 23:23:01.302062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.302181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.302211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.149 qpair failed and we were unable to recover it. 00:30:58.149 [2024-11-28 23:23:01.302348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.302476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.302503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.149 qpair failed and we were unable to recover it. 00:30:58.149 [2024-11-28 23:23:01.302631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.302725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.302755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.149 qpair failed and we were unable to recover it. 00:30:58.149 [2024-11-28 23:23:01.302919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.303022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.303053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.149 qpair failed and we were unable to recover it. 00:30:58.149 [2024-11-28 23:23:01.303194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.303313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.303340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.149 qpair failed and we were unable to recover it. 00:30:58.149 [2024-11-28 23:23:01.303469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.303588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.303615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.149 qpair failed and we were unable to recover it. 00:30:58.149 [2024-11-28 23:23:01.303726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.303852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.303881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.149 qpair failed and we were unable to recover it. 00:30:58.149 [2024-11-28 23:23:01.303984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.304098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.304124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.149 qpair failed and we were unable to recover it. 00:30:58.149 [2024-11-28 23:23:01.304243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.304345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.304389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.149 qpair failed and we were unable to recover it. 00:30:58.149 [2024-11-28 23:23:01.304568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.304679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.304705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.149 qpair failed and we were unable to recover it. 00:30:58.149 [2024-11-28 23:23:01.304814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.304945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.304971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.149 qpair failed and we were unable to recover it. 00:30:58.149 [2024-11-28 23:23:01.305091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.305219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.305249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.149 qpair failed and we were unable to recover it. 00:30:58.149 [2024-11-28 23:23:01.305375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.305548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.305578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.149 qpair failed and we were unable to recover it. 00:30:58.149 [2024-11-28 23:23:01.305705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.305902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.305946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.149 qpair failed and we were unable to recover it. 00:30:58.149 [2024-11-28 23:23:01.306075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.306203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.306232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.149 qpair failed and we were unable to recover it. 00:30:58.149 [2024-11-28 23:23:01.306328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.306440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.306471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.149 qpair failed and we were unable to recover it. 00:30:58.149 [2024-11-28 23:23:01.306574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.306664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.149 [2024-11-28 23:23:01.306691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.149 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.306834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.306915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.306942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.307034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.307248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.307278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.307411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.307547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.307574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.307714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.307882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.307909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.308054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.308162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.308190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.308356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.308506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.308550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.308703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.308862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.308892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.309007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.309134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.309164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.309276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.309421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.309455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.309626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.309737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.309766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.309901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.310028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.310057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.310168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.310314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.310340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.310499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.310609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.310636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.310813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.310942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.310973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.311110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.311229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.311255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.311402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.311600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.311629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.311786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.311915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.311949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.312089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.312200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.312228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.312379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.312546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.312576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.312680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.312774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.312804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.312974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.313094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.313121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.313255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.313410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.313441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.313534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.313637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.313666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.313800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.313899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.313926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.314119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.314258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.314300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.314417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.314512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.314539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.314650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.314770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.314796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.314937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.315070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.315100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.315299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.315456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.315486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.315621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.315744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.315770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.315930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.316057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.316086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.316212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.316370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.316407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.316557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.316685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.316712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.316888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.317041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.317082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.317205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.317338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.317369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.317577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.317691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.317733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.317825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.317920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.317952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.318110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.318214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.318246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.318416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.318510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.318537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.318634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.318750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.318796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.318897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.319024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.319053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.319196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.319282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.319308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.319504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.319627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.319656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.319749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.319868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.319896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.320007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.320118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.320146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.320240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.320335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.320364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.320460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.320584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.320613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.320735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.320887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.320928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.321024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.321146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.321174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.321306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.321428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.321457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.150 qpair failed and we were unable to recover it. 00:30:58.150 [2024-11-28 23:23:01.321563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.150 [2024-11-28 23:23:01.321679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.321706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.321838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.321964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.321992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.322097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.322245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.322272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.322446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.322638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.322665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.322759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.322846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.322873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.323019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.323107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.323134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.323286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.323408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.323436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.323600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.323721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.323753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.323905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.323994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.324022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.324126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.324236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.324262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.324426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.324512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.324540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.324628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.324715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.324742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.324901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.324994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.325021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.325230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.325344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.325371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.325511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.325613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.325640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.325724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.325829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.325856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.325993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.326107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.326134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.326258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.326354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.326383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.326530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.326615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.326642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.326752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.326902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.326929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.327041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.327180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.327207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.327323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.327407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.327433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.327544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.327630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.327656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.327741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.327931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.327957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.328035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.328149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.328173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.328264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.328351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.328375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.328477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.328597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.328621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.328736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.328857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.328881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.328971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.329060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.329084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.329237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.329329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.329354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.329478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.329561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.329586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.329705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.329788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.329813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.329894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.330038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.330063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.330147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.330239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.330264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.330383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.330512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.330537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.330648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.330770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.330794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.330886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.330979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.331003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.331122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.331210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.331234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.331382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.331587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.331612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.331736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.331876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.331900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.332010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.332093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.332117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.332216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.332327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.332351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.332461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.332571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.332596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.332669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.332809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.332833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.332918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.333008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.333033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.333131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.333223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.333248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.333343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.333459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.333485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.333600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.333725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.333750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.333858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.333980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.334004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.334089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.334208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.334234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.334349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.334465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.334491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.151 qpair failed and we were unable to recover it. 00:30:58.151 [2024-11-28 23:23:01.334576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.151 [2024-11-28 23:23:01.334653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.334678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.152 qpair failed and we were unable to recover it. 00:30:58.152 [2024-11-28 23:23:01.334771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.334861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.334885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.152 qpair failed and we were unable to recover it. 00:30:58.152 [2024-11-28 23:23:01.334972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.335100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.335125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.152 qpair failed and we were unable to recover it. 00:30:58.152 [2024-11-28 23:23:01.335245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.335361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.335386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.152 qpair failed and we were unable to recover it. 00:30:58.152 [2024-11-28 23:23:01.335511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.335627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.335652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.152 qpair failed and we were unable to recover it. 00:30:58.152 [2024-11-28 23:23:01.335747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.335861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.335888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.152 qpair failed and we were unable to recover it. 00:30:58.152 [2024-11-28 23:23:01.336006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.336100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.336124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.152 qpair failed and we were unable to recover it. 00:30:58.152 [2024-11-28 23:23:01.336242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.336321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.336351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.152 qpair failed and we were unable to recover it. 00:30:58.152 [2024-11-28 23:23:01.336473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.336560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.336586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.152 qpair failed and we were unable to recover it. 00:30:58.152 [2024-11-28 23:23:01.336707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.336833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.336860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.152 qpair failed and we were unable to recover it. 00:30:58.152 [2024-11-28 23:23:01.337056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.337167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.337193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.152 qpair failed and we were unable to recover it. 00:30:58.152 [2024-11-28 23:23:01.337314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.337407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.337435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.152 qpair failed and we were unable to recover it. 00:30:58.152 [2024-11-28 23:23:01.337554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.337644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.337670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.152 qpair failed and we were unable to recover it. 00:30:58.152 [2024-11-28 23:23:01.337769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.337908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.337936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.152 qpair failed and we were unable to recover it. 00:30:58.152 [2024-11-28 23:23:01.338050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.338163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.338189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.152 qpair failed and we were unable to recover it. 00:30:58.152 [2024-11-28 23:23:01.338384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.338528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.338556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.152 qpair failed and we were unable to recover it. 00:30:58.152 [2024-11-28 23:23:01.338644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.338739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.338766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.152 qpair failed and we were unable to recover it. 00:30:58.152 [2024-11-28 23:23:01.338884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.338965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.338992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.152 qpair failed and we were unable to recover it. 00:30:58.152 [2024-11-28 23:23:01.339093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.339235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.339261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.152 qpair failed and we were unable to recover it. 00:30:58.152 [2024-11-28 23:23:01.339372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.339468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.339495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.152 qpair failed and we were unable to recover it. 00:30:58.152 [2024-11-28 23:23:01.339586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.339708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.339734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.152 qpair failed and we were unable to recover it. 00:30:58.152 [2024-11-28 23:23:01.339855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.339974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.340000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.152 qpair failed and we were unable to recover it. 00:30:58.152 [2024-11-28 23:23:01.340125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.340245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.340271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.152 qpair failed and we were unable to recover it. 00:30:58.152 [2024-11-28 23:23:01.340389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.340515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.340542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.152 qpair failed and we were unable to recover it. 00:30:58.152 [2024-11-28 23:23:01.340638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.340833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.340860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.152 qpair failed and we were unable to recover it. 00:30:58.152 [2024-11-28 23:23:01.340955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.341070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.341097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.152 qpair failed and we were unable to recover it. 00:30:58.152 [2024-11-28 23:23:01.341210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.341317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.341344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.152 qpair failed and we were unable to recover it. 00:30:58.152 [2024-11-28 23:23:01.341485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.341572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.341599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.152 qpair failed and we were unable to recover it. 00:30:58.152 [2024-11-28 23:23:01.341759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.341955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.341982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.152 qpair failed and we were unable to recover it. 00:30:58.152 [2024-11-28 23:23:01.342107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.342190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.342216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.152 qpair failed and we were unable to recover it. 00:30:58.152 [2024-11-28 23:23:01.342330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.342436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.342462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.152 qpair failed and we were unable to recover it. 00:30:58.152 [2024-11-28 23:23:01.342571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.342714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.342740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.152 qpair failed and we were unable to recover it. 00:30:58.152 [2024-11-28 23:23:01.342936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.343064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.343092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.152 qpair failed and we were unable to recover it. 00:30:58.152 [2024-11-28 23:23:01.343188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.343302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.343328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.152 qpair failed and we were unable to recover it. 00:30:58.152 [2024-11-28 23:23:01.343419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.343534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.343560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.152 qpair failed and we were unable to recover it. 00:30:58.152 [2024-11-28 23:23:01.343680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.343800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.343826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.152 qpair failed and we were unable to recover it. 00:30:58.152 [2024-11-28 23:23:01.343955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.344076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.344102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.152 qpair failed and we were unable to recover it. 00:30:58.152 [2024-11-28 23:23:01.344220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.344311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.344338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.152 qpair failed and we were unable to recover it. 00:30:58.152 [2024-11-28 23:23:01.344443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.344540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.344566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.152 qpair failed and we were unable to recover it. 00:30:58.152 [2024-11-28 23:23:01.344655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.344735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.344761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.152 qpair failed and we were unable to recover it. 00:30:58.152 [2024-11-28 23:23:01.344955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.345068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.345095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.152 qpair failed and we were unable to recover it. 00:30:58.152 [2024-11-28 23:23:01.345239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.345332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.345358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.152 qpair failed and we were unable to recover it. 00:30:58.152 [2024-11-28 23:23:01.345461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.345554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.345580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.152 qpair failed and we were unable to recover it. 00:30:58.152 [2024-11-28 23:23:01.345700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.345819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.345845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.152 qpair failed and we were unable to recover it. 00:30:58.152 [2024-11-28 23:23:01.345962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.346105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.346131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.152 qpair failed and we were unable to recover it. 00:30:58.152 [2024-11-28 23:23:01.346224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.346365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.346416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.152 qpair failed and we were unable to recover it. 00:30:58.152 [2024-11-28 23:23:01.346549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.346664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.152 [2024-11-28 23:23:01.346690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.152 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.346813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.346899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.346926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.347038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.347160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.347189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.347310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.347429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.347457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.347544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.347735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.347762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.347881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.347998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.348024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.348113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.348192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.348218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.348314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.348406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.348434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.348555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.348672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.348698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.348814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.348902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.348929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.349046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.349131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.349158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.349250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.349347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.349374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.349501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.349596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.349627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.349723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.349808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.349835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.349985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.350071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.350097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.350217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.350311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.350338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.350451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.350574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.350601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.350688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.350798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.350825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.350908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.351035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.351061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.351207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.351328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.351354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.351508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.351605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.351632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.351725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.351866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.351893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.351986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.352077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.352103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.352236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.352355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.352381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.352490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.352574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.352600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.352733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.352826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.352854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.352975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.353071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.353098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.353219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.353360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.353387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.353516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.353611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.353637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.353722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.353836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.353862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.353956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.354042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.354068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.354149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.354261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.354288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.354484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.354601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.354628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.354745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.354854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.354881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.354997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.355089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.355116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.355211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.355303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.355329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.355429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.355519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.355545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.355664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.355747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.355773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.355864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.355949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.355977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.356097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.356219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.356245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.356390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.356481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.356507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.356716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.356844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.356870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.356988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.357075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.357101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.357186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.357312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.357338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.357458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.357551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.357577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.357720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.357838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.357863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.357951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.358042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.358068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.358147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.358257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.358282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.358369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.358489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.358516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.358606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.358721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.358747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.358836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.358950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.358976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.153 [2024-11-28 23:23:01.359063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.359203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.153 [2024-11-28 23:23:01.359229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.153 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.359344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.359464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.359493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.154 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.359584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.359667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.359698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.154 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.359792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.359866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.359891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.154 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.360034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.360150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.360176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.154 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.360294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.360378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.360412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.154 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.360500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.360612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.360638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.154 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.360753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.360873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.360899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.154 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.361014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.361093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.361119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.154 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.361238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.361324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.361350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.154 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.361441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.361557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.361582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.154 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.361676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.361761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.361788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.154 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.361898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.362015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.362042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.154 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.362135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.362287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.362313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.154 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.362425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.362518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.362544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.154 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.362636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.362718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.362744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.154 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.362835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.362946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.362973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.154 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.363065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.363157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.363183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.154 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.363281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.363379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.363414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.154 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.363531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.363673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.363700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.154 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.363798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.363912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.363939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.154 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.364030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.364113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.364139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.154 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.364238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.364345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.364372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.154 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.364591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.364679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.364705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.154 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.364851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.364939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.364965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.154 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.365089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.365207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.365234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.154 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.365329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.365417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.365444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.154 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.365534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.365659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.365684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.154 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.365796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.365879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.365904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.154 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.366037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.366176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.366201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.154 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.366319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.366412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.366438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.154 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.366550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.366663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.366689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.154 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.366812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.366966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.366992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.154 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.367111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.367204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.367231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.154 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.367324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.367447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.367474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.154 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.367566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.367681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.367706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.154 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.367822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.367945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.367971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.154 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.368094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.368235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.368261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.154 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.368385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.368477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.368506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.154 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.368599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.368684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.368709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.154 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.368835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.368957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.368982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.154 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.369074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.369159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.369185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.154 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.369293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.369386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.369419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.154 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.369520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.369650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.369676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.154 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.369825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.369935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.369960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.154 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.370043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.370184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.370210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.154 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.370328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.370424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.370451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.154 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.370544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.370636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.154 [2024-11-28 23:23:01.370663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.154 qpair failed and we were unable to recover it. 00:30:58.154 [2024-11-28 23:23:01.370783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.370876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.370902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.371055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.371145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.371171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.371261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.371382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.371418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.371567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.371649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.371675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.371773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.371890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.371916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.372001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.372112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.372142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.372257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.372378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.372410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.372506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.372617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.372644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.372736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.372827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.372854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.372968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.373116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.373143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.373263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.373390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.373423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.373532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.373620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.373646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.373740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.373832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.373860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.373984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.374107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.374134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.374226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.374314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.374341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.374458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.374541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.374567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.374665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.374786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.374812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.374903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.375004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.375030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.375124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.375202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.375228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.375312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.375445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.375472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.375592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.375683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.375709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.375857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.375945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.375971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.376065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.376174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.376200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.376312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.376402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.376429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.376524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.376641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.376668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.376783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.376898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.376925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.377050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.377132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.377158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.377246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.377340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.377366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.377493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.377580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.377607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.377734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.377853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.377880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.377974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.378086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.378112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.378256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.378345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.378371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.378534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.378675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.378702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.378812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.378897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.378924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.379010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.379124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.379151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.379245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.379332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.379358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.379480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.379583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.379610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.379707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.379793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.379818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.379928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.380045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.380072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.380189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.380279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.380304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.380445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.380537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.380562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.380653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.380765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.380792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.380890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.380981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.381008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.381150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.381265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.381297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.381432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.381564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.381593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.381716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.381843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.381870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.381985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.382110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.382137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.382265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.382360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.382387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.382507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.382625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.382652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.382775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.382919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.382947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.155 [2024-11-28 23:23:01.383081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.383196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.155 [2024-11-28 23:23:01.383223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.155 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.383314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.383433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.383461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.383560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.383650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.383678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.383775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.383903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.383931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.384026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.384141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.384168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.384288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.384403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.384431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.384526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.384620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.384653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.384772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.384891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.384918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.385049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.385177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.385204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.385324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.385438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.385466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.385589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.385674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.385701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.385820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.386331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.386362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.386492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.386610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.386637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.386733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.386827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.386855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.386976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.387071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.387098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.388365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.388507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.388536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.388628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.388727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.388760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.388860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.389000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.389028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.389150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.389264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.389292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.389417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.389568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.389595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.389718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.389838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.389865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.389984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.390102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.390129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.390218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.390334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.390362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.390465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.390590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.390617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.390728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.390824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.390852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.390941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.391029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.391058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.391175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.391295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.391327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.391446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.391595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.391622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.391755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.391847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.391875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.391974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.392059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.392086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.392180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.392277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.392304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.392424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.392520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.392548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.392642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.392760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.392787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.392875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.392998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.393025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.393145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.393228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.393255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.393350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.393503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.393531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.393665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.393747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.393779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.393868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.393957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.393984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.394069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.394180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.394208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.394330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.394427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.394456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.394548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.394625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.394652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.394772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.394890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.394919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.395045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.395166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.395193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.395334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.395457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.395486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.395608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.395699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.395725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.395839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.395994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.396021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.396136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.396225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.396252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.396346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.396461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.396489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.396584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.396706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.396733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.396835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.396950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.396977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.397093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.397207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.397233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.156 qpair failed and we were unable to recover it. 00:30:58.156 [2024-11-28 23:23:01.397332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.397448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.156 [2024-11-28 23:23:01.397476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.157 qpair failed and we were unable to recover it. 00:30:58.157 [2024-11-28 23:23:01.397604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.397690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.397717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.157 qpair failed and we were unable to recover it. 00:30:58.157 [2024-11-28 23:23:01.397840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.397936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.397963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.157 qpair failed and we were unable to recover it. 00:30:58.157 [2024-11-28 23:23:01.398105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.398200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.398228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.157 qpair failed and we were unable to recover it. 00:30:58.157 [2024-11-28 23:23:01.398324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.398411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.398439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.157 qpair failed and we were unable to recover it. 00:30:58.157 [2024-11-28 23:23:01.398544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.398664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.398692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.157 qpair failed and we were unable to recover it. 00:30:58.157 [2024-11-28 23:23:01.398786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.398902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.398929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.157 qpair failed and we were unable to recover it. 00:30:58.157 [2024-11-28 23:23:01.399026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.399148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.399177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.157 qpair failed and we were unable to recover it. 00:30:58.157 [2024-11-28 23:23:01.399278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.399389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.399422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.157 qpair failed and we were unable to recover it. 00:30:58.157 [2024-11-28 23:23:01.399512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.399627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.399654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.157 qpair failed and we were unable to recover it. 00:30:58.157 [2024-11-28 23:23:01.399773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.399855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.399882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.157 qpair failed and we were unable to recover it. 00:30:58.157 [2024-11-28 23:23:01.400000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.400089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.400116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.157 qpair failed and we were unable to recover it. 00:30:58.157 [2024-11-28 23:23:01.400238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.400355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.400382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.157 qpair failed and we were unable to recover it. 00:30:58.157 [2024-11-28 23:23:01.400509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.400617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.400644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.157 qpair failed and we were unable to recover it. 00:30:58.157 [2024-11-28 23:23:01.400737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.400853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.400880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.157 qpair failed and we were unable to recover it. 00:30:58.157 [2024-11-28 23:23:01.400998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.401144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.401171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.157 qpair failed and we were unable to recover it. 00:30:58.157 [2024-11-28 23:23:01.401274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.401416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.401444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.157 qpair failed and we were unable to recover it. 00:30:58.157 [2024-11-28 23:23:01.401527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.401623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.401650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.157 qpair failed and we were unable to recover it. 00:30:58.157 [2024-11-28 23:23:01.401733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.401876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.401902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.157 qpair failed and we were unable to recover it. 00:30:58.157 [2024-11-28 23:23:01.402023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.402144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.402173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.157 qpair failed and we were unable to recover it. 00:30:58.157 [2024-11-28 23:23:01.402329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.402430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.402459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.157 qpair failed and we were unable to recover it. 00:30:58.157 [2024-11-28 23:23:01.402550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.402645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.402672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.157 qpair failed and we were unable to recover it. 00:30:58.157 [2024-11-28 23:23:01.402794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.402918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.402945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.157 qpair failed and we were unable to recover it. 00:30:58.157 [2024-11-28 23:23:01.403038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.403126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.403154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.157 qpair failed and we were unable to recover it. 00:30:58.157 [2024-11-28 23:23:01.403236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.403334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.403362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.157 qpair failed and we were unable to recover it. 00:30:58.157 [2024-11-28 23:23:01.403491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.403582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.403610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.157 qpair failed and we were unable to recover it. 00:30:58.157 [2024-11-28 23:23:01.403706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.403794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.403821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.157 qpair failed and we were unable to recover it. 00:30:58.157 [2024-11-28 23:23:01.403915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.404036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.404063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.157 qpair failed and we were unable to recover it. 00:30:58.157 [2024-11-28 23:23:01.404149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.404266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.404292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.157 qpair failed and we were unable to recover it. 00:30:58.157 [2024-11-28 23:23:01.404387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.404538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.404565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.157 qpair failed and we were unable to recover it. 00:30:58.157 [2024-11-28 23:23:01.404654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.404738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.404765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.157 qpair failed and we were unable to recover it. 00:30:58.157 [2024-11-28 23:23:01.404911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.405056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.405084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.157 qpair failed and we were unable to recover it. 00:30:58.157 [2024-11-28 23:23:01.405180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.405272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.405299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.157 qpair failed and we were unable to recover it. 00:30:58.157 [2024-11-28 23:23:01.405387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.405514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.405542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.157 qpair failed and we were unable to recover it. 00:30:58.157 [2024-11-28 23:23:01.405645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.405756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.405783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.157 qpair failed and we were unable to recover it. 00:30:58.157 [2024-11-28 23:23:01.405876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.405996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.406023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.157 qpair failed and we were unable to recover it. 00:30:58.157 [2024-11-28 23:23:01.406127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.406228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.406255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.157 qpair failed and we were unable to recover it. 00:30:58.157 [2024-11-28 23:23:01.406368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.406490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.406517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.157 qpair failed and we were unable to recover it. 00:30:58.157 [2024-11-28 23:23:01.406606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.406692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.406719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.157 qpair failed and we were unable to recover it. 00:30:58.157 [2024-11-28 23:23:01.406812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.406930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.406957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.157 qpair failed and we were unable to recover it. 00:30:58.157 [2024-11-28 23:23:01.407078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.407164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.407192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.157 qpair failed and we were unable to recover it. 00:30:58.157 [2024-11-28 23:23:01.407314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.407411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.407439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.157 qpair failed and we were unable to recover it. 00:30:58.157 [2024-11-28 23:23:01.407529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.407670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.407697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.157 qpair failed and we were unable to recover it. 00:30:58.157 [2024-11-28 23:23:01.407784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.407901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.407928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.157 qpair failed and we were unable to recover it. 00:30:58.157 [2024-11-28 23:23:01.408044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.408163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.408190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.157 qpair failed and we were unable to recover it. 00:30:58.157 [2024-11-28 23:23:01.408279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.408396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.157 [2024-11-28 23:23:01.408424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.157 qpair failed and we were unable to recover it. 00:30:58.157 [2024-11-28 23:23:01.408560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.408644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.408671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.408761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.408850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.408877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.408996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.409109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.409135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.409227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.409344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.409372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.409493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.409611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.409638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.409731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.409848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.409876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.409973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.410070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.410097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.410194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.410284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.410311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.410455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.410542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.410568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.410689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.410808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.410835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.410958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.411052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.411079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.411173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.411290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.411317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.411419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.411561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.411589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.411677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.411759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.411786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.411872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.411990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.412017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.412138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.412235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.412262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.412357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.412485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.412513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.412597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.412713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.412740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.412857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.412955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.412981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.413071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.413185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.413212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.413363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.413491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.413518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.413612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.413715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.413742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.413864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.413981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.414008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.414090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.414201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.414229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.414353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.414476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.414504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.414611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.414728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.414755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.414848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.414935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.414961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.415057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.415139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.415166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.415281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.415368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.415403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.415508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.415595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.415624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.415715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.415842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.415870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.415958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.416043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.416071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.416222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.416340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.416368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.416490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.416587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.416615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.416764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.416847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.416874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.417017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.417108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.417135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.417225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.417308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.417335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.417475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.417587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.417613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.417708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.417792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.417819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.417918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.418001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.418028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.418123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.418269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.418296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.418383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.418477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.418504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.418617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.418711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.418740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.418851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.418996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.419023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.419119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.419210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.419238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.419384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.419506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.419533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.419621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.419741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.419768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.419861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.419946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.419975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.420094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.420216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.420244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.420330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.420431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.420459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.158 [2024-11-28 23:23:01.420571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.420697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.158 [2024-11-28 23:23:01.420724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.158 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.420842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.420926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.420953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.421033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.421155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.421182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.421299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.421418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.421447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.421529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.421617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.421644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.421762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.421852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.421879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.421963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.422052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.422080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.422209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.422354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.422381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.422489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.422616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.422643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.422731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.422871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.422897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.423011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.423101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.423128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.423248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.423388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.423420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.423537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.423661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.423688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.423794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.423944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.423971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.424114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.424199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.424227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.424316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.424408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.424436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.424520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.424635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.424663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.424744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.424836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.424862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.424940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.425020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.425046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.425190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.425278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.425306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.425399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.425488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.425521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.425664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.425782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.425810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.425934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.426054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.426081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.426170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.426290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.426317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.426412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.426511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.426538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.426681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.426770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.426797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.426914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.427015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.427043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.427164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.427252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.427279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.427403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.427493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.427521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.427641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.427738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.427765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.427850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.427966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.427997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.428095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.428177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.428204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.428327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.428426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.428454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.428543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.428654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.428681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.428805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.428890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.428917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.429038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.429164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.429191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.429286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.429416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.429444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.429547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.429691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.429718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.429810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.429928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.429955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.430048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.430168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.430196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.430294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.430386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.430426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.430539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.430654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.430681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.430838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.430932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.430959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.431044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.431161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.431188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.431339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.431438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.431466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.431566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.431655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.431683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.431780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.431869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.431897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.431988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.432074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.432100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.432225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.432318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.159 [2024-11-28 23:23:01.432345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.159 qpair failed and we were unable to recover it. 00:30:58.159 [2024-11-28 23:23:01.432458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.432548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.432575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.160 [2024-11-28 23:23:01.432658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.432777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.432808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.160 [2024-11-28 23:23:01.432953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.433069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.433096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.160 [2024-11-28 23:23:01.433181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.433266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.433293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.160 [2024-11-28 23:23:01.433439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.433532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.433560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.160 [2024-11-28 23:23:01.433675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.433821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.433848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.160 [2024-11-28 23:23:01.433936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.434020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.434049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.160 [2024-11-28 23:23:01.434143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.434235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.434262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.160 [2024-11-28 23:23:01.434406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.434500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.434527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.160 [2024-11-28 23:23:01.434662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.434795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.434822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.160 [2024-11-28 23:23:01.434945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.435068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.435096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.160 [2024-11-28 23:23:01.435212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.435329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.435356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.160 [2024-11-28 23:23:01.435453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.435575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.435602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.160 [2024-11-28 23:23:01.435746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.435832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.435861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.160 [2024-11-28 23:23:01.435963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.436054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.436082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.160 [2024-11-28 23:23:01.436178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.436261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.436288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.160 [2024-11-28 23:23:01.436421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.436540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.436567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.160 [2024-11-28 23:23:01.436685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.436778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.436805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.160 [2024-11-28 23:23:01.436923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.437006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.437034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.160 [2024-11-28 23:23:01.437147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.437263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.437290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.160 [2024-11-28 23:23:01.437422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.437509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.437538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.160 [2024-11-28 23:23:01.437659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.437771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.437798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.160 [2024-11-28 23:23:01.437924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.438044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.438071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.160 [2024-11-28 23:23:01.438185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.438278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.438306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.160 [2024-11-28 23:23:01.438406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.438496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.438523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.160 [2024-11-28 23:23:01.438613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.438695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.438722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.160 [2024-11-28 23:23:01.438840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.438960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.438987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.160 [2024-11-28 23:23:01.439081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.439200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.439227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.160 [2024-11-28 23:23:01.439347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.439441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.439469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.160 [2024-11-28 23:23:01.439586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.439679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.439707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.160 [2024-11-28 23:23:01.439820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.439910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.439937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.160 [2024-11-28 23:23:01.440019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.440108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.440135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.160 [2024-11-28 23:23:01.440228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.440311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.440338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.160 [2024-11-28 23:23:01.440467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.440557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.440584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.160 [2024-11-28 23:23:01.440679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.440797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.440824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.160 [2024-11-28 23:23:01.440947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.441074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.441101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.160 [2024-11-28 23:23:01.441192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.441286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.441313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.160 [2024-11-28 23:23:01.441437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.441555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.441584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.160 [2024-11-28 23:23:01.441709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.441821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.441849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.160 [2024-11-28 23:23:01.441966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.442080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.442107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.160 [2024-11-28 23:23:01.442203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.442314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.442341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.160 [2024-11-28 23:23:01.442491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.442608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.442635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.160 [2024-11-28 23:23:01.442730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.442848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.442874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.160 [2024-11-28 23:23:01.442969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.443054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.443082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.160 [2024-11-28 23:23:01.443198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.443313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.443340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.160 [2024-11-28 23:23:01.443435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.443549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.443576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.160 [2024-11-28 23:23:01.443665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.443753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.443781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.160 [2024-11-28 23:23:01.443881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.444001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.160 [2024-11-28 23:23:01.444029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.160 qpair failed and we were unable to recover it. 00:30:58.161 [2024-11-28 23:23:01.444147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.444264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.444291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.161 qpair failed and we were unable to recover it. 00:30:58.161 [2024-11-28 23:23:01.444386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.444472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.444499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.161 qpair failed and we were unable to recover it. 00:30:58.161 [2024-11-28 23:23:01.444594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.444706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.444733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.161 qpair failed and we were unable to recover it. 00:30:58.161 [2024-11-28 23:23:01.444849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.444969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.444996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.161 qpair failed and we were unable to recover it. 00:30:58.161 [2024-11-28 23:23:01.445101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.445217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.445245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.161 qpair failed and we were unable to recover it. 00:30:58.161 [2024-11-28 23:23:01.445345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.445461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.445489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.161 qpair failed and we were unable to recover it. 00:30:58.161 [2024-11-28 23:23:01.445580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.445705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.445731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.161 qpair failed and we were unable to recover it. 00:30:58.161 [2024-11-28 23:23:01.445874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.445995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.446023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.161 qpair failed and we were unable to recover it. 00:30:58.161 [2024-11-28 23:23:01.446109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.446195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.446222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.161 qpair failed and we were unable to recover it. 00:30:58.161 [2024-11-28 23:23:01.446319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.446405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.446433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.161 qpair failed and we were unable to recover it. 00:30:58.161 [2024-11-28 23:23:01.446521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.446608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.446635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.161 qpair failed and we were unable to recover it. 00:30:58.161 [2024-11-28 23:23:01.446778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.446897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.446924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.161 qpair failed and we were unable to recover it. 00:30:58.161 [2024-11-28 23:23:01.447015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.447132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.447161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.161 qpair failed and we were unable to recover it. 00:30:58.161 [2024-11-28 23:23:01.447242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.447338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.447365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:30:58.161 qpair failed and we were unable to recover it. 00:30:58.161 Read completed with error (sct=0, sc=8) 00:30:58.161 starting I/O failed 00:30:58.161 Read completed with error (sct=0, sc=8) 00:30:58.161 starting I/O failed 00:30:58.161 Read completed with error (sct=0, sc=8) 00:30:58.161 starting I/O failed 00:30:58.161 Read completed with error (sct=0, sc=8) 00:30:58.161 starting I/O failed 00:30:58.161 Read completed with error (sct=0, sc=8) 00:30:58.161 starting I/O failed 00:30:58.161 Write completed with error (sct=0, sc=8) 00:30:58.161 starting I/O failed 00:30:58.161 Write completed with error (sct=0, sc=8) 00:30:58.161 starting I/O failed 00:30:58.161 Write completed with error (sct=0, sc=8) 00:30:58.161 starting I/O failed 00:30:58.161 Write completed with error (sct=0, sc=8) 00:30:58.161 starting I/O failed 00:30:58.161 Read completed with error (sct=0, sc=8) 00:30:58.161 starting I/O failed 00:30:58.161 Read completed with error (sct=0, sc=8) 00:30:58.161 starting I/O failed 00:30:58.161 Read completed with error (sct=0, sc=8) 00:30:58.161 starting I/O failed 00:30:58.161 Write completed with error (sct=0, sc=8) 00:30:58.161 starting I/O failed 00:30:58.161 Read completed with error (sct=0, sc=8) 00:30:58.161 starting I/O failed 00:30:58.161 Write completed with error (sct=0, sc=8) 00:30:58.161 starting I/O failed 00:30:58.161 Read completed with error (sct=0, sc=8) 00:30:58.161 starting I/O failed 00:30:58.161 Read completed with error (sct=0, sc=8) 00:30:58.161 starting I/O failed 00:30:58.161 Write completed with error (sct=0, sc=8) 00:30:58.161 starting I/O failed 00:30:58.161 Read completed with error (sct=0, sc=8) 00:30:58.161 starting I/O failed 00:30:58.161 Write completed with error (sct=0, sc=8) 00:30:58.161 starting I/O failed 00:30:58.161 Read completed with error (sct=0, sc=8) 00:30:58.161 starting I/O failed 00:30:58.161 Read completed with error (sct=0, sc=8) 00:30:58.161 starting I/O failed 00:30:58.161 Write completed with error (sct=0, sc=8) 00:30:58.161 starting I/O failed 00:30:58.161 Write completed with error (sct=0, sc=8) 00:30:58.161 starting I/O failed 00:30:58.161 Read completed with error (sct=0, sc=8) 00:30:58.161 starting I/O failed 00:30:58.161 Read completed with error (sct=0, sc=8) 00:30:58.161 starting I/O failed 00:30:58.161 Write completed with error (sct=0, sc=8) 00:30:58.161 starting I/O failed 00:30:58.161 Read completed with error (sct=0, sc=8) 00:30:58.161 starting I/O failed 00:30:58.161 Read completed with error (sct=0, sc=8) 00:30:58.161 starting I/O failed 00:30:58.161 Read completed with error (sct=0, sc=8) 00:30:58.161 starting I/O failed 00:30:58.161 Write completed with error (sct=0, sc=8) 00:30:58.161 starting I/O failed 00:30:58.161 Write completed with error (sct=0, sc=8) 00:30:58.161 starting I/O failed 00:30:58.161 [2024-11-28 23:23:01.447731] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:58.161 [2024-11-28 23:23:01.447845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.447978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.448007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.161 qpair failed and we were unable to recover it. 00:30:58.161 [2024-11-28 23:23:01.448125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.448214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.448240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.161 qpair failed and we were unable to recover it. 00:30:58.161 [2024-11-28 23:23:01.448373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.448481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.448510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.161 qpair failed and we were unable to recover it. 00:30:58.161 [2024-11-28 23:23:01.448610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.448698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.448724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.161 qpair failed and we were unable to recover it. 00:30:58.161 [2024-11-28 23:23:01.448846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.448929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.448954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.161 qpair failed and we were unable to recover it. 00:30:58.161 [2024-11-28 23:23:01.449082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.449194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.449220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.161 qpair failed and we were unable to recover it. 00:30:58.161 [2024-11-28 23:23:01.449306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.449422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.449450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.161 qpair failed and we were unable to recover it. 00:30:58.161 [2024-11-28 23:23:01.449548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.449667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.449693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.161 qpair failed and we were unable to recover it. 00:30:58.161 [2024-11-28 23:23:01.449840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.449927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.449954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.161 qpair failed and we were unable to recover it. 00:30:58.161 [2024-11-28 23:23:01.450074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.450193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.450219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.161 qpair failed and we were unable to recover it. 00:30:58.161 [2024-11-28 23:23:01.450339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.450434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.450461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.161 qpair failed and we were unable to recover it. 00:30:58.161 [2024-11-28 23:23:01.450579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.450663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.450689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.161 qpair failed and we were unable to recover it. 00:30:58.161 [2024-11-28 23:23:01.450783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.450897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.450924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.161 qpair failed and we were unable to recover it. 00:30:58.161 [2024-11-28 23:23:01.451018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.451128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.451155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.161 qpair failed and we were unable to recover it. 00:30:58.161 [2024-11-28 23:23:01.451241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.451331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.451357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.161 qpair failed and we were unable to recover it. 00:30:58.161 [2024-11-28 23:23:01.451487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.451634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.451661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.161 qpair failed and we were unable to recover it. 00:30:58.161 [2024-11-28 23:23:01.451780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.451876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.451901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.161 qpair failed and we were unable to recover it. 00:30:58.161 [2024-11-28 23:23:01.452044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.452135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.452160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.161 qpair failed and we were unable to recover it. 00:30:58.161 [2024-11-28 23:23:01.452250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.452362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.452388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.161 qpair failed and we were unable to recover it. 00:30:58.161 [2024-11-28 23:23:01.452491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.452581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.452607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.161 qpair failed and we were unable to recover it. 00:30:58.161 [2024-11-28 23:23:01.452728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.452811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.452837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.161 qpair failed and we were unable to recover it. 00:30:58.161 [2024-11-28 23:23:01.452933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.453016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.453042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.161 qpair failed and we were unable to recover it. 00:30:58.161 [2024-11-28 23:23:01.453133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.453221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.453247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.161 qpair failed and we were unable to recover it. 00:30:58.161 [2024-11-28 23:23:01.453346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.453443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.453470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.161 qpair failed and we were unable to recover it. 00:30:58.161 [2024-11-28 23:23:01.453585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.453704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.453730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.161 qpair failed and we were unable to recover it. 00:30:58.161 [2024-11-28 23:23:01.453828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.453944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.453974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.161 qpair failed and we were unable to recover it. 00:30:58.161 [2024-11-28 23:23:01.454093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.454242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.454268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.161 qpair failed and we were unable to recover it. 00:30:58.161 [2024-11-28 23:23:01.454386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.454482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.454507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.161 qpair failed and we were unable to recover it. 00:30:58.161 [2024-11-28 23:23:01.454629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.454714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.161 [2024-11-28 23:23:01.454740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.161 qpair failed and we were unable to recover it. 00:30:58.162 [2024-11-28 23:23:01.454857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.454973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.454999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.162 qpair failed and we were unable to recover it. 00:30:58.162 [2024-11-28 23:23:01.455117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.455202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.455228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.162 qpair failed and we were unable to recover it. 00:30:58.162 [2024-11-28 23:23:01.455348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.455470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.455497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.162 qpair failed and we were unable to recover it. 00:30:58.162 [2024-11-28 23:23:01.455610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.455701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.455726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.162 qpair failed and we were unable to recover it. 00:30:58.162 [2024-11-28 23:23:01.455821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.455931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.455957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.162 qpair failed and we were unable to recover it. 00:30:58.162 [2024-11-28 23:23:01.456076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.456185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.456211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.162 qpair failed and we were unable to recover it. 00:30:58.162 [2024-11-28 23:23:01.456330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.456436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.456462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.162 qpair failed and we were unable to recover it. 00:30:58.162 [2024-11-28 23:23:01.456588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.456678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.456703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.162 qpair failed and we were unable to recover it. 00:30:58.162 [2024-11-28 23:23:01.456804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.456932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.456958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.162 qpair failed and we were unable to recover it. 00:30:58.162 [2024-11-28 23:23:01.457077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.457166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.457192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.162 qpair failed and we were unable to recover it. 00:30:58.162 [2024-11-28 23:23:01.457308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.457405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.457432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.162 qpair failed and we were unable to recover it. 00:30:58.162 [2024-11-28 23:23:01.457526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.457655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.457682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.162 qpair failed and we were unable to recover it. 00:30:58.162 [2024-11-28 23:23:01.457802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.457892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.457917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.162 qpair failed and we were unable to recover it. 00:30:58.162 [2024-11-28 23:23:01.458011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.458124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.458150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.162 qpair failed and we were unable to recover it. 00:30:58.162 [2024-11-28 23:23:01.458271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.458360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.458387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.162 qpair failed and we were unable to recover it. 00:30:58.162 [2024-11-28 23:23:01.458517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.458614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.458640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.162 qpair failed and we were unable to recover it. 00:30:58.162 [2024-11-28 23:23:01.458760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.458846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.458872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.162 qpair failed and we were unable to recover it. 00:30:58.162 [2024-11-28 23:23:01.458975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.459068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.459094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.162 qpair failed and we were unable to recover it. 00:30:58.162 [2024-11-28 23:23:01.459202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.459297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.459323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.162 qpair failed and we were unable to recover it. 00:30:58.162 [2024-11-28 23:23:01.459413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.459503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.459529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.162 qpair failed and we were unable to recover it. 00:30:58.162 [2024-11-28 23:23:01.459621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.459738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.459766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.162 qpair failed and we were unable to recover it. 00:30:58.162 [2024-11-28 23:23:01.459852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.459956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.459981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.162 qpair failed and we were unable to recover it. 00:30:58.162 [2024-11-28 23:23:01.460103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.460199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.460224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.162 qpair failed and we were unable to recover it. 00:30:58.162 [2024-11-28 23:23:01.460318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.460411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.460438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.162 qpair failed and we were unable to recover it. 00:30:58.162 [2024-11-28 23:23:01.460541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.460621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.460648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.162 qpair failed and we were unable to recover it. 00:30:58.162 [2024-11-28 23:23:01.460766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.460854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.460879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.162 qpair failed and we were unable to recover it. 00:30:58.162 [2024-11-28 23:23:01.460974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.461088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.461115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.162 qpair failed and we were unable to recover it. 00:30:58.162 [2024-11-28 23:23:01.461241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.461320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.461345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.162 qpair failed and we were unable to recover it. 00:30:58.162 [2024-11-28 23:23:01.461444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.461562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.461589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.162 qpair failed and we were unable to recover it. 00:30:58.162 [2024-11-28 23:23:01.461669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.461758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.461784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.162 qpair failed and we were unable to recover it. 00:30:58.162 [2024-11-28 23:23:01.461874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.461990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.462018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.162 qpair failed and we were unable to recover it. 00:30:58.162 [2024-11-28 23:23:01.462116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.462203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.462230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.162 qpair failed and we were unable to recover it. 00:30:58.162 [2024-11-28 23:23:01.462341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.462441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.462468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.162 qpair failed and we were unable to recover it. 00:30:58.162 [2024-11-28 23:23:01.462561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.462672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.462698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.162 qpair failed and we were unable to recover it. 00:30:58.162 [2024-11-28 23:23:01.462801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.462887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.462912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.162 qpair failed and we were unable to recover it. 00:30:58.162 [2024-11-28 23:23:01.463007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.463123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.463150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.162 qpair failed and we were unable to recover it. 00:30:58.162 [2024-11-28 23:23:01.463240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.463322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.463347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.162 qpair failed and we were unable to recover it. 00:30:58.162 [2024-11-28 23:23:01.463462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.463581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.463607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.162 qpair failed and we were unable to recover it. 00:30:58.162 [2024-11-28 23:23:01.463698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.463787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.463814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.162 qpair failed and we were unable to recover it. 00:30:58.162 [2024-11-28 23:23:01.463935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.464052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.464078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.162 qpair failed and we were unable to recover it. 00:30:58.162 [2024-11-28 23:23:01.464178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.464297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.464323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.162 qpair failed and we were unable to recover it. 00:30:58.162 [2024-11-28 23:23:01.464415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.464500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.464527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.162 qpair failed and we were unable to recover it. 00:30:58.162 [2024-11-28 23:23:01.464620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.464737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.464762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.162 qpair failed and we were unable to recover it. 00:30:58.162 [2024-11-28 23:23:01.464888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.465006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.465032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.162 qpair failed and we were unable to recover it. 00:30:58.162 [2024-11-28 23:23:01.465154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.465246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.465271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.162 qpair failed and we were unable to recover it. 00:30:58.162 [2024-11-28 23:23:01.465355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.465475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.465503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.162 qpair failed and we were unable to recover it. 00:30:58.162 [2024-11-28 23:23:01.465617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.465716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.162 [2024-11-28 23:23:01.465743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.163 qpair failed and we were unable to recover it. 00:30:58.163 [2024-11-28 23:23:01.465859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.465945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.465976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.163 qpair failed and we were unable to recover it. 00:30:58.163 [2024-11-28 23:23:01.466070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.466164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.466189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.163 qpair failed and we were unable to recover it. 00:30:58.163 [2024-11-28 23:23:01.466270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.466389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.466421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.163 qpair failed and we were unable to recover it. 00:30:58.163 [2024-11-28 23:23:01.466536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.466621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.466646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.163 qpair failed and we were unable to recover it. 00:30:58.163 [2024-11-28 23:23:01.466759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.466872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.466899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.163 qpair failed and we were unable to recover it. 00:30:58.163 [2024-11-28 23:23:01.466994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.467087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.467114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.163 qpair failed and we were unable to recover it. 00:30:58.163 [2024-11-28 23:23:01.467230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.467310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.467336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.163 qpair failed and we were unable to recover it. 00:30:58.163 [2024-11-28 23:23:01.467431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.467579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.467605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.163 qpair failed and we were unable to recover it. 00:30:58.163 [2024-11-28 23:23:01.467703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.467895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.467922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.163 qpair failed and we were unable to recover it. 00:30:58.163 [2024-11-28 23:23:01.468010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.468151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.468177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.163 qpair failed and we were unable to recover it. 00:30:58.163 [2024-11-28 23:23:01.468297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.468419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.468447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.163 qpair failed and we were unable to recover it. 00:30:58.163 [2024-11-28 23:23:01.468585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.468676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.468703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.163 qpair failed and we were unable to recover it. 00:30:58.163 [2024-11-28 23:23:01.468847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.468934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.468961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.163 qpair failed and we were unable to recover it. 00:30:58.163 [2024-11-28 23:23:01.469048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.469135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.469161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.163 qpair failed and we were unable to recover it. 00:30:58.163 [2024-11-28 23:23:01.469271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.469363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.469389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.163 qpair failed and we were unable to recover it. 00:30:58.163 [2024-11-28 23:23:01.469483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.469577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.469605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.163 qpair failed and we were unable to recover it. 00:30:58.163 [2024-11-28 23:23:01.469704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.469787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.469815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.163 qpair failed and we were unable to recover it. 00:30:58.163 [2024-11-28 23:23:01.469905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.470095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.470122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.163 qpair failed and we were unable to recover it. 00:30:58.163 [2024-11-28 23:23:01.470242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.470353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.470379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.163 qpair failed and we were unable to recover it. 00:30:58.163 [2024-11-28 23:23:01.470476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.470569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.470597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.163 qpair failed and we were unable to recover it. 00:30:58.163 [2024-11-28 23:23:01.470742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.470863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.470889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.163 qpair failed and we were unable to recover it. 00:30:58.163 [2024-11-28 23:23:01.470984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.471102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.471128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.163 qpair failed and we were unable to recover it. 00:30:58.163 [2024-11-28 23:23:01.471212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.471295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.471321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.163 qpair failed and we were unable to recover it. 00:30:58.163 [2024-11-28 23:23:01.471417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.471535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.471561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.163 qpair failed and we were unable to recover it. 00:30:58.163 [2024-11-28 23:23:01.471649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.471763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.471790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.163 qpair failed and we were unable to recover it. 00:30:58.163 [2024-11-28 23:23:01.471911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.471998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.472024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.163 qpair failed and we were unable to recover it. 00:30:58.163 [2024-11-28 23:23:01.472167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.472259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.472286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.163 qpair failed and we were unable to recover it. 00:30:58.163 [2024-11-28 23:23:01.472371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.472501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.472527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.163 qpair failed and we were unable to recover it. 00:30:58.163 [2024-11-28 23:23:01.472654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.472743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.472769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.163 qpair failed and we were unable to recover it. 00:30:58.163 [2024-11-28 23:23:01.472887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.472980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.473006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.163 qpair failed and we were unable to recover it. 00:30:58.163 [2024-11-28 23:23:01.473091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.473204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.473231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.163 qpair failed and we were unable to recover it. 00:30:58.163 [2024-11-28 23:23:01.473330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.473430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.473457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.163 qpair failed and we were unable to recover it. 00:30:58.163 [2024-11-28 23:23:01.473557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.473667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.163 [2024-11-28 23:23:01.473692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.163 qpair failed and we were unable to recover it. 00:30:58.164 [2024-11-28 23:23:01.473778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.473886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.473912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.164 qpair failed and we were unable to recover it. 00:30:58.164 [2024-11-28 23:23:01.474013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.474110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.474136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.164 qpair failed and we were unable to recover it. 00:30:58.164 [2024-11-28 23:23:01.474236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.474330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.474356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.164 qpair failed and we were unable to recover it. 00:30:58.164 [2024-11-28 23:23:01.474491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.474619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.474645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.164 qpair failed and we were unable to recover it. 00:30:58.164 [2024-11-28 23:23:01.474740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.474821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.474848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.164 qpair failed and we were unable to recover it. 00:30:58.164 [2024-11-28 23:23:01.474959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.475049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.475074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.164 qpair failed and we were unable to recover it. 00:30:58.164 [2024-11-28 23:23:01.475170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.475255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.475281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.164 qpair failed and we were unable to recover it. 00:30:58.164 [2024-11-28 23:23:01.475366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.475464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.475491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.164 qpair failed and we were unable to recover it. 00:30:58.164 [2024-11-28 23:23:01.475615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.475730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.475757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.164 qpair failed and we were unable to recover it. 00:30:58.164 [2024-11-28 23:23:01.475845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.475938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.475964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.164 qpair failed and we were unable to recover it. 00:30:58.164 [2024-11-28 23:23:01.476084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.476175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.476200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.164 qpair failed and we were unable to recover it. 00:30:58.164 [2024-11-28 23:23:01.476292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.476376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.476418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.164 qpair failed and we were unable to recover it. 00:30:58.164 [2024-11-28 23:23:01.476511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.476596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.476621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.164 qpair failed and we were unable to recover it. 00:30:58.164 [2024-11-28 23:23:01.476721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.476851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.476877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.164 qpair failed and we were unable to recover it. 00:30:58.164 [2024-11-28 23:23:01.476968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.477091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.477117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.164 qpair failed and we were unable to recover it. 00:30:58.164 [2024-11-28 23:23:01.477207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.477349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.477375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.164 qpair failed and we were unable to recover it. 00:30:58.164 [2024-11-28 23:23:01.477474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.477581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.477608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.164 qpair failed and we were unable to recover it. 00:30:58.164 [2024-11-28 23:23:01.477699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.477784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.477810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.164 qpair failed and we were unable to recover it. 00:30:58.164 [2024-11-28 23:23:01.477905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.478021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.478051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.164 qpair failed and we were unable to recover it. 00:30:58.164 [2024-11-28 23:23:01.478129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.478218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.478244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.164 qpair failed and we were unable to recover it. 00:30:58.164 [2024-11-28 23:23:01.478364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.478497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.478524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.164 qpair failed and we were unable to recover it. 00:30:58.164 [2024-11-28 23:23:01.478614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.478707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.478733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.164 qpair failed and we were unable to recover it. 00:30:58.164 [2024-11-28 23:23:01.478882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.478977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.479003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.164 qpair failed and we were unable to recover it. 00:30:58.164 [2024-11-28 23:23:01.479084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.479196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.479222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.164 qpair failed and we were unable to recover it. 00:30:58.164 [2024-11-28 23:23:01.479309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.479404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.479432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.164 qpair failed and we were unable to recover it. 00:30:58.164 [2024-11-28 23:23:01.479519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.479591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.479618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.164 qpair failed and we were unable to recover it. 00:30:58.164 [2024-11-28 23:23:01.479699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.479849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.479875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.164 qpair failed and we were unable to recover it. 00:30:58.164 [2024-11-28 23:23:01.479963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.480083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.480109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.164 qpair failed and we were unable to recover it. 00:30:58.164 [2024-11-28 23:23:01.480201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.480284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.480309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.164 qpair failed and we were unable to recover it. 00:30:58.164 [2024-11-28 23:23:01.480490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.480592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.480619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.164 qpair failed and we were unable to recover it. 00:30:58.164 [2024-11-28 23:23:01.480710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.480821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.480846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.164 qpair failed and we were unable to recover it. 00:30:58.164 [2024-11-28 23:23:01.480992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.164 [2024-11-28 23:23:01.481079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.481106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.165 qpair failed and we were unable to recover it. 00:30:58.165 [2024-11-28 23:23:01.481193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.481275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.481301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.165 qpair failed and we were unable to recover it. 00:30:58.165 [2024-11-28 23:23:01.481400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.481515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.481542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.165 qpair failed and we were unable to recover it. 00:30:58.165 [2024-11-28 23:23:01.481640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.481751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.481777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.165 qpair failed and we were unable to recover it. 00:30:58.165 [2024-11-28 23:23:01.481866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.481942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.481968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.165 qpair failed and we were unable to recover it. 00:30:58.165 [2024-11-28 23:23:01.482062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.482150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.482176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.165 qpair failed and we were unable to recover it. 00:30:58.165 [2024-11-28 23:23:01.482262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.482348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.482373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.165 qpair failed and we were unable to recover it. 00:30:58.165 [2024-11-28 23:23:01.482502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.482600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.482627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.165 qpair failed and we were unable to recover it. 00:30:58.165 [2024-11-28 23:23:01.482726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.482820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.482846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.165 qpair failed and we were unable to recover it. 00:30:58.165 [2024-11-28 23:23:01.482930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.483044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.483069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.165 qpair failed and we were unable to recover it. 00:30:58.165 [2024-11-28 23:23:01.483158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.483250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.483276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.165 qpair failed and we were unable to recover it. 00:30:58.165 [2024-11-28 23:23:01.483376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.483475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.483502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.165 qpair failed and we were unable to recover it. 00:30:58.165 [2024-11-28 23:23:01.483619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.483702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.483728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.165 qpair failed and we were unable to recover it. 00:30:58.165 [2024-11-28 23:23:01.483827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.483935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.483960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.165 qpair failed and we were unable to recover it. 00:30:58.165 [2024-11-28 23:23:01.484077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.484168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.484194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.165 qpair failed and we were unable to recover it. 00:30:58.165 [2024-11-28 23:23:01.484283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.484427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.484455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.165 qpair failed and we were unable to recover it. 00:30:58.165 [2024-11-28 23:23:01.484548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.484670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.484696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.165 qpair failed and we were unable to recover it. 00:30:58.165 [2024-11-28 23:23:01.484778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.484899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.484925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.165 qpair failed and we were unable to recover it. 00:30:58.165 [2024-11-28 23:23:01.485010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.485105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.485130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.165 qpair failed and we were unable to recover it. 00:30:58.165 [2024-11-28 23:23:01.485226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.485316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.485342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.165 qpair failed and we were unable to recover it. 00:30:58.165 [2024-11-28 23:23:01.485426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.485523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.485549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.165 qpair failed and we were unable to recover it. 00:30:58.165 [2024-11-28 23:23:01.485650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.485736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.485762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.165 qpair failed and we were unable to recover it. 00:30:58.165 [2024-11-28 23:23:01.485841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.485930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.485957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.165 qpair failed and we were unable to recover it. 00:30:58.165 [2024-11-28 23:23:01.486045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.486140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.486167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.165 qpair failed and we were unable to recover it. 00:30:58.165 [2024-11-28 23:23:01.486249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.486343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.486370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.165 qpair failed and we were unable to recover it. 00:30:58.165 [2024-11-28 23:23:01.486469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.486583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.486609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.165 qpair failed and we were unable to recover it. 00:30:58.165 [2024-11-28 23:23:01.486730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.486848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.486875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.165 qpair failed and we were unable to recover it. 00:30:58.165 [2024-11-28 23:23:01.486988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.487098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.487125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.165 qpair failed and we were unable to recover it. 00:30:58.165 [2024-11-28 23:23:01.487210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.487305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.487336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.165 qpair failed and we were unable to recover it. 00:30:58.165 [2024-11-28 23:23:01.487450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.487540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.487566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.165 qpair failed and we were unable to recover it. 00:30:58.165 [2024-11-28 23:23:01.487648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.487790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.487816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.165 qpair failed and we were unable to recover it. 00:30:58.165 [2024-11-28 23:23:01.487936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.488054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.165 [2024-11-28 23:23:01.488080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.165 qpair failed and we were unable to recover it. 00:30:58.165 [2024-11-28 23:23:01.488174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.488268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.488295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.166 qpair failed and we were unable to recover it. 00:30:58.166 [2024-11-28 23:23:01.488384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.488479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.488504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.166 qpair failed and we were unable to recover it. 00:30:58.166 [2024-11-28 23:23:01.488590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.488701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.488727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.166 qpair failed and we were unable to recover it. 00:30:58.166 [2024-11-28 23:23:01.488836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.488917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.488943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.166 qpair failed and we were unable to recover it. 00:30:58.166 [2024-11-28 23:23:01.489068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.489150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.489176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.166 qpair failed and we were unable to recover it. 00:30:58.166 [2024-11-28 23:23:01.489295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.489379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.489412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.166 qpair failed and we were unable to recover it. 00:30:58.166 [2024-11-28 23:23:01.489509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.489624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.489649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.166 qpair failed and we were unable to recover it. 00:30:58.166 [2024-11-28 23:23:01.489772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.489854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.489879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.166 qpair failed and we were unable to recover it. 00:30:58.166 [2024-11-28 23:23:01.489961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.490080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.490107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.166 qpair failed and we were unable to recover it. 00:30:58.166 [2024-11-28 23:23:01.490214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.490308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.490334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.166 qpair failed and we were unable to recover it. 00:30:58.166 [2024-11-28 23:23:01.490448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.490526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.490552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.166 qpair failed and we were unable to recover it. 00:30:58.166 [2024-11-28 23:23:01.490649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.490741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.490768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.166 qpair failed and we were unable to recover it. 00:30:58.166 [2024-11-28 23:23:01.490869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.490957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.490983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.166 qpair failed and we were unable to recover it. 00:30:58.166 [2024-11-28 23:23:01.491074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.491187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.491213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.166 qpair failed and we were unable to recover it. 00:30:58.166 [2024-11-28 23:23:01.491326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.491419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.491446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.166 qpair failed and we were unable to recover it. 00:30:58.166 [2024-11-28 23:23:01.491537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.491625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.491650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.166 qpair failed and we were unable to recover it. 00:30:58.166 [2024-11-28 23:23:01.491736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.491843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.491869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.166 qpair failed and we were unable to recover it. 00:30:58.166 [2024-11-28 23:23:01.491953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.492062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.492087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.166 qpair failed and we were unable to recover it. 00:30:58.166 [2024-11-28 23:23:01.492180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.492260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.492286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.166 qpair failed and we were unable to recover it. 00:30:58.166 [2024-11-28 23:23:01.492379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.492489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.492515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.166 qpair failed and we were unable to recover it. 00:30:58.166 [2024-11-28 23:23:01.492603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.492734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.492760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.166 qpair failed and we were unable to recover it. 00:30:58.166 [2024-11-28 23:23:01.492857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.492965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.492991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.166 qpair failed and we were unable to recover it. 00:30:58.166 [2024-11-28 23:23:01.493102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.493191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.493216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.166 qpair failed and we were unable to recover it. 00:30:58.166 [2024-11-28 23:23:01.493302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.493429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.493456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.166 qpair failed and we were unable to recover it. 00:30:58.166 [2024-11-28 23:23:01.493549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.493639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.493665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.166 qpair failed and we were unable to recover it. 00:30:58.166 [2024-11-28 23:23:01.493754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.493843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.493869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.166 qpair failed and we were unable to recover it. 00:30:58.166 [2024-11-28 23:23:01.493971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.494061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.494088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.166 qpair failed and we were unable to recover it. 00:30:58.166 [2024-11-28 23:23:01.494183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.166 [2024-11-28 23:23:01.494277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.494304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.167 qpair failed and we were unable to recover it. 00:30:58.167 [2024-11-28 23:23:01.494400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.494484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.494510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.167 qpair failed and we were unable to recover it. 00:30:58.167 [2024-11-28 23:23:01.494627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.494753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.494778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.167 qpair failed and we were unable to recover it. 00:30:58.167 [2024-11-28 23:23:01.494874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.494954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.494980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.167 qpair failed and we were unable to recover it. 00:30:58.167 [2024-11-28 23:23:01.495076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.495173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.495198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.167 qpair failed and we were unable to recover it. 00:30:58.167 [2024-11-28 23:23:01.495295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.495381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.495414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.167 qpair failed and we were unable to recover it. 00:30:58.167 [2024-11-28 23:23:01.495543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.495687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.495713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.167 qpair failed and we were unable to recover it. 00:30:58.167 [2024-11-28 23:23:01.495826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.495918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.495944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.167 qpair failed and we were unable to recover it. 00:30:58.167 [2024-11-28 23:23:01.496062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.496147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.496173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.167 qpair failed and we were unable to recover it. 00:30:58.167 [2024-11-28 23:23:01.496256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.496344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.496370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.167 qpair failed and we were unable to recover it. 00:30:58.167 [2024-11-28 23:23:01.496487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.496583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.496609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.167 qpair failed and we were unable to recover it. 00:30:58.167 [2024-11-28 23:23:01.496730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.496818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.496843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.167 qpair failed and we were unable to recover it. 00:30:58.167 [2024-11-28 23:23:01.496936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.497053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.497080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.167 qpair failed and we were unable to recover it. 00:30:58.167 [2024-11-28 23:23:01.497177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.497271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.497297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.167 qpair failed and we were unable to recover it. 00:30:58.167 [2024-11-28 23:23:01.497375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.497480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.497506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.167 qpair failed and we were unable to recover it. 00:30:58.167 [2024-11-28 23:23:01.497594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.497680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.497707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.167 qpair failed and we were unable to recover it. 00:30:58.167 [2024-11-28 23:23:01.497798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.497885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.497912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.167 qpair failed and we were unable to recover it. 00:30:58.167 [2024-11-28 23:23:01.498038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.498123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.498149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.167 qpair failed and we were unable to recover it. 00:30:58.167 [2024-11-28 23:23:01.498232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.498328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.498354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.167 qpair failed and we were unable to recover it. 00:30:58.167 [2024-11-28 23:23:01.498455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.498575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.498601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.167 qpair failed and we were unable to recover it. 00:30:58.167 [2024-11-28 23:23:01.498694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.498812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.498843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.167 qpair failed and we were unable to recover it. 00:30:58.167 [2024-11-28 23:23:01.498970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.499053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.499078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.167 qpair failed and we were unable to recover it. 00:30:58.167 [2024-11-28 23:23:01.499195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.499310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.499336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.167 qpair failed and we were unable to recover it. 00:30:58.167 [2024-11-28 23:23:01.499434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.499530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.499557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.167 qpair failed and we were unable to recover it. 00:30:58.167 [2024-11-28 23:23:01.499646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.499761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.499788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.167 qpair failed and we were unable to recover it. 00:30:58.167 [2024-11-28 23:23:01.499875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.499985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.500011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.167 qpair failed and we were unable to recover it. 00:30:58.167 [2024-11-28 23:23:01.500109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.500193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.500219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.167 qpair failed and we were unable to recover it. 00:30:58.167 [2024-11-28 23:23:01.500300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.500412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.500440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.167 qpair failed and we were unable to recover it. 00:30:58.167 [2024-11-28 23:23:01.500525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.500652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.500678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.167 qpair failed and we were unable to recover it. 00:30:58.167 [2024-11-28 23:23:01.500781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.500895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.500922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.167 qpair failed and we were unable to recover it. 00:30:58.167 [2024-11-28 23:23:01.501042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.501130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.501157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.167 qpair failed and we were unable to recover it. 00:30:58.167 [2024-11-28 23:23:01.501269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.501354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.167 [2024-11-28 23:23:01.501379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.167 qpair failed and we were unable to recover it. 00:30:58.167 [2024-11-28 23:23:01.501505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.501595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.501621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.168 qpair failed and we were unable to recover it. 00:30:58.168 [2024-11-28 23:23:01.501730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.501874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.501900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.168 qpair failed and we were unable to recover it. 00:30:58.168 [2024-11-28 23:23:01.501989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.502132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.502158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.168 qpair failed and we were unable to recover it. 00:30:58.168 [2024-11-28 23:23:01.502287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.502374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.502405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.168 qpair failed and we were unable to recover it. 00:30:58.168 [2024-11-28 23:23:01.502508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.502596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.502622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.168 qpair failed and we were unable to recover it. 00:30:58.168 [2024-11-28 23:23:01.502762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.502871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.502898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.168 qpair failed and we were unable to recover it. 00:30:58.168 [2024-11-28 23:23:01.503027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.503115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.503141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.168 qpair failed and we were unable to recover it. 00:30:58.168 [2024-11-28 23:23:01.503231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.503315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.503341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.168 qpair failed and we were unable to recover it. 00:30:58.168 [2024-11-28 23:23:01.503458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.503556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.503582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.168 qpair failed and we were unable to recover it. 00:30:58.168 [2024-11-28 23:23:01.503676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.503765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.503793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.168 qpair failed and we were unable to recover it. 00:30:58.168 [2024-11-28 23:23:01.503914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.504033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.504060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.168 qpair failed and we were unable to recover it. 00:30:58.168 [2024-11-28 23:23:01.504181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.504282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.504309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.168 qpair failed and we were unable to recover it. 00:30:58.168 [2024-11-28 23:23:01.504428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.504524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.504551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.168 qpair failed and we were unable to recover it. 00:30:58.168 [2024-11-28 23:23:01.504638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.504726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.504752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.168 qpair failed and we were unable to recover it. 00:30:58.168 [2024-11-28 23:23:01.504861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.504958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.504984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.168 qpair failed and we were unable to recover it. 00:30:58.168 [2024-11-28 23:23:01.505080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.505169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.505195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.168 qpair failed and we were unable to recover it. 00:30:58.168 [2024-11-28 23:23:01.505285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.505377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.505410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.168 qpair failed and we were unable to recover it. 00:30:58.168 [2024-11-28 23:23:01.505497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.505647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.505674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.168 qpair failed and we were unable to recover it. 00:30:58.168 [2024-11-28 23:23:01.505770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.505866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.505892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.168 qpair failed and we were unable to recover it. 00:30:58.168 [2024-11-28 23:23:01.505984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.506076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.506102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.168 qpair failed and we were unable to recover it. 00:30:58.168 [2024-11-28 23:23:01.506202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.506289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.506316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.168 qpair failed and we were unable to recover it. 00:30:58.168 [2024-11-28 23:23:01.506409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.506502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.506529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.168 qpair failed and we were unable to recover it. 00:30:58.168 [2024-11-28 23:23:01.506618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.506700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.506727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.168 qpair failed and we were unable to recover it. 00:30:58.168 [2024-11-28 23:23:01.506844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.506934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.506960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.168 qpair failed and we were unable to recover it. 00:30:58.168 [2024-11-28 23:23:01.507074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.507159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.507185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.168 qpair failed and we were unable to recover it. 00:30:58.168 [2024-11-28 23:23:01.507337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.507482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.507509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.168 qpair failed and we were unable to recover it. 00:30:58.168 [2024-11-28 23:23:01.507599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.507713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.507739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.168 qpair failed and we were unable to recover it. 00:30:58.168 [2024-11-28 23:23:01.507824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.507931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.507957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.168 qpair failed and we were unable to recover it. 00:30:58.168 [2024-11-28 23:23:01.508072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.508213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.508239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.168 qpair failed and we were unable to recover it. 00:30:58.168 [2024-11-28 23:23:01.508323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.508415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.508442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.168 qpair failed and we were unable to recover it. 00:30:58.168 [2024-11-28 23:23:01.508531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.508624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.508650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.168 qpair failed and we were unable to recover it. 00:30:58.168 [2024-11-28 23:23:01.508774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.168 [2024-11-28 23:23:01.508905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.508932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.169 qpair failed and we were unable to recover it. 00:30:58.169 [2024-11-28 23:23:01.509023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.509108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.509135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.169 qpair failed and we were unable to recover it. 00:30:58.169 [2024-11-28 23:23:01.509227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.509309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.509334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.169 qpair failed and we were unable to recover it. 00:30:58.169 [2024-11-28 23:23:01.509461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.509557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.509583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.169 qpair failed and we were unable to recover it. 00:30:58.169 [2024-11-28 23:23:01.509690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.509809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.509835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.169 qpair failed and we were unable to recover it. 00:30:58.169 [2024-11-28 23:23:01.509958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.510052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.510078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.169 qpair failed and we were unable to recover it. 00:30:58.169 [2024-11-28 23:23:01.510195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.510279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.510305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.169 qpair failed and we were unable to recover it. 00:30:58.169 [2024-11-28 23:23:01.510412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.510504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.510531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.169 qpair failed and we were unable to recover it. 00:30:58.169 [2024-11-28 23:23:01.510646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.510733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.510764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.169 qpair failed and we were unable to recover it. 00:30:58.169 [2024-11-28 23:23:01.510881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.510992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.511020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.169 qpair failed and we were unable to recover it. 00:30:58.169 [2024-11-28 23:23:01.511111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.511193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.511219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.169 qpair failed and we were unable to recover it. 00:30:58.169 [2024-11-28 23:23:01.511342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.511452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.511478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.169 qpair failed and we were unable to recover it. 00:30:58.169 [2024-11-28 23:23:01.511572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.511662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.511688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.169 qpair failed and we were unable to recover it. 00:30:58.169 [2024-11-28 23:23:01.511783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.511865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.511891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.169 qpair failed and we were unable to recover it. 00:30:58.169 [2024-11-28 23:23:01.512002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.512094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.512122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.169 qpair failed and we were unable to recover it. 00:30:58.169 [2024-11-28 23:23:01.512252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.512347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.512373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.169 qpair failed and we were unable to recover it. 00:30:58.169 [2024-11-28 23:23:01.512502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.512618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.512645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.169 qpair failed and we were unable to recover it. 00:30:58.169 [2024-11-28 23:23:01.512761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.512842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.512868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.169 qpair failed and we were unable to recover it. 00:30:58.169 [2024-11-28 23:23:01.512967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.513056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.513082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.169 qpair failed and we were unable to recover it. 00:30:58.169 [2024-11-28 23:23:01.513188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.513282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.513309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.169 qpair failed and we were unable to recover it. 00:30:58.169 [2024-11-28 23:23:01.513403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.513516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.513543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.169 qpair failed and we were unable to recover it. 00:30:58.169 [2024-11-28 23:23:01.513688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.513802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.513829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.169 qpair failed and we were unable to recover it. 00:30:58.169 [2024-11-28 23:23:01.513933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.514025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.514052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.169 qpair failed and we were unable to recover it. 00:30:58.169 [2024-11-28 23:23:01.514177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.514261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.514288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.169 qpair failed and we were unable to recover it. 00:30:58.169 [2024-11-28 23:23:01.514402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.514498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.514524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.169 qpair failed and we were unable to recover it. 00:30:58.169 [2024-11-28 23:23:01.514610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.514694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.514721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.169 qpair failed and we were unable to recover it. 00:30:58.169 [2024-11-28 23:23:01.514816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.514900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.514925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.169 qpair failed and we were unable to recover it. 00:30:58.169 [2024-11-28 23:23:01.515038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.515126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.515151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.169 qpair failed and we were unable to recover it. 00:30:58.169 [2024-11-28 23:23:01.515262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.515374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.515407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.169 qpair failed and we were unable to recover it. 00:30:58.169 [2024-11-28 23:23:01.515502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.515586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.515613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.169 qpair failed and we were unable to recover it. 00:30:58.169 [2024-11-28 23:23:01.515708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.515802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.515829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.169 qpair failed and we were unable to recover it. 00:30:58.169 [2024-11-28 23:23:01.515949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.516038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.516064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.169 qpair failed and we were unable to recover it. 00:30:58.169 [2024-11-28 23:23:01.516151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.516263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.516289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.169 qpair failed and we were unable to recover it. 00:30:58.169 [2024-11-28 23:23:01.516377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.516495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.516522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.169 qpair failed and we were unable to recover it. 00:30:58.169 [2024-11-28 23:23:01.516613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.516701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.169 [2024-11-28 23:23:01.516727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.170 qpair failed and we were unable to recover it. 00:30:58.170 [2024-11-28 23:23:01.516810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.516927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.516953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.170 qpair failed and we were unable to recover it. 00:30:58.170 [2024-11-28 23:23:01.517071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.517189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.517215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.170 qpair failed and we were unable to recover it. 00:30:58.170 [2024-11-28 23:23:01.517309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.517401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.517428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.170 qpair failed and we were unable to recover it. 00:30:58.170 [2024-11-28 23:23:01.517540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.517625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.517650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.170 qpair failed and we were unable to recover it. 00:30:58.170 [2024-11-28 23:23:01.517764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.517858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.517885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.170 qpair failed and we were unable to recover it. 00:30:58.170 [2024-11-28 23:23:01.517974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.518062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.518088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.170 qpair failed and we were unable to recover it. 00:30:58.170 [2024-11-28 23:23:01.518183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.518336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.518362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.170 qpair failed and we were unable to recover it. 00:30:58.170 [2024-11-28 23:23:01.518460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.518561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.518587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.170 qpair failed and we were unable to recover it. 00:30:58.170 [2024-11-28 23:23:01.518680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.518772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.518798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.170 qpair failed and we were unable to recover it. 00:30:58.170 [2024-11-28 23:23:01.518922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.519007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.519032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.170 qpair failed and we were unable to recover it. 00:30:58.170 [2024-11-28 23:23:01.519129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.519224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.519250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.170 qpair failed and we were unable to recover it. 00:30:58.170 [2024-11-28 23:23:01.519340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.519427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.519454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.170 qpair failed and we were unable to recover it. 00:30:58.170 [2024-11-28 23:23:01.519539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.519646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.519672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.170 qpair failed and we were unable to recover it. 00:30:58.170 [2024-11-28 23:23:01.519753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.519837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.519865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.170 qpair failed and we were unable to recover it. 00:30:58.170 [2024-11-28 23:23:01.519986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.520076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.520105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.170 qpair failed and we were unable to recover it. 00:30:58.170 [2024-11-28 23:23:01.520207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.520288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.520314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.170 qpair failed and we were unable to recover it. 00:30:58.170 [2024-11-28 23:23:01.520430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.520513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.520539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.170 qpair failed and we were unable to recover it. 00:30:58.170 [2024-11-28 23:23:01.520626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.520713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.520739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.170 qpair failed and we were unable to recover it. 00:30:58.170 [2024-11-28 23:23:01.520856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.520969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.520994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.170 qpair failed and we were unable to recover it. 00:30:58.170 [2024-11-28 23:23:01.521114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.521255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.521281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.170 qpair failed and we were unable to recover it. 00:30:58.170 [2024-11-28 23:23:01.521423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.521546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.521572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.170 qpair failed and we were unable to recover it. 00:30:58.170 [2024-11-28 23:23:01.521662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.521779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.521805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.170 qpair failed and we were unable to recover it. 00:30:58.170 [2024-11-28 23:23:01.521923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.522021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.522046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.170 qpair failed and we were unable to recover it. 00:30:58.170 [2024-11-28 23:23:01.522145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.522235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.522261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.170 qpair failed and we were unable to recover it. 00:30:58.170 [2024-11-28 23:23:01.522347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.522442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.522469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.170 qpair failed and we were unable to recover it. 00:30:58.170 [2024-11-28 23:23:01.522559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.522643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.522669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.170 qpair failed and we were unable to recover it. 00:30:58.170 [2024-11-28 23:23:01.522757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.522877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.522903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.170 qpair failed and we were unable to recover it. 00:30:58.170 [2024-11-28 23:23:01.522996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.523085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.523110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.170 qpair failed and we were unable to recover it. 00:30:58.170 [2024-11-28 23:23:01.523228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.523309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.523334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.170 qpair failed and we were unable to recover it. 00:30:58.170 [2024-11-28 23:23:01.523456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.523549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.523575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.170 qpair failed and we were unable to recover it. 00:30:58.170 [2024-11-28 23:23:01.523666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.170 [2024-11-28 23:23:01.523757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.523784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.171 qpair failed and we were unable to recover it. 00:30:58.171 [2024-11-28 23:23:01.523899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.523992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.524018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.171 qpair failed and we were unable to recover it. 00:30:58.171 [2024-11-28 23:23:01.524137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.524256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.524282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.171 qpair failed and we were unable to recover it. 00:30:58.171 [2024-11-28 23:23:01.524371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.524489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.524516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.171 qpair failed and we were unable to recover it. 00:30:58.171 [2024-11-28 23:23:01.524600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.524716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.524742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.171 qpair failed and we were unable to recover it. 00:30:58.171 [2024-11-28 23:23:01.524866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.524960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.524986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.171 qpair failed and we were unable to recover it. 00:30:58.171 [2024-11-28 23:23:01.525105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.525183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.525210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.171 qpair failed and we were unable to recover it. 00:30:58.171 [2024-11-28 23:23:01.525300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.525423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.525451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.171 qpair failed and we were unable to recover it. 00:30:58.171 [2024-11-28 23:23:01.525533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.525653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.525680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.171 qpair failed and we were unable to recover it. 00:30:58.171 [2024-11-28 23:23:01.525777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.525862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.525889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.171 qpair failed and we were unable to recover it. 00:30:58.171 [2024-11-28 23:23:01.525986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.526101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.526127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.171 qpair failed and we were unable to recover it. 00:30:58.171 [2024-11-28 23:23:01.526244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.526326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.526353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.171 qpair failed and we were unable to recover it. 00:30:58.171 [2024-11-28 23:23:01.526450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.526541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.526569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.171 qpair failed and we were unable to recover it. 00:30:58.171 [2024-11-28 23:23:01.526660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.526745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.526772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.171 qpair failed and we were unable to recover it. 00:30:58.171 [2024-11-28 23:23:01.526888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.526997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.527023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.171 qpair failed and we were unable to recover it. 00:30:58.171 [2024-11-28 23:23:01.527149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.527232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.527259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.171 qpair failed and we were unable to recover it. 00:30:58.171 [2024-11-28 23:23:01.527404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.527499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.527526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.171 qpair failed and we were unable to recover it. 00:30:58.171 [2024-11-28 23:23:01.527617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.527738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.527764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.171 qpair failed and we were unable to recover it. 00:30:58.171 [2024-11-28 23:23:01.527843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.527958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.527984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.171 qpair failed and we were unable to recover it. 00:30:58.171 [2024-11-28 23:23:01.528084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.528166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.528194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.171 qpair failed and we were unable to recover it. 00:30:58.171 [2024-11-28 23:23:01.528273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.528390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.528433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.171 qpair failed and we were unable to recover it. 00:30:58.171 [2024-11-28 23:23:01.528555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.528639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.528664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.171 qpair failed and we were unable to recover it. 00:30:58.171 [2024-11-28 23:23:01.528753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.528872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.528898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.171 qpair failed and we were unable to recover it. 00:30:58.171 [2024-11-28 23:23:01.528993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.529100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.529127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.171 qpair failed and we were unable to recover it. 00:30:58.171 [2024-11-28 23:23:01.529235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.529362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.529388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.171 qpair failed and we were unable to recover it. 00:30:58.171 [2024-11-28 23:23:01.529521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.529615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.529641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.171 qpair failed and we were unable to recover it. 00:30:58.171 [2024-11-28 23:23:01.529726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.529868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.529895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.171 qpair failed and we were unable to recover it. 00:30:58.171 [2024-11-28 23:23:01.530011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.530104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.530130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.171 qpair failed and we were unable to recover it. 00:30:58.171 [2024-11-28 23:23:01.530240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.530328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.530353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.171 qpair failed and we were unable to recover it. 00:30:58.171 [2024-11-28 23:23:01.530448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.530537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.530564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.171 qpair failed and we were unable to recover it. 00:30:58.171 [2024-11-28 23:23:01.530659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.530747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.530773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.171 qpair failed and we were unable to recover it. 00:30:58.171 [2024-11-28 23:23:01.530871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.530984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.531010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.171 qpair failed and we were unable to recover it. 00:30:58.171 [2024-11-28 23:23:01.531126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.531239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.531265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.171 qpair failed and we were unable to recover it. 00:30:58.171 [2024-11-28 23:23:01.531348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.531435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.531462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.171 qpair failed and we were unable to recover it. 00:30:58.171 [2024-11-28 23:23:01.531561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.171 [2024-11-28 23:23:01.531652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.531679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.172 qpair failed and we were unable to recover it. 00:30:58.172 [2024-11-28 23:23:01.531823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.531906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.531936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.172 qpair failed and we were unable to recover it. 00:30:58.172 [2024-11-28 23:23:01.532048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.532131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.532158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.172 qpair failed and we were unable to recover it. 00:30:58.172 [2024-11-28 23:23:01.532242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.532319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.532344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.172 qpair failed and we were unable to recover it. 00:30:58.172 [2024-11-28 23:23:01.532441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.532558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.532586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.172 qpair failed and we were unable to recover it. 00:30:58.172 [2024-11-28 23:23:01.532680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.532765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.532793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.172 qpair failed and we were unable to recover it. 00:30:58.172 [2024-11-28 23:23:01.532902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.533047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.533073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.172 qpair failed and we were unable to recover it. 00:30:58.172 [2024-11-28 23:23:01.533196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.533291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.533317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.172 qpair failed and we were unable to recover it. 00:30:58.172 [2024-11-28 23:23:01.533434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.533555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.533582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.172 qpair failed and we were unable to recover it. 00:30:58.172 [2024-11-28 23:23:01.533666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.533777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.533803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.172 qpair failed and we were unable to recover it. 00:30:58.172 [2024-11-28 23:23:01.533914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.534001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.534026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.172 qpair failed and we were unable to recover it. 00:30:58.172 [2024-11-28 23:23:01.534134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.534245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.534271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.172 qpair failed and we were unable to recover it. 00:30:58.172 [2024-11-28 23:23:01.534354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.534439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.534466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.172 qpair failed and we were unable to recover it. 00:30:58.172 [2024-11-28 23:23:01.534544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.534639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.534664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.172 qpair failed and we were unable to recover it. 00:30:58.172 [2024-11-28 23:23:01.534781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.534857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.534883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.172 qpair failed and we were unable to recover it. 00:30:58.172 [2024-11-28 23:23:01.534974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.535098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.535124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.172 qpair failed and we were unable to recover it. 00:30:58.172 [2024-11-28 23:23:01.535244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.535324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.535349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.172 qpair failed and we were unable to recover it. 00:30:58.172 [2024-11-28 23:23:01.535486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.535604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.535631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.172 qpair failed and we were unable to recover it. 00:30:58.172 [2024-11-28 23:23:01.535779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.535882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.535908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.172 qpair failed and we were unable to recover it. 00:30:58.172 [2024-11-28 23:23:01.535997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.536108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.536133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.172 qpair failed and we were unable to recover it. 00:30:58.172 [2024-11-28 23:23:01.536247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.536368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.536415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.172 qpair failed and we were unable to recover it. 00:30:58.172 [2024-11-28 23:23:01.536510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.536599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.536624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.172 qpair failed and we were unable to recover it. 00:30:58.172 [2024-11-28 23:23:01.536715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.536810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.536837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.172 qpair failed and we were unable to recover it. 00:30:58.172 [2024-11-28 23:23:01.536926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.537038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.537064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.172 qpair failed and we were unable to recover it. 00:30:58.172 [2024-11-28 23:23:01.537157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.537273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.537299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.172 qpair failed and we were unable to recover it. 00:30:58.172 [2024-11-28 23:23:01.537391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.537513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.537540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.172 qpair failed and we were unable to recover it. 00:30:58.172 [2024-11-28 23:23:01.537689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.537804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.537831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.172 qpair failed and we were unable to recover it. 00:30:58.172 [2024-11-28 23:23:01.537914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.538031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.538057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.172 qpair failed and we were unable to recover it. 00:30:58.172 [2024-11-28 23:23:01.538136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.538252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.538277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.172 qpair failed and we were unable to recover it. 00:30:58.172 [2024-11-28 23:23:01.538356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.538446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.538473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.172 qpair failed and we were unable to recover it. 00:30:58.172 [2024-11-28 23:23:01.538568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.538657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.538682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.172 qpair failed and we were unable to recover it. 00:30:58.172 [2024-11-28 23:23:01.538795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.538881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.538906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.172 qpair failed and we were unable to recover it. 00:30:58.172 [2024-11-28 23:23:01.538996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.539117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.539144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.172 qpair failed and we were unable to recover it. 00:30:58.172 [2024-11-28 23:23:01.539236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.539347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.539374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.172 qpair failed and we were unable to recover it. 00:30:58.172 [2024-11-28 23:23:01.539481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.539570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.539597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.172 qpair failed and we were unable to recover it. 00:30:58.172 [2024-11-28 23:23:01.539676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.539783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.539810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.172 qpair failed and we were unable to recover it. 00:30:58.172 [2024-11-28 23:23:01.539899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.539988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.172 [2024-11-28 23:23:01.540015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.173 qpair failed and we were unable to recover it. 00:30:58.173 [2024-11-28 23:23:01.540095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.540217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.540244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.173 qpair failed and we were unable to recover it. 00:30:58.173 [2024-11-28 23:23:01.540335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.540449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.540476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.173 qpair failed and we were unable to recover it. 00:30:58.173 [2024-11-28 23:23:01.540568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.540644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.540670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.173 qpair failed and we were unable to recover it. 00:30:58.173 [2024-11-28 23:23:01.540762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.540853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.540879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.173 qpair failed and we were unable to recover it. 00:30:58.173 [2024-11-28 23:23:01.540996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.541080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.541107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.173 qpair failed and we were unable to recover it. 00:30:58.173 [2024-11-28 23:23:01.541196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.541296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.541323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.173 qpair failed and we were unable to recover it. 00:30:58.173 [2024-11-28 23:23:01.541421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.541500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.541526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.173 qpair failed and we were unable to recover it. 00:30:58.173 [2024-11-28 23:23:01.541611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.541731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.541757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.173 qpair failed and we were unable to recover it. 00:30:58.173 [2024-11-28 23:23:01.541869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.541991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.542017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.173 qpair failed and we were unable to recover it. 00:30:58.173 [2024-11-28 23:23:01.542109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.542189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.542215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.173 qpair failed and we were unable to recover it. 00:30:58.173 [2024-11-28 23:23:01.542303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.542411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.542438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.173 qpair failed and we were unable to recover it. 00:30:58.173 [2024-11-28 23:23:01.542565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.542705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.542731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.173 qpair failed and we were unable to recover it. 00:30:58.173 [2024-11-28 23:23:01.542809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.542897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.542924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.173 qpair failed and we were unable to recover it. 00:30:58.173 [2024-11-28 23:23:01.543020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.543110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.543137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.173 qpair failed and we were unable to recover it. 00:30:58.173 [2024-11-28 23:23:01.543233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.543356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.543382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.173 qpair failed and we were unable to recover it. 00:30:58.173 [2024-11-28 23:23:01.543542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.543661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.543691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.173 qpair failed and we were unable to recover it. 00:30:58.173 [2024-11-28 23:23:01.543780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.543877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.543904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.173 qpair failed and we were unable to recover it. 00:30:58.173 [2024-11-28 23:23:01.543999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.544089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.544115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.173 qpair failed and we were unable to recover it. 00:30:58.173 [2024-11-28 23:23:01.544211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.544302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.544328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.173 qpair failed and we were unable to recover it. 00:30:58.173 [2024-11-28 23:23:01.544432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.544556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.544582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.173 qpair failed and we were unable to recover it. 00:30:58.173 [2024-11-28 23:23:01.544703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.544798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.544824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.173 qpair failed and we were unable to recover it. 00:30:58.173 [2024-11-28 23:23:01.544913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.545020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.545047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.173 qpair failed and we were unable to recover it. 00:30:58.173 [2024-11-28 23:23:01.545173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.545255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.545281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.173 qpair failed and we were unable to recover it. 00:30:58.173 [2024-11-28 23:23:01.545407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.545520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.545547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.173 qpair failed and we were unable to recover it. 00:30:58.173 [2024-11-28 23:23:01.545642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.545752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.545779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.173 qpair failed and we were unable to recover it. 00:30:58.173 [2024-11-28 23:23:01.545867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.545978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.546005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.173 qpair failed and we were unable to recover it. 00:30:58.173 [2024-11-28 23:23:01.546102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.546201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.546227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.173 qpair failed and we were unable to recover it. 00:30:58.173 [2024-11-28 23:23:01.546316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.546425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.546451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.173 qpair failed and we were unable to recover it. 00:30:58.173 [2024-11-28 23:23:01.546563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.546647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.546674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.173 qpair failed and we were unable to recover it. 00:30:58.173 [2024-11-28 23:23:01.546789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.546876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.546903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.173 qpair failed and we were unable to recover it. 00:30:58.173 [2024-11-28 23:23:01.546985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.547096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.547122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.173 qpair failed and we were unable to recover it. 00:30:58.173 [2024-11-28 23:23:01.547214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.547327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.547352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.173 qpair failed and we were unable to recover it. 00:30:58.173 [2024-11-28 23:23:01.547481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.547568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.547596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.173 qpair failed and we were unable to recover it. 00:30:58.173 [2024-11-28 23:23:01.547693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.547781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.547807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.173 qpair failed and we were unable to recover it. 00:30:58.173 [2024-11-28 23:23:01.547903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.547978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.548004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.173 qpair failed and we were unable to recover it. 00:30:58.173 [2024-11-28 23:23:01.548101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.548192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.173 [2024-11-28 23:23:01.548219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.173 qpair failed and we were unable to recover it. 00:30:58.173 [2024-11-28 23:23:01.548337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.548461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.548488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.174 qpair failed and we were unable to recover it. 00:30:58.174 [2024-11-28 23:23:01.548573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.548654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.548680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.174 qpair failed and we were unable to recover it. 00:30:58.174 [2024-11-28 23:23:01.548764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.548873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.548899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.174 qpair failed and we were unable to recover it. 00:30:58.174 [2024-11-28 23:23:01.548985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.549093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.549118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.174 qpair failed and we were unable to recover it. 00:30:58.174 [2024-11-28 23:23:01.549215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.549293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.549319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.174 qpair failed and we were unable to recover it. 00:30:58.174 [2024-11-28 23:23:01.549405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.549500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.549527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.174 qpair failed and we were unable to recover it. 00:30:58.174 [2024-11-28 23:23:01.549620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.549717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.549743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.174 qpair failed and we were unable to recover it. 00:30:58.174 [2024-11-28 23:23:01.549840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.549931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.549958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.174 qpair failed and we were unable to recover it. 00:30:58.174 [2024-11-28 23:23:01.550040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.550154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.550180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.174 qpair failed and we were unable to recover it. 00:30:58.174 [2024-11-28 23:23:01.550267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.550362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.550388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.174 qpair failed and we were unable to recover it. 00:30:58.174 [2024-11-28 23:23:01.550490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.550576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.550603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.174 qpair failed and we were unable to recover it. 00:30:58.174 [2024-11-28 23:23:01.550702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.550815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.550841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.174 qpair failed and we were unable to recover it. 00:30:58.174 [2024-11-28 23:23:01.550924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.551015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.551041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.174 qpair failed and we were unable to recover it. 00:30:58.174 [2024-11-28 23:23:01.551130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.551246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.551273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.174 qpair failed and we were unable to recover it. 00:30:58.174 [2024-11-28 23:23:01.551367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.551467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.551493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.174 qpair failed and we were unable to recover it. 00:30:58.174 [2024-11-28 23:23:01.551597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.551679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.551705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.174 qpair failed and we were unable to recover it. 00:30:58.174 [2024-11-28 23:23:01.551792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.551904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.551930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.174 qpair failed and we were unable to recover it. 00:30:58.174 [2024-11-28 23:23:01.552012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.552130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.552156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.174 qpair failed and we were unable to recover it. 00:30:58.174 [2024-11-28 23:23:01.552299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.552389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.552423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.174 qpair failed and we were unable to recover it. 00:30:58.174 [2024-11-28 23:23:01.552512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.552614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.552641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.174 qpair failed and we were unable to recover it. 00:30:58.174 [2024-11-28 23:23:01.552741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.552879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.552913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.174 qpair failed and we were unable to recover it. 00:30:58.174 [2024-11-28 23:23:01.553028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.553128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.553154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.174 qpair failed and we were unable to recover it. 00:30:58.174 [2024-11-28 23:23:01.553274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.553372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.553406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.174 qpair failed and we were unable to recover it. 00:30:58.174 [2024-11-28 23:23:01.553526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.553615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.553641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.174 qpair failed and we were unable to recover it. 00:30:58.174 [2024-11-28 23:23:01.553751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.553826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.553852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.174 qpair failed and we were unable to recover it. 00:30:58.174 [2024-11-28 23:23:01.553970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.554083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.554109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.174 qpair failed and we were unable to recover it. 00:30:58.174 [2024-11-28 23:23:01.554207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.554292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.554318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.174 qpair failed and we were unable to recover it. 00:30:58.174 [2024-11-28 23:23:01.554404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.554482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.554507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.174 qpair failed and we were unable to recover it. 00:30:58.174 [2024-11-28 23:23:01.554592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.554672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.554699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.174 qpair failed and we were unable to recover it. 00:30:58.174 [2024-11-28 23:23:01.554800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.554900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.554926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.174 qpair failed and we were unable to recover it. 00:30:58.174 [2024-11-28 23:23:01.555066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.555156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.555182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.174 qpair failed and we were unable to recover it. 00:30:58.174 [2024-11-28 23:23:01.555277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.555363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.555390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.174 qpair failed and we were unable to recover it. 00:30:58.174 [2024-11-28 23:23:01.555503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.555591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.555617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.174 qpair failed and we were unable to recover it. 00:30:58.174 [2024-11-28 23:23:01.555743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.174 [2024-11-28 23:23:01.555825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.555850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.175 qpair failed and we were unable to recover it. 00:30:58.175 [2024-11-28 23:23:01.555943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.556034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.556060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.175 qpair failed and we were unable to recover it. 00:30:58.175 [2024-11-28 23:23:01.556178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.556272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.556298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.175 qpair failed and we were unable to recover it. 00:30:58.175 [2024-11-28 23:23:01.556410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.556507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.556533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.175 qpair failed and we were unable to recover it. 00:30:58.175 [2024-11-28 23:23:01.556628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.556723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.556749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.175 qpair failed and we were unable to recover it. 00:30:58.175 [2024-11-28 23:23:01.556869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.556954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.556981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.175 qpair failed and we were unable to recover it. 00:30:58.175 [2024-11-28 23:23:01.557062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.557152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.557179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.175 qpair failed and we were unable to recover it. 00:30:58.175 [2024-11-28 23:23:01.557277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.557362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.557390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.175 qpair failed and we were unable to recover it. 00:30:58.175 [2024-11-28 23:23:01.557500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.557601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.557627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.175 qpair failed and we were unable to recover it. 00:30:58.175 [2024-11-28 23:23:01.557725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.557818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.557844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.175 qpair failed and we were unable to recover it. 00:30:58.175 [2024-11-28 23:23:01.557953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.558044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.558070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.175 qpair failed and we were unable to recover it. 00:30:58.175 [2024-11-28 23:23:01.558164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.558251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.558277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.175 qpair failed and we were unable to recover it. 00:30:58.175 [2024-11-28 23:23:01.558361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.558449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.558475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.175 qpair failed and we were unable to recover it. 00:30:58.175 [2024-11-28 23:23:01.558606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.558698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.558723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.175 qpair failed and we were unable to recover it. 00:30:58.175 [2024-11-28 23:23:01.558809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.558945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.558971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.175 qpair failed and we were unable to recover it. 00:30:58.175 [2024-11-28 23:23:01.559063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.559179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.559204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.175 qpair failed and we were unable to recover it. 00:30:58.175 [2024-11-28 23:23:01.559324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.559420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.559447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.175 qpair failed and we were unable to recover it. 00:30:58.175 [2024-11-28 23:23:01.559571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.559683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.559708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.175 qpair failed and we were unable to recover it. 00:30:58.175 [2024-11-28 23:23:01.559826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.559920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.559945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.175 qpair failed and we were unable to recover it. 00:30:58.175 [2024-11-28 23:23:01.560032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.560152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.560177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.175 qpair failed and we were unable to recover it. 00:30:58.175 [2024-11-28 23:23:01.560288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.560364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.560391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.175 qpair failed and we were unable to recover it. 00:30:58.175 [2024-11-28 23:23:01.560522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.560611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.560637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.175 qpair failed and we were unable to recover it. 00:30:58.175 [2024-11-28 23:23:01.560754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.560847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.560873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.175 qpair failed and we were unable to recover it. 00:30:58.175 [2024-11-28 23:23:01.560957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.561050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.561075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.175 qpair failed and we were unable to recover it. 00:30:58.175 [2024-11-28 23:23:01.561168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.561248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.561273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.175 qpair failed and we were unable to recover it. 00:30:58.175 [2024-11-28 23:23:01.561448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.561542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.561567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.175 qpair failed and we were unable to recover it. 00:30:58.175 [2024-11-28 23:23:01.561654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.561742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.561766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.175 qpair failed and we were unable to recover it. 00:30:58.175 [2024-11-28 23:23:01.561881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.561975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.562000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.175 qpair failed and we were unable to recover it. 00:30:58.175 [2024-11-28 23:23:01.562083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.562178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.562202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.175 qpair failed and we were unable to recover it. 00:30:58.175 [2024-11-28 23:23:01.562300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.562410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.562435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.175 qpair failed and we were unable to recover it. 00:30:58.175 [2024-11-28 23:23:01.562532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.562649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.562673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.175 qpair failed and we were unable to recover it. 00:30:58.175 [2024-11-28 23:23:01.562758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.562842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.562866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.175 qpair failed and we were unable to recover it. 00:30:58.175 [2024-11-28 23:23:01.562964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.563083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.563106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.175 qpair failed and we were unable to recover it. 00:30:58.175 [2024-11-28 23:23:01.563197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.563290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.563313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.175 qpair failed and we were unable to recover it. 00:30:58.175 [2024-11-28 23:23:01.563402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.563521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.563545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.175 qpair failed and we were unable to recover it. 00:30:58.175 [2024-11-28 23:23:01.563638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.563726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.563751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.175 qpair failed and we were unable to recover it. 00:30:58.175 [2024-11-28 23:23:01.563834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.563924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.175 [2024-11-28 23:23:01.563949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.175 qpair failed and we were unable to recover it. 00:30:58.176 [2024-11-28 23:23:01.564034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.564149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.564174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.176 qpair failed and we were unable to recover it. 00:30:58.176 [2024-11-28 23:23:01.564254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.564327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.564354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.176 qpair failed and we were unable to recover it. 00:30:58.176 [2024-11-28 23:23:01.564478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.564601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.564625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.176 qpair failed and we were unable to recover it. 00:30:58.176 [2024-11-28 23:23:01.564738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.564829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.564853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.176 qpair failed and we were unable to recover it. 00:30:58.176 [2024-11-28 23:23:01.564973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.565088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.565111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.176 qpair failed and we were unable to recover it. 00:30:58.176 [2024-11-28 23:23:01.565212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.565302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.565325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.176 qpair failed and we were unable to recover it. 00:30:58.176 [2024-11-28 23:23:01.565416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.565504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.565529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.176 qpair failed and we were unable to recover it. 00:30:58.176 [2024-11-28 23:23:01.565626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.565720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.565744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.176 qpair failed and we were unable to recover it. 00:30:58.176 [2024-11-28 23:23:01.565827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.565938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.565962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.176 qpair failed and we were unable to recover it. 00:30:58.176 [2024-11-28 23:23:01.566049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.566145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.566168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.176 qpair failed and we were unable to recover it. 00:30:58.176 [2024-11-28 23:23:01.566284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.566359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.566383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.176 qpair failed and we were unable to recover it. 00:30:58.176 [2024-11-28 23:23:01.570404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.570562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.570590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.176 qpair failed and we were unable to recover it. 00:30:58.176 [2024-11-28 23:23:01.570727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.570848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.570872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.176 qpair failed and we were unable to recover it. 00:30:58.176 [2024-11-28 23:23:01.570976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.571124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.571147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.176 qpair failed and we were unable to recover it. 00:30:58.176 [2024-11-28 23:23:01.571233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.571353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.571376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.176 qpair failed and we were unable to recover it. 00:30:58.176 [2024-11-28 23:23:01.571521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.571620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.571647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.176 qpair failed and we were unable to recover it. 00:30:58.176 [2024-11-28 23:23:01.571745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.571836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.571860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.176 qpair failed and we were unable to recover it. 00:30:58.176 [2024-11-28 23:23:01.571978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.572097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.572121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.176 qpair failed and we were unable to recover it. 00:30:58.176 [2024-11-28 23:23:01.572273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.572412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.572437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.176 qpair failed and we were unable to recover it. 00:30:58.176 [2024-11-28 23:23:01.572549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.572650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.572673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.176 qpair failed and we were unable to recover it. 00:30:58.176 [2024-11-28 23:23:01.572767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.572860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.572884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.176 qpair failed and we were unable to recover it. 00:30:58.176 [2024-11-28 23:23:01.572979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.573095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.573119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.176 qpair failed and we were unable to recover it. 00:30:58.176 [2024-11-28 23:23:01.573219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.573315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.573339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.176 qpair failed and we were unable to recover it. 00:30:58.176 [2024-11-28 23:23:01.573444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.573537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.573561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.176 qpair failed and we were unable to recover it. 00:30:58.176 [2024-11-28 23:23:01.573685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.573778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.573801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.176 qpair failed and we were unable to recover it. 00:30:58.176 [2024-11-28 23:23:01.573888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.574010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.574033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.176 qpair failed and we were unable to recover it. 00:30:58.176 [2024-11-28 23:23:01.574148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.574283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.574306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.176 qpair failed and we were unable to recover it. 00:30:58.176 [2024-11-28 23:23:01.574411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.574514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.574537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.176 qpair failed and we were unable to recover it. 00:30:58.176 [2024-11-28 23:23:01.574628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.574720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.574744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.176 qpair failed and we were unable to recover it. 00:30:58.176 [2024-11-28 23:23:01.574867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.574955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.574978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.176 qpair failed and we were unable to recover it. 00:30:58.176 [2024-11-28 23:23:01.575100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.575198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.575221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.176 qpair failed and we were unable to recover it. 00:30:58.176 [2024-11-28 23:23:01.575305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.575397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.575422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.176 qpair failed and we were unable to recover it. 00:30:58.176 [2024-11-28 23:23:01.575524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.575621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.575645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.176 qpair failed and we were unable to recover it. 00:30:58.176 [2024-11-28 23:23:01.575769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.575852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.575876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.176 qpair failed and we were unable to recover it. 00:30:58.176 [2024-11-28 23:23:01.575972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.576061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.576085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.176 qpair failed and we were unable to recover it. 00:30:58.176 [2024-11-28 23:23:01.576202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.576292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.576316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.176 qpair failed and we were unable to recover it. 00:30:58.176 [2024-11-28 23:23:01.576410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.576515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.576538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.176 qpair failed and we were unable to recover it. 00:30:58.176 [2024-11-28 23:23:01.576630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.577404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.176 [2024-11-28 23:23:01.577430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.176 qpair failed and we were unable to recover it. 00:30:58.177 [2024-11-28 23:23:01.577561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.577647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.577671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.177 qpair failed and we were unable to recover it. 00:30:58.177 [2024-11-28 23:23:01.577772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.577890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.577914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.177 qpair failed and we were unable to recover it. 00:30:58.177 [2024-11-28 23:23:01.578037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.578164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.578188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.177 qpair failed and we were unable to recover it. 00:30:58.177 [2024-11-28 23:23:01.578317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.581403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.581429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.177 qpair failed and we were unable to recover it. 00:30:58.177 [2024-11-28 23:23:01.581571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.581670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.581697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.177 qpair failed and we were unable to recover it. 00:30:58.177 [2024-11-28 23:23:01.581790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.581894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.581919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.177 qpair failed and we were unable to recover it. 00:30:58.177 [2024-11-28 23:23:01.582028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.582144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.582168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.177 qpair failed and we were unable to recover it. 00:30:58.177 [2024-11-28 23:23:01.582312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.582405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.582430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.177 qpair failed and we were unable to recover it. 00:30:58.177 [2024-11-28 23:23:01.582532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.582656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.582681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.177 qpair failed and we were unable to recover it. 00:30:58.177 [2024-11-28 23:23:01.582808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.582931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.582956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.177 qpair failed and we were unable to recover it. 00:30:58.177 [2024-11-28 23:23:01.583045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.583161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.583185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.177 qpair failed and we were unable to recover it. 00:30:58.177 [2024-11-28 23:23:01.583315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.583411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.583435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.177 qpair failed and we were unable to recover it. 00:30:58.177 [2024-11-28 23:23:01.583591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.583685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.583711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.177 qpair failed and we were unable to recover it. 00:30:58.177 [2024-11-28 23:23:01.583831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.583929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.583954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.177 qpair failed and we were unable to recover it. 00:30:58.177 [2024-11-28 23:23:01.584079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.584185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.584213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.177 qpair failed and we were unable to recover it. 00:30:58.177 [2024-11-28 23:23:01.584328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.584419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.584443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.177 qpair failed and we were unable to recover it. 00:30:58.177 [2024-11-28 23:23:01.584539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.584621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.584645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.177 qpair failed and we were unable to recover it. 00:30:58.177 [2024-11-28 23:23:01.584732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.584877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.584901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.177 qpair failed and we were unable to recover it. 00:30:58.177 [2024-11-28 23:23:01.584995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.585084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.585106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.177 qpair failed and we were unable to recover it. 00:30:58.177 [2024-11-28 23:23:01.585192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.585312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.585336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.177 qpair failed and we were unable to recover it. 00:30:58.177 [2024-11-28 23:23:01.585430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.585536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.585560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.177 qpair failed and we were unable to recover it. 00:30:58.177 [2024-11-28 23:23:01.585654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.585735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.585758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.177 qpair failed and we were unable to recover it. 00:30:58.177 [2024-11-28 23:23:01.585851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.585977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.586001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.177 qpair failed and we were unable to recover it. 00:30:58.177 [2024-11-28 23:23:01.586126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.587417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.587443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.177 qpair failed and we were unable to recover it. 00:30:58.177 [2024-11-28 23:23:01.587570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.587715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.587738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.177 qpair failed and we were unable to recover it. 00:30:58.177 [2024-11-28 23:23:01.587843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.587986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.588009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.177 qpair failed and we were unable to recover it. 00:30:58.177 [2024-11-28 23:23:01.588106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.588221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.588244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.177 qpair failed and we were unable to recover it. 00:30:58.177 [2024-11-28 23:23:01.588348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.588505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.588533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.177 qpair failed and we were unable to recover it. 00:30:58.177 [2024-11-28 23:23:01.588624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.588735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.588757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.177 qpair failed and we were unable to recover it. 00:30:58.177 [2024-11-28 23:23:01.588907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.589015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.589038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.177 qpair failed and we were unable to recover it. 00:30:58.177 [2024-11-28 23:23:01.589185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.589302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.589324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.177 qpair failed and we were unable to recover it. 00:30:58.177 [2024-11-28 23:23:01.592418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.592547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.592571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.177 qpair failed and we were unable to recover it. 00:30:58.177 [2024-11-28 23:23:01.592695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.592793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.592815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.177 qpair failed and we were unable to recover it. 00:30:58.177 [2024-11-28 23:23:01.592934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.593028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.593051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.177 qpair failed and we were unable to recover it. 00:30:58.177 [2024-11-28 23:23:01.593181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.593269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.177 [2024-11-28 23:23:01.593300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.178 qpair failed and we were unable to recover it. 00:30:58.178 [2024-11-28 23:23:01.593467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.178 [2024-11-28 23:23:01.593587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.178 [2024-11-28 23:23:01.593610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.178 qpair failed and we were unable to recover it. 00:30:58.178 [2024-11-28 23:23:01.593735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.178 [2024-11-28 23:23:01.593832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.178 [2024-11-28 23:23:01.593855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.178 qpair failed and we were unable to recover it. 00:30:58.178 [2024-11-28 23:23:01.593967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.178 [2024-11-28 23:23:01.594054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.178 [2024-11-28 23:23:01.594078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.178 qpair failed and we were unable to recover it. 00:30:58.178 [2024-11-28 23:23:01.594192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.178 [2024-11-28 23:23:01.594309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.178 [2024-11-28 23:23:01.594334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.178 qpair failed and we were unable to recover it. 00:30:58.178 [2024-11-28 23:23:01.594414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.178 [2024-11-28 23:23:01.594539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.178 [2024-11-28 23:23:01.594563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.178 qpair failed and we were unable to recover it. 00:30:58.178 [2024-11-28 23:23:01.594690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.178 [2024-11-28 23:23:01.594780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.178 [2024-11-28 23:23:01.594803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.178 qpair failed and we were unable to recover it. 00:30:58.178 [2024-11-28 23:23:01.594954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.178 [2024-11-28 23:23:01.595105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.178 [2024-11-28 23:23:01.595129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.178 qpair failed and we were unable to recover it. 00:30:58.178 [2024-11-28 23:23:01.595249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.178 [2024-11-28 23:23:01.595373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.178 [2024-11-28 23:23:01.595401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.178 qpair failed and we were unable to recover it. 00:30:58.178 [2024-11-28 23:23:01.595526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.178 [2024-11-28 23:23:01.595626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.437 [2024-11-28 23:23:01.996805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.437 qpair failed and we were unable to recover it. 00:30:58.437 [2024-11-28 23:23:01.997068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.437 [2024-11-28 23:23:01.997179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.437 [2024-11-28 23:23:01.997206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.437 qpair failed and we were unable to recover it. 00:30:58.437 [2024-11-28 23:23:01.997295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.437 [2024-11-28 23:23:01.997433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.437 [2024-11-28 23:23:01.997458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.437 qpair failed and we were unable to recover it. 00:30:58.437 [2024-11-28 23:23:01.997559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.437 [2024-11-28 23:23:01.997652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.437 [2024-11-28 23:23:01.997678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.437 qpair failed and we were unable to recover it. 00:30:58.437 [2024-11-28 23:23:01.997842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:01.997969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:01.997992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:01.998085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:01.998216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:01.998240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:01.998317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:01.998426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:01.998451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:01.998582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:01.998673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:01.998698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:01.998819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:01.998941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:01.998965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:01.999084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:01.999176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:01.999200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:01.999318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:01.999413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:01.999439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:01.999561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:01.999661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:01.999685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:01.999811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:01.999934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:01.999964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:02.000089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.000233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.000258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:02.000375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.000484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.000509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:02.000614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.000695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.000719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:02.000805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.000925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.000951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:02.001038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.001155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.001181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:02.001297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.001429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.001457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:02.001542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.001635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.001662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:02.001754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.001874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.001901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:02.002046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.002162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.002196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:02.002302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.002388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.002419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:02.002547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.002670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.002696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:02.002791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.002877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.002903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:02.002990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.003067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.003091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:02.003187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.003291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.003317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:02.003423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.003517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.003544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:02.003641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.003763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.003789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:02.003910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.004037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.004064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:02.004156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.004256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.004282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:02.004366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.004453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.004480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:02.004568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.004661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.004688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:02.004788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.004869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.004895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:02.004983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.005124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.005150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:02.005270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.005360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.005386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:02.005495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.005582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.005607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:02.005752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.005845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.005872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:02.006020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.006142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.006169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:02.006314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.006431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.006459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:02.006556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.006649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.006675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:02.006794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.006894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.006921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:02.007020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.007102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.007128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:02.007277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.007363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.007388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:02.007484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.007571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.007597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:02.007717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.007810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.007835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:02.007926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.008017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.008042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:02.008154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.008277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.008304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:02.008403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.008484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.008508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:02.008617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.008707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.008732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:02.008819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.008911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.008936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:02.009053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.009173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.009200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:02.009290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.009371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.009401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:02.009521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.009614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.009638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:02.009750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.009871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.009898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:02.009990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.010110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.010137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:02.010284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.010374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.010408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:02.010499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.010586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.010611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:02.010724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.010806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.438 [2024-11-28 23:23:02.010831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.438 qpair failed and we were unable to recover it. 00:30:58.438 [2024-11-28 23:23:02.010927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.011009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.011035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.011123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.011240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.011266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.011364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.011490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.011518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.011608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.011724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.011750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.011841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.011928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.011957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.012103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.012233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.012261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.012353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.012449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.012475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.012570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.012659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.012683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.012764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.012888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.012915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.013011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.013128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.013154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.013276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.013419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.013446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.013538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.013650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.013675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.013801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.013942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.013969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.014063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.014145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.014172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.014292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.014380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.014411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.014515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.014623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.014650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.014768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.014883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.014910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.015021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.015135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.015162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.015256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.015422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.015450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.015531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.015646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.015671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.015790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.015885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.015912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.016043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.016136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.016163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.016273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.016423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.016451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.016551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.016649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.016676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.016792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.016881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.016908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.017001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.017111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.017138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.017223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.017344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.017371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.017481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.017598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.017627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.017724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.017835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.017862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.017983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.018098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.018125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.018235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.018314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.018341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.018424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.018519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.018544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.018668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.018811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.018838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.018938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.019083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.019110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.019194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.019302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.019329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.019425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.019574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.019602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.019719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.019864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.019891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.019977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.020095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.020122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.020210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.020292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.020317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.020427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.020520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.020547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.020661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.020769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.020795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.020945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.021055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.021082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.021200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.021289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.021316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.021434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.021515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.021542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.021631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.021777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.021804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.021946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.022071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.022098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.022187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.022302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.022329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.022422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.022541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.022568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.022692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.022785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.022812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.022900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.022983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.023008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.023152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.023280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.023312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.023433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.023548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.023574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.023691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.023804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.023831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.023941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.024062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.024089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.024207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.024320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.024346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.024435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.024552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.439 [2024-11-28 23:23:02.024583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.439 qpair failed and we were unable to recover it. 00:30:58.439 [2024-11-28 23:23:02.024664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.024811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.024838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.024931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.025028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.025055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.025174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.025296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.025322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.025436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.025561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.025587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.025665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.025746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.025771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.025918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.026038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.026064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.026185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.026313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.026339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.026417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.026508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.026534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.026667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.026785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.026812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.026930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.027053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.027080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.027180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.027298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.027325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.027411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.027499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.027524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.027642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.027731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.027757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.027850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.027967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.027993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.028112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.028228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.028255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.028340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.028434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.028461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.028580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.028725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.028752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.028885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.028993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.029020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.029113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.029219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.029246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.029359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.029449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.029474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.029621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.029706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.029732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.029854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.029949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.029976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.030090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.030177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.030203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.030311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.030409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.030437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.030563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.030680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.030707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.030799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.030907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.030934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.031030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.031117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.031144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.031266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.031382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.031426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.031525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.031667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.031694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.031814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.031902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.031932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.032076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.032206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.032234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.032328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.032444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.032472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.032554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.032662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.032689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.032799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.032891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.032916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.033036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.033125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.033152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.033298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.033419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.033448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.033573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.033666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.033694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.033804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.033924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.033952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.034050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.034135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.034162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.034257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.034340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.034366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.034494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.034635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.034666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.034788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.034864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.034891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.035036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.035122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.035149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.035269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.035417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.035445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.035543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.035687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.035714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.035859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.035969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.035996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.036106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.036250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.036277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.036367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.036456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.036483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.036608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.036693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.036720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.440 [2024-11-28 23:23:02.036811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.036902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.440 [2024-11-28 23:23:02.036927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.440 qpair failed and we were unable to recover it. 00:30:58.441 [2024-11-28 23:23:02.037025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.441 [2024-11-28 23:23:02.037132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.441 [2024-11-28 23:23:02.037160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.441 qpair failed and we were unable to recover it. 00:30:58.441 [2024-11-28 23:23:02.037277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.441 [2024-11-28 23:23:02.037390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.441 [2024-11-28 23:23:02.037421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.441 qpair failed and we were unable to recover it. 00:30:58.441 [2024-11-28 23:23:02.037543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.441 [2024-11-28 23:23:02.037659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.441 [2024-11-28 23:23:02.037686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.441 qpair failed and we were unable to recover it. 00:30:58.441 [2024-11-28 23:23:02.037801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.441 [2024-11-28 23:23:02.037893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.441 [2024-11-28 23:23:02.037919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.441 qpair failed and we were unable to recover it. 00:30:58.441 [2024-11-28 23:23:02.038006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.441 [2024-11-28 23:23:02.038125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.441 [2024-11-28 23:23:02.038152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.441 qpair failed and we were unable to recover it. 00:30:58.441 [2024-11-28 23:23:02.038248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.441 [2024-11-28 23:23:02.038388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.441 [2024-11-28 23:23:02.038420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.441 qpair failed and we were unable to recover it. 00:30:58.441 [2024-11-28 23:23:02.038543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.441 [2024-11-28 23:23:02.038626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.441 [2024-11-28 23:23:02.038652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.441 qpair failed and we were unable to recover it. 00:30:58.441 [2024-11-28 23:23:02.038780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.441 [2024-11-28 23:23:02.038862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.441 [2024-11-28 23:23:02.038889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.441 qpair failed and we were unable to recover it. 00:30:58.441 [2024-11-28 23:23:02.039011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.441 [2024-11-28 23:23:02.039103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.441 [2024-11-28 23:23:02.039130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.441 qpair failed and we were unable to recover it. 00:30:58.441 [2024-11-28 23:23:02.039224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.441 [2024-11-28 23:23:02.039310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.441 [2024-11-28 23:23:02.039337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.441 qpair failed and we were unable to recover it. 00:30:58.441 [2024-11-28 23:23:02.039432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.441 [2024-11-28 23:23:02.039549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.441 [2024-11-28 23:23:02.039576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.441 qpair failed and we were unable to recover it. 00:30:58.441 [2024-11-28 23:23:02.039702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.441 [2024-11-28 23:23:02.039819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.441 [2024-11-28 23:23:02.039846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.441 qpair failed and we were unable to recover it. 00:30:58.441 [2024-11-28 23:23:02.039960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.441 [2024-11-28 23:23:02.040073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.441 [2024-11-28 23:23:02.040099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.441 qpair failed and we were unable to recover it. 00:30:58.441 [2024-11-28 23:23:02.040220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.441 [2024-11-28 23:23:02.040319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.441 [2024-11-28 23:23:02.040347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.441 qpair failed and we were unable to recover it. 00:30:58.441 [2024-11-28 23:23:02.040469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.441 [2024-11-28 23:23:02.040562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.441 [2024-11-28 23:23:02.040589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.441 qpair failed and we were unable to recover it. 00:30:58.441 [2024-11-28 23:23:02.040688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.441 [2024-11-28 23:23:02.040833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.441 [2024-11-28 23:23:02.040859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.441 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.040980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.041068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.041094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.041191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.041285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.041312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.041417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.041513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.041540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.041635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.041753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.041780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.041901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.041996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.042022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.042112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.042209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.042235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.042330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.042432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.042459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.042545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.042633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.042661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.042806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.042923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.042950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.043071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.043188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.043215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.043332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.043447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.043475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.043601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.043694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.043721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.043841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.043958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.043986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.044105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.044225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.044252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.044379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.044478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.044505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.044623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.044739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.044766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.044890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.044982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.045009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.045094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.045170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.045196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.045309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.045429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.045456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.045567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.045691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.045718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.045817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.045905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.045931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.046052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.046136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.046162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.046280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.046428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.046455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.046574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.046689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.046715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.046839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.046962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.046988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.047100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.047183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.047214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.047334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.047445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.047473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.047564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.047675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.047707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.047797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.047934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.047961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.048084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.048203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.048229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.048348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.048466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.048494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.048612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.048734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.048760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.048847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.048965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.048991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.049070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.049210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.049237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.049351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.049492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.049520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.049612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.049701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.049727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.049833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.049972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.049999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.050096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.050183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.050210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.050295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.050419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.050447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.050559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.050678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.050705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.050848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.050963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.050990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.051108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.051219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.051247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.051399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.051486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.051513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.051659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.051777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.051803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.051931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.052020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.052048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.052169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.052259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.052286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.052417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.052560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.052587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.052716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.052865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.052891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.711 qpair failed and we were unable to recover it. 00:30:58.711 [2024-11-28 23:23:02.053015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.053128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-11-28 23:23:02.053154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.053252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.053343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.053369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.053481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.053595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.053621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.053715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.053831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.053858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.053977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.054090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.054118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.054203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.054315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.054341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.054426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.054517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.054545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.054687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.054831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.054858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.054949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.055079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.055106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.055231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.055349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.055375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.055526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.055639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.055666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.055748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.055845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.055872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.055982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.056097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.056124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.056242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.056363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.056389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.056523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.056612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.056639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.056735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.056848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.056874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.056995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.057113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.057141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.057256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.057375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.057410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.057528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.057644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.057670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.057788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.057873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.057899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.058039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.058151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.058178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.058255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.058371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.058404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.058494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.058611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.058638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.058735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.058825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.058851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.058961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.059055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.059083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.059230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.059318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.059344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.059465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.059573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.059599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.059685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.059792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.059818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.059966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.060052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.060083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.060204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.060349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.060376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.060494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.060611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.060636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.060750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.060845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.060871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.061017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.061105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.061133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.061229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.061379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.061437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.061582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.061728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.061755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.061837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.061948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.061974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.062068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.062142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.062169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.062316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.062408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.062437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.062556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.062646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.062673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.062816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.062966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.062992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.063112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.063203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.063231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.063354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.063469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.063496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.063615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.063730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.063757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.063876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.063996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.064023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.064126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.064242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.064270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.064386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.064478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.064505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.064598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.064683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.064710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.064847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.064938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.064964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.065087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.065173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.065199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.065316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.065418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.065446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.065538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.065627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.065654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.065774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.065928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.065955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.066074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.066164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.066190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.066312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.066427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.066454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.066537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.066648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.066675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.066760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.066876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.066902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.712 qpair failed and we were unable to recover it. 00:30:58.712 [2024-11-28 23:23:02.067010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-11-28 23:23:02.067127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.067153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.067240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.067358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.067384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.067513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.067622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.067649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.067761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.067861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.067889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.068035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.068120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.068147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.068269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.068364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.068390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.068509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.068628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.068654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.068777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.068919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.068945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.069063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.069141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.069168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.069256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.069342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.069368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.069490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.069577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.069604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.069725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.069843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.069869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.069952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.070060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.070087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.070184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.070303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.070337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.070451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.070592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.070619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.070742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.070890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.070917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.071032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.071158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.071185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.071279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.071424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.071452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.071572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.071649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.071676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.071773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.071889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.071915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.072061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.072181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.072208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.072319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.072430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.072458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.072546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.072629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.072656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.072767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.072861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.072888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.073014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.073102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.073129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.073239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.073383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.073415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.073537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.073653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.073680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.073801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.073949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.073976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.074095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.074229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.074256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.074367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.074484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.074511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.074631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.074741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.074767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.074887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.074996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.075024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.075150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.075234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.075260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.075349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.075494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.075522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.075648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.075796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.075823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.075918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.076034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.076063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.076154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.076270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.076297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.076427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.076547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.076575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.076688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.076806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.076833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.076927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.077056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.077082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.077168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.077300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.077327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.077447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.077545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.077572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.077681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.077800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.077826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.077949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.078045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.078072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.078218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.078340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.078366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.078465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.078588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.078614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.078759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.078903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.078930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.079019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.079145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.079171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.079252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.079369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.713 [2024-11-28 23:23:02.079400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.713 qpair failed and we were unable to recover it. 00:30:58.713 [2024-11-28 23:23:02.079522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.079600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.079627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.079745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.079862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.079889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.080031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.080177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.080204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.080319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.080448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.080475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.080554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.080669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.080696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.080795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.080910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.080937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.081047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.081161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.081188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.081266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.081410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.081437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.081551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.081667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.081694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.081789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.081905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.081932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.082043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.082186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.082212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.082359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.082498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.082525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.082626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.082742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.082768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.082861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.083000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.083026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.083139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.083262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.083288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.083388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.083509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.083541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.083661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.083749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.083775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.083890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.084005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.084031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.084152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.084270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.084296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.084381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.084499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.084525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.084648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.084731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.084757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.084879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.084998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.085025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.085115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.085205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.085231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.085375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.085470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.085497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.085609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.085726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.085752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.085873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.085993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.086020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.086169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.086281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.086308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.086388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.086536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.086563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.086686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.086806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.086832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.086923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.087032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.087058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.087174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.087270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.087296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.087408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.087524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.087551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.087637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.087732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.087759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.087874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.087954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.087981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.088072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.088194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.088221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.088364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.088490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.088517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.088671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.088749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.088774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.088918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.089032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.089059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.089157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.089304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.089331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.089421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.089540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.089567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.089655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.089765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.089792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.089910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.090028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.090055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.090175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.090294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.090321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.090438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.090528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.090556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.090645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.090787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.090814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.090904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.091013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.091039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.091125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.091220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.091247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.091388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.091512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.091538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.091628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.091740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.091767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.091859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.091973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.091999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.092123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.092202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.092229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.092307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.092397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.092425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.092546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.092658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.092685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.092795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.092937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.092963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.093077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.093192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.093219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.093337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.093419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.714 [2024-11-28 23:23:02.093446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.714 qpair failed and we were unable to recover it. 00:30:58.714 [2024-11-28 23:23:02.093533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.093653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.093681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.093817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.093959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.093986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.094066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.094154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.094181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.094273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.094384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.094437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.094530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.094647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.094673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.094796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.094917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.094943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.095057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.095168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.095194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.095281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.095401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.095429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.095553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.095631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.095658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.095743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.095860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.095887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.096005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.096150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.096182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.096302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.096388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.096420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.096543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.096626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.096653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.096765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.096907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.096934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.097026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.097102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.097129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.097270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.097417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.097444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.097554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.097639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.097666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.097812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.097899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.097926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.098022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.098098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.098123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.098244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.098323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.098350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.098499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.098624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.098651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.098773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.098917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.098943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.099055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.099172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.099198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.099318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.099461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.099488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.099598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.099717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.099743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.099829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.099943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.099971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.100077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.100200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.100227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.100324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.100449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.100477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.100561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.100682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.100708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.100827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.100970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.100997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.101108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.101231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.101258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.101377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.101478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.101506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.101593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.101682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.101708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.101851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.101935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.101962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.102052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.102166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.102192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.102284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.102415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.102443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.102561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.102701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.102727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.102846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.102955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.102982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.103068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.103175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.103201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.103289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.103380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.103413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.103559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.103678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.103704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.103817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.103912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.103939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.104051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.104177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.104203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.104295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.104466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.104496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.104641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.104782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.104809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.104919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.105025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.105052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.105165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.105306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.105333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.105447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.105536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.105562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.105651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.105759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.105785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.105879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.105993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.106020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.106106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.106202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.715 [2024-11-28 23:23:02.106229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.715 qpair failed and we were unable to recover it. 00:30:58.715 [2024-11-28 23:23:02.106340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.106463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.106495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.106614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.106701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.106728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.106844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.106988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.107015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.107132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.107247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.107274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.107359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.107484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.107511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.107628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.107743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.107769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.107884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.107996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.108022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.108113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.108224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.108250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.108368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.108459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.108486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.108609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.108736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.108763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.108886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.108982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.109009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.109129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.109250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.109277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.109396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.109539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.109565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.109687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.109804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.109829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.109940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.110026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.110054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.110172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.110265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.110291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.110386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.110499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.110525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.110644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.110735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.110769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.110913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.111035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.111061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.111205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.111295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.111322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.111455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.111579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.111605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.111705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.111816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.111842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.111962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.112085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.112112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.112235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.112333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.112359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.112479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.112559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.112585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.112675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.112786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.112812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.112900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.112988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.113015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.113128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.113224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.113250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.113336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.113433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.113460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.113579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.113671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.113697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.113839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.113935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.113963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.114081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.114196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.114223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.114347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.114438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.114465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.114586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.114674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.114700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.114782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.114897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.114923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.115070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.115167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.115193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.115288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.115405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.115443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.115585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.115669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.115696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.115817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.115939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.115964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.116088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.116198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.116224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.116326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.116422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.116449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.116535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.116678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.116704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.116816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.116933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.116961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.117039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.117148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.117174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.117297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.117411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.117439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.117539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.117682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.117707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.117828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.117912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.117939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.118057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.118151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.118179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.118299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.118417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.118447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.118567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.118686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.118712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.118834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.118933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.118959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.119082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.119197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.119228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.119314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.119450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.119477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.119590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.119734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.119761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.119857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.119946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.716 [2024-11-28 23:23:02.119972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.716 qpair failed and we were unable to recover it. 00:30:58.716 [2024-11-28 23:23:02.120092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.120242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.120268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.120348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.120463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.120490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.120585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.120699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.120726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.120838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.120959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.120985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.121141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.121234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.121261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.121372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.121486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.121513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.121634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.121751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.121777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.121927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.122046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.122072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.122213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.122303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.122330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.122457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.122549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.122575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.122668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.122807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.122833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.122951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.123061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.123088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.123234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.123351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.123377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.123471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.123585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.123611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.123689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.123805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.123832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.123953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.124059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.124086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.124195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.124340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.124365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.124476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.124556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.124582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.124727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.124853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.124879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.125024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.125140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.125166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.125289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.125382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.125415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.125529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.125672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.125698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.125800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.125908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.125934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.126026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.126145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.126171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.126271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.126414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.126441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.126556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.126675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.126700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.126791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.126873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.126899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.127017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.127116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.127143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.127285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.127431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.127458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.127601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.127693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.127720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.127835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.127972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.127998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.128101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.128191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.128217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.128307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.128428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.128453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.128596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.128711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.128738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.128858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.128974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.129002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.129090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.129199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.129226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.129348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.129439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.129466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.129578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.129666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.129692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.129802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.129947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.129973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.130087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.130207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.130233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.130382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.130490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.130517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.130603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.130747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.130774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.130898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.131015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.131042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.131160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.131306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.131332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.131429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.131517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.131543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.131624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.131740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.131767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.131849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.131925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.131951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.132096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.132192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.132222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.132343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.132486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.132512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.132658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.132751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.132777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.132893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.132983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.133008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.133125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.133209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.133235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.133319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.133438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.133466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.133554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.133666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.133692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.133803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.133922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.133949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.134067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.134151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.717 [2024-11-28 23:23:02.134178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.717 qpair failed and we were unable to recover it. 00:30:58.717 [2024-11-28 23:23:02.134325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.134438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.134466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.134558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.134658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.134685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.134833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.134922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.134948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.135065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.135151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.135179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.135294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.135371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.135404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.135501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.135643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.135669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.135765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.135882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.135909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.135993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.136135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.136161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.136278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.136390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.136423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.136501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.136624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.136651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.136741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.136830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.136855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.136999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.137144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.137171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.137296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.137447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.137475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.137592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.137713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.137739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.137853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.137931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.137958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.138071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.138212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.138238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.138353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.138490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.138517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.138598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.138738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.138765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.138844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.138929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.138957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.139103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.139211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.139238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.139352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.139469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.139496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.139641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.139722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.139748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.139866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.139979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.140006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.140117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.140216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.140242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.140323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.140423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.140449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.140589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.140674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.140700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.140820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.140944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.140971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.141115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.141207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.141234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.141321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.141448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.141475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.141574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.141683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.141709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.141833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.141951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.141977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.142090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.142231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.142257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.142344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.142443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.142475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.142575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.142687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.142713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.142861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.142972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.142998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.143117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.143235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.143262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.143379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.143470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.143497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.143618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.143702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.143730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.143840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.143987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.144013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.144132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.144240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.144266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.144399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.144497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.144523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.144632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.144746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.144773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.144855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.144962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.144989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.145108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.145224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.145251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.145360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.145454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.145481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.145583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.145695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.145722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.145821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.145939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.145965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.146082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.146193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.146219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.146311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.146422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.146450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.146574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.146657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.146683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.146806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.146924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.146949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.147069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.147189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.718 [2024-11-28 23:23:02.147215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.718 qpair failed and we were unable to recover it. 00:30:58.718 [2024-11-28 23:23:02.147334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.147452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.147480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.147607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.147726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.147753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.147870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.147957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.147984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.148099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.148219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.148245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.148364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.148489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.148516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.148625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.148777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.148804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.148915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.149005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.149031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.149155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.149275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.149301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.149397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.149515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.149542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.149629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.149745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.149772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.149899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.149993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.150020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.150114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.150199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.150225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.150338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.150466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.150493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.150586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.150674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.150701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.150790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.150910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.150937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.151085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.151175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.151201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.151330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.151450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.151477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.151564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.151654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.151681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.151798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.151907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.151934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.152049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.152160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.152186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.152304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.152421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.152455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.152569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.152686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.152713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.152825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.152933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.152960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.153101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.153184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.153210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.153291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.153430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.153459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.153603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.153706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.153733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.153821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.153907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.153934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.154078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.154195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.154221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.154370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.154523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.154550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.154691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.154814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.154840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.154993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.155074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.155101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.155196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.155286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.155317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.155407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.155533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.155559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.155653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.155769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.155795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.155903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.155993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.156019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.156136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.156221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.156248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.156346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.156469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.156495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.156606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.156751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.156777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.156864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.156980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.157007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.157127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.157268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.157294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.157422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.157519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.157545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.157689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.157835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.157862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.158013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.158097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.158122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.158220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.158304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.158330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.158455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.158550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.158577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.158666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.158789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.158815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.158944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.159039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.159066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.159178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.159261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.159289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.159382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.159471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.159497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.159586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.159689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.159715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.159817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.159897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.159924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.160043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.160131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.160160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.160316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.160410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.160445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.160535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.160626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.160658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.160775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.160889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.160915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.719 [2024-11-28 23:23:02.160995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.161137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.719 [2024-11-28 23:23:02.161164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.719 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.161318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.161445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.161472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.161611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.161727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.161755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.161843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.161940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.161967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.162117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.162238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.162264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.162348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.162476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.162503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.162617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.162738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.162764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.162881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.162975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.163001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.163086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.163203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.163230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.163318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.163429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.163468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.163594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.163715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.163741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.163862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.163974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.164000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.164109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.164253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.164280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.164372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.164498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.164525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.164615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.164759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.164786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.164878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.164997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.165023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.165139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.165254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.165280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.165368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.165499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.165528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.165617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.165735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.165762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.165882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.165970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.165997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.166079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.166173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.166200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.166321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.166464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.166491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.166608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.166724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.166750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.166870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.166959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.166985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.167065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.167189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.167216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.167334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.167449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.167476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.167597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.167719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.167746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.167863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.167983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.168014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.168168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.168256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.168283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.168432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.168519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.168545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.168694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.168779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.168807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.168947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.169089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.169116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.169227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.169314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.169340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.169486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.169574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.169601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.169720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.169832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.169859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.170003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.170105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.170134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.170230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.170373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.170414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.170523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.170641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.170669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.170771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.170892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.170919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.171034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.171123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.171151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.171266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.171351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.171378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.171512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.171601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.171627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.171753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.171838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.171864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.171944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.172028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.172056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.172210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.172356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.172383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.172507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.172628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.172665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.172778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.172917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.172944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.173087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.173172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.173198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.173319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.173454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.173481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.173600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.173692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.173718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.173812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.173894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.173921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.174037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.174188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.174214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.720 qpair failed and we were unable to recover it. 00:30:58.720 [2024-11-28 23:23:02.174324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.720 [2024-11-28 23:23:02.174480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.174507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.174594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.174722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.174749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.174827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.174939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.174966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.175085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.175174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.175200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.175277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.175391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.175422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.175516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.175624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.175657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.175766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.175900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.175926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.176009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.176136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.176163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.176259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.176339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.176365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.176529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.176606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.176632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.176777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.176918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.176945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.177063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.177182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.177209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.177353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.177506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.177533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.177650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.177771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.177798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.177915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.177996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.178022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.178103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.178215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.178242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.178387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.178501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.178532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.178628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.178772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.178798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.178915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.179032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.179059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.179201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.179318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.179344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.179465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.179591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.179617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.179732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.179846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.179872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.179991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.180112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.180138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.180239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.180324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.180350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.180472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.180591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.180618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.180737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.180858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.180885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.180978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.181121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.181148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.181261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.181356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.181384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.181518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.181613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.181641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.181736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.181856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.181883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.182001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.182122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.182148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.182268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.182382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.182414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.182571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.182662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.182688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.182805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.182884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.182910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.183061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.183177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.183203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.183327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.183517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.183546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.183641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.183760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.183786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.183904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.183990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.184016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.184158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.184276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.184302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.184380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.184522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.184549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.184633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.184723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.184749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.184845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.184927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.184952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.185036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.185148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.185175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.185285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.185380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.185412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.185515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.185660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.185686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.185804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.185891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.185917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.186060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.186204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.186230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.186355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.186515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.186542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.186670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.186752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.186778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.186858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.187002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.187028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.187141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.187263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.187289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.187385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.187507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.187533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.187683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.187792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.187818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.187932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.188071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.188097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.188210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.188320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.188347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.188453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.188540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.721 [2024-11-28 23:23:02.188566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.721 qpair failed and we were unable to recover it. 00:30:58.721 [2024-11-28 23:23:02.188652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.188732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.188758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.188900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.188996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.189022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.189139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.189234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.189262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.189347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.189447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.189475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.189570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.189690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.189716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.189807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.189903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.189929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.190052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.190168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.190195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.190305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.190457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.190485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.190632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.190759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.190785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.190914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.191032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.191058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.191159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.191252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.191278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.191388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.191481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.191513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.191632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.191730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.191756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.191841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.191984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.192010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.192095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.192185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.192212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.192335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.192453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.192480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.192599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.192726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.192752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.192842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.192952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.192978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.193126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.193232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.193259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.193403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.193530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.193556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.193650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.193760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.193787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.193939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.194058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.194084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.194195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.194335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.194362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.194469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.194564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.194590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.194706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.194826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.194853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.194969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.195109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.195135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.195255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.195340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.195366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.195533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.195658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.195684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.195829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.195971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.195996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.196107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.196254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.196280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.196407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.196526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.196553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.196663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.196785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.196811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.196902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.197017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.197043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.197162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.197309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.197335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.197462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.197554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.197582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.197670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.197778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.197804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.197917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.198025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.198051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.198194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.198316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.198342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.198466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.198552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.198579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.198693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.198800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.198826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.198914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.198998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.199028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.199143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.199254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.199280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.199422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.199519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.199545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.199635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.199745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.199771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.199922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.200015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.200041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.200161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.200275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.200303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.200390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.200515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.200542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.200666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.200752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.200778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.200890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.201007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.201032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.201130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.201247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.201273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.201383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.201478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.201504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.201599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.201725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.201752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.201907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.202052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.202079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.202161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.202241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.202268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.722 [2024-11-28 23:23:02.202345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.202488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.722 [2024-11-28 23:23:02.202515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.722 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.202606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.202755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.202781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.202898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.203011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.203039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.203122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.203233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.203259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.203385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.203484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.203510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.203635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.203712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.203738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.203847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.203935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.203961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.204073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.204167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.204193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.204305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.204445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.204476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.204558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.204669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.204695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.204821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.204930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.204956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.205101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.205219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.205246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.205357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.205439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.205465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.205577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.205661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.205687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.205764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.205884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.205910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.206056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.206137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.206163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.206279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.206399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.206425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.206505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.206596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.206622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.206748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.206891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.206916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.207038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.207147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.207173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.207253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.207401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.207428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.207525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.207606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.207633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.207712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.207831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.207857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.208002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.208086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.208112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.208219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.208332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.208358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.208477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.208587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.208613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.208764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.208849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.208875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.208994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.209110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.209136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.209256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.209335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.209362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.209489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.209613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.209640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.209768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.209879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.209906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.209997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.210138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.210164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.210259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.210412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.210440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.210529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.210640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.210666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.210822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.210968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.210994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.211114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.211233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.211259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.211374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.211498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.211525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.211619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.211729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.211755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.211866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.211956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.211983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.212098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.212198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.212224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.212335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.212454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.212481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.212602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.212695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.212722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.212864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.212982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.213010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.213095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.213241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.213267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.213357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.213443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.213470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.213588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.213676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.213703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.213796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.213907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.213933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.214011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.214126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.214153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.214235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.214353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.214380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.214475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.214581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.214611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.214733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.214867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.214894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.723 qpair failed and we were unable to recover it. 00:30:58.723 [2024-11-28 23:23:02.215012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.723 [2024-11-28 23:23:02.215098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.215124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.215246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.215351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.215377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.215508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.215598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.215625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.215745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.215897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.215924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.216042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.216132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.216159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.216270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.216357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.216384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.216513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.216600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.216626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.216772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.216892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.216918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.217007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.217104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.217133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.217259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.217406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.217433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.217550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.217647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.217673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.217818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.217936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.217962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.218083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.218227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.218253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.218346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.218459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.218486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.218563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.218654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.218680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.218773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.218863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.218890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.219010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.219100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.219126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.219234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.219345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.219371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.219472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.219590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.219617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.219721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.219875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.219902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.220018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.220129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.220155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.220237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.220360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.220386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.220487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.220573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.220600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.220681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.220799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.220827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.220971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.221074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.221101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.221188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.221300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.221326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.221440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.221558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.221584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.221705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.221790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.221816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.221908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.222049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.222075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.222202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.222335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.222361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.222496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.222611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.222638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.222759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.222869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.222895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.223012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.223104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.223130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.223247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.223363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.223390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.223497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.223635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.223673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.223786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.223929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.223956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.224051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.224148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.224174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.224283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.224361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.224387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.224484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.224592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.224618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.224747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.224841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.224868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.224977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.225085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.225112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.225235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.225376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.225410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.225545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.225632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.225668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.225759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.225880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.225909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.225992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.226108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.226133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.226260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.226374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.226425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.226546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.226642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.226681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.226827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.226969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.226996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.227107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.227194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.227220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.227335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.227479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.227511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.227631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.227750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.227778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.227864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.227973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.228000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.228102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.228209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.228236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.228316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.228404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.228431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.228517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.228608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.228635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.228743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.228864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.228891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.724 qpair failed and we were unable to recover it. 00:30:58.724 [2024-11-28 23:23:02.229017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.229116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.724 [2024-11-28 23:23:02.229143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.229260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.229349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.229375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.229499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.229614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.229641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.229765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.229844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.229870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.229956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.230081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.230108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.230188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.230294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.230321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.230449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.230573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.230600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.230685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.230777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.230805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.230896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.231004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.231031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.231128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.231249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.231276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.231404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.231521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.231547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.231635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.231722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.231749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.231871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.232000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.232026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.232121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.232262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.232288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.232417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.232569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.232596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.232710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.232840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.232866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.232960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.233044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.233070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.233191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.233310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.233336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.233423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.233568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.233594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.233685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.233797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.233823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.233942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.234059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.234085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.234194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.234290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.234318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.234417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.234573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.234599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.234724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.234834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.234860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.234985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.235129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.235155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.235269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.235385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.235417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.235501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.235608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.235635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.235721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.235832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.235859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.235983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.236104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.236130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.236274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.236400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.236429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.236545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.236633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.236659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.236776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.236891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.236918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.237038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.237155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.237181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.237297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.237409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.237435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.237546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.237687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.237714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.237859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.238004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.238030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.238151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.238234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.238261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.238415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.238515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.238541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.238667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.238775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.238801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.238888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.238979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.239005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.239146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.239267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.239293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.239415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.239507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.239534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.239622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.239738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.239764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.239881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.239991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.240017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.240130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.240216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.240247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.240369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.240524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.240565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.240662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.240781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.240807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.240909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.241030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.241055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.241201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.241277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.241305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.241456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.241552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.241580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.241663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.241784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.241811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.725 qpair failed and we were unable to recover it. 00:30:58.725 [2024-11-28 23:23:02.241919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.725 [2024-11-28 23:23:02.242031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.242057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.242172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.242255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.242281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.242373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.242481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.242508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.242594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.242743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.242769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.242899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.243049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.243075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.243188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.243307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.243332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.243422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.243516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.243543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.243654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.243746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.243773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.243867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.243950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.243977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.244097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.244216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.244242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.244367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.244461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.244488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.244575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.244667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.244693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.244836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.244949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.244976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.245064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.245180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.245206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.245330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.245417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.245450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.245544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.245666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.245695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.245784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.245882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.245909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.245997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.246088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.246114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.246204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.246356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.246382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.246530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.246673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.246700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.246808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.246934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.246960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.247071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.247180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.247207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.247320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.247412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.247450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.247567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.247691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.247717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.247839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.247960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.247987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.248103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.248220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.248247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.248397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.248489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.248515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.248597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.248698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.248725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.248806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.248945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.248972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.249118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.249211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.249237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.249346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.249477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.249505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.249593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.249695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.249723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.249811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.249927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.249954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.250100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.250192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.250219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.250331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.250456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.250488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.250572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.250671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.250699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.250817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.250939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.250965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.251082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.251174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.251201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.251287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.251376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.251407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.251504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.251610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.251636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.251729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.251812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.251839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.251948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.252091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.252117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.252201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.252293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.252321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.252443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.252561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.252587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.252714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.252805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.252831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.252927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.253023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.253050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.253162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.253305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.253331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.253422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.253539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.253565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.253684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.253794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.253820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.253941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.254019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.254046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.254135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.254254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.254281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.254370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.254517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.254545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.254689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.254799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.254825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.254926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.255046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.255072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.255161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.255251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.255279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.255418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.255502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.255528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.726 qpair failed and we were unable to recover it. 00:30:58.726 [2024-11-28 23:23:02.255614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.255700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.726 [2024-11-28 23:23:02.255725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.255841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.255989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.256015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.256139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.256255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.256283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.256404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.256512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.256539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.256673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.256762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.256788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.256900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.257043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.257069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.257179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.257262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.257288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.257381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.257508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.257534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.257625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.257762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.257788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.257891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.258008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.258034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.258118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.258240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.258267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.258426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.258556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.258582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.258729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.258846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.258872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.258989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.259105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.259132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.259220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.259314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.259341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.259500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.259621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.259657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.259751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.259844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.259870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.259954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.260051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.260077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.260160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.260276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.260303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.260383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.260490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.260517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.260597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.260685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.260711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.260802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.260888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.260915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.261006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.261094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.261120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.261248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.261345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.261372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.261483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.261600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.261625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.261721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.261829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.261855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.261958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.262045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.262071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.262161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.262274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.262301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.262387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.262523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.262550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.262644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.262739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.262772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.262858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.262942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.262970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.263064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.263211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.263237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.263354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.263466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.263493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.263611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.263705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.263731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.263850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.263947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.263974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.264116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.264205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.264232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.264345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.264468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.264495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.264589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.264712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.264739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.264885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.264973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.265000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.265088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.265205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.265232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.265318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.265466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.265493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.265638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.265759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.265786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.265906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.265986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.266012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.266162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.266254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.266281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.266384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.266493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.266520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.266605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.266694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.266731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.266848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.266930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.266957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.267078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.267204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.267231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.267342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.267458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.267486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.267610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.267731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.267758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.267841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.267941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.267967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.268056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.268193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.268219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.268330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.268435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.727 [2024-11-28 23:23:02.268461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.727 qpair failed and we were unable to recover it. 00:30:58.727 [2024-11-28 23:23:02.268579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.268694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.268720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.268816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.268935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.268962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.269111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.269201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.269228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.269315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.269431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.269466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.269548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.269629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.269662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.269747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.269844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.269870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.269989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.270085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.270112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.270211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.270333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.270359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.270488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.270568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.270594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.270713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.270790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.270817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.270916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.271008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.271034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.271148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.271231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.271259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.271379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.271479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.271505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.271648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.271763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.271789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.271881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.271967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.271994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.272090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.272211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.272238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.272327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.272426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.272460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.272558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.272682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.272708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.272786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.272878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.272904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.273023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.273118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.273145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.273244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.273331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.273359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.273489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.273577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.273604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.273717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.273840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.273867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.273952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.274038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.274066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.274152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.274272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.274299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.274461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.274571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.274597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.274691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.274816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.274844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.274932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.275045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.275085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.275237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.275364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.275391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.275510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.275625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.275656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.275743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.275858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.275884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.275973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.276057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.276085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.276171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.276283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.276309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.276403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.276489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.276516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.276631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.276749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.276786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.276912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.276995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.277022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.277150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.277246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.277272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.277369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.277494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.277521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.277634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.277785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.277811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.277900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.277991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.278018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.278109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.278252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.278279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.278426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.278513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.278540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.278634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.278724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.278751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.278846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.278956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.278983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.279100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.279215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.279241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.279359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.279456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.279484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.279578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.279700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.279726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.279850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.279968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.279995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.280088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.280210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.280237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.280358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.280503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.280530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.280629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.280726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.280753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.280835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.280915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.280942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.281035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.281156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.281183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.281286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.281372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.281408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.281511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.281623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.281649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.281765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.281854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.728 [2024-11-28 23:23:02.281881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.728 qpair failed and we were unable to recover it. 00:30:58.728 [2024-11-28 23:23:02.281977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.282064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.282091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.282167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.282293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.282320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.282415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.282503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.282529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.282643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.282734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.282761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.282883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.282973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.282999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.283121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.283235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.283261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.283355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.283463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.283490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.283579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.283704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.283731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.283842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.283928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.283955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.284039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.284153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.284179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.284292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.284379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.284412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.284537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.284658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.284684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.284802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.284886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.284918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.285036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.285157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.285183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.285325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.285449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.285477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.285597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.285692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.285720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.285837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.285913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.285940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.286029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.286137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.286163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.286285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.286399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.286427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.286516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.286599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.286626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.286710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.286828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.286854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.286965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.287086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.287112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.287202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.287343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.287370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.287474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.287562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.287589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.287683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.287779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.287806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.287900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.288018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.288044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.288156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.288235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.288261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.288378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.288504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.288532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.288629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.288722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.288749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.288872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.288958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.288984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.289077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.289177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.289203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.289298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.289388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.289422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.289512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.289652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.289679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.289801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.289889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.289915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.290000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.290082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.290108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.290229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.290335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.290362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.290532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.290623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.290650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.290735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.290856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.290882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.290976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.291065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.291093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.291181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.291322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.291348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.291439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.291526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.291553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.291637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.291725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.291751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.291864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.291952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.291980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.292069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.292182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.292209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.292330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.292438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.292465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.292561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.292645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.292671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.292758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.292842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.292868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.292980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.293096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.293123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.293210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.293301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.293327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.293415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.293502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.293529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.293608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.293722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.293749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.293865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.293973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.293999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.294097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.294213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.294239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.294319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.294491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.294519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.294639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.294752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.294779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.729 [2024-11-28 23:23:02.294862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.294978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.729 [2024-11-28 23:23:02.295005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.729 qpair failed and we were unable to recover it. 00:30:58.730 [2024-11-28 23:23:02.295115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.295233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.295259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.730 qpair failed and we were unable to recover it. 00:30:58.730 [2024-11-28 23:23:02.295356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.295480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.295507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.730 qpair failed and we were unable to recover it. 00:30:58.730 [2024-11-28 23:23:02.295619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.295742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.295768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.730 qpair failed and we were unable to recover it. 00:30:58.730 [2024-11-28 23:23:02.295851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.295975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.296002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.730 qpair failed and we were unable to recover it. 00:30:58.730 [2024-11-28 23:23:02.296144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.296235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.296262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.730 qpair failed and we were unable to recover it. 00:30:58.730 [2024-11-28 23:23:02.296341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.296435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.296462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.730 qpair failed and we were unable to recover it. 00:30:58.730 [2024-11-28 23:23:02.296589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.296675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.296701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.730 qpair failed and we were unable to recover it. 00:30:58.730 [2024-11-28 23:23:02.296848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.296931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.296961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.730 qpair failed and we were unable to recover it. 00:30:58.730 [2024-11-28 23:23:02.297090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.297177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.297204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.730 qpair failed and we were unable to recover it. 00:30:58.730 [2024-11-28 23:23:02.297348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.297474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.297500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.730 qpair failed and we were unable to recover it. 00:30:58.730 [2024-11-28 23:23:02.297590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.297712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.297738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.730 qpair failed and we were unable to recover it. 00:30:58.730 [2024-11-28 23:23:02.297840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.297924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.297950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.730 qpair failed and we were unable to recover it. 00:30:58.730 [2024-11-28 23:23:02.298071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.298187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.298213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.730 qpair failed and we were unable to recover it. 00:30:58.730 [2024-11-28 23:23:02.298299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.298419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.298447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.730 qpair failed and we were unable to recover it. 00:30:58.730 [2024-11-28 23:23:02.298567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.298643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.298670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.730 qpair failed and we were unable to recover it. 00:30:58.730 [2024-11-28 23:23:02.298760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.298878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.298905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.730 qpair failed and we were unable to recover it. 00:30:58.730 [2024-11-28 23:23:02.299000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.299116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.299143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.730 qpair failed and we were unable to recover it. 00:30:58.730 [2024-11-28 23:23:02.299232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.299320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.299346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.730 qpair failed and we were unable to recover it. 00:30:58.730 [2024-11-28 23:23:02.299481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.299567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.299593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.730 qpair failed and we were unable to recover it. 00:30:58.730 [2024-11-28 23:23:02.299680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.299768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.299794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.730 qpair failed and we were unable to recover it. 00:30:58.730 [2024-11-28 23:23:02.299872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.299965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.299991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.730 qpair failed and we were unable to recover it. 00:30:58.730 [2024-11-28 23:23:02.300080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.300194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.300220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.730 qpair failed and we were unable to recover it. 00:30:58.730 [2024-11-28 23:23:02.300343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.300433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.300462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.730 qpair failed and we were unable to recover it. 00:30:58.730 [2024-11-28 23:23:02.300588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.300731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.300758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.730 qpair failed and we were unable to recover it. 00:30:58.730 [2024-11-28 23:23:02.300845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.300923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.300950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.730 qpair failed and we were unable to recover it. 00:30:58.730 [2024-11-28 23:23:02.301038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.301113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.301140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.730 qpair failed and we were unable to recover it. 00:30:58.730 [2024-11-28 23:23:02.301254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.301342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.301368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.730 qpair failed and we were unable to recover it. 00:30:58.730 [2024-11-28 23:23:02.301464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.301549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.301575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.730 qpair failed and we were unable to recover it. 00:30:58.730 [2024-11-28 23:23:02.301674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.301789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.301815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.730 qpair failed and we were unable to recover it. 00:30:58.730 [2024-11-28 23:23:02.301908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.302024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.302051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.730 qpair failed and we were unable to recover it. 00:30:58.730 [2024-11-28 23:23:02.302156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.302243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.302269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.730 qpair failed and we were unable to recover it. 00:30:58.730 [2024-11-28 23:23:02.302397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.302488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.302514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.730 qpair failed and we were unable to recover it. 00:30:58.730 [2024-11-28 23:23:02.302603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.302687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.302713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.730 qpair failed and we were unable to recover it. 00:30:58.730 [2024-11-28 23:23:02.302859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.302980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.303006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.730 qpair failed and we were unable to recover it. 00:30:58.730 [2024-11-28 23:23:02.303089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.303204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.303230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.730 qpair failed and we were unable to recover it. 00:30:58.730 [2024-11-28 23:23:02.303351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.303447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.303474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.730 qpair failed and we were unable to recover it. 00:30:58.730 [2024-11-28 23:23:02.303569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.303661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.303687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.730 qpair failed and we were unable to recover it. 00:30:58.730 [2024-11-28 23:23:02.303798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.303912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.730 [2024-11-28 23:23:02.303937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:58.730 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.304056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.304158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.304184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.304294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.304405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.304432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.304521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.304610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.304636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.304726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.304823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.304850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.304947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.305031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.305059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.305181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.305269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.305295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.305383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.305505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.305532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.305632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.305728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.305755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.305874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.305966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.305994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.306091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.306177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.306204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.306293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.306436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.306463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.306547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.306638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.306664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.306753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.306836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.306863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.306947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.307045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.307071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.307181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.307270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.307296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.307382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.307502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.307529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.307627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.307740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.307766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.307859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.307937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.307963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.308051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.308170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.308198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.308287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.308400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.308428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.308517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.308609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.308640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.308738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.308858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.308884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.308972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.309064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.309090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.309212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.309329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.309356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.309466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.309562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.309588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.309679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.309771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.309797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.309897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.310032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.310058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.310186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.310307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.310333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.310421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.310540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.310567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.310659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.310803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.310830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.310915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.311036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.311062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.311182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.311324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.311350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.311445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.311536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.311563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.311676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.311771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.311797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.311911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.312070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.312111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.312258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.312353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.312381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.312497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.312581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.312607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.312754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.312842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.312884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.313012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.313101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.313129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.313291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.313456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.313485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.313606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.313691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.313718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.313854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.313999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.314026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.314116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.314192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.314218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.314300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.314384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.314425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.314536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.314656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.314682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.314775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.314892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.314919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.315029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.315193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.315219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.315365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.315493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.315520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.315664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.315783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.029 [2024-11-28 23:23:02.315809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.029 qpair failed and we were unable to recover it. 00:30:59.029 [2024-11-28 23:23:02.315903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.316046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.316072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.316186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.316264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.316289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.316408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.316530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.316557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.316649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.316809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.316838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.316927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.317082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.317112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.317245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.317371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.317418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.317551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.317678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.317704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.317799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.317913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.317940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.318055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.318185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.318216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.318383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.318545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.318572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.318662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.318772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.318799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.318916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.319003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.319029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.319121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.319232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.319262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.319389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.319539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.319565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.319666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.319759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.319786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.319873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.319950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.319976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.320118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.320204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.320230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.320319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.320503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.320534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.320676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.320794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.320822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.320913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.320999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.321026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.321175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.321258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.321285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.321366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.321497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.321524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.321671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.321829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.321858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.321997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.322105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.322132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.322233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.322323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.322350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.322486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.322565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.322591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.322720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.322809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.322835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.322925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.323041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.323067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.323164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.323247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.323291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.323397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.323532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.323559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.323666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.323745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.323771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.323885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.324043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.324072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.324244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.324387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.324421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.324532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.324674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.324701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.324815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.324934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.324961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.325082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.325169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.325195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.325314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.325426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.325463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.325583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.325709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.325738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.325900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.326021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.326048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.326174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.326255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.326282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.326371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.326513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.326541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.326676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.326848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.326877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.326994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.327129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.327156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.327306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.327420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.327453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.327562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.327664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.327694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.327796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.327918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.327948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.328085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.328229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.328255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.328363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.328457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.328484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.328635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.328797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.328826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.328942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.329054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.329081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.329169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.329288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.329314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.329406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.329497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.329523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.329604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.329802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.329828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.329923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.330060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.330087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.330178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.330299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.030 [2024-11-28 23:23:02.330326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.030 qpair failed and we were unable to recover it. 00:30:59.030 [2024-11-28 23:23:02.330446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.330537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.330563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.330661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.330787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.330813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.330897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.331052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.331079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.331205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.331332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.331359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.331529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.331653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.331683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.331781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.331935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.331964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.332100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.332190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.332217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.332328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.332416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.332443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.332535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.332620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.332651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.332769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.332861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.332888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.333032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.333163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.333193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.333368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.333486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.333514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.333637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.333759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.333786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.333900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.333979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.334022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.334108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.334252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.334281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.334425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.334514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.334541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.334629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.334723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.334750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.334869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.334987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.335014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.335157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.335275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.335301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.335397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.335508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.335535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.335654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.335799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.335826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.335912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.336029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.336056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.336175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.336342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.336371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.336524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.336666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.336692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.336809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.336948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.336975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.337064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.337139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.337166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.337313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.337408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.337435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.337551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.337647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.337673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.337819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.337911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.337938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.338070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.338186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.338213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.338331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.338451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.338479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.338589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.338717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.338745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.338911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.339037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.339066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.339210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.339334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.339361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.339467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.339586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.339620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.339739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.339856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.339883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.340007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.340122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.340149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.340229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.340341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.340367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.340517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.340651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.340678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.340798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.340918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.340946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.341068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.341156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.341184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.341269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.341419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.341462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.341639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.341825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.341880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.342049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.342166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.342193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.342291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.342374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.342415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.342574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.342663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.342689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.342852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.342957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.342985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.343098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.343175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.343201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.343310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.343410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.031 [2024-11-28 23:23:02.343437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.031 qpair failed and we were unable to recover it. 00:30:59.031 [2024-11-28 23:23:02.343532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.343641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.343671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.343790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.343943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.343973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.344106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.344221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.344247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.344328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.344444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.344471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.344572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.344693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.344720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.344842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.344948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.344977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.345095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.345240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.345267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.345353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.345439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.345465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.345569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.345689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.345716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.345835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.345953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.345980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.346122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.346262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.346293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.346432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.346563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.346590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.346676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.346768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.346795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.346882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.346978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.347005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.347100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.347213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.347240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.347354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.347450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.347494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.347620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.347762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.347789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.347939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.348058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.348084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.348186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.348277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.348306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.348429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.348548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.348575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.348660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.348827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.348856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.348963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.349082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.349109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.349198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.349285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.349312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.349405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.349520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.349547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.349655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.349815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.349842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.349954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.350051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.350095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.350263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.350415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.350442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.350532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.350656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.350683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.350783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.350899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.350926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.351047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.351133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.351159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.351242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.351328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.351356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.351453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.351545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.351571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.351667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.351777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.351803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.351923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.352038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.352065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.352183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.352275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.352301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.352424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.352546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.352572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.352658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.352799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.352843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.353000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.353131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.353160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.353263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.353387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.353419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.353545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.353629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.353655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.353804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.353893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.353920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.354038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.354129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.354157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.354302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.354400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.354428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.354524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.354644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.354687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.354768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.354890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.354916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.355026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.355146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.355173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.355263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.355414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.355442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.355532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.355647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.355673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.355764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.355882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.355909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.356023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.356108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.356135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.356279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.356403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.356431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.356577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.356710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.356744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.356887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.357031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.357058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.357144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.357232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.357259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.357337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.357461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.357489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.032 qpair failed and we were unable to recover it. 00:30:59.032 [2024-11-28 23:23:02.357603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.357735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.032 [2024-11-28 23:23:02.357761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.357880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.357998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.358041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.358119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.358256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.358284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.358390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.358484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.358511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.358596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.358685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.358711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.358810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.358927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.358973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.359107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.359260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.359290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.359420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.359568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.359595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.359696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.359789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.359815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.359914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.359994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.360020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.360130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.360217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.360243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.360332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.360429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.360457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.360572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.360660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.360687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.360784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.360875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.360901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.361009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.361144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.361172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.361348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.361468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.361495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.361584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.361696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.361722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.361826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.361915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.361942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.362032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.362136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.362165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.362285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.362407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.362450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.362548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.362688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.362715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.362830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.362920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.362947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.363091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.363227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.363270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.363397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.363486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.363513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.363611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.363754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.363781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.363862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.363979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.364005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.364125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.364211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.364237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.364327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.364417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.364456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.364550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.364692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.364718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.364838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.364933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.364962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.365091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.365220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.365251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.365415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.365529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.365555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.365653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.365761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.365787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.365879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.366018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.366044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.366166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.366268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.366297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.366442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.366565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.366592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.366680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.366764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.366790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.366912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.367048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.367079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.367198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.367360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.367390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.367538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.367658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.367686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.367798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.367917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.367944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.368030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.368173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.368199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.368307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.368481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.368508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.368655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.368781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.368807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.368922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.369013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.369039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.369142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.369247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.369276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.369361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.369492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.369519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.369664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.369785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.369816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.369975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.370094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.370121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.370235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.370360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.370389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.033 qpair failed and we were unable to recover it. 00:30:59.033 [2024-11-28 23:23:02.370538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.370654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.033 [2024-11-28 23:23:02.370683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.370860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.371001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.371028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.371172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.371306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.371335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.371430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.371585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.371612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.371711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.371795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.371822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.371914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.372031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.372058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.372152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.372243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.372282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.372409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.372504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.372545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.372682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.372812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.372838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.372951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.373030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.373057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.373148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.373259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.373286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.373400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.373553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.373582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.373700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.373813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.373840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.373941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.374060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.374087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.374174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.374288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.374314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.374431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.374523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.374552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.374641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.374746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.374773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.374861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.375005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.375033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.375157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.375292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.375322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.375448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.375615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.375641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.375759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.375891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.375917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.376037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.376123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.376149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.376234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.376320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.376347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.376466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.376576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.376603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.376727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.376811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.376837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.376936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.377046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.377072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.377186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.377307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.377335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.377422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.377537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.377564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.377681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.377800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.377826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.377909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.378021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.378047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.378179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.378295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.378321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.378432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.378548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.378578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.378663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.378768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.378797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.378901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.379011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.379037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.379121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.379227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.379253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.379342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.379452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.379479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.379587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.379707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.379737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.379850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.379958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.379984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.380104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.380200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.380232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.380314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.380455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.380482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.380596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.380688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.380719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.380840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.380927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.380955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.381072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.381208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.381238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.381364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.381487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.381513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.381606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.381716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.381742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.381854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.381997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.382023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.382201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.382291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.382317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.382440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.382559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.382586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.382673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.382783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.382814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.382903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.382990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.383017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.383103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.383231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.383262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.383359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.383523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.383553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.383699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.383798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.383827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.383967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.384118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.384145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.384259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.384431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.384462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.034 [2024-11-28 23:23:02.384588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.384711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.034 [2024-11-28 23:23:02.384740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.034 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.384827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.384995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.385021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.385164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.385278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.385304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.385425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.385514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.385556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.385699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.385834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.385863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.385985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.386103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.386129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.386226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.386345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.386372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.386497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.386625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.386655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.386841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.386926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.386953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.387098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.387206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.387236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.387383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.387532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.387558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.387706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.387811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.387840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.387931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.388069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.388095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.388186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.388304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.388330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.388448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.388531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.388557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.388698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.388791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.388820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.388941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.389039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.389068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.389229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.389322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.389348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.389476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.389561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.389589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.389702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.389824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.389853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.389992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.390078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.390107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.390270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.390363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.390399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.390540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.390661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.390688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.390777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.390893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.390919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.391004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.391094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.391124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.391221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.391379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.391414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.391555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.391649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.391676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.391787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.391902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.391930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.392051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.392173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.392200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.392345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.392480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.392512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.392667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.392781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.392807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.392965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.393081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.393107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.393219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.393313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.393339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.393426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.393544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.393571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.393668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.393788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.393819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.393983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.394125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.394152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.394269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.394356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.394383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.394479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.394595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.394625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.394752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.394867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.394893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.394999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.395160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.395186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.395330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.395475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.395502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.395622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.395708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.395734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.395826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.395940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.395966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.396071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.396233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.396263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.396414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.396535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.396562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.396684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.396774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.396802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.396946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.397038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.397065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.397164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.397272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.397302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.397464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.397586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.397615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.397739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.397841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.397886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.398003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.398121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.398149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.398242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.398384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.398416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.398560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.398656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.398686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.398844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.399003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.399030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.399157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.399272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.399299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.399386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.399510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.399537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.035 qpair failed and we were unable to recover it. 00:30:59.035 [2024-11-28 23:23:02.399631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.399782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.035 [2024-11-28 23:23:02.399812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.399940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.400031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.400060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.400195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.400320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.400346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.400499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.400621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.400648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.400740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.400828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.400854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.400941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.401062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.401088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.401195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.401280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.401307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.401405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.401520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.401548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.401633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.401749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.401776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.401875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.402017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.402046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.402161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.402260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.402287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.402376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.402474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.402501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.402589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.402702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.402730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.402819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.402930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.402959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.403099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.403212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.403239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.403333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.403431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.403458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.403575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.403693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.403722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.403817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.403951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.403978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.404118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.404261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.404288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.404408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.404529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.404555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.404640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.404751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.404797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.404893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.405006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.405047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.405192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.405275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.405301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.405389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.405515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.405542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.405685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.405842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.405871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.406012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.406135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.406164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.406304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.406422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.406449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.406542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.406679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.406709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.406831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.406968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.406998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.407134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.407233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.407264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.407376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.407501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.407528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.407674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.407781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.407808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.407924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.408040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.408066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.408156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.408263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.408292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.408431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.408547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.408575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.408673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.408824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.408851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.408945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.409027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.409054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.409147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.409229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.409255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.409424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.409541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.409568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.409646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.409735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.409761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.409846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.409963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.409989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.410100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.410197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.410226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.410326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.410420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.410448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.410533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.410645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.410672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.410821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.410937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.410964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.411078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.411206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.411235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.411356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.411495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.411522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.411645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.411790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.411817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.411972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.412077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.412103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.412219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.412338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.412365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.036 qpair failed and we were unable to recover it. 00:30:59.036 [2024-11-28 23:23:02.412482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.036 [2024-11-28 23:23:02.412575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.412601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.412732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.412833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.412863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.413057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.413154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.413181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.413324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.413410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.413437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.413554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.413635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.413662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.413807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.413925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.413951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.414037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.414117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.414143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.414231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.414317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.414344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.414514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.414633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.414660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.414762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.414870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.414897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.414976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.415122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.415149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.415292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.415461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.415488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.415599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.415714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.415741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.415841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.415987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.416013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.416129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.416258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.416286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.416445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.416564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.416591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.416681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.416767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.416794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.416881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.416964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.416991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.417115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.417290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.417319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.417457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.417579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.417610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.417724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.417845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.417879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.417994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.418129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.418156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.418266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.418363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.418391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.418491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.418584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.418611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.418742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.418858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.418885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.418972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.419087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.419114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.419193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.419326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.419355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.419487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.419575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.419605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.419736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.419825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.419853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.420002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.420144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.420171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.420261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.420350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.420381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.420496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.420628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.420655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.420771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.420863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.420889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.421002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.421096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.421122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.421214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.421314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.421356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.421493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.421619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.421649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.421791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.421901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.421928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.422074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.422187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.422213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.422335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.422419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.422446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.422533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.422642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.422668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.422759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.422899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.422924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.423089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.423207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.423233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.423376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.423477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.423504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.423622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.423768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.423797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.423904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.424020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.424046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.424196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.424322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.424348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.424470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.424565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.424592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.424739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.424852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.424878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.424963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.425104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.425130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.425278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.425396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.425423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.425562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.425687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.425716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.425854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.425998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.426025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.426162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.426246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.426272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.426359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.426441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.426468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.426601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.426705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.426734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.426859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.426993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.037 [2024-11-28 23:23:02.427020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.037 qpair failed and we were unable to recover it. 00:30:59.037 [2024-11-28 23:23:02.427116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.427226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.427253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.427337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.427481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.427525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.427645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.427774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.427803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.427963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.428128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.428155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.428265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.428350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.428380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.428542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.428645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.428674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.428776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.428881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.428911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.429066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.429187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.429214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.429361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.429479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.429505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.429624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.429710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.429737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.429914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.430055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.430082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.430233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.430357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.430383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.430469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.430582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.430609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.430698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.430843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.430888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.431008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.431119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.431145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.431242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.431327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.431357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.431457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.431536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.431562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.431645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.431725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.431752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.431869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.431980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.432025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.432203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.432331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.432358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.432483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.432565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.432592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.432679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.432767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.432794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.432903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.433002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.433028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.433149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.433236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.433279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.433445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.433567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.433593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.433686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.433797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.433824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.433961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.434082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.434111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.434247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.434336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.434363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.434458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.434577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.434603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.434722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.434820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.434848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.434928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.435043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.435072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.435233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.435357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.435411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.435503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.435605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.435631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.435742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.435884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.435911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.436066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.436182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.436208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.436349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.436452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.436479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.436568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.436666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.436693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.436815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.436929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.436958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.437082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.437204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.437233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.437368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.437498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.437525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.437614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.437728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.437755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.437863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.437987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.438016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.438115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.438243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.438273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.438359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.438469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.438499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.438632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.438779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.438807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.438900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.439015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.439042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.439214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.439347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.439373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.439482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.439613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.439642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.439764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.439852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.439880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.440002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.440095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.440122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.440208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.440329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.440357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.440537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.440672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.038 [2024-11-28 23:23:02.440701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.038 qpair failed and we were unable to recover it. 00:30:59.038 [2024-11-28 23:23:02.440843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.440929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.440956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.441065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.441229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.441258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.441383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.441500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.441528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.441613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.441733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.441760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.441849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.441967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.441993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.442121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.442231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.442258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.442425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.442566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.442592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.442714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.442856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.442883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.442981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.443095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.443121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.443207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.443320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.443347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.443467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.443563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.443589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.443676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.443849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.443877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.444010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.444158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.444184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.444327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.444453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.444480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.444599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.444678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.444728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.444887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.445017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.445046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.445160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.445278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.445305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.445401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.445548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.445575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.445677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.445791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.445818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.445908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.446048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.446075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.446189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.446280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.446311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.446495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.446587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.446613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.446693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.446810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.446836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.446947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.447081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.447110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.447251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.447343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.447370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.447474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.447584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.447611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.447700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.447794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.447822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.447936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.448031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.448058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.448154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.448236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.448264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.448348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.448436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.448464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.448560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.448676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.448704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.448812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.448906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.448933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.449028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.449143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.449170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.449284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.449399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.449426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.449547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.449642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.449669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.449778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.449902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.449931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.450064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.450146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.450172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.450301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.450433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.450463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.450602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.450717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.450745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.450855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.450973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.451000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.451147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.451289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.451315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.451428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.451543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.451569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.451710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.451850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.451876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.451967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.452081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.452108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.452230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.452351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.452377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.452521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.452659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.452689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.452828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.452927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.452954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.453074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.453186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.453231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.453367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.453496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.453523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.453658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.453824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.453853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.454009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.454175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.454201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.454327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.454418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.454445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.454568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.454678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.454704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.454814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.454987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.455014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.455132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.455212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.455238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.039 qpair failed and we were unable to recover it. 00:30:59.039 [2024-11-28 23:23:02.455357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.039 [2024-11-28 23:23:02.455472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.455504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.455583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.455697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.455724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.455843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.456007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.456049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.456142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.456237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.456264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.456378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.456503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.456531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.456616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.456730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.456757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.456934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.457048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.457074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.457204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.457286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.457313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.457441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.457556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.457583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.457669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.457756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.457783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.457880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.457971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.458031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.458151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.458293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.458320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.458410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.458489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.458533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.458660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.458768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.458795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.458876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.458995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.459022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.459158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.459284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.459313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.459482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.459581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.459608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.459728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.459816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.459844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.459936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.460023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.460049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.460163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.460261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.460287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.460371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.460494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.460521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.460621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.460722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.460748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.460893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.460973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.460999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.461117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.461199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.461225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.461337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.461448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.461476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.461566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.461643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.461669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.461761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.461892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.461921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.462072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.462216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.462243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.462377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.462489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.462520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.462659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.462743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.462769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.462906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.463040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.463066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.463216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.463374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.463411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.463536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.463621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.463648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.463758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.463978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.464004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.464111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.464269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.464299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.464427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.464542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.464571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.464713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.464806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.464833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.464946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.465067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.465093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.465207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.465303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.465333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.465455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.465607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.465638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.465748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.465884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.465910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.466004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.466098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.466125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.466222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.466315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.466342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.466433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.466513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.466541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.466655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.466752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.466780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.466905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.467000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.467027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.467110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.467224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.467251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.467388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.467521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.467551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.467673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.467829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.467859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.468008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.468151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.468177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.468316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.468428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.468459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.468546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.468663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.468694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.468816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.468939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.468966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.469060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.469146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.469172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.469292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.469404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.469434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.040 [2024-11-28 23:23:02.469556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.469692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.040 [2024-11-28 23:23:02.469718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.040 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.469809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.469907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.469934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.470019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.470118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.470146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.470263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.470373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.470405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.470531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.470627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.470655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.470766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.470876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.470905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.471043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.471171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.471198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.471295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.471414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.471441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.471544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.471661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.471687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.471859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.471992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.472022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.472151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.472305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.472331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.472458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.472543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.472570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.472651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.472815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.472845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.472936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.473078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.473105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.473214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.473337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.473364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.473471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.473563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.473590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.473722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.473842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.473870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.474021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.474166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.474193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.474314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.474433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.474460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.474570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.474654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.474683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.474813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.474955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.474982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.475075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.475175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.475202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.475333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.475450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.475478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.475570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.475711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.475740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.475895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.476027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.476053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.476165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.476252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.476278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.476404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.476529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.476556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.476676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.476848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.476875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.477003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.477112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.477141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.477267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.477434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.477477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.477605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.477727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.477754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.477843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.477961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.477987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.478089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.478208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.478235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.478380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.478494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.478520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.478663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.478777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.478804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.478925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.479041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.479086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.479217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.479340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.479369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.479506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.479627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.479655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.479767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.479888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.479915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.480035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.480179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.480206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.480371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.480476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.480507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.480619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.480745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.480775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.480881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.480957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.480983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.481125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.481246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.481272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.481401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.481511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.481538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.481680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.481771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.481800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.481918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.482066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.482092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.482238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.482347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.482378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.482509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.482645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.482675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.482768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.482898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.482928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.483064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.483173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.483200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.483301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.483452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.483480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.483587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.483688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.041 [2024-11-28 23:23:02.483716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.041 qpair failed and we were unable to recover it. 00:30:59.041 [2024-11-28 23:23:02.483841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.483970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.483999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.484177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.484260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.484287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.484427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.484601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.484627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.484774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.484857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.484885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.484969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.485050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.485078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.485177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.485279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.485306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.485443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.485535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.485565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.485701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.485791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.485818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.485908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.485989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.486016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.486157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.486268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.486295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.486415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.486530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.486557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.486639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.486781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.486807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.486890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.486975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.487021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.487128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.487213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.487242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.487362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.487513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.487558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.487685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.487802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.487828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.487945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.488035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.488062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.488184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.488275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.488301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.488418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.488525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.488554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.488645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.488735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.488763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.488871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.488981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.489007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.489127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.489270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.489296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.489444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.489603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.489631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.489758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.489921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.489951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.490041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.490166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.490197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.490371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.490503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.490530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.490648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.490764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.490791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.490880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.490969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.490995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.491107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.491215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.491244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.491356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.491472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.491498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.491617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.491700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.491727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.491817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.491952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.491981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.492073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.492157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.492186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.492308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.492432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.492460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.492623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.492725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.492755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.492906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.493030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.493061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.493211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.493322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.493348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.493470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.493612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.493638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.493761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.493936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.493963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.494089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.494206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.494232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.494355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.494453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.494480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.494594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.494704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.494730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.494825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.494983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.495012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.495170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.495265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.495296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.495459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.495560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.495585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.495681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.495770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.495802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.495917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.496023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.496053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.496182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.496299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.496328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.496478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.496573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.496600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.496739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.496831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.496858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.496943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.497075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.497104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.497234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.497355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.497386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.497518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.497619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.497648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.497814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.497903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.497929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.498076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.498170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.498196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.498288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.498369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.042 [2024-11-28 23:23:02.498401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.042 qpair failed and we were unable to recover it. 00:30:59.042 [2024-11-28 23:23:02.498535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.498670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.498699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.498832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.498922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.498949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.499066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.499181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.499208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.499304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.499385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.499417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.499529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.499619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.499645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.499746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.499896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.499922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.500006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.500144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.500171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.500262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.500380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.500448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.500551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.500640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.500669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.500786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.500901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.500927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.501053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.501172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.501199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.501280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.501359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.501386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.501485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.501600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.501645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.501778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.501890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.501917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.502050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.502201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.502231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.502365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.502509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.502536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.502628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.502717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.502760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.502890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.503007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.503035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.503141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.503287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.503313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.503413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.503503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.503530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.503645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.503772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.503799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.503883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.503979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.504005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.504167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.504320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.504349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.504462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.504556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.504584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.504676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.504768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.504794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.504916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.505027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.505053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.505194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.505358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.505384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.505482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.505582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.505609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.505755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.505874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.505918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.506028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.506146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.506173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.506282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.506419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.506454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.506541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.506659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.506688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.506797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.506903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.506931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.507054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.507140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.507168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.507316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.507422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.507453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.507583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.507737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.507766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.507876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.507965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.507993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.508102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.508215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.508242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.508417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.508577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.508607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.508762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.508858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.508887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.509007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.509101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.509131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.509270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.509358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.509385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.509514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.509589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.509616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.509736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.509885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.509911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.510053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.510211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.510240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.510384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.510474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.510502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.510649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.510732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.510759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.510847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.510947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.510978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.511066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.511172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.511216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.511297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.511398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.511426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.511511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.511611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.511637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.043 qpair failed and we were unable to recover it. 00:30:59.043 [2024-11-28 23:23:02.511754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.511844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.043 [2024-11-28 23:23:02.511872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.511986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.512110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.512137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.512259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.512371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.512423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.512536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.512646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.512688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.512834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.512928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.512955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.513072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.513183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.513210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.513323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.513473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.513500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.513594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.513696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.513726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.513851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.513983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.514014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.514147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.514294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.514323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.514481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.514600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.514627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.514724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.514806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.514833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.514946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.515064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.515091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.515211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.515319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.515349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.515469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.515616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.515642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.515733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.515857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.515886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.516024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.516141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.516168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.516279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.516376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.516408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.516500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.516591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.516617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.516702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.516847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.516876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.517006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.517102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.517129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.517222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.517303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.517330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.517441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.517530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.517557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.517669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.517769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.517798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.517943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.518059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.518086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.518173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.518258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.518284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.518403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.518526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.518553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.518636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.518752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.518780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.518898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.519015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.519042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.519126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.519210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.519237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.519321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.519440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.519472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.519577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.519684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.519713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.519824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.519911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.519938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.520087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.520202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.520230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.520323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.520419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.520446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.520550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.520636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.520663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.520808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.520888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.520915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.521001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.521083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.521109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.521187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.521301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.521327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.521448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.521580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.521610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.521723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.521813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.521841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.521934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.522023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.522050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.522195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.522278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.522305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.522454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.522574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.522601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.522769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.522920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.522949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.523075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.523195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.523222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.523334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.523425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.523453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.523539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.523671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.523700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.523802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.523956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.523986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.524118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.524254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.524280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.524430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.524551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.524577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.524669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.524848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.524875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.524990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.525075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.525121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.525226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.525352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.525381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.525528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.525622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.525648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.525739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.525847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.044 [2024-11-28 23:23:02.525873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.044 qpair failed and we were unable to recover it. 00:30:59.044 [2024-11-28 23:23:02.525968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.526081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.526107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.526185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.526323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.526349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.526498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.526616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.526643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.526790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.526935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.526961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.527053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.527142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.527169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.527315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.527458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.527489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.527632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.527710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.527736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.527879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.528036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.528065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.528203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.528299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.528325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.528449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.528562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.528589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.528750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.528898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.528944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.529038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.529145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.529188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.529332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.529448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.529476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.529628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.529798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.529828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.529955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.530070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.530099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.530248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.530404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.530440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.530574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.530711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.530753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.530895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.530981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.531009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.531129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.531241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.531267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.531409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.531556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.531582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.531708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.531801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.531829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.531973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.532095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.532121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.532207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.532293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.532319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.532411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.532537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.532567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.532699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.532840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.532866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.533009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.533097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.533129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.533247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.533361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.533388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.533505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.533622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.533648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.533787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.533886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.533913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.534000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.534103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.534132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.534270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.534391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.534422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.534540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.534650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.534677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.534768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.534913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.534940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.535075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.535211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.535241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.535370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.535497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.535524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.535643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.535755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.535782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.535889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.536029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.536058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.536186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.536316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.536345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.536487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.536572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.536598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.536725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.536846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.536872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.536995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.537135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.537178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.537327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.537413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.537457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.537602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.537719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.537746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.537839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.537949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.537976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.538081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.538191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.538218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.538295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.538389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.538421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.538546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.538711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.538743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.538843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.539008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.539057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.539171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.539335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.539362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.539477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.539605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.539632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.539777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.539931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.539980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.045 qpair failed and we were unable to recover it. 00:30:59.045 [2024-11-28 23:23:02.540167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.540287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.045 [2024-11-28 23:23:02.540314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.540437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.540526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.540554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.540672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.540790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.540817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.540931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.541059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.541087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.541237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.541354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.541381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.541536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.541645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.541672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.541799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.541899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.541926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.542028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.542123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.542154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.542240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.542360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.542387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.542514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.542610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.542638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.542739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.542860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.542886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.543014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.543132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.543159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.543306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.543402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.543429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.543543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.543626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.543653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.543775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.543914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.543940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.544028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.544114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.544141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.544234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.544320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.544348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.544525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.544624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.544655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.544786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.544915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.544946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.545079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.545196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.545241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.545360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.545445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.545472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.545555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.545643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.545687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.545820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.545948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.545978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.546159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.546295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.546321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.546435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.546573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.546599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.546760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.546864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.546899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.547004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.547125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.547154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.547273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.547397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.547424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.547528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.547645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.547688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.547780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.547947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.547974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.548141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.548279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.548306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.548421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.548505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.548532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.548617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.548733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.548762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.548900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.549054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.549084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.549234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.549377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.549414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.549512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.549652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.549680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.549866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.549990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.550019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.550143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.550240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.550271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.550402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.550546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.550573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.550707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.550871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.550900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.551008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.551164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.551192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.551291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.551386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.551423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.551558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.551655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.551684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.551840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.551958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.551988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.552082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.552243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.552272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.552372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.552524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.552551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.552643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.552769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.552798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.552925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.553069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.553095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.553214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.553327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.553354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.553509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.553634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.553660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.553747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.553854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.553880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.553972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.554113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.554139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.554260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.554383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.554416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.554516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.554598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.554624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.554756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.554875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.554903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.046 qpair failed and we were unable to recover it. 00:30:59.046 [2024-11-28 23:23:02.555018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.046 [2024-11-28 23:23:02.555101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.555128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.555253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.555331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.555357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.555485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.555576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.555603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.555782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.555910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.555953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.556105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.556193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.556221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.556341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.556437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.556464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.556608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.556735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.556765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.556918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.557049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.557076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.557189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.557311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.557338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.557459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.557554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.557581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.557676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.557790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.557834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.557976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.558111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.558141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.558273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.558399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.558426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.558570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.558695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.558721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.558842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.558960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.558986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.559129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.559226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.559256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.559403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.559524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.559551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.559697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.559845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.559871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.559963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.560046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.560073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.560198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.560291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.560319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.560438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.560585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.560612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.560725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.560858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.560906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.561057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.561191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.561220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.561373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.561511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.561541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.561646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.561769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.561795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.561918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.562016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.562043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.562129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.562253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.562279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.562412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.562498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.562524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.562653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.562779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.562805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.562915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.563080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.563106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.563198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.563280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.563306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.563403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.563520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.563547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.563666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.563749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.563775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.563866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.563943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.563969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.564093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.564214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.564240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.564355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.564536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.564566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.564720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.564826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.564855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.564996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.565085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.565111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.565200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.565285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.565311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.565423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.565521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.565550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.565689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.565801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.565827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.565918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.566032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.566060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.566157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.566268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.566295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.566387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.566534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.566561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.566650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.566760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.566787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.566900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.567013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.567039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.567160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.567278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.567304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.567390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.567515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.567541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.567639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.567783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.567809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.567924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.568014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.568041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.568185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.568298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.568325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.568407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.568483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.568508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.568595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.568720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.568747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.568842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.568924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.568950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.569046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.569189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.569218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.569374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.569478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.569508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.047 qpair failed and we were unable to recover it. 00:30:59.047 [2024-11-28 23:23:02.569645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.569732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.047 [2024-11-28 23:23:02.569758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.569862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.569945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.569974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.570068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.570218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.570249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.570405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.570533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.570578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.570696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.570811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.570838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.570926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.571087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.571118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.571295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.571405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.571450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.571571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.571664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.571691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.571779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.571870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.571897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.572039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.572158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.572185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.572271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.572352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.572380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.572586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.572705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.572732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.572851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.572942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.572970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.573081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.573164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.573192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.573291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.573449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.573479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.573619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.573743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.573772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.573877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.573992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.574023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.574142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.574261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.574288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.574410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.574552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.574581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.574678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.574778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.574808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.574948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.575057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.575083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.575194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.575280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.575307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.575419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.575506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.575532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.575622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.575715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.575742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.575857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.575974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.576001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.576098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.576215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.576243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.576333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.576505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.576536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.576636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.576736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.576763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.576905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.577050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.577076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.577173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.577280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.577307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.577437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.577592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.577620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.577744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.577871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.577897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.578007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.578093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.578120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.578265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.578349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.578376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.578495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.578643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.578670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.578809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.578924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.578951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.579097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.579210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.579236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.579385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.579515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.579543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.579673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.579825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.579867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.579988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.580136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.580163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.580260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.580373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.580405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.580542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.580683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.580709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.580822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.580943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.580969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.581062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.581148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.581174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.581259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.581375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.581408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.581588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.581705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.581732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.581878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.581997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.582023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.582143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.582282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.582310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.582482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.582573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.582600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.582736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.582839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.582866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.582970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.583055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.583083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.583177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.583278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.583308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.048 [2024-11-28 23:23:02.583447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.583538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.048 [2024-11-28 23:23:02.583566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.048 qpair failed and we were unable to recover it. 00:30:59.049 [2024-11-28 23:23:02.583695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.583790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.583818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.049 qpair failed and we were unable to recover it. 00:30:59.049 [2024-11-28 23:23:02.583914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.584036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.584063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.049 qpair failed and we were unable to recover it. 00:30:59.049 [2024-11-28 23:23:02.584179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.584267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.584310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.049 qpair failed and we were unable to recover it. 00:30:59.049 [2024-11-28 23:23:02.584423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.584510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.584537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.049 qpair failed and we were unable to recover it. 00:30:59.049 [2024-11-28 23:23:02.584659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.584791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.584823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.049 qpair failed and we were unable to recover it. 00:30:59.049 [2024-11-28 23:23:02.584943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.585038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.585065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.049 qpair failed and we were unable to recover it. 00:30:59.049 [2024-11-28 23:23:02.585189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.585321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.585347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.049 qpair failed and we were unable to recover it. 00:30:59.049 [2024-11-28 23:23:02.585476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.585576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.585603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.049 qpair failed and we were unable to recover it. 00:30:59.049 [2024-11-28 23:23:02.585681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.585768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.585795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.049 qpair failed and we were unable to recover it. 00:30:59.049 [2024-11-28 23:23:02.585907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.585999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.586025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.049 qpair failed and we were unable to recover it. 00:30:59.049 [2024-11-28 23:23:02.586116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.586241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.586270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.049 qpair failed and we were unable to recover it. 00:30:59.049 [2024-11-28 23:23:02.586409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.586530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.586556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.049 qpair failed and we were unable to recover it. 00:30:59.049 [2024-11-28 23:23:02.586666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.586842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.586872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.049 qpair failed and we were unable to recover it. 00:30:59.049 [2024-11-28 23:23:02.586981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.587108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.587137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.049 qpair failed and we were unable to recover it. 00:30:59.049 [2024-11-28 23:23:02.587280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.587400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.587429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.049 qpair failed and we were unable to recover it. 00:30:59.049 [2024-11-28 23:23:02.587597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.587739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.587765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.049 qpair failed and we were unable to recover it. 00:30:59.049 [2024-11-28 23:23:02.587946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.588093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.588119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.049 qpair failed and we were unable to recover it. 00:30:59.049 [2024-11-28 23:23:02.588251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.588379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.588410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.049 qpair failed and we were unable to recover it. 00:30:59.049 [2024-11-28 23:23:02.588536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.588682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.588708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.049 qpair failed and we were unable to recover it. 00:30:59.049 [2024-11-28 23:23:02.588829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.588912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.588939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.049 qpair failed and we were unable to recover it. 00:30:59.049 [2024-11-28 23:23:02.589037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.589196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.589224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.049 qpair failed and we were unable to recover it. 00:30:59.049 [2024-11-28 23:23:02.589323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.589407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.589436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.049 qpair failed and we were unable to recover it. 00:30:59.049 [2024-11-28 23:23:02.589570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.589713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.589741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.049 qpair failed and we were unable to recover it. 00:30:59.049 [2024-11-28 23:23:02.589856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.589940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.589966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.049 qpair failed and we were unable to recover it. 00:30:59.049 [2024-11-28 23:23:02.590061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.590160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.590186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.049 qpair failed and we were unable to recover it. 00:30:59.049 [2024-11-28 23:23:02.590308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.590440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.590469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.049 qpair failed and we were unable to recover it. 00:30:59.049 [2024-11-28 23:23:02.590596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.590691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.590719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.049 qpair failed and we were unable to recover it. 00:30:59.049 [2024-11-28 23:23:02.590824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.590962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.590988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.049 qpair failed and we were unable to recover it. 00:30:59.049 [2024-11-28 23:23:02.591127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.591245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.591270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.049 qpair failed and we were unable to recover it. 00:30:59.049 [2024-11-28 23:23:02.591370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.591481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.591510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.049 qpair failed and we were unable to recover it. 00:30:59.049 [2024-11-28 23:23:02.591631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.591724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.591752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.049 qpair failed and we were unable to recover it. 00:30:59.049 [2024-11-28 23:23:02.591859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.591977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.592004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.049 qpair failed and we were unable to recover it. 00:30:59.049 [2024-11-28 23:23:02.592118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.592208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.592236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.049 qpair failed and we were unable to recover it. 00:30:59.049 [2024-11-28 23:23:02.592329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.592464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.592495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.049 qpair failed and we were unable to recover it. 00:30:59.049 [2024-11-28 23:23:02.592660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.592777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.592805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.049 qpair failed and we were unable to recover it. 00:30:59.049 [2024-11-28 23:23:02.592928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.593048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.593075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.049 qpair failed and we were unable to recover it. 00:30:59.049 [2024-11-28 23:23:02.593154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.593249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.593276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.049 qpair failed and we were unable to recover it. 00:30:59.049 [2024-11-28 23:23:02.593386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.593518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.593547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.049 qpair failed and we were unable to recover it. 00:30:59.049 [2024-11-28 23:23:02.593644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.593794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.049 [2024-11-28 23:23:02.593823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.049 qpair failed and we were unable to recover it. 00:30:59.328 [2024-11-28 23:23:02.593965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.328 [2024-11-28 23:23:02.594049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.328 [2024-11-28 23:23:02.594075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.328 qpair failed and we were unable to recover it. 00:30:59.328 [2024-11-28 23:23:02.594165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.328 [2024-11-28 23:23:02.594283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.328 [2024-11-28 23:23:02.594327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.328 qpair failed and we were unable to recover it. 00:30:59.328 [2024-11-28 23:23:02.594411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.328 [2024-11-28 23:23:02.594546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.328 [2024-11-28 23:23:02.594575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.328 qpair failed and we were unable to recover it. 00:30:59.328 [2024-11-28 23:23:02.594697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.328 [2024-11-28 23:23:02.594834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.328 [2024-11-28 23:23:02.594863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.328 qpair failed and we were unable to recover it. 00:30:59.328 [2024-11-28 23:23:02.594988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.328 [2024-11-28 23:23:02.595100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.328 [2024-11-28 23:23:02.595127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.328 qpair failed and we were unable to recover it. 00:30:59.328 [2024-11-28 23:23:02.595204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.328 [2024-11-28 23:23:02.595321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.595366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.329 qpair failed and we were unable to recover it. 00:30:59.329 [2024-11-28 23:23:02.595487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.595582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.595610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.329 qpair failed and we were unable to recover it. 00:30:59.329 [2024-11-28 23:23:02.595705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.595799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.595825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.329 qpair failed and we were unable to recover it. 00:30:59.329 [2024-11-28 23:23:02.595939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.596034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.596060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.329 qpair failed and we were unable to recover it. 00:30:59.329 [2024-11-28 23:23:02.596158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.596247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.596276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.329 qpair failed and we were unable to recover it. 00:30:59.329 [2024-11-28 23:23:02.596422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.596548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.596574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.329 qpair failed and we were unable to recover it. 00:30:59.329 [2024-11-28 23:23:02.596659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.596797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.596824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.329 qpair failed and we were unable to recover it. 00:30:59.329 [2024-11-28 23:23:02.596946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.597039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.597066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.329 qpair failed and we were unable to recover it. 00:30:59.329 [2024-11-28 23:23:02.597148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.597236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.597263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.329 qpair failed and we were unable to recover it. 00:30:59.329 [2024-11-28 23:23:02.597430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.597552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.597578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.329 qpair failed and we were unable to recover it. 00:30:59.329 [2024-11-28 23:23:02.597725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.597867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.597895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.329 qpair failed and we were unable to recover it. 00:30:59.329 [2024-11-28 23:23:02.598013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.598123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.598154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.329 qpair failed and we were unable to recover it. 00:30:59.329 [2024-11-28 23:23:02.598297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.598468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.598498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.329 qpair failed and we were unable to recover it. 00:30:59.329 [2024-11-28 23:23:02.598600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.598706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.598737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.329 qpair failed and we were unable to recover it. 00:30:59.329 [2024-11-28 23:23:02.598840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.598935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.598986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.329 qpair failed and we were unable to recover it. 00:30:59.329 [2024-11-28 23:23:02.599144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.599264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.599290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.329 qpair failed and we were unable to recover it. 00:30:59.329 [2024-11-28 23:23:02.599433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.599568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.599597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.329 qpair failed and we were unable to recover it. 00:30:59.329 [2024-11-28 23:23:02.599720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.599841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.599869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.329 qpair failed and we were unable to recover it. 00:30:59.329 [2024-11-28 23:23:02.599986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.600144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.600171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.329 qpair failed and we were unable to recover it. 00:30:59.329 [2024-11-28 23:23:02.600295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.600382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.600432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.329 qpair failed and we were unable to recover it. 00:30:59.329 [2024-11-28 23:23:02.600567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.600681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.600711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.329 qpair failed and we were unable to recover it. 00:30:59.329 [2024-11-28 23:23:02.600802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.600939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.600969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.329 qpair failed and we were unable to recover it. 00:30:59.329 [2024-11-28 23:23:02.601064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.601190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.601221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.329 qpair failed and we were unable to recover it. 00:30:59.329 [2024-11-28 23:23:02.601335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.601460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.601487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.329 qpair failed and we were unable to recover it. 00:30:59.329 [2024-11-28 23:23:02.601654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.601795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.601821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.329 qpair failed and we were unable to recover it. 00:30:59.329 [2024-11-28 23:23:02.601900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.602018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.602046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.329 qpair failed and we were unable to recover it. 00:30:59.329 [2024-11-28 23:23:02.602147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.602260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.329 [2024-11-28 23:23:02.602302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.329 qpair failed and we were unable to recover it. 00:30:59.329 [2024-11-28 23:23:02.602413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.602558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.602584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.330 qpair failed and we were unable to recover it. 00:30:59.330 [2024-11-28 23:23:02.602730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.602880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.602906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.330 qpair failed and we were unable to recover it. 00:30:59.330 [2024-11-28 23:23:02.603052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.603158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.603188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.330 qpair failed and we were unable to recover it. 00:30:59.330 [2024-11-28 23:23:02.603346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.603451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.603482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.330 qpair failed and we were unable to recover it. 00:30:59.330 [2024-11-28 23:23:02.603597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.603743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.603770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.330 qpair failed and we were unable to recover it. 00:30:59.330 [2024-11-28 23:23:02.603901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.604017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.604048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.330 qpair failed and we were unable to recover it. 00:30:59.330 [2024-11-28 23:23:02.604142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.604274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.604300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.330 qpair failed and we were unable to recover it. 00:30:59.330 [2024-11-28 23:23:02.604403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.604499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.604525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.330 qpair failed and we were unable to recover it. 00:30:59.330 [2024-11-28 23:23:02.604672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.604760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.604786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.330 qpair failed and we were unable to recover it. 00:30:59.330 [2024-11-28 23:23:02.604922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.605076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.605106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.330 qpair failed and we were unable to recover it. 00:30:59.330 [2024-11-28 23:23:02.605235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.605344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.605371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.330 qpair failed and we were unable to recover it. 00:30:59.330 [2024-11-28 23:23:02.605465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.605584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.605611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.330 qpair failed and we were unable to recover it. 00:30:59.330 [2024-11-28 23:23:02.605804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.605915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.605942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.330 qpair failed and we were unable to recover it. 00:30:59.330 [2024-11-28 23:23:02.606059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.606155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.606183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.330 qpair failed and we were unable to recover it. 00:30:59.330 [2024-11-28 23:23:02.606281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.606387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.606421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.330 qpair failed and we were unable to recover it. 00:30:59.330 [2024-11-28 23:23:02.606555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.606678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.606708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.330 qpair failed and we were unable to recover it. 00:30:59.330 [2024-11-28 23:23:02.606857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.606944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.606971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.330 qpair failed and we were unable to recover it. 00:30:59.330 [2024-11-28 23:23:02.607109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.607199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.607228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.330 qpair failed and we were unable to recover it. 00:30:59.330 [2024-11-28 23:23:02.607344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.607520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.607548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.330 qpair failed and we were unable to recover it. 00:30:59.330 [2024-11-28 23:23:02.607668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.607762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.607790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.330 qpair failed and we were unable to recover it. 00:30:59.330 [2024-11-28 23:23:02.607869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.607963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.607990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.330 qpair failed and we were unable to recover it. 00:30:59.330 [2024-11-28 23:23:02.608107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.608225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.608251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.330 qpair failed and we were unable to recover it. 00:30:59.330 [2024-11-28 23:23:02.608353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.608498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.608526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.330 qpair failed and we were unable to recover it. 00:30:59.330 [2024-11-28 23:23:02.608642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.608786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.608812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.330 qpair failed and we were unable to recover it. 00:30:59.330 [2024-11-28 23:23:02.608935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.609046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.609072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.330 qpair failed and we were unable to recover it. 00:30:59.330 [2024-11-28 23:23:02.609190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.609310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.609338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.330 qpair failed and we were unable to recover it. 00:30:59.330 [2024-11-28 23:23:02.609515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.609669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.609699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.330 qpair failed and we were unable to recover it. 00:30:59.330 [2024-11-28 23:23:02.609821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.609979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.610009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.330 qpair failed and we were unable to recover it. 00:30:59.330 [2024-11-28 23:23:02.610150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.610258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.330 [2024-11-28 23:23:02.610286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.330 qpair failed and we were unable to recover it. 00:30:59.330 [2024-11-28 23:23:02.610413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.610577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.610604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.331 qpair failed and we were unable to recover it. 00:30:59.331 [2024-11-28 23:23:02.610725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.610805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.610837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.331 qpair failed and we were unable to recover it. 00:30:59.331 [2024-11-28 23:23:02.610983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.611108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.611137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.331 qpair failed and we were unable to recover it. 00:30:59.331 [2024-11-28 23:23:02.611277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.611423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.611450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.331 qpair failed and we were unable to recover it. 00:30:59.331 [2024-11-28 23:23:02.611538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.611649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.611675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.331 qpair failed and we were unable to recover it. 00:30:59.331 [2024-11-28 23:23:02.611788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.611877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.611921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.331 qpair failed and we were unable to recover it. 00:30:59.331 [2024-11-28 23:23:02.612038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.612170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.612204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.331 qpair failed and we were unable to recover it. 00:30:59.331 [2024-11-28 23:23:02.612350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.612453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.612481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.331 qpair failed and we were unable to recover it. 00:30:59.331 [2024-11-28 23:23:02.612600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.612724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.612750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.331 qpair failed and we were unable to recover it. 00:30:59.331 [2024-11-28 23:23:02.612839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.612985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.613012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.331 qpair failed and we were unable to recover it. 00:30:59.331 [2024-11-28 23:23:02.613122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.613202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.613246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.331 qpair failed and we were unable to recover it. 00:30:59.331 [2024-11-28 23:23:02.613374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.613470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.613498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.331 qpair failed and we were unable to recover it. 00:30:59.331 [2024-11-28 23:23:02.613613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.613729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.613755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.331 qpair failed and we were unable to recover it. 00:30:59.331 [2024-11-28 23:23:02.613879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.613970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.613996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.331 qpair failed and we were unable to recover it. 00:30:59.331 [2024-11-28 23:23:02.614081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.614161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.614187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.331 qpair failed and we were unable to recover it. 00:30:59.331 [2024-11-28 23:23:02.614286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.614408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.614436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.331 qpair failed and we were unable to recover it. 00:30:59.331 [2024-11-28 23:23:02.614533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.614652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.614678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.331 qpair failed and we were unable to recover it. 00:30:59.331 [2024-11-28 23:23:02.614816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.614903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.614933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.331 qpair failed and we were unable to recover it. 00:30:59.331 [2024-11-28 23:23:02.615023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.615155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.615184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.331 qpair failed and we were unable to recover it. 00:30:59.331 [2024-11-28 23:23:02.615296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.615373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.615406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.331 qpair failed and we were unable to recover it. 00:30:59.331 [2024-11-28 23:23:02.615553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.615641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.615668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.331 qpair failed and we were unable to recover it. 00:30:59.331 [2024-11-28 23:23:02.615817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.615979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.616008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.331 qpair failed and we were unable to recover it. 00:30:59.331 [2024-11-28 23:23:02.616131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.616230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.616259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.331 qpair failed and we were unable to recover it. 00:30:59.331 [2024-11-28 23:23:02.616426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.616554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.616582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.331 qpair failed and we were unable to recover it. 00:30:59.331 [2024-11-28 23:23:02.616744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.616840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.616882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.331 qpair failed and we were unable to recover it. 00:30:59.331 [2024-11-28 23:23:02.616995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.617080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.617106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.331 qpair failed and we were unable to recover it. 00:30:59.331 [2024-11-28 23:23:02.617201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.617333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.617363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.331 qpair failed and we were unable to recover it. 00:30:59.331 [2024-11-28 23:23:02.617518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.617635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.617661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.331 qpair failed and we were unable to recover it. 00:30:59.331 [2024-11-28 23:23:02.617751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.617862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.331 [2024-11-28 23:23:02.617891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.332 qpair failed and we were unable to recover it. 00:30:59.332 [2024-11-28 23:23:02.618025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.618146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.618172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.332 qpair failed and we were unable to recover it. 00:30:59.332 [2024-11-28 23:23:02.618294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.618428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.618458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.332 qpair failed and we were unable to recover it. 00:30:59.332 [2024-11-28 23:23:02.618563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.618688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.618714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.332 qpair failed and we were unable to recover it. 00:30:59.332 [2024-11-28 23:23:02.618894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.619034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.619061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.332 qpair failed and we were unable to recover it. 00:30:59.332 [2024-11-28 23:23:02.619226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.619355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.619386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.332 qpair failed and we were unable to recover it. 00:30:59.332 [2024-11-28 23:23:02.619511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.619597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.619623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.332 qpair failed and we were unable to recover it. 00:30:59.332 [2024-11-28 23:23:02.619770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.619868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.619896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.332 qpair failed and we were unable to recover it. 00:30:59.332 [2024-11-28 23:23:02.620033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.620125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.620166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.332 qpair failed and we were unable to recover it. 00:30:59.332 [2024-11-28 23:23:02.620304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.620446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.620476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.332 qpair failed and we were unable to recover it. 00:30:59.332 [2024-11-28 23:23:02.620591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.620707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.620733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.332 qpair failed and we were unable to recover it. 00:30:59.332 [2024-11-28 23:23:02.620846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.620956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.620982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.332 qpair failed and we were unable to recover it. 00:30:59.332 [2024-11-28 23:23:02.621081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.621234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.621263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.332 qpair failed and we were unable to recover it. 00:30:59.332 [2024-11-28 23:23:02.621356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.621494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.621538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.332 qpair failed and we were unable to recover it. 00:30:59.332 [2024-11-28 23:23:02.621639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.621763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.621789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.332 qpair failed and we were unable to recover it. 00:30:59.332 [2024-11-28 23:23:02.621914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.622024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.622050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.332 qpair failed and we were unable to recover it. 00:30:59.332 [2024-11-28 23:23:02.622226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.622345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.622372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.332 qpair failed and we were unable to recover it. 00:30:59.332 [2024-11-28 23:23:02.622493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.622619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.622646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.332 qpair failed and we were unable to recover it. 00:30:59.332 [2024-11-28 23:23:02.622779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.622912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.622941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.332 qpair failed and we were unable to recover it. 00:30:59.332 [2024-11-28 23:23:02.623051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.623189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.623222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.332 qpair failed and we were unable to recover it. 00:30:59.332 [2024-11-28 23:23:02.623321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.623436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.623476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.332 qpair failed and we were unable to recover it. 00:30:59.332 [2024-11-28 23:23:02.623628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.623746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.623774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.332 qpair failed and we were unable to recover it. 00:30:59.332 [2024-11-28 23:23:02.623904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.624022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.624050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.332 qpair failed and we were unable to recover it. 00:30:59.332 [2024-11-28 23:23:02.624190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.624282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.624309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.332 qpair failed and we were unable to recover it. 00:30:59.332 [2024-11-28 23:23:02.624460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.624568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.624599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.332 qpair failed and we were unable to recover it. 00:30:59.332 [2024-11-28 23:23:02.624753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.624840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.624870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.332 qpair failed and we were unable to recover it. 00:30:59.332 [2024-11-28 23:23:02.625000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.625153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.625182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.332 qpair failed and we were unable to recover it. 00:30:59.332 [2024-11-28 23:23:02.625307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.625418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.625445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.332 qpair failed and we were unable to recover it. 00:30:59.332 [2024-11-28 23:23:02.625558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.625703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.625729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.332 qpair failed and we were unable to recover it. 00:30:59.332 [2024-11-28 23:23:02.625877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.626002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.332 [2024-11-28 23:23:02.626028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.332 qpair failed and we were unable to recover it. 00:30:59.332 [2024-11-28 23:23:02.626119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.626231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.626257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.333 qpair failed and we were unable to recover it. 00:30:59.333 [2024-11-28 23:23:02.626374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.626463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.626490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.333 qpair failed and we were unable to recover it. 00:30:59.333 [2024-11-28 23:23:02.626588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.626758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.626785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.333 qpair failed and we were unable to recover it. 00:30:59.333 [2024-11-28 23:23:02.626903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.626997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.627024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.333 qpair failed and we were unable to recover it. 00:30:59.333 [2024-11-28 23:23:02.627107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.627218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.627244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.333 qpair failed and we were unable to recover it. 00:30:59.333 [2024-11-28 23:23:02.627405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.627548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.627575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.333 qpair failed and we were unable to recover it. 00:30:59.333 [2024-11-28 23:23:02.627654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.627785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.627814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.333 qpair failed and we were unable to recover it. 00:30:59.333 [2024-11-28 23:23:02.627949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.628056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.628085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.333 qpair failed and we were unable to recover it. 00:30:59.333 [2024-11-28 23:23:02.628250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.628365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.628391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.333 qpair failed and we were unable to recover it. 00:30:59.333 [2024-11-28 23:23:02.628511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.628624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.628657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.333 qpair failed and we were unable to recover it. 00:30:59.333 [2024-11-28 23:23:02.628827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.628925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.628954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.333 qpair failed and we were unable to recover it. 00:30:59.333 [2024-11-28 23:23:02.629106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.629233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.629259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.333 qpair failed and we were unable to recover it. 00:30:59.333 [2024-11-28 23:23:02.629412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.629530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.629557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.333 qpair failed and we were unable to recover it. 00:30:59.333 [2024-11-28 23:23:02.629684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.629813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.629840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.333 qpair failed and we were unable to recover it. 00:30:59.333 [2024-11-28 23:23:02.629965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.630062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.630088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.333 qpair failed and we were unable to recover it. 00:30:59.333 [2024-11-28 23:23:02.630207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.630351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.630378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.333 qpair failed and we were unable to recover it. 00:30:59.333 [2024-11-28 23:23:02.630507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.630590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.630635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.333 qpair failed and we were unable to recover it. 00:30:59.333 [2024-11-28 23:23:02.630746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.630857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.630884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.333 qpair failed and we were unable to recover it. 00:30:59.333 [2024-11-28 23:23:02.631031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.631155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.631184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.333 qpair failed and we were unable to recover it. 00:30:59.333 [2024-11-28 23:23:02.631284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.631374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.631410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.333 qpair failed and we were unable to recover it. 00:30:59.333 [2024-11-28 23:23:02.631602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.631691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.631718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.333 qpair failed and we were unable to recover it. 00:30:59.333 [2024-11-28 23:23:02.631830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.631923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.631949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.333 qpair failed and we were unable to recover it. 00:30:59.333 [2024-11-28 23:23:02.632038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.632119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.632145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.333 qpair failed and we were unable to recover it. 00:30:59.333 [2024-11-28 23:23:02.632227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.632370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.632421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.333 qpair failed and we were unable to recover it. 00:30:59.333 [2024-11-28 23:23:02.632562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.632707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.632733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.333 qpair failed and we were unable to recover it. 00:30:59.333 [2024-11-28 23:23:02.632881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.632996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.633022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.333 qpair failed and we were unable to recover it. 00:30:59.333 [2024-11-28 23:23:02.633145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.633254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.633298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.333 qpair failed and we were unable to recover it. 00:30:59.333 [2024-11-28 23:23:02.633455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.633576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.633605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.333 qpair failed and we were unable to recover it. 00:30:59.333 [2024-11-28 23:23:02.633725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.633893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.633919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.333 qpair failed and we were unable to recover it. 00:30:59.333 [2024-11-28 23:23:02.634060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.333 [2024-11-28 23:23:02.634145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.634171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.334 qpair failed and we were unable to recover it. 00:30:59.334 [2024-11-28 23:23:02.634262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.634378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.634411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.334 qpair failed and we were unable to recover it. 00:30:59.334 [2024-11-28 23:23:02.634527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.634648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.634674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.334 qpair failed and we were unable to recover it. 00:30:59.334 [2024-11-28 23:23:02.634758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.634850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.634877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.334 qpair failed and we were unable to recover it. 00:30:59.334 [2024-11-28 23:23:02.635019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.635100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.635127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.334 qpair failed and we were unable to recover it. 00:30:59.334 [2024-11-28 23:23:02.635220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.635331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.635358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.334 qpair failed and we were unable to recover it. 00:30:59.334 [2024-11-28 23:23:02.635482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.635597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.635624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.334 qpair failed and we were unable to recover it. 00:30:59.334 [2024-11-28 23:23:02.635741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.635838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.635864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.334 qpair failed and we were unable to recover it. 00:30:59.334 [2024-11-28 23:23:02.636010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.636102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.636128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.334 qpair failed and we were unable to recover it. 00:30:59.334 [2024-11-28 23:23:02.636238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.636318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.636343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.334 qpair failed and we were unable to recover it. 00:30:59.334 [2024-11-28 23:23:02.636455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.636555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.636582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.334 qpair failed and we were unable to recover it. 00:30:59.334 [2024-11-28 23:23:02.636675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.636806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.636840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.334 qpair failed and we were unable to recover it. 00:30:59.334 [2024-11-28 23:23:02.636976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.637120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.637147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.334 qpair failed and we were unable to recover it. 00:30:59.334 [2024-11-28 23:23:02.637312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.637447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.637474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.334 qpair failed and we were unable to recover it. 00:30:59.334 [2024-11-28 23:23:02.637558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.637698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.637725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.334 qpair failed and we were unable to recover it. 00:30:59.334 [2024-11-28 23:23:02.637852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.638027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.638056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.334 qpair failed and we were unable to recover it. 00:30:59.334 [2024-11-28 23:23:02.638218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.638316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.638342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.334 qpair failed and we were unable to recover it. 00:30:59.334 [2024-11-28 23:23:02.638437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.638515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.638541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.334 qpair failed and we were unable to recover it. 00:30:59.334 [2024-11-28 23:23:02.638627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.638744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.638779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.334 qpair failed and we were unable to recover it. 00:30:59.334 [2024-11-28 23:23:02.638911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.639003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.639044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.334 qpair failed and we were unable to recover it. 00:30:59.334 [2024-11-28 23:23:02.639158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.639254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.639282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.334 qpair failed and we were unable to recover it. 00:30:59.334 [2024-11-28 23:23:02.639424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.639542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.639569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.334 qpair failed and we were unable to recover it. 00:30:59.334 [2024-11-28 23:23:02.639670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.639783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.639812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.334 qpair failed and we were unable to recover it. 00:30:59.334 [2024-11-28 23:23:02.639944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.640068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.640097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.334 qpair failed and we were unable to recover it. 00:30:59.334 [2024-11-28 23:23:02.640199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.640295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.640322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.334 qpair failed and we were unable to recover it. 00:30:59.334 [2024-11-28 23:23:02.640442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.334 [2024-11-28 23:23:02.640536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.640562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.335 qpair failed and we were unable to recover it. 00:30:59.335 [2024-11-28 23:23:02.640652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.640765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.640791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.335 qpair failed and we were unable to recover it. 00:30:59.335 [2024-11-28 23:23:02.640926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.641054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.641083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.335 qpair failed and we were unable to recover it. 00:30:59.335 [2024-11-28 23:23:02.641194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.641306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.641332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.335 qpair failed and we were unable to recover it. 00:30:59.335 [2024-11-28 23:23:02.641454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.641538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.641565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.335 qpair failed and we were unable to recover it. 00:30:59.335 [2024-11-28 23:23:02.641686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.641773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.641799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.335 qpair failed and we were unable to recover it. 00:30:59.335 [2024-11-28 23:23:02.641950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.642070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.642099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.335 qpair failed and we were unable to recover it. 00:30:59.335 [2024-11-28 23:23:02.642242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.642361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.642388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.335 qpair failed and we were unable to recover it. 00:30:59.335 [2024-11-28 23:23:02.642518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.642605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.642631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.335 qpair failed and we were unable to recover it. 00:30:59.335 [2024-11-28 23:23:02.642750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.642841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.642882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.335 qpair failed and we were unable to recover it. 00:30:59.335 [2024-11-28 23:23:02.643038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.643151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.643177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.335 qpair failed and we were unable to recover it. 00:30:59.335 [2024-11-28 23:23:02.643260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.643371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.643402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.335 qpair failed and we were unable to recover it. 00:30:59.335 [2024-11-28 23:23:02.643523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.643606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.643635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.335 qpair failed and we were unable to recover it. 00:30:59.335 [2024-11-28 23:23:02.643740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.643904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.643932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.335 qpair failed and we were unable to recover it. 00:30:59.335 [2024-11-28 23:23:02.644058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.644181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.644210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.335 qpair failed and we were unable to recover it. 00:30:59.335 [2024-11-28 23:23:02.644340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.644456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.644483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.335 qpair failed and we were unable to recover it. 00:30:59.335 [2024-11-28 23:23:02.644633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.644769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.644797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.335 qpair failed and we were unable to recover it. 00:30:59.335 [2024-11-28 23:23:02.644910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.645037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.645065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.335 qpair failed and we were unable to recover it. 00:30:59.335 [2024-11-28 23:23:02.645162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.645278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.645305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.335 qpair failed and we were unable to recover it. 00:30:59.335 [2024-11-28 23:23:02.645423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.645512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.645539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.335 qpair failed and we were unable to recover it. 00:30:59.335 [2024-11-28 23:23:02.645625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.645740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.645766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.335 qpair failed and we were unable to recover it. 00:30:59.335 [2024-11-28 23:23:02.645918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.646059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.646085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.335 qpair failed and we were unable to recover it. 00:30:59.335 [2024-11-28 23:23:02.646245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.646370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.646402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.335 qpair failed and we were unable to recover it. 00:30:59.335 [2024-11-28 23:23:02.646525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.646665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.646691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.335 qpair failed and we were unable to recover it. 00:30:59.335 [2024-11-28 23:23:02.646844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.646989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.647015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.335 qpair failed and we were unable to recover it. 00:30:59.335 [2024-11-28 23:23:02.647113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.647237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.647272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.335 qpair failed and we were unable to recover it. 00:30:59.335 [2024-11-28 23:23:02.647402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.647502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.647531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.335 qpair failed and we were unable to recover it. 00:30:59.335 [2024-11-28 23:23:02.647670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.647781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.647814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.335 qpair failed and we were unable to recover it. 00:30:59.335 [2024-11-28 23:23:02.647918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.648035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.648061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.335 qpair failed and we were unable to recover it. 00:30:59.335 [2024-11-28 23:23:02.648145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.648263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.335 [2024-11-28 23:23:02.648306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.336 qpair failed and we were unable to recover it. 00:30:59.336 [2024-11-28 23:23:02.648444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.648577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.648604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.336 qpair failed and we were unable to recover it. 00:30:59.336 [2024-11-28 23:23:02.648713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.648834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.648859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.336 qpair failed and we were unable to recover it. 00:30:59.336 [2024-11-28 23:23:02.648970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.649081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.649108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.336 qpair failed and we were unable to recover it. 00:30:59.336 [2024-11-28 23:23:02.649193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.649306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.649333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.336 qpair failed and we were unable to recover it. 00:30:59.336 [2024-11-28 23:23:02.649480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.649612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.649640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.336 qpair failed and we were unable to recover it. 00:30:59.336 [2024-11-28 23:23:02.649745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.649860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.649887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.336 qpair failed and we were unable to recover it. 00:30:59.336 [2024-11-28 23:23:02.649999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.650113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.650139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.336 qpair failed and we were unable to recover it. 00:30:59.336 [2024-11-28 23:23:02.650249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.650419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.650453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.336 qpair failed and we were unable to recover it. 00:30:59.336 [2024-11-28 23:23:02.650619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.650750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.650778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.336 qpair failed and we were unable to recover it. 00:30:59.336 [2024-11-28 23:23:02.650886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.651029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.651055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.336 qpair failed and we were unable to recover it. 00:30:59.336 [2024-11-28 23:23:02.651154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.651238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.651264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.336 qpair failed and we were unable to recover it. 00:30:59.336 [2024-11-28 23:23:02.651381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.651509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.651536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.336 qpair failed and we were unable to recover it. 00:30:59.336 [2024-11-28 23:23:02.651655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.651757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.651785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.336 qpair failed and we were unable to recover it. 00:30:59.336 [2024-11-28 23:23:02.651921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.652010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.652036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.336 qpair failed and we were unable to recover it. 00:30:59.336 [2024-11-28 23:23:02.652145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.652261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.652306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.336 qpair failed and we were unable to recover it. 00:30:59.336 [2024-11-28 23:23:02.652411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.652547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.652573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.336 qpair failed and we were unable to recover it. 00:30:59.336 [2024-11-28 23:23:02.652714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.652876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.652902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.336 qpair failed and we were unable to recover it. 00:30:59.336 [2024-11-28 23:23:02.653000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.653088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.653115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.336 qpair failed and we were unable to recover it. 00:30:59.336 [2024-11-28 23:23:02.653253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.653382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.653415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.336 qpair failed and we were unable to recover it. 00:30:59.336 [2024-11-28 23:23:02.653523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.653611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.653636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.336 qpair failed and we were unable to recover it. 00:30:59.336 [2024-11-28 23:23:02.653793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.653911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.653939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.336 qpair failed and we were unable to recover it. 00:30:59.336 [2024-11-28 23:23:02.654080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.654226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.654253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.336 qpair failed and we were unable to recover it. 00:30:59.336 [2024-11-28 23:23:02.654347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.654434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.654461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.336 qpair failed and we were unable to recover it. 00:30:59.336 [2024-11-28 23:23:02.654552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.654671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.654698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.336 qpair failed and we were unable to recover it. 00:30:59.336 [2024-11-28 23:23:02.654783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.654877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.654903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.336 qpair failed and we were unable to recover it. 00:30:59.336 [2024-11-28 23:23:02.654994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.655135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.655161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.336 qpair failed and we were unable to recover it. 00:30:59.336 [2024-11-28 23:23:02.655293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.655425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.655453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.336 qpair failed and we were unable to recover it. 00:30:59.336 [2024-11-28 23:23:02.655569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.655682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.655708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.336 qpair failed and we were unable to recover it. 00:30:59.336 [2024-11-28 23:23:02.655872] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x53c980 is same with the state(5) to be set 00:30:59.336 [2024-11-28 23:23:02.656047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.656200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.336 [2024-11-28 23:23:02.656250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.337 qpair failed and we were unable to recover it. 00:30:59.337 [2024-11-28 23:23:02.656355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.656481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.656510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.337 qpair failed and we were unable to recover it. 00:30:59.337 [2024-11-28 23:23:02.656632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.656713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.656740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.337 qpair failed and we were unable to recover it. 00:30:59.337 [2024-11-28 23:23:02.656830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.656945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.656972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.337 qpair failed and we were unable to recover it. 00:30:59.337 [2024-11-28 23:23:02.657088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.657237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.657264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.337 qpair failed and we were unable to recover it. 00:30:59.337 [2024-11-28 23:23:02.657383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.657501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.657528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.337 qpair failed and we were unable to recover it. 00:30:59.337 [2024-11-28 23:23:02.657622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.657742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.657770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.337 qpair failed and we were unable to recover it. 00:30:59.337 [2024-11-28 23:23:02.657860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.657958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.657985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.337 qpair failed and we were unable to recover it. 00:30:59.337 [2024-11-28 23:23:02.658074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.658171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.658201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.337 qpair failed and we were unable to recover it. 00:30:59.337 [2024-11-28 23:23:02.658302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.658385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.658419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.337 qpair failed and we were unable to recover it. 00:30:59.337 [2024-11-28 23:23:02.658544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.658641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.658669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.337 qpair failed and we were unable to recover it. 00:30:59.337 [2024-11-28 23:23:02.658752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.658833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.658861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.337 qpair failed and we were unable to recover it. 00:30:59.337 [2024-11-28 23:23:02.658944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.659089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.659117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.337 qpair failed and we were unable to recover it. 00:30:59.337 [2024-11-28 23:23:02.659234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.659380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.659415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.337 qpair failed and we were unable to recover it. 00:30:59.337 [2024-11-28 23:23:02.659566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.659700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.659729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.337 qpair failed and we were unable to recover it. 00:30:59.337 [2024-11-28 23:23:02.659883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.660045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.660072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.337 qpair failed and we were unable to recover it. 00:30:59.337 [2024-11-28 23:23:02.660193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.660304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.660331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.337 qpair failed and we were unable to recover it. 00:30:59.337 [2024-11-28 23:23:02.660437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.660563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.660593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.337 qpair failed and we were unable to recover it. 00:30:59.337 [2024-11-28 23:23:02.660755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.660875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.660905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.337 qpair failed and we were unable to recover it. 00:30:59.337 [2024-11-28 23:23:02.661065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.661179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.661206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.337 qpair failed and we were unable to recover it. 00:30:59.337 [2024-11-28 23:23:02.661336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.661516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.661546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.337 qpair failed and we were unable to recover it. 00:30:59.337 [2024-11-28 23:23:02.661699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.661875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.661920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.337 qpair failed and we were unable to recover it. 00:30:59.337 [2024-11-28 23:23:02.662038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.662182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.662210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.337 qpair failed and we were unable to recover it. 00:30:59.337 [2024-11-28 23:23:02.662330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.662474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.662504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.337 qpair failed and we were unable to recover it. 00:30:59.337 [2024-11-28 23:23:02.662612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.662779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.662825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.337 qpair failed and we were unable to recover it. 00:30:59.337 [2024-11-28 23:23:02.662968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.663065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.663092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.337 qpair failed and we were unable to recover it. 00:30:59.337 [2024-11-28 23:23:02.663242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.663361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.663388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.337 qpair failed and we were unable to recover it. 00:30:59.337 [2024-11-28 23:23:02.663526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.663715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.663759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.337 qpair failed and we were unable to recover it. 00:30:59.337 [2024-11-28 23:23:02.663897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.664032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.664060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.337 qpair failed and we were unable to recover it. 00:30:59.337 [2024-11-28 23:23:02.664182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.664282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.337 [2024-11-28 23:23:02.664308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.338 qpair failed and we were unable to recover it. 00:30:59.338 [2024-11-28 23:23:02.664432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.664517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.664544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.338 qpair failed and we were unable to recover it. 00:30:59.338 [2024-11-28 23:23:02.664654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.664771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.664799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.338 qpair failed and we were unable to recover it. 00:30:59.338 [2024-11-28 23:23:02.664919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.665008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.665036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.338 qpair failed and we were unable to recover it. 00:30:59.338 [2024-11-28 23:23:02.665152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.665274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.665303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.338 qpair failed and we were unable to recover it. 00:30:59.338 [2024-11-28 23:23:02.665428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.665578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.665605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.338 qpair failed and we were unable to recover it. 00:30:59.338 [2024-11-28 23:23:02.665726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.665821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.665848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.338 qpair failed and we were unable to recover it. 00:30:59.338 [2024-11-28 23:23:02.665966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.666079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.666106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.338 qpair failed and we were unable to recover it. 00:30:59.338 [2024-11-28 23:23:02.666255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.666356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.666383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.338 qpair failed and we were unable to recover it. 00:30:59.338 [2024-11-28 23:23:02.666488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.666606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.666634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.338 qpair failed and we were unable to recover it. 00:30:59.338 [2024-11-28 23:23:02.666771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.666914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.666942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.338 qpair failed and we were unable to recover it. 00:30:59.338 [2024-11-28 23:23:02.667067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.667156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.667183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.338 qpair failed and we were unable to recover it. 00:30:59.338 [2024-11-28 23:23:02.667275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.667391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.667424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.338 qpair failed and we were unable to recover it. 00:30:59.338 [2024-11-28 23:23:02.667541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.667657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.667685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.338 qpair failed and we were unable to recover it. 00:30:59.338 [2024-11-28 23:23:02.667778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.667872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.667900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.338 qpair failed and we were unable to recover it. 00:30:59.338 [2024-11-28 23:23:02.668022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.668168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.668195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.338 qpair failed and we were unable to recover it. 00:30:59.338 [2024-11-28 23:23:02.668315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.668412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.668441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.338 qpair failed and we were unable to recover it. 00:30:59.338 [2024-11-28 23:23:02.668585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.668709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.668753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.338 qpair failed and we were unable to recover it. 00:30:59.338 [2024-11-28 23:23:02.668896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.669014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.669042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.338 qpair failed and we were unable to recover it. 00:30:59.338 [2024-11-28 23:23:02.669132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.669275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.669302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.338 qpair failed and we were unable to recover it. 00:30:59.338 [2024-11-28 23:23:02.669423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.669560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.669603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.338 qpair failed and we were unable to recover it. 00:30:59.338 [2024-11-28 23:23:02.669742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.669857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.669885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.338 qpair failed and we were unable to recover it. 00:30:59.338 [2024-11-28 23:23:02.669975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.670120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.670148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.338 qpair failed and we were unable to recover it. 00:30:59.338 [2024-11-28 23:23:02.670266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.670407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.670435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.338 qpair failed and we were unable to recover it. 00:30:59.338 [2024-11-28 23:23:02.670572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.670751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.670796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.338 qpair failed and we were unable to recover it. 00:30:59.338 [2024-11-28 23:23:02.670943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.671066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.671093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.338 qpair failed and we were unable to recover it. 00:30:59.338 [2024-11-28 23:23:02.671237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.338 [2024-11-28 23:23:02.671354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.671382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.339 qpair failed and we were unable to recover it. 00:30:59.339 [2024-11-28 23:23:02.671520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.671674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.671720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.339 qpair failed and we were unable to recover it. 00:30:59.339 [2024-11-28 23:23:02.671867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.672010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.672037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.339 qpair failed and we were unable to recover it. 00:30:59.339 [2024-11-28 23:23:02.672157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.672270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.672297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.339 qpair failed and we were unable to recover it. 00:30:59.339 [2024-11-28 23:23:02.672422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.672528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.672558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.339 qpair failed and we were unable to recover it. 00:30:59.339 [2024-11-28 23:23:02.672698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.672829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.672857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.339 qpair failed and we were unable to recover it. 00:30:59.339 [2024-11-28 23:23:02.672944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.673067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.673094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.339 qpair failed and we were unable to recover it. 00:30:59.339 [2024-11-28 23:23:02.673183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.673300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.673328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.339 qpair failed and we were unable to recover it. 00:30:59.339 [2024-11-28 23:23:02.673446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.673559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.673586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.339 qpair failed and we were unable to recover it. 00:30:59.339 [2024-11-28 23:23:02.673680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.673760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.673802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.339 qpair failed and we were unable to recover it. 00:30:59.339 [2024-11-28 23:23:02.673908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.674037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.674066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.339 qpair failed and we were unable to recover it. 00:30:59.339 [2024-11-28 23:23:02.674163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.674313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.674343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.339 qpair failed and we were unable to recover it. 00:30:59.339 [2024-11-28 23:23:02.674484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.674616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.674642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.339 qpair failed and we were unable to recover it. 00:30:59.339 [2024-11-28 23:23:02.674731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.674875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.674904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.339 qpair failed and we were unable to recover it. 00:30:59.339 [2024-11-28 23:23:02.675065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.675225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.675254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.339 qpair failed and we were unable to recover it. 00:30:59.339 [2024-11-28 23:23:02.675428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.675550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.675577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.339 qpair failed and we were unable to recover it. 00:30:59.339 [2024-11-28 23:23:02.675694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.675832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.675860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.339 qpair failed and we were unable to recover it. 00:30:59.339 [2024-11-28 23:23:02.676010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.676166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.676195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.339 qpair failed and we were unable to recover it. 00:30:59.339 [2024-11-28 23:23:02.676308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.676431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.676458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.339 qpair failed and we were unable to recover it. 00:30:59.339 [2024-11-28 23:23:02.676542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.676655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.676683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.339 qpair failed and we were unable to recover it. 00:30:59.339 [2024-11-28 23:23:02.676783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.676913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.676942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.339 qpair failed and we were unable to recover it. 00:30:59.339 [2024-11-28 23:23:02.677073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.677194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.677223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.339 qpair failed and we were unable to recover it. 00:30:59.339 [2024-11-28 23:23:02.677359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.677526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.677553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.339 qpair failed and we were unable to recover it. 00:30:59.339 [2024-11-28 23:23:02.677639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.677753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.677781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.339 qpair failed and we were unable to recover it. 00:30:59.339 [2024-11-28 23:23:02.677922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.678050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.678080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.339 qpair failed and we were unable to recover it. 00:30:59.339 [2024-11-28 23:23:02.678213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.678334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.678368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.339 qpair failed and we were unable to recover it. 00:30:59.339 [2024-11-28 23:23:02.678513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.678604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.678631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.339 qpair failed and we were unable to recover it. 00:30:59.339 [2024-11-28 23:23:02.678753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.678901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.678932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.339 qpair failed and we were unable to recover it. 00:30:59.339 [2024-11-28 23:23:02.679076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.679205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.679234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.339 qpair failed and we were unable to recover it. 00:30:59.339 [2024-11-28 23:23:02.679364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.679498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.339 [2024-11-28 23:23:02.679526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.339 qpair failed and we were unable to recover it. 00:30:59.340 [2024-11-28 23:23:02.679638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.679776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.679804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.340 qpair failed and we were unable to recover it. 00:30:59.340 [2024-11-28 23:23:02.679936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.680070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.680099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.340 qpair failed and we were unable to recover it. 00:30:59.340 [2024-11-28 23:23:02.680261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.680384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.680422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.340 qpair failed and we were unable to recover it. 00:30:59.340 [2024-11-28 23:23:02.680570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.680697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.680726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.340 qpair failed and we were unable to recover it. 00:30:59.340 [2024-11-28 23:23:02.680850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.680972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.681002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.340 qpair failed and we were unable to recover it. 00:30:59.340 [2024-11-28 23:23:02.681164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.681314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.681344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.340 qpair failed and we were unable to recover it. 00:30:59.340 [2024-11-28 23:23:02.681525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.681624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.681650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.340 qpair failed and we were unable to recover it. 00:30:59.340 [2024-11-28 23:23:02.681768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.681893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.681922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.340 qpair failed and we were unable to recover it. 00:30:59.340 [2024-11-28 23:23:02.682144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.682296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.682325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.340 qpair failed and we were unable to recover it. 00:30:59.340 [2024-11-28 23:23:02.682491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.682610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.682636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.340 qpair failed and we were unable to recover it. 00:30:59.340 [2024-11-28 23:23:02.682775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.682900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.682929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.340 qpair failed and we were unable to recover it. 00:30:59.340 [2024-11-28 23:23:02.683026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.683142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.683171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.340 qpair failed and we were unable to recover it. 00:30:59.340 [2024-11-28 23:23:02.683256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.683374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.683410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.340 qpair failed and we were unable to recover it. 00:30:59.340 [2024-11-28 23:23:02.683575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.683656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.683699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.340 qpair failed and we were unable to recover it. 00:30:59.340 [2024-11-28 23:23:02.683839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.683954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.683982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.340 qpair failed and we were unable to recover it. 00:30:59.340 [2024-11-28 23:23:02.684151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.684289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.684318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.340 qpair failed and we were unable to recover it. 00:30:59.340 [2024-11-28 23:23:02.684494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.684615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.684642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.340 qpair failed and we were unable to recover it. 00:30:59.340 [2024-11-28 23:23:02.684765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.684906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.684932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.340 qpair failed and we were unable to recover it. 00:30:59.340 [2024-11-28 23:23:02.685099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.685221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.685250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.340 qpair failed and we were unable to recover it. 00:30:59.340 [2024-11-28 23:23:02.685369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.685589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.685619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.340 qpair failed and we were unable to recover it. 00:30:59.340 [2024-11-28 23:23:02.685729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.685913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.685956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.340 qpair failed and we were unable to recover it. 00:30:59.340 [2024-11-28 23:23:02.686088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.686213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.686255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.340 qpair failed and we were unable to recover it. 00:30:59.340 [2024-11-28 23:23:02.686442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.686561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.686587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.340 qpair failed and we were unable to recover it. 00:30:59.340 [2024-11-28 23:23:02.686683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.686800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.686827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.340 qpair failed and we were unable to recover it. 00:30:59.340 [2024-11-28 23:23:02.686940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.687071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.687100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.340 qpair failed and we were unable to recover it. 00:30:59.340 [2024-11-28 23:23:02.687197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.687323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.687353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.340 qpair failed and we were unable to recover it. 00:30:59.340 [2024-11-28 23:23:02.687500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.687580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.687608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.340 qpair failed and we were unable to recover it. 00:30:59.340 [2024-11-28 23:23:02.687710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.687841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.687870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.340 qpair failed and we were unable to recover it. 00:30:59.340 [2024-11-28 23:23:02.687992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.688118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.340 [2024-11-28 23:23:02.688147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.340 qpair failed and we were unable to recover it. 00:30:59.341 [2024-11-28 23:23:02.688280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.688404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.688431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.341 qpair failed and we were unable to recover it. 00:30:59.341 [2024-11-28 23:23:02.688524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.688641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.688668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.341 qpair failed and we were unable to recover it. 00:30:59.341 [2024-11-28 23:23:02.688788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.688929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.688959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.341 qpair failed and we were unable to recover it. 00:30:59.341 [2024-11-28 23:23:02.689128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.689251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.689278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.341 qpair failed and we were unable to recover it. 00:30:59.341 [2024-11-28 23:23:02.689412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.689572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.689602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.341 qpair failed and we were unable to recover it. 00:30:59.341 [2024-11-28 23:23:02.689734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.689858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.689887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.341 qpair failed and we were unable to recover it. 00:30:59.341 [2024-11-28 23:23:02.689998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.690107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.690134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.341 qpair failed and we were unable to recover it. 00:30:59.341 [2024-11-28 23:23:02.690220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.690329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.690359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.341 qpair failed and we were unable to recover it. 00:30:59.341 [2024-11-28 23:23:02.690506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.690599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.690626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.341 qpair failed and we were unable to recover it. 00:30:59.341 [2024-11-28 23:23:02.690744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.690888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.690914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.341 qpair failed and we were unable to recover it. 00:30:59.341 [2024-11-28 23:23:02.691071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.691213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.691240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.341 qpair failed and we were unable to recover it. 00:30:59.341 [2024-11-28 23:23:02.691408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.691533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.691562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.341 qpair failed and we were unable to recover it. 00:30:59.341 [2024-11-28 23:23:02.691679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.691789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.691815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.341 qpair failed and we were unable to recover it. 00:30:59.341 [2024-11-28 23:23:02.691976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.692065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.692094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.341 qpair failed and we were unable to recover it. 00:30:59.341 [2024-11-28 23:23:02.692214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.692368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.692404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.341 qpair failed and we were unable to recover it. 00:30:59.341 [2024-11-28 23:23:02.692538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.692659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.692686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.341 qpair failed and we were unable to recover it. 00:30:59.341 [2024-11-28 23:23:02.692796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.692918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.692947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.341 qpair failed and we were unable to recover it. 00:30:59.341 [2024-11-28 23:23:02.693077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.693222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.693253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.341 qpair failed and we were unable to recover it. 00:30:59.341 [2024-11-28 23:23:02.693365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.693497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.693525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.341 qpair failed and we were unable to recover it. 00:30:59.341 [2024-11-28 23:23:02.693699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.693818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.693847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.341 qpair failed and we were unable to recover it. 00:30:59.341 [2024-11-28 23:23:02.693968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.694120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.694149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.341 qpair failed and we were unable to recover it. 00:30:59.341 [2024-11-28 23:23:02.694261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.694448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.694476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.341 qpair failed and we were unable to recover it. 00:30:59.341 [2024-11-28 23:23:02.694591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.694687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.694713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.341 qpair failed and we were unable to recover it. 00:30:59.341 [2024-11-28 23:23:02.694801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.694912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.694942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.341 qpair failed and we were unable to recover it. 00:30:59.341 [2024-11-28 23:23:02.695077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.695199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.695226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.341 qpair failed and we were unable to recover it. 00:30:59.341 [2024-11-28 23:23:02.695347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.695429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.695472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.341 qpair failed and we were unable to recover it. 00:30:59.341 [2024-11-28 23:23:02.695599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.695722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.695751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.341 qpair failed and we were unable to recover it. 00:30:59.341 [2024-11-28 23:23:02.695893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.696035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.696077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.341 qpair failed and we were unable to recover it. 00:30:59.341 [2024-11-28 23:23:02.696216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.696375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.341 [2024-11-28 23:23:02.696410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.342 qpair failed and we were unable to recover it. 00:30:59.342 [2024-11-28 23:23:02.696505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.696616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.696642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.342 qpair failed and we were unable to recover it. 00:30:59.342 [2024-11-28 23:23:02.696769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.696885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.696913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.342 qpair failed and we were unable to recover it. 00:30:59.342 [2024-11-28 23:23:02.697053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.697223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.697250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.342 qpair failed and we were unable to recover it. 00:30:59.342 [2024-11-28 23:23:02.697340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.697448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.697475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.342 qpair failed and we were unable to recover it. 00:30:59.342 [2024-11-28 23:23:02.697562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.697647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.697674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.342 qpair failed and we were unable to recover it. 00:30:59.342 [2024-11-28 23:23:02.697787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.697953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.697982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.342 qpair failed and we were unable to recover it. 00:30:59.342 [2024-11-28 23:23:02.698114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.698247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.698277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.342 qpair failed and we were unable to recover it. 00:30:59.342 [2024-11-28 23:23:02.698416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.698561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.698588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.342 qpair failed and we were unable to recover it. 00:30:59.342 [2024-11-28 23:23:02.698751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.698909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.698951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.342 qpair failed and we were unable to recover it. 00:30:59.342 [2024-11-28 23:23:02.699057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.699218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.699247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.342 qpair failed and we were unable to recover it. 00:30:59.342 [2024-11-28 23:23:02.699385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.699475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.699502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.342 qpair failed and we were unable to recover it. 00:30:59.342 [2024-11-28 23:23:02.699668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.699793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.699822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.342 qpair failed and we were unable to recover it. 00:30:59.342 [2024-11-28 23:23:02.699946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.700041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.700070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.342 qpair failed and we were unable to recover it. 00:30:59.342 [2024-11-28 23:23:02.700203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.700322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.700348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.342 qpair failed and we were unable to recover it. 00:30:59.342 [2024-11-28 23:23:02.700492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.700636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.700662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.342 qpair failed and we were unable to recover it. 00:30:59.342 [2024-11-28 23:23:02.700822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.700945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.700975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.342 qpair failed and we were unable to recover it. 00:30:59.342 [2024-11-28 23:23:02.701144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.701234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.701262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.342 qpair failed and we were unable to recover it. 00:30:59.342 [2024-11-28 23:23:02.701421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.701553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.701582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.342 qpair failed and we were unable to recover it. 00:30:59.342 [2024-11-28 23:23:02.701670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.701825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.701851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.342 qpair failed and we were unable to recover it. 00:30:59.342 [2024-11-28 23:23:02.701970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.702088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.702114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.342 qpair failed and we were unable to recover it. 00:30:59.342 [2024-11-28 23:23:02.702258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.702400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.702430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.342 qpair failed and we were unable to recover it. 00:30:59.342 [2024-11-28 23:23:02.702595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.702740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.702769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.342 qpair failed and we were unable to recover it. 00:30:59.342 [2024-11-28 23:23:02.702905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.703018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.703045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.342 qpair failed and we were unable to recover it. 00:30:59.342 [2024-11-28 23:23:02.703215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.703339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.703368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.342 qpair failed and we were unable to recover it. 00:30:59.342 [2024-11-28 23:23:02.703542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.703625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.703652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.342 qpair failed and we were unable to recover it. 00:30:59.342 [2024-11-28 23:23:02.703798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.703878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.703905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.342 qpair failed and we were unable to recover it. 00:30:59.342 [2024-11-28 23:23:02.704061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.704190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.704221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.342 qpair failed and we were unable to recover it. 00:30:59.342 [2024-11-28 23:23:02.704350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.704442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.704486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.342 qpair failed and we were unable to recover it. 00:30:59.342 [2024-11-28 23:23:02.704567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.704654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.342 [2024-11-28 23:23:02.704680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.343 qpair failed and we were unable to recover it. 00:30:59.343 [2024-11-28 23:23:02.704801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.704898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.704929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.343 qpair failed and we were unable to recover it. 00:30:59.343 [2024-11-28 23:23:02.705046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.705163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.705190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.343 qpair failed and we were unable to recover it. 00:30:59.343 [2024-11-28 23:23:02.705272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.705390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.705429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.343 qpair failed and we were unable to recover it. 00:30:59.343 [2024-11-28 23:23:02.705529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.705657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.705686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.343 qpair failed and we were unable to recover it. 00:30:59.343 [2024-11-28 23:23:02.705807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.705903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.705933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.343 qpair failed and we were unable to recover it. 00:30:59.343 [2024-11-28 23:23:02.706037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.706146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.706173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.343 qpair failed and we were unable to recover it. 00:30:59.343 [2024-11-28 23:23:02.706317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.706476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.706507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.343 qpair failed and we were unable to recover it. 00:30:59.343 [2024-11-28 23:23:02.706629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.706782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.706811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.343 qpair failed and we were unable to recover it. 00:30:59.343 [2024-11-28 23:23:02.706929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.707081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.707108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.343 qpair failed and we were unable to recover it. 00:30:59.343 [2024-11-28 23:23:02.707239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.707328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.707357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.343 qpair failed and we were unable to recover it. 00:30:59.343 [2024-11-28 23:23:02.707505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.707627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.707658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.343 qpair failed and we were unable to recover it. 00:30:59.343 [2024-11-28 23:23:02.707814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.707934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.707961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.343 qpair failed and we were unable to recover it. 00:30:59.343 [2024-11-28 23:23:02.708109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.708231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.708261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.343 qpair failed and we were unable to recover it. 00:30:59.343 [2024-11-28 23:23:02.708381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.708560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.708587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.343 qpair failed and we were unable to recover it. 00:30:59.343 [2024-11-28 23:23:02.708730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.708814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.708840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.343 qpair failed and we were unable to recover it. 00:30:59.343 [2024-11-28 23:23:02.708984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.709067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.709110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.343 qpair failed and we were unable to recover it. 00:30:59.343 [2024-11-28 23:23:02.709207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.709313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.709344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.343 qpair failed and we were unable to recover it. 00:30:59.343 [2024-11-28 23:23:02.709524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.709672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.709698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.343 qpair failed and we were unable to recover it. 00:30:59.343 [2024-11-28 23:23:02.709838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.709967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.709997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.343 qpair failed and we were unable to recover it. 00:30:59.343 [2024-11-28 23:23:02.710156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.710316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.710345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.343 qpair failed and we were unable to recover it. 00:30:59.343 [2024-11-28 23:23:02.710518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.710648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.710674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.343 qpair failed and we were unable to recover it. 00:30:59.343 [2024-11-28 23:23:02.710773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.710884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.710911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.343 qpair failed and we were unable to recover it. 00:30:59.343 [2024-11-28 23:23:02.711044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.711144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.711174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.343 qpair failed and we were unable to recover it. 00:30:59.343 [2024-11-28 23:23:02.711313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.711429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.711456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.343 qpair failed and we were unable to recover it. 00:30:59.343 [2024-11-28 23:23:02.711591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.711687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.711716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.343 qpair failed and we were unable to recover it. 00:30:59.343 [2024-11-28 23:23:02.711835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.711993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.343 [2024-11-28 23:23:02.712023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.343 qpair failed and we were unable to recover it. 00:30:59.344 [2024-11-28 23:23:02.712166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.712291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.712318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.344 qpair failed and we were unable to recover it. 00:30:59.344 [2024-11-28 23:23:02.712471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.712601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.712630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.344 qpair failed and we were unable to recover it. 00:30:59.344 [2024-11-28 23:23:02.712747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.712869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.712898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.344 qpair failed and we were unable to recover it. 00:30:59.344 [2024-11-28 23:23:02.713015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.713101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.713127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.344 qpair failed and we were unable to recover it. 00:30:59.344 [2024-11-28 23:23:02.713287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.713390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.713426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.344 qpair failed and we were unable to recover it. 00:30:59.344 [2024-11-28 23:23:02.713568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.713665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.713694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.344 qpair failed and we were unable to recover it. 00:30:59.344 [2024-11-28 23:23:02.713831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.713927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.713954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.344 qpair failed and we were unable to recover it. 00:30:59.344 [2024-11-28 23:23:02.714119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.714280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.714307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.344 qpair failed and we were unable to recover it. 00:30:59.344 [2024-11-28 23:23:02.714426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.714561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.714591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.344 qpair failed and we were unable to recover it. 00:30:59.344 [2024-11-28 23:23:02.714763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.714884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.714910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.344 qpair failed and we were unable to recover it. 00:30:59.344 [2024-11-28 23:23:02.714988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.715095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.715122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.344 qpair failed and we were unable to recover it. 00:30:59.344 [2024-11-28 23:23:02.715215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.715310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.715337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.344 qpair failed and we were unable to recover it. 00:30:59.344 [2024-11-28 23:23:02.715426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.715569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.715595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.344 qpair failed and we were unable to recover it. 00:30:59.344 [2024-11-28 23:23:02.715784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.715926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.715952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.344 qpair failed and we were unable to recover it. 00:30:59.344 [2024-11-28 23:23:02.716068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.716215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.716242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.344 qpair failed and we were unable to recover it. 00:30:59.344 [2024-11-28 23:23:02.716360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.716527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.716570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.344 qpair failed and we were unable to recover it. 00:30:59.344 [2024-11-28 23:23:02.716700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.716837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.716867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.344 qpair failed and we were unable to recover it. 00:30:59.344 [2024-11-28 23:23:02.716987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.717114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.717143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.344 qpair failed and we were unable to recover it. 00:30:59.344 [2024-11-28 23:23:02.717286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.717415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.717443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.344 qpair failed and we were unable to recover it. 00:30:59.344 [2024-11-28 23:23:02.717536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.717728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.717755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.344 qpair failed and we were unable to recover it. 00:30:59.344 [2024-11-28 23:23:02.717887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.718044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.718073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.344 qpair failed and we were unable to recover it. 00:30:59.344 [2024-11-28 23:23:02.718180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.718319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.718348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.344 qpair failed and we were unable to recover it. 00:30:59.344 [2024-11-28 23:23:02.718518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.718615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.718643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.344 qpair failed and we were unable to recover it. 00:30:59.344 [2024-11-28 23:23:02.718777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.718906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.718934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.344 qpair failed and we were unable to recover it. 00:30:59.344 [2024-11-28 23:23:02.719078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.719174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.719200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.344 qpair failed and we were unable to recover it. 00:30:59.344 [2024-11-28 23:23:02.719300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.719388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.719426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.344 qpair failed and we were unable to recover it. 00:30:59.344 [2024-11-28 23:23:02.719549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.719635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.719679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.344 qpair failed and we were unable to recover it. 00:30:59.344 [2024-11-28 23:23:02.719844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.719986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.720013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.344 qpair failed and we were unable to recover it. 00:30:59.344 [2024-11-28 23:23:02.720165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.720282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.720310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.344 qpair failed and we were unable to recover it. 00:30:59.344 [2024-11-28 23:23:02.720443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.344 [2024-11-28 23:23:02.720601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.720631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.345 qpair failed and we were unable to recover it. 00:30:59.345 [2024-11-28 23:23:02.720768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.720909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.720935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.345 qpair failed and we were unable to recover it. 00:30:59.345 [2024-11-28 23:23:02.721101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.721245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.721271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.345 qpair failed and we were unable to recover it. 00:30:59.345 [2024-11-28 23:23:02.721430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.721558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.721588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.345 qpair failed and we were unable to recover it. 00:30:59.345 [2024-11-28 23:23:02.721725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.721834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.721860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.345 qpair failed and we were unable to recover it. 00:30:59.345 [2024-11-28 23:23:02.721980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.722138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.722167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.345 qpair failed and we were unable to recover it. 00:30:59.345 [2024-11-28 23:23:02.722287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.722443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.722474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.345 qpair failed and we were unable to recover it. 00:30:59.345 [2024-11-28 23:23:02.722617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.722700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.722728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.345 qpair failed and we were unable to recover it. 00:30:59.345 [2024-11-28 23:23:02.722856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.722988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.723017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.345 qpair failed and we were unable to recover it. 00:30:59.345 [2024-11-28 23:23:02.723138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.723255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.723284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.345 qpair failed and we were unable to recover it. 00:30:59.345 [2024-11-28 23:23:02.723397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.723520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.723547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.345 qpair failed and we were unable to recover it. 00:30:59.345 [2024-11-28 23:23:02.723673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.723760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.723787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.345 qpair failed and we were unable to recover it. 00:30:59.345 [2024-11-28 23:23:02.723898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.724021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.724050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.345 qpair failed and we were unable to recover it. 00:30:59.345 [2024-11-28 23:23:02.724158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.724241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.724268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.345 qpair failed and we were unable to recover it. 00:30:59.345 [2024-11-28 23:23:02.724411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.724535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.724564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.345 qpair failed and we were unable to recover it. 00:30:59.345 [2024-11-28 23:23:02.724716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.724902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.724928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.345 qpair failed and we were unable to recover it. 00:30:59.345 [2024-11-28 23:23:02.725039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.725154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.725181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.345 qpair failed and we were unable to recover it. 00:30:59.345 [2024-11-28 23:23:02.725291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.725448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.725478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.345 qpair failed and we were unable to recover it. 00:30:59.345 [2024-11-28 23:23:02.725635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.725727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.725772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.345 qpair failed and we were unable to recover it. 00:30:59.345 [2024-11-28 23:23:02.725917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.726032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.726058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.345 qpair failed and we were unable to recover it. 00:30:59.345 [2024-11-28 23:23:02.726168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.726267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.726296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.345 qpair failed and we were unable to recover it. 00:30:59.345 [2024-11-28 23:23:02.726398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.726559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.726585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.345 qpair failed and we were unable to recover it. 00:30:59.345 [2024-11-28 23:23:02.726707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.726825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.726851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.345 qpair failed and we were unable to recover it. 00:30:59.345 [2024-11-28 23:23:02.726974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.727141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.727170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.345 qpair failed and we were unable to recover it. 00:30:59.345 [2024-11-28 23:23:02.727308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.727475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.727505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.345 qpair failed and we were unable to recover it. 00:30:59.345 [2024-11-28 23:23:02.727648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.727786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.727813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.345 qpair failed and we were unable to recover it. 00:30:59.345 [2024-11-28 23:23:02.727943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.728103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.728131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.345 qpair failed and we were unable to recover it. 00:30:59.345 [2024-11-28 23:23:02.728221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.728346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.728376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.345 qpair failed and we were unable to recover it. 00:30:59.345 [2024-11-28 23:23:02.728525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.728601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.728629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.345 qpair failed and we were unable to recover it. 00:30:59.345 [2024-11-28 23:23:02.728769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.345 [2024-11-28 23:23:02.728910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.728939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.346 qpair failed and we were unable to recover it. 00:30:59.346 [2024-11-28 23:23:02.729092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.729189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.729218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.346 qpair failed and we were unable to recover it. 00:30:59.346 [2024-11-28 23:23:02.729348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.729439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.729467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.346 qpair failed and we were unable to recover it. 00:30:59.346 [2024-11-28 23:23:02.729627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.729783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.729812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.346 qpair failed and we were unable to recover it. 00:30:59.346 [2024-11-28 23:23:02.729978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.730095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.730132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.346 qpair failed and we were unable to recover it. 00:30:59.346 [2024-11-28 23:23:02.730235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.730351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.730379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.346 qpair failed and we were unable to recover it. 00:30:59.346 [2024-11-28 23:23:02.730553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.730747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.730806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.346 qpair failed and we were unable to recover it. 00:30:59.346 [2024-11-28 23:23:02.730936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.731023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.731053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.346 qpair failed and we were unable to recover it. 00:30:59.346 [2024-11-28 23:23:02.731195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.731348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.731375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.346 qpair failed and we were unable to recover it. 00:30:59.346 [2024-11-28 23:23:02.731524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.731653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.731682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.346 qpair failed and we were unable to recover it. 00:30:59.346 [2024-11-28 23:23:02.731773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.731907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.731937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.346 qpair failed and we were unable to recover it. 00:30:59.346 [2024-11-28 23:23:02.732075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.732193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.732223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.346 qpair failed and we were unable to recover it. 00:30:59.346 [2024-11-28 23:23:02.732332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.732468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.732498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.346 qpair failed and we were unable to recover it. 00:30:59.346 [2024-11-28 23:23:02.732638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.732770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.732799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.346 qpair failed and we were unable to recover it. 00:30:59.346 [2024-11-28 23:23:02.732939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.733049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.733075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.346 qpair failed and we were unable to recover it. 00:30:59.346 [2024-11-28 23:23:02.733191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.733329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.733355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.346 qpair failed and we were unable to recover it. 00:30:59.346 [2024-11-28 23:23:02.733506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.733617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.733644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.346 qpair failed and we were unable to recover it. 00:30:59.346 [2024-11-28 23:23:02.733740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.733878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.733904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.346 qpair failed and we were unable to recover it. 00:30:59.346 [2024-11-28 23:23:02.734019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.734133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.734164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.346 qpair failed and we were unable to recover it. 00:30:59.346 [2024-11-28 23:23:02.734271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.734401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.734431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.346 qpair failed and we were unable to recover it. 00:30:59.346 [2024-11-28 23:23:02.734537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.734647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.734674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.346 qpair failed and we were unable to recover it. 00:30:59.346 [2024-11-28 23:23:02.734779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.734940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.734966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.346 qpair failed and we were unable to recover it. 00:30:59.346 [2024-11-28 23:23:02.735043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.735186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.735215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.346 qpair failed and we were unable to recover it. 00:30:59.346 [2024-11-28 23:23:02.735316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.735464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.735491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.346 qpair failed and we were unable to recover it. 00:30:59.346 [2024-11-28 23:23:02.735623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.735754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.735783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.346 qpair failed and we were unable to recover it. 00:30:59.346 [2024-11-28 23:23:02.735920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.736060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.736090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.346 qpair failed and we were unable to recover it. 00:30:59.346 [2024-11-28 23:23:02.736221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.736369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.736419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.346 qpair failed and we were unable to recover it. 00:30:59.346 [2024-11-28 23:23:02.736549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.736677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.736706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.346 qpair failed and we were unable to recover it. 00:30:59.346 [2024-11-28 23:23:02.736801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.736923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.736952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.346 qpair failed and we were unable to recover it. 00:30:59.346 [2024-11-28 23:23:02.737069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.737191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.346 [2024-11-28 23:23:02.737221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.346 qpair failed and we were unable to recover it. 00:30:59.347 [2024-11-28 23:23:02.737325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.737453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.737484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.347 qpair failed and we were unable to recover it. 00:30:59.347 [2024-11-28 23:23:02.737623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.737725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.737755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.347 qpair failed and we were unable to recover it. 00:30:59.347 [2024-11-28 23:23:02.737853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.737948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.737975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.347 qpair failed and we were unable to recover it. 00:30:59.347 [2024-11-28 23:23:02.738085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.738185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.738229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.347 qpair failed and we were unable to recover it. 00:30:59.347 [2024-11-28 23:23:02.738315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.738440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.738472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.347 qpair failed and we were unable to recover it. 00:30:59.347 [2024-11-28 23:23:02.738611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.738752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.738779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.347 qpair failed and we were unable to recover it. 00:30:59.347 [2024-11-28 23:23:02.738888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.738992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.739021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.347 qpair failed and we were unable to recover it. 00:30:59.347 [2024-11-28 23:23:02.739144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.739273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.739302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.347 qpair failed and we were unable to recover it. 00:30:59.347 [2024-11-28 23:23:02.739442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.739531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.739557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.347 qpair failed and we were unable to recover it. 00:30:59.347 [2024-11-28 23:23:02.739684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.739765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.739792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.347 qpair failed and we were unable to recover it. 00:30:59.347 [2024-11-28 23:23:02.739880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.739998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.740024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.347 qpair failed and we were unable to recover it. 00:30:59.347 [2024-11-28 23:23:02.740113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.740209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.740237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.347 qpair failed and we were unable to recover it. 00:30:59.347 [2024-11-28 23:23:02.740328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.740443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.740471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.347 qpair failed and we were unable to recover it. 00:30:59.347 [2024-11-28 23:23:02.740557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.740651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.740677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.347 qpair failed and we were unable to recover it. 00:30:59.347 [2024-11-28 23:23:02.740795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.740879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.740905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.347 qpair failed and we were unable to recover it. 00:30:59.347 [2024-11-28 23:23:02.741021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.741145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.741188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.347 qpair failed and we were unable to recover it. 00:30:59.347 [2024-11-28 23:23:02.741324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.741479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.741509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.347 qpair failed and we were unable to recover it. 00:30:59.347 [2024-11-28 23:23:02.741619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.741730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.741757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.347 qpair failed and we were unable to recover it. 00:30:59.347 [2024-11-28 23:23:02.741873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.741961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.741988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.347 qpair failed and we were unable to recover it. 00:30:59.347 [2024-11-28 23:23:02.742078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.742224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.742251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.347 qpair failed and we were unable to recover it. 00:30:59.347 [2024-11-28 23:23:02.742401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.742493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.742521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.347 qpair failed and we were unable to recover it. 00:30:59.347 [2024-11-28 23:23:02.742610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.742750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.742777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.347 qpair failed and we were unable to recover it. 00:30:59.347 [2024-11-28 23:23:02.742893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.743017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.743046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.347 qpair failed and we were unable to recover it. 00:30:59.347 [2024-11-28 23:23:02.743174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.743323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.743349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.347 qpair failed and we were unable to recover it. 00:30:59.347 [2024-11-28 23:23:02.743440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.743525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.743552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.347 qpair failed and we were unable to recover it. 00:30:59.347 [2024-11-28 23:23:02.743656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.743742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.347 [2024-11-28 23:23:02.743786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.347 qpair failed and we were unable to recover it. 00:30:59.348 [2024-11-28 23:23:02.743908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.744027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.744053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.348 qpair failed and we were unable to recover it. 00:30:59.348 [2024-11-28 23:23:02.744194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.744290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.744333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.348 qpair failed and we were unable to recover it. 00:30:59.348 [2024-11-28 23:23:02.744428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.744571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.744599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.348 qpair failed and we were unable to recover it. 00:30:59.348 [2024-11-28 23:23:02.744687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.744771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.744802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.348 qpair failed and we were unable to recover it. 00:30:59.348 [2024-11-28 23:23:02.744891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.745054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.745083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.348 qpair failed and we were unable to recover it. 00:30:59.348 [2024-11-28 23:23:02.745209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.745340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.745367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.348 qpair failed and we were unable to recover it. 00:30:59.348 [2024-11-28 23:23:02.745515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.745659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.745686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.348 qpair failed and we were unable to recover it. 00:30:59.348 [2024-11-28 23:23:02.745803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.745955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.745982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.348 qpair failed and we were unable to recover it. 00:30:59.348 [2024-11-28 23:23:02.746098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.746190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.746217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.348 qpair failed and we were unable to recover it. 00:30:59.348 [2024-11-28 23:23:02.746306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.746426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.746454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.348 qpair failed and we were unable to recover it. 00:30:59.348 [2024-11-28 23:23:02.746574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.746654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.746680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.348 qpair failed and we were unable to recover it. 00:30:59.348 [2024-11-28 23:23:02.746770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.746905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.746934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.348 qpair failed and we were unable to recover it. 00:30:59.348 [2024-11-28 23:23:02.747071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.747167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.747194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.348 qpair failed and we were unable to recover it. 00:30:59.348 [2024-11-28 23:23:02.747316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.747460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.747493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.348 qpair failed and we were unable to recover it. 00:30:59.348 [2024-11-28 23:23:02.747612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.747705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.747731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.348 qpair failed and we were unable to recover it. 00:30:59.348 [2024-11-28 23:23:02.747843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.747991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.748018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.348 qpair failed and we were unable to recover it. 00:30:59.348 [2024-11-28 23:23:02.748176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.748294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.748321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.348 qpair failed and we were unable to recover it. 00:30:59.348 [2024-11-28 23:23:02.748433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.748576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.748603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.348 qpair failed and we were unable to recover it. 00:30:59.348 [2024-11-28 23:23:02.748721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.748836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.748863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.348 qpair failed and we were unable to recover it. 00:30:59.348 [2024-11-28 23:23:02.748978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.749083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.749112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.348 qpair failed and we were unable to recover it. 00:30:59.348 [2024-11-28 23:23:02.749219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.749362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.749388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.348 qpair failed and we were unable to recover it. 00:30:59.348 [2024-11-28 23:23:02.749482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.749603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.749631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.348 qpair failed and we were unable to recover it. 00:30:59.348 [2024-11-28 23:23:02.749714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.749808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.749836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.348 qpair failed and we were unable to recover it. 00:30:59.348 [2024-11-28 23:23:02.749950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.750040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.750067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.348 qpair failed and we were unable to recover it. 00:30:59.348 [2024-11-28 23:23:02.750186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.750325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.750352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.348 qpair failed and we were unable to recover it. 00:30:59.348 [2024-11-28 23:23:02.750481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.750564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.750590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.348 qpair failed and we were unable to recover it. 00:30:59.348 [2024-11-28 23:23:02.750711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.750823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.750850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.348 qpair failed and we were unable to recover it. 00:30:59.348 [2024-11-28 23:23:02.750928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.751041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.751067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.348 qpair failed and we were unable to recover it. 00:30:59.348 [2024-11-28 23:23:02.751153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.751233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.348 [2024-11-28 23:23:02.751259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.348 qpair failed and we were unable to recover it. 00:30:59.348 [2024-11-28 23:23:02.751381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.751483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.751511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.349 qpair failed and we were unable to recover it. 00:30:59.349 [2024-11-28 23:23:02.751626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.751738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.751765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.349 qpair failed and we were unable to recover it. 00:30:59.349 [2024-11-28 23:23:02.751939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.752078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.752105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.349 qpair failed and we were unable to recover it. 00:30:59.349 [2024-11-28 23:23:02.752219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.752307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.752333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.349 qpair failed and we were unable to recover it. 00:30:59.349 [2024-11-28 23:23:02.752422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.752513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.752540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.349 qpair failed and we were unable to recover it. 00:30:59.349 [2024-11-28 23:23:02.752661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.752747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.752774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.349 qpair failed and we were unable to recover it. 00:30:59.349 [2024-11-28 23:23:02.752864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.752997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.753028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.349 qpair failed and we were unable to recover it. 00:30:59.349 [2024-11-28 23:23:02.753150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.753239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.753266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.349 qpair failed and we were unable to recover it. 00:30:59.349 [2024-11-28 23:23:02.753427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.753542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.753571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.349 qpair failed and we were unable to recover it. 00:30:59.349 [2024-11-28 23:23:02.753696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.753815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.753842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.349 qpair failed and we were unable to recover it. 00:30:59.349 [2024-11-28 23:23:02.753963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.754112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.754139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.349 qpair failed and we were unable to recover it. 00:30:59.349 [2024-11-28 23:23:02.754238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.754375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.754409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.349 qpair failed and we were unable to recover it. 00:30:59.349 [2024-11-28 23:23:02.754529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.754639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.754666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.349 qpair failed and we were unable to recover it. 00:30:59.349 [2024-11-28 23:23:02.754758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.754844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.754872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.349 qpair failed and we were unable to recover it. 00:30:59.349 [2024-11-28 23:23:02.755018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.755125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.755170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.349 qpair failed and we were unable to recover it. 00:30:59.349 [2024-11-28 23:23:02.755267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.755361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.755391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.349 qpair failed and we were unable to recover it. 00:30:59.349 [2024-11-28 23:23:02.755541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.755660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.755686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.349 qpair failed and we were unable to recover it. 00:30:59.349 [2024-11-28 23:23:02.755831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.755920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.755946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.349 qpair failed and we were unable to recover it. 00:30:59.349 [2024-11-28 23:23:02.756054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.756209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.756239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.349 qpair failed and we were unable to recover it. 00:30:59.349 [2024-11-28 23:23:02.756348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.756456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.756484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.349 qpair failed and we were unable to recover it. 00:30:59.349 [2024-11-28 23:23:02.756570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.756687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.756713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.349 qpair failed and we were unable to recover it. 00:30:59.349 [2024-11-28 23:23:02.756869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.756956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.756983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.349 qpair failed and we were unable to recover it. 00:30:59.349 [2024-11-28 23:23:02.757092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.757171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.757197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.349 qpair failed and we were unable to recover it. 00:30:59.349 [2024-11-28 23:23:02.757280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.757454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.757482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.349 qpair failed and we were unable to recover it. 00:30:59.349 [2024-11-28 23:23:02.757573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.757689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.757714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.349 qpair failed and we were unable to recover it. 00:30:59.349 [2024-11-28 23:23:02.757815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.757925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.757955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.349 qpair failed and we were unable to recover it. 00:30:59.349 [2024-11-28 23:23:02.758130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.758258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.758284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.349 qpair failed and we were unable to recover it. 00:30:59.349 [2024-11-28 23:23:02.758401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.758505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.758532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.349 qpair failed and we were unable to recover it. 00:30:59.349 [2024-11-28 23:23:02.758648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.758732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.349 [2024-11-28 23:23:02.758760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.349 qpair failed and we were unable to recover it. 00:30:59.349 [2024-11-28 23:23:02.758840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.761484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.761513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.350 qpair failed and we were unable to recover it. 00:30:59.350 [2024-11-28 23:23:02.761642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.761724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.761749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.350 qpair failed and we were unable to recover it. 00:30:59.350 [2024-11-28 23:23:02.761868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.761961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.761987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.350 qpair failed and we were unable to recover it. 00:30:59.350 [2024-11-28 23:23:02.762080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.762157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.762184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.350 qpair failed and we were unable to recover it. 00:30:59.350 [2024-11-28 23:23:02.762328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.762418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.762445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.350 qpair failed and we were unable to recover it. 00:30:59.350 [2024-11-28 23:23:02.762539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.762652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.762678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.350 qpair failed and we were unable to recover it. 00:30:59.350 [2024-11-28 23:23:02.762790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.762934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.762963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.350 qpair failed and we were unable to recover it. 00:30:59.350 [2024-11-28 23:23:02.763069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.763185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.763212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.350 qpair failed and we were unable to recover it. 00:30:59.350 [2024-11-28 23:23:02.763324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.763435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.763463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.350 qpair failed and we were unable to recover it. 00:30:59.350 [2024-11-28 23:23:02.763573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.763659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.763686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.350 qpair failed and we were unable to recover it. 00:30:59.350 [2024-11-28 23:23:02.763774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.763882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.763908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.350 qpair failed and we were unable to recover it. 00:30:59.350 [2024-11-28 23:23:02.764057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.764146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.764172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.350 qpair failed and we were unable to recover it. 00:30:59.350 [2024-11-28 23:23:02.764266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.764377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.764411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.350 qpair failed and we were unable to recover it. 00:30:59.350 [2024-11-28 23:23:02.764490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.764571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.764596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.350 qpair failed and we were unable to recover it. 00:30:59.350 [2024-11-28 23:23:02.764785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.764893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.764920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.350 qpair failed and we were unable to recover it. 00:30:59.350 [2024-11-28 23:23:02.765008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.765118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.765145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.350 qpair failed and we were unable to recover it. 00:30:59.350 [2024-11-28 23:23:02.765259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.765346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.765373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.350 qpair failed and we were unable to recover it. 00:30:59.350 [2024-11-28 23:23:02.765516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.765604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.765631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.350 qpair failed and we were unable to recover it. 00:30:59.350 [2024-11-28 23:23:02.765716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.765820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.765849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.350 qpair failed and we were unable to recover it. 00:30:59.350 [2024-11-28 23:23:02.765995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.766088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.766115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.350 qpair failed and we were unable to recover it. 00:30:59.350 [2024-11-28 23:23:02.766203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.766316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.766342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.350 qpair failed and we were unable to recover it. 00:30:59.350 [2024-11-28 23:23:02.766454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.766586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.766615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.350 qpair failed and we were unable to recover it. 00:30:59.350 [2024-11-28 23:23:02.766711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.766810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.766839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.350 qpair failed and we were unable to recover it. 00:30:59.350 [2024-11-28 23:23:02.766970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.767083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.767110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.350 qpair failed and we were unable to recover it. 00:30:59.350 [2024-11-28 23:23:02.767198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.767307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.767334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.350 qpair failed and we were unable to recover it. 00:30:59.350 [2024-11-28 23:23:02.767434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.767527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.767554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.350 qpair failed and we were unable to recover it. 00:30:59.350 [2024-11-28 23:23:02.767668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.767813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.767839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.350 qpair failed and we were unable to recover it. 00:30:59.350 [2024-11-28 23:23:02.767939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.768056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.768083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.350 qpair failed and we were unable to recover it. 00:30:59.350 [2024-11-28 23:23:02.768180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.768295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.768322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.350 qpair failed and we were unable to recover it. 00:30:59.350 [2024-11-28 23:23:02.768408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.350 [2024-11-28 23:23:02.768499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.768525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.351 qpair failed and we were unable to recover it. 00:30:59.351 [2024-11-28 23:23:02.768651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.768746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.768776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.351 qpair failed and we were unable to recover it. 00:30:59.351 [2024-11-28 23:23:02.768889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.769003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.769030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.351 qpair failed and we were unable to recover it. 00:30:59.351 [2024-11-28 23:23:02.769124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.769237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.769263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.351 qpair failed and we were unable to recover it. 00:30:59.351 [2024-11-28 23:23:02.769424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.769519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.769550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.351 qpair failed and we were unable to recover it. 00:30:59.351 [2024-11-28 23:23:02.769714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.769854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.769881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.351 qpair failed and we were unable to recover it. 00:30:59.351 [2024-11-28 23:23:02.769999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.770115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.770141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.351 qpair failed and we were unable to recover it. 00:30:59.351 [2024-11-28 23:23:02.770302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.770448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.770478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.351 qpair failed and we were unable to recover it. 00:30:59.351 [2024-11-28 23:23:02.770630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.770721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.770751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.351 qpair failed and we were unable to recover it. 00:30:59.351 [2024-11-28 23:23:02.770917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.771040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.771066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.351 qpair failed and we were unable to recover it. 00:30:59.351 [2024-11-28 23:23:02.771186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.771278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.771305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.351 qpair failed and we were unable to recover it. 00:30:59.351 [2024-11-28 23:23:02.771431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.771550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.771578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.351 qpair failed and we were unable to recover it. 00:30:59.351 [2024-11-28 23:23:02.771697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.771782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.771809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.351 qpair failed and we were unable to recover it. 00:30:59.351 [2024-11-28 23:23:02.771927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.772046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.772072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.351 qpair failed and we were unable to recover it. 00:30:59.351 [2024-11-28 23:23:02.772187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.772302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.772329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.351 qpair failed and we were unable to recover it. 00:30:59.351 [2024-11-28 23:23:02.772407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.772524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.772550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.351 qpair failed and we were unable to recover it. 00:30:59.351 [2024-11-28 23:23:02.772640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.772751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.772777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.351 qpair failed and we were unable to recover it. 00:30:59.351 [2024-11-28 23:23:02.772888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.773001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.773027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.351 qpair failed and we were unable to recover it. 00:30:59.351 [2024-11-28 23:23:02.773119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.773219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.773251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.351 qpair failed and we were unable to recover it. 00:30:59.351 [2024-11-28 23:23:02.773374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.773512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.773539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.351 qpair failed and we were unable to recover it. 00:30:59.351 [2024-11-28 23:23:02.773659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.773768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.773795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.351 qpair failed and we were unable to recover it. 00:30:59.351 [2024-11-28 23:23:02.773915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.773999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.774027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.351 qpair failed and we were unable to recover it. 00:30:59.351 [2024-11-28 23:23:02.774148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.774284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.774313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.351 qpair failed and we were unable to recover it. 00:30:59.351 [2024-11-28 23:23:02.774416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.774536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.774565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.351 qpair failed and we were unable to recover it. 00:30:59.351 [2024-11-28 23:23:02.774679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.774766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.774793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.351 qpair failed and we were unable to recover it. 00:30:59.351 [2024-11-28 23:23:02.774883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.774973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.774999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.351 qpair failed and we were unable to recover it. 00:30:59.351 [2024-11-28 23:23:02.775081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.775247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.775276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.351 qpair failed and we were unable to recover it. 00:30:59.351 [2024-11-28 23:23:02.775415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.775539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.775566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.351 qpair failed and we were unable to recover it. 00:30:59.351 [2024-11-28 23:23:02.775689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.775811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.351 [2024-11-28 23:23:02.775838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.351 qpair failed and we were unable to recover it. 00:30:59.351 [2024-11-28 23:23:02.775962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.776103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.776132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.352 qpair failed and we were unable to recover it. 00:30:59.352 [2024-11-28 23:23:02.776295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.776407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.776434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.352 qpair failed and we were unable to recover it. 00:30:59.352 [2024-11-28 23:23:02.776579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.776671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.776700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.352 qpair failed and we were unable to recover it. 00:30:59.352 [2024-11-28 23:23:02.776804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.776923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.776952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.352 qpair failed and we were unable to recover it. 00:30:59.352 [2024-11-28 23:23:02.777113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.777258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.777284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.352 qpair failed and we were unable to recover it. 00:30:59.352 [2024-11-28 23:23:02.777415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.777539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.777566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.352 qpair failed and we were unable to recover it. 00:30:59.352 [2024-11-28 23:23:02.777679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.777810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.777840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.352 qpair failed and we were unable to recover it. 00:30:59.352 [2024-11-28 23:23:02.777937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.778046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.778073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.352 qpair failed and we were unable to recover it. 00:30:59.352 [2024-11-28 23:23:02.778220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.778334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.778360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.352 qpair failed and we were unable to recover it. 00:30:59.352 [2024-11-28 23:23:02.778489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.778569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.778595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.352 qpair failed and we were unable to recover it. 00:30:59.352 [2024-11-28 23:23:02.778724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.778813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.778840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.352 qpair failed and we were unable to recover it. 00:30:59.352 [2024-11-28 23:23:02.778935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.779025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.779052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.352 qpair failed and we were unable to recover it. 00:30:59.352 [2024-11-28 23:23:02.779152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.779234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.779259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.352 qpair failed and we were unable to recover it. 00:30:59.352 [2024-11-28 23:23:02.779415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.779558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.779584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.352 qpair failed and we were unable to recover it. 00:30:59.352 [2024-11-28 23:23:02.779737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.779868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.779910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.352 qpair failed and we were unable to recover it. 00:30:59.352 [2024-11-28 23:23:02.780029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.780149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.780175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.352 qpair failed and we were unable to recover it. 00:30:59.352 [2024-11-28 23:23:02.780297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.780413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.780441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.352 qpair failed and we were unable to recover it. 00:30:59.352 [2024-11-28 23:23:02.780581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.780701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.780730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.352 qpair failed and we were unable to recover it. 00:30:59.352 [2024-11-28 23:23:02.780849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.780967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.780994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.352 qpair failed and we were unable to recover it. 00:30:59.352 [2024-11-28 23:23:02.781144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.781255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.781282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.352 qpair failed and we were unable to recover it. 00:30:59.352 [2024-11-28 23:23:02.781407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.781503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.781531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.352 qpair failed and we were unable to recover it. 00:30:59.352 [2024-11-28 23:23:02.781646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.781810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.781840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.352 qpair failed and we were unable to recover it. 00:30:59.352 [2024-11-28 23:23:02.781973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.782091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.782118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.352 qpair failed and we were unable to recover it. 00:30:59.352 [2024-11-28 23:23:02.782223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.782315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.782344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.352 qpair failed and we were unable to recover it. 00:30:59.352 [2024-11-28 23:23:02.782496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.782581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.782607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.352 qpair failed and we were unable to recover it. 00:30:59.352 [2024-11-28 23:23:02.782725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.782837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.352 [2024-11-28 23:23:02.782863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.352 qpair failed and we were unable to recover it. 00:30:59.352 [2024-11-28 23:23:02.782984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.783118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.783147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.353 qpair failed and we were unable to recover it. 00:30:59.353 [2024-11-28 23:23:02.783253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.783379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.783418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.353 qpair failed and we were unable to recover it. 00:30:59.353 [2024-11-28 23:23:02.783563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.783654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.783680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.353 qpair failed and we were unable to recover it. 00:30:59.353 [2024-11-28 23:23:02.783797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.783921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.783947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.353 qpair failed and we were unable to recover it. 00:30:59.353 [2024-11-28 23:23:02.784032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.784126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.784174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.353 qpair failed and we were unable to recover it. 00:30:59.353 [2024-11-28 23:23:02.784333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.784473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.784500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.353 qpair failed and we were unable to recover it. 00:30:59.353 [2024-11-28 23:23:02.784585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.784682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.784709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.353 qpair failed and we were unable to recover it. 00:30:59.353 [2024-11-28 23:23:02.784797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.784916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.784943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.353 qpair failed and we were unable to recover it. 00:30:59.353 [2024-11-28 23:23:02.785059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.785177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.785203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.353 qpair failed and we were unable to recover it. 00:30:59.353 [2024-11-28 23:23:02.785363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.785464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.785491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.353 qpair failed and we were unable to recover it. 00:30:59.353 [2024-11-28 23:23:02.785611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.785705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.785732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.353 qpair failed and we were unable to recover it. 00:30:59.353 [2024-11-28 23:23:02.785851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.785943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.785971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.353 qpair failed and we were unable to recover it. 00:30:59.353 [2024-11-28 23:23:02.786101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.786264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.786290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.353 qpair failed and we were unable to recover it. 00:30:59.353 [2024-11-28 23:23:02.786418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.786557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.786583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.353 qpair failed and we were unable to recover it. 00:30:59.353 [2024-11-28 23:23:02.786675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.786760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.786790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.353 qpair failed and we were unable to recover it. 00:30:59.353 [2024-11-28 23:23:02.786905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.786984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.787025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.353 qpair failed and we were unable to recover it. 00:30:59.353 [2024-11-28 23:23:02.787157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.787318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.787345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.353 qpair failed and we were unable to recover it. 00:30:59.353 [2024-11-28 23:23:02.787487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.787588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.787615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.353 qpair failed and we were unable to recover it. 00:30:59.353 [2024-11-28 23:23:02.787706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.787825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.787851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.353 qpair failed and we were unable to recover it. 00:30:59.353 [2024-11-28 23:23:02.787947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.788075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.788102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.353 qpair failed and we were unable to recover it. 00:30:59.353 [2024-11-28 23:23:02.788192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.788300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.788326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.353 qpair failed and we were unable to recover it. 00:30:59.353 [2024-11-28 23:23:02.788460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.788613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.788642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.353 qpair failed and we were unable to recover it. 00:30:59.353 [2024-11-28 23:23:02.788773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.788947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.788974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.353 qpair failed and we were unable to recover it. 00:30:59.353 [2024-11-28 23:23:02.789102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.789233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.789260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.353 qpair failed and we were unable to recover it. 00:30:59.353 [2024-11-28 23:23:02.789355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.789504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.789535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.353 qpair failed and we were unable to recover it. 00:30:59.353 [2024-11-28 23:23:02.789676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.789800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.789826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.353 qpair failed and we were unable to recover it. 00:30:59.353 [2024-11-28 23:23:02.789939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.790056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.790082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.353 qpair failed and we were unable to recover it. 00:30:59.353 [2024-11-28 23:23:02.790202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.790293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.790319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.353 qpair failed and we were unable to recover it. 00:30:59.353 [2024-11-28 23:23:02.790434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.790530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.790556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.353 qpair failed and we were unable to recover it. 00:30:59.353 [2024-11-28 23:23:02.790640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.353 [2024-11-28 23:23:02.790783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.790808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.354 qpair failed and we were unable to recover it. 00:30:59.354 [2024-11-28 23:23:02.790903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.790996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.791022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.354 qpair failed and we were unable to recover it. 00:30:59.354 [2024-11-28 23:23:02.791110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.791187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.791213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.354 qpair failed and we were unable to recover it. 00:30:59.354 [2024-11-28 23:23:02.791302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.791412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.791440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.354 qpair failed and we were unable to recover it. 00:30:59.354 [2024-11-28 23:23:02.791581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.791705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.791735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.354 qpair failed and we were unable to recover it. 00:30:59.354 [2024-11-28 23:23:02.791872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.791995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.792020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.354 qpair failed and we were unable to recover it. 00:30:59.354 [2024-11-28 23:23:02.792115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.792230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.792256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.354 qpair failed and we were unable to recover it. 00:30:59.354 [2024-11-28 23:23:02.792353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.792442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.792486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.354 qpair failed and we were unable to recover it. 00:30:59.354 [2024-11-28 23:23:02.792616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.792714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.792741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.354 qpair failed and we were unable to recover it. 00:30:59.354 [2024-11-28 23:23:02.792846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.792965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.792990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.354 qpair failed and we were unable to recover it. 00:30:59.354 [2024-11-28 23:23:02.793114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.793269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.793293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.354 qpair failed and we were unable to recover it. 00:30:59.354 [2024-11-28 23:23:02.793424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.793508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.793535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.354 qpair failed and we were unable to recover it. 00:30:59.354 [2024-11-28 23:23:02.793682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.793804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.793828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.354 qpair failed and we were unable to recover it. 00:30:59.354 [2024-11-28 23:23:02.793922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.794039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.794063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.354 qpair failed and we were unable to recover it. 00:30:59.354 [2024-11-28 23:23:02.794154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.794235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.794259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.354 qpair failed and we were unable to recover it. 00:30:59.354 [2024-11-28 23:23:02.794355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.794468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.794492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.354 qpair failed and we were unable to recover it. 00:30:59.354 [2024-11-28 23:23:02.794631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.794768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.794808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.354 qpair failed and we were unable to recover it. 00:30:59.354 [2024-11-28 23:23:02.794903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.794992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.795015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.354 qpair failed and we were unable to recover it. 00:30:59.354 [2024-11-28 23:23:02.795127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.795267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.795291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.354 qpair failed and we were unable to recover it. 00:30:59.354 [2024-11-28 23:23:02.795404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.795536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.795562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.354 qpair failed and we were unable to recover it. 00:30:59.354 [2024-11-28 23:23:02.795707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.795786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.795811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.354 qpair failed and we were unable to recover it. 00:30:59.354 [2024-11-28 23:23:02.795927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.796039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.796064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.354 qpair failed and we were unable to recover it. 00:30:59.354 [2024-11-28 23:23:02.796153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.796244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.796268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.354 qpair failed and we were unable to recover it. 00:30:59.354 [2024-11-28 23:23:02.796363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.796489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.796531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.354 qpair failed and we were unable to recover it. 00:30:59.354 [2024-11-28 23:23:02.796642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.796764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.796788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.354 qpair failed and we were unable to recover it. 00:30:59.354 [2024-11-28 23:23:02.796915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.797006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.797030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.354 qpair failed and we were unable to recover it. 00:30:59.354 [2024-11-28 23:23:02.797127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.797277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.797324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.354 qpair failed and we were unable to recover it. 00:30:59.354 [2024-11-28 23:23:02.797465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.797578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.797602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.354 qpair failed and we were unable to recover it. 00:30:59.354 [2024-11-28 23:23:02.797714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.797839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.797864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.354 qpair failed and we were unable to recover it. 00:30:59.354 [2024-11-28 23:23:02.798027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.798185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.354 [2024-11-28 23:23:02.798213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.355 qpair failed and we were unable to recover it. 00:30:59.355 [2024-11-28 23:23:02.798321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.798432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.798459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.355 qpair failed and we were unable to recover it. 00:30:59.355 [2024-11-28 23:23:02.798556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.798639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.798663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.355 qpair failed and we were unable to recover it. 00:30:59.355 [2024-11-28 23:23:02.798760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.798841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.798865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.355 qpair failed and we were unable to recover it. 00:30:59.355 [2024-11-28 23:23:02.799008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.799101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.799126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.355 qpair failed and we were unable to recover it. 00:30:59.355 [2024-11-28 23:23:02.799267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.799377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.799409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.355 qpair failed and we were unable to recover it. 00:30:59.355 [2024-11-28 23:23:02.799532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.799672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.799696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.355 qpair failed and we were unable to recover it. 00:30:59.355 [2024-11-28 23:23:02.799804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.799941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.799965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.355 qpair failed and we were unable to recover it. 00:30:59.355 [2024-11-28 23:23:02.800111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.800237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.800266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.355 qpair failed and we were unable to recover it. 00:30:59.355 [2024-11-28 23:23:02.800406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.800553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.800580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.355 qpair failed and we were unable to recover it. 00:30:59.355 [2024-11-28 23:23:02.800677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.800817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.800843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.355 qpair failed and we were unable to recover it. 00:30:59.355 [2024-11-28 23:23:02.801003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.801135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.801161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.355 qpair failed and we were unable to recover it. 00:30:59.355 [2024-11-28 23:23:02.801279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.801370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.801404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.355 qpair failed and we were unable to recover it. 00:30:59.355 [2024-11-28 23:23:02.801498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.801589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.801614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.355 qpair failed and we were unable to recover it. 00:30:59.355 [2024-11-28 23:23:02.801751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.801875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.801904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.355 qpair failed and we were unable to recover it. 00:30:59.355 [2024-11-28 23:23:02.802028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.802156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.802185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.355 qpair failed and we were unable to recover it. 00:30:59.355 [2024-11-28 23:23:02.802325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.802436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.802463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.355 qpair failed and we were unable to recover it. 00:30:59.355 [2024-11-28 23:23:02.802583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.802672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.802697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.355 qpair failed and we were unable to recover it. 00:30:59.355 [2024-11-28 23:23:02.802782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.802909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.802939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.355 qpair failed and we were unable to recover it. 00:30:59.355 [2024-11-28 23:23:02.803073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.803191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.803216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.355 qpair failed and we were unable to recover it. 00:30:59.355 [2024-11-28 23:23:02.803352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.803532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.803558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.355 qpair failed and we were unable to recover it. 00:30:59.355 [2024-11-28 23:23:02.803645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.803758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.803784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.355 qpair failed and we were unable to recover it. 00:30:59.355 [2024-11-28 23:23:02.803934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.804049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.804074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.355 qpair failed and we were unable to recover it. 00:30:59.355 [2024-11-28 23:23:02.804170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.804266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.804291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.355 qpair failed and we were unable to recover it. 00:30:59.355 [2024-11-28 23:23:02.804448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.804541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.804567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.355 qpair failed and we were unable to recover it. 00:30:59.355 [2024-11-28 23:23:02.804680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.804800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.804825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.355 qpair failed and we were unable to recover it. 00:30:59.355 [2024-11-28 23:23:02.804937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.805034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.805059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.355 qpair failed and we were unable to recover it. 00:30:59.355 [2024-11-28 23:23:02.805159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.805245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.805270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.355 qpair failed and we were unable to recover it. 00:30:59.355 [2024-11-28 23:23:02.805432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.805564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.805594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.355 qpair failed and we were unable to recover it. 00:30:59.355 [2024-11-28 23:23:02.805751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.805890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.355 [2024-11-28 23:23:02.805918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.355 qpair failed and we were unable to recover it. 00:30:59.356 [2024-11-28 23:23:02.806030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.806126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.806153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.356 qpair failed and we were unable to recover it. 00:30:59.356 [2024-11-28 23:23:02.806273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.806361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.806388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.356 qpair failed and we were unable to recover it. 00:30:59.356 [2024-11-28 23:23:02.806520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.806638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.806668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.356 qpair failed and we were unable to recover it. 00:30:59.356 [2024-11-28 23:23:02.806765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.806883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.806913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.356 qpair failed and we were unable to recover it. 00:30:59.356 [2024-11-28 23:23:02.807035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.807183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.807210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.356 qpair failed and we were unable to recover it. 00:30:59.356 [2024-11-28 23:23:02.807304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.807425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.807452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.356 qpair failed and we were unable to recover it. 00:30:59.356 [2024-11-28 23:23:02.807543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.807687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.807713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.356 qpair failed and we were unable to recover it. 00:30:59.356 [2024-11-28 23:23:02.807809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.807950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.807977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.356 qpair failed and we were unable to recover it. 00:30:59.356 [2024-11-28 23:23:02.808124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.808221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.808250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.356 qpair failed and we were unable to recover it. 00:30:59.356 [2024-11-28 23:23:02.808385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.808511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.808540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.356 qpair failed and we were unable to recover it. 00:30:59.356 [2024-11-28 23:23:02.808659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.808746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.808774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.356 qpair failed and we were unable to recover it. 00:30:59.356 [2024-11-28 23:23:02.808881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.808974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.809002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.356 qpair failed and we were unable to recover it. 00:30:59.356 [2024-11-28 23:23:02.809092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.809191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.809220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.356 qpair failed and we were unable to recover it. 00:30:59.356 [2024-11-28 23:23:02.809402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.809523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.809552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.356 qpair failed and we were unable to recover it. 00:30:59.356 [2024-11-28 23:23:02.809687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.809845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.809891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.356 qpair failed and we were unable to recover it. 00:30:59.356 [2024-11-28 23:23:02.810060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.810222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.810249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.356 qpair failed and we were unable to recover it. 00:30:59.356 [2024-11-28 23:23:02.810339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.810494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.810523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.356 qpair failed and we were unable to recover it. 00:30:59.356 [2024-11-28 23:23:02.810651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.810827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.810876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.356 qpair failed and we were unable to recover it. 00:30:59.356 [2024-11-28 23:23:02.811017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.811160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.811190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.356 qpair failed and we were unable to recover it. 00:30:59.356 [2024-11-28 23:23:02.811296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.811409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.811447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.356 qpair failed and we were unable to recover it. 00:30:59.356 [2024-11-28 23:23:02.811565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.811712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.811743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.356 qpair failed and we were unable to recover it. 00:30:59.356 [2024-11-28 23:23:02.811905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.811993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.812020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.356 qpair failed and we were unable to recover it. 00:30:59.356 [2024-11-28 23:23:02.812118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.812237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.812264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.356 qpair failed and we were unable to recover it. 00:30:59.356 [2024-11-28 23:23:02.812344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.812475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.812503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.356 qpair failed and we were unable to recover it. 00:30:59.356 [2024-11-28 23:23:02.812596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.812709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.812736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.356 qpair failed and we were unable to recover it. 00:30:59.356 [2024-11-28 23:23:02.812848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.356 [2024-11-28 23:23:02.812944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.812972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.357 qpair failed and we were unable to recover it. 00:30:59.357 [2024-11-28 23:23:02.813092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.813216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.813244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.357 qpair failed and we were unable to recover it. 00:30:59.357 [2024-11-28 23:23:02.813330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.813462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.813490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.357 qpair failed and we were unable to recover it. 00:30:59.357 [2024-11-28 23:23:02.813617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.813730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.813762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.357 qpair failed and we were unable to recover it. 00:30:59.357 [2024-11-28 23:23:02.813880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.813978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.814006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.357 qpair failed and we were unable to recover it. 00:30:59.357 [2024-11-28 23:23:02.814097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.814224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.814252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.357 qpair failed and we were unable to recover it. 00:30:59.357 [2024-11-28 23:23:02.814373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.814507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.814535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.357 qpair failed and we were unable to recover it. 00:30:59.357 [2024-11-28 23:23:02.814632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.814782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.814809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.357 qpair failed and we were unable to recover it. 00:30:59.357 [2024-11-28 23:23:02.814928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.815046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.815075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.357 qpair failed and we were unable to recover it. 00:30:59.357 [2024-11-28 23:23:02.815235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.815358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.815386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.357 qpair failed and we were unable to recover it. 00:30:59.357 [2024-11-28 23:23:02.815488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.815587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.815614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.357 qpair failed and we were unable to recover it. 00:30:59.357 [2024-11-28 23:23:02.815732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.815841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.815870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.357 qpair failed and we were unable to recover it. 00:30:59.357 [2024-11-28 23:23:02.815991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.816076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.816104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.357 qpair failed and we were unable to recover it. 00:30:59.357 [2024-11-28 23:23:02.816196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.816312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.816344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.357 qpair failed and we were unable to recover it. 00:30:59.357 [2024-11-28 23:23:02.816472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.816585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.816611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.357 qpair failed and we were unable to recover it. 00:30:59.357 [2024-11-28 23:23:02.816710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.816851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.816877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.357 qpair failed and we were unable to recover it. 00:30:59.357 [2024-11-28 23:23:02.816997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.817112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.817138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.357 qpair failed and we were unable to recover it. 00:30:59.357 [2024-11-28 23:23:02.817233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.817349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.817379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.357 qpair failed and we were unable to recover it. 00:30:59.357 [2024-11-28 23:23:02.817509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.817644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.817671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.357 qpair failed and we were unable to recover it. 00:30:59.357 [2024-11-28 23:23:02.817785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.817884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.817911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.357 qpair failed and we were unable to recover it. 00:30:59.357 [2024-11-28 23:23:02.818005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.818119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.818146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.357 qpair failed and we were unable to recover it. 00:30:59.357 [2024-11-28 23:23:02.818237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.818334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.818362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.357 qpair failed and we were unable to recover it. 00:30:59.357 [2024-11-28 23:23:02.818460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.818555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.818582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.357 qpair failed and we were unable to recover it. 00:30:59.357 [2024-11-28 23:23:02.818682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.818778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.818811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.357 qpair failed and we were unable to recover it. 00:30:59.357 [2024-11-28 23:23:02.818912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.819059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.819089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.357 qpair failed and we were unable to recover it. 00:30:59.357 [2024-11-28 23:23:02.819202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.819320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.819347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.357 qpair failed and we were unable to recover it. 00:30:59.357 [2024-11-28 23:23:02.819446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.819565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.819591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.357 qpair failed and we were unable to recover it. 00:30:59.357 [2024-11-28 23:23:02.819724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.819810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.819837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.357 qpair failed and we were unable to recover it. 00:30:59.357 [2024-11-28 23:23:02.819926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.820051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.820078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.357 qpair failed and we were unable to recover it. 00:30:59.357 [2024-11-28 23:23:02.820204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.357 [2024-11-28 23:23:02.820321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.820347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.358 qpair failed and we were unable to recover it. 00:30:59.358 [2024-11-28 23:23:02.820478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.820648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.820674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.358 qpair failed and we were unable to recover it. 00:30:59.358 [2024-11-28 23:23:02.820772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.820862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.820893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.358 qpair failed and we were unable to recover it. 00:30:59.358 [2024-11-28 23:23:02.820981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.821084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.821110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.358 qpair failed and we were unable to recover it. 00:30:59.358 [2024-11-28 23:23:02.821239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.821344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.821375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.358 qpair failed and we were unable to recover it. 00:30:59.358 [2024-11-28 23:23:02.821477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.821598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.821625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.358 qpair failed and we were unable to recover it. 00:30:59.358 [2024-11-28 23:23:02.821714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.821830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.821856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.358 qpair failed and we were unable to recover it. 00:30:59.358 [2024-11-28 23:23:02.821942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.822037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.822063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.358 qpair failed and we were unable to recover it. 00:30:59.358 [2024-11-28 23:23:02.822160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.822252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.822278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.358 qpair failed and we were unable to recover it. 00:30:59.358 [2024-11-28 23:23:02.822375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.822474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.822500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.358 qpair failed and we were unable to recover it. 00:30:59.358 [2024-11-28 23:23:02.822620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.822705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.822735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.358 qpair failed and we were unable to recover it. 00:30:59.358 [2024-11-28 23:23:02.822861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.822980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.823006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.358 qpair failed and we were unable to recover it. 00:30:59.358 [2024-11-28 23:23:02.823132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.823221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.823249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.358 qpair failed and we were unable to recover it. 00:30:59.358 [2024-11-28 23:23:02.823343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.823440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.823467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.358 qpair failed and we were unable to recover it. 00:30:59.358 [2024-11-28 23:23:02.823565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.823656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.823682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.358 qpair failed and we were unable to recover it. 00:30:59.358 [2024-11-28 23:23:02.823780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.823862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.823888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.358 qpair failed and we were unable to recover it. 00:30:59.358 [2024-11-28 23:23:02.824010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.824093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.824119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.358 qpair failed and we were unable to recover it. 00:30:59.358 [2024-11-28 23:23:02.824239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.824357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.824382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.358 qpair failed and we were unable to recover it. 00:30:59.358 [2024-11-28 23:23:02.824477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.824560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.824585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.358 qpair failed and we were unable to recover it. 00:30:59.358 [2024-11-28 23:23:02.824716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.824829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.824854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.358 qpair failed and we were unable to recover it. 00:30:59.358 [2024-11-28 23:23:02.825002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.825086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.825113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.358 qpair failed and we were unable to recover it. 00:30:59.358 [2024-11-28 23:23:02.825223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.825341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.825371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.358 qpair failed and we were unable to recover it. 00:30:59.358 [2024-11-28 23:23:02.825472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.825584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.825611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.358 qpair failed and we were unable to recover it. 00:30:59.358 [2024-11-28 23:23:02.825731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.825879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.825905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.358 qpair failed and we were unable to recover it. 00:30:59.358 [2024-11-28 23:23:02.825996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.826086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.826112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.358 qpair failed and we were unable to recover it. 00:30:59.358 [2024-11-28 23:23:02.826235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.826356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.826382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.358 qpair failed and we were unable to recover it. 00:30:59.358 [2024-11-28 23:23:02.826497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.826597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.826623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.358 qpair failed and we were unable to recover it. 00:30:59.358 [2024-11-28 23:23:02.826764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.826906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.826931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.358 qpair failed and we were unable to recover it. 00:30:59.358 [2024-11-28 23:23:02.827052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.827147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.827172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.358 qpair failed and we were unable to recover it. 00:30:59.358 [2024-11-28 23:23:02.827294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.358 [2024-11-28 23:23:02.827412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.827439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.359 qpair failed and we were unable to recover it. 00:30:59.359 [2024-11-28 23:23:02.827528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.827625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.827651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.359 qpair failed and we were unable to recover it. 00:30:59.359 [2024-11-28 23:23:02.827736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.827828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.827853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.359 qpair failed and we were unable to recover it. 00:30:59.359 [2024-11-28 23:23:02.827976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.828122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.828148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.359 qpair failed and we were unable to recover it. 00:30:59.359 [2024-11-28 23:23:02.828240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.828357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.828383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.359 qpair failed and we were unable to recover it. 00:30:59.359 [2024-11-28 23:23:02.828477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.828565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.828591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.359 qpair failed and we were unable to recover it. 00:30:59.359 [2024-11-28 23:23:02.828751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.828893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.828919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.359 qpair failed and we were unable to recover it. 00:30:59.359 [2024-11-28 23:23:02.829009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.829108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.829135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.359 qpair failed and we were unable to recover it. 00:30:59.359 [2024-11-28 23:23:02.829279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.829418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.829445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.359 qpair failed and we were unable to recover it. 00:30:59.359 [2024-11-28 23:23:02.829565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.829693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.829722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.359 qpair failed and we were unable to recover it. 00:30:59.359 [2024-11-28 23:23:02.829880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.830031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.830057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.359 qpair failed and we were unable to recover it. 00:30:59.359 [2024-11-28 23:23:02.830140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.830263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.830289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.359 qpair failed and we were unable to recover it. 00:30:59.359 [2024-11-28 23:23:02.830380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.830501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.830527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.359 qpair failed and we were unable to recover it. 00:30:59.359 [2024-11-28 23:23:02.830611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.830696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.830721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.359 qpair failed and we were unable to recover it. 00:30:59.359 [2024-11-28 23:23:02.830819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.830937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.830964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.359 qpair failed and we were unable to recover it. 00:30:59.359 [2024-11-28 23:23:02.831061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.831154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.831180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.359 qpair failed and we were unable to recover it. 00:30:59.359 [2024-11-28 23:23:02.831329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.831421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.831448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.359 qpair failed and we were unable to recover it. 00:30:59.359 [2024-11-28 23:23:02.831532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.831650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.831676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.359 qpair failed and we were unable to recover it. 00:30:59.359 [2024-11-28 23:23:02.831820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.831913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.831940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.359 qpair failed and we were unable to recover it. 00:30:59.359 [2024-11-28 23:23:02.832042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.832118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.832144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.359 qpair failed and we were unable to recover it. 00:30:59.359 [2024-11-28 23:23:02.832265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.832351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.832377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.359 qpair failed and we were unable to recover it. 00:30:59.359 [2024-11-28 23:23:02.832543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.832631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.832657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.359 qpair failed and we were unable to recover it. 00:30:59.359 [2024-11-28 23:23:02.832751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.832851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.832877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.359 qpair failed and we were unable to recover it. 00:30:59.359 [2024-11-28 23:23:02.832962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.833063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.833089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.359 qpair failed and we were unable to recover it. 00:30:59.359 [2024-11-28 23:23:02.833184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.833271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.833297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.359 qpair failed and we were unable to recover it. 00:30:59.359 [2024-11-28 23:23:02.833416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.833511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.833537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.359 qpair failed and we were unable to recover it. 00:30:59.359 [2024-11-28 23:23:02.833645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.833738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.833764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.359 qpair failed and we were unable to recover it. 00:30:59.359 [2024-11-28 23:23:02.833856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.833999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.834025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.359 qpair failed and we were unable to recover it. 00:30:59.359 [2024-11-28 23:23:02.834153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.834244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.834270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.359 qpair failed and we were unable to recover it. 00:30:59.359 [2024-11-28 23:23:02.834361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.359 [2024-11-28 23:23:02.834477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.834508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.360 qpair failed and we were unable to recover it. 00:30:59.360 [2024-11-28 23:23:02.834600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.834719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.834745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.360 qpair failed and we were unable to recover it. 00:30:59.360 [2024-11-28 23:23:02.834834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.834918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.834944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.360 qpair failed and we were unable to recover it. 00:30:59.360 [2024-11-28 23:23:02.835058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.835174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.835199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.360 qpair failed and we were unable to recover it. 00:30:59.360 [2024-11-28 23:23:02.835298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.835381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.835415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.360 qpair failed and we were unable to recover it. 00:30:59.360 [2024-11-28 23:23:02.835541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.835634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.835661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.360 qpair failed and we were unable to recover it. 00:30:59.360 [2024-11-28 23:23:02.835804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.835927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.835955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.360 qpair failed and we were unable to recover it. 00:30:59.360 [2024-11-28 23:23:02.836051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.836165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.836191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.360 qpair failed and we were unable to recover it. 00:30:59.360 [2024-11-28 23:23:02.836336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.836440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.836475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.360 qpair failed and we were unable to recover it. 00:30:59.360 [2024-11-28 23:23:02.836599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.836697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.836723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.360 qpair failed and we were unable to recover it. 00:30:59.360 [2024-11-28 23:23:02.836812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.836928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.836953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.360 qpair failed and we were unable to recover it. 00:30:59.360 [2024-11-28 23:23:02.837063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.837184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.837210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.360 qpair failed and we were unable to recover it. 00:30:59.360 [2024-11-28 23:23:02.837299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.837400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.837426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.360 qpair failed and we were unable to recover it. 00:30:59.360 [2024-11-28 23:23:02.837526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.837612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.837639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.360 qpair failed and we were unable to recover it. 00:30:59.360 [2024-11-28 23:23:02.837756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.837840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.837869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.360 qpair failed and we were unable to recover it. 00:30:59.360 [2024-11-28 23:23:02.837958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.838103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.838129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.360 qpair failed and we were unable to recover it. 00:30:59.360 [2024-11-28 23:23:02.838252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.838367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.838399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.360 qpair failed and we were unable to recover it. 00:30:59.360 [2024-11-28 23:23:02.838500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.838581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.838607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.360 qpair failed and we were unable to recover it. 00:30:59.360 [2024-11-28 23:23:02.838721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.838838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.838865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.360 qpair failed and we were unable to recover it. 00:30:59.360 [2024-11-28 23:23:02.838994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.839081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.839107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.360 qpair failed and we were unable to recover it. 00:30:59.360 [2024-11-28 23:23:02.839224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.839308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.839334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.360 qpair failed and we were unable to recover it. 00:30:59.360 [2024-11-28 23:23:02.839458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.839580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.839609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.360 qpair failed and we were unable to recover it. 00:30:59.360 [2024-11-28 23:23:02.839740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.839878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.839904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.360 qpair failed and we were unable to recover it. 00:30:59.360 [2024-11-28 23:23:02.839990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.840108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.840134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.360 qpair failed and we were unable to recover it. 00:30:59.360 [2024-11-28 23:23:02.840230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.840348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.840374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.360 qpair failed and we were unable to recover it. 00:30:59.360 [2024-11-28 23:23:02.840510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.840606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.840632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.360 qpair failed and we were unable to recover it. 00:30:59.360 [2024-11-28 23:23:02.840728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.840810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.840835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.360 qpair failed and we were unable to recover it. 00:30:59.360 [2024-11-28 23:23:02.840960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.841073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.841103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.360 qpair failed and we were unable to recover it. 00:30:59.360 [2024-11-28 23:23:02.841205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.841322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.360 [2024-11-28 23:23:02.841347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.360 qpair failed and we were unable to recover it. 00:30:59.361 [2024-11-28 23:23:02.841470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.841573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.841602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.361 qpair failed and we were unable to recover it. 00:30:59.361 [2024-11-28 23:23:02.841734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.841865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.841890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.361 qpair failed and we were unable to recover it. 00:30:59.361 [2024-11-28 23:23:02.842005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.842114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.842141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.361 qpair failed and we were unable to recover it. 00:30:59.361 [2024-11-28 23:23:02.842231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.842350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.842375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.361 qpair failed and we were unable to recover it. 00:30:59.361 [2024-11-28 23:23:02.842475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.842560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.842603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.361 qpair failed and we were unable to recover it. 00:30:59.361 [2024-11-28 23:23:02.842696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.842816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.842844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.361 qpair failed and we were unable to recover it. 00:30:59.361 [2024-11-28 23:23:02.842940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.843035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.843064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.361 qpair failed and we were unable to recover it. 00:30:59.361 [2024-11-28 23:23:02.843193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.843310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.843335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.361 qpair failed and we were unable to recover it. 00:30:59.361 [2024-11-28 23:23:02.843467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.843565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.843594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.361 qpair failed and we were unable to recover it. 00:30:59.361 [2024-11-28 23:23:02.843689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.843818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.843848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.361 qpair failed and we were unable to recover it. 00:30:59.361 [2024-11-28 23:23:02.843973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.844096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.844124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.361 qpair failed and we were unable to recover it. 00:30:59.361 [2024-11-28 23:23:02.844282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.844376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.844414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.361 qpair failed and we were unable to recover it. 00:30:59.361 [2024-11-28 23:23:02.844547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.844630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.844664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.361 qpair failed and we were unable to recover it. 00:30:59.361 [2024-11-28 23:23:02.844809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.844942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.844970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.361 qpair failed and we were unable to recover it. 00:30:59.361 [2024-11-28 23:23:02.845105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.845225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.845253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.361 qpair failed and we were unable to recover it. 00:30:59.361 [2024-11-28 23:23:02.845340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.845436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.845482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.361 qpair failed and we were unable to recover it. 00:30:59.361 [2024-11-28 23:23:02.845602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.845729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.845755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.361 qpair failed and we were unable to recover it. 00:30:59.361 [2024-11-28 23:23:02.845843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.845921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.845945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.361 qpair failed and we were unable to recover it. 00:30:59.361 [2024-11-28 23:23:02.846054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.846158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.846190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.361 qpair failed and we were unable to recover it. 00:30:59.361 [2024-11-28 23:23:02.846319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.846446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.846472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.361 qpair failed and we were unable to recover it. 00:30:59.361 [2024-11-28 23:23:02.846590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.846685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.846710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.361 qpair failed and we were unable to recover it. 00:30:59.361 [2024-11-28 23:23:02.846799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.846912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.846955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.361 qpair failed and we were unable to recover it. 00:30:59.361 [2024-11-28 23:23:02.847143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.847265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.847292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.361 qpair failed and we were unable to recover it. 00:30:59.361 [2024-11-28 23:23:02.847428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.847581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.847607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.361 qpair failed and we were unable to recover it. 00:30:59.361 [2024-11-28 23:23:02.847769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.847896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.847922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.361 qpair failed and we were unable to recover it. 00:30:59.361 [2024-11-28 23:23:02.848061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.361 [2024-11-28 23:23:02.848163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.848190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.362 qpair failed and we were unable to recover it. 00:30:59.362 [2024-11-28 23:23:02.848350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.848458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.848483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.362 qpair failed and we were unable to recover it. 00:30:59.362 [2024-11-28 23:23:02.848601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.848743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.848773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.362 qpair failed and we were unable to recover it. 00:30:59.362 [2024-11-28 23:23:02.848921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.849075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.849103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.362 qpair failed and we were unable to recover it. 00:30:59.362 [2024-11-28 23:23:02.849266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.849399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.849444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.362 qpair failed and we were unable to recover it. 00:30:59.362 [2024-11-28 23:23:02.849565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.849652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.849694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.362 qpair failed and we were unable to recover it. 00:30:59.362 [2024-11-28 23:23:02.849815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.849979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.850006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.362 qpair failed and we were unable to recover it. 00:30:59.362 [2024-11-28 23:23:02.850146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.850236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.850263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.362 qpair failed and we were unable to recover it. 00:30:59.362 [2024-11-28 23:23:02.850400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.850535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.850559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.362 qpair failed and we were unable to recover it. 00:30:59.362 [2024-11-28 23:23:02.850686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.850802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.850843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.362 qpair failed and we were unable to recover it. 00:30:59.362 [2024-11-28 23:23:02.850967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.851091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.851118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.362 qpair failed and we were unable to recover it. 00:30:59.362 [2024-11-28 23:23:02.851255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.851360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.851388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.362 qpair failed and we were unable to recover it. 00:30:59.362 [2024-11-28 23:23:02.851523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.851605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.851630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.362 qpair failed and we were unable to recover it. 00:30:59.362 [2024-11-28 23:23:02.851721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.851834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.851860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.362 qpair failed and we were unable to recover it. 00:30:59.362 [2024-11-28 23:23:02.851993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.852125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.852154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.362 qpair failed and we were unable to recover it. 00:30:59.362 [2024-11-28 23:23:02.852239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.852398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.852426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.362 qpair failed and we were unable to recover it. 00:30:59.362 [2024-11-28 23:23:02.852537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.852654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.852698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.362 qpair failed and we were unable to recover it. 00:30:59.362 [2024-11-28 23:23:02.852789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.852923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.852951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.362 qpair failed and we were unable to recover it. 00:30:59.362 [2024-11-28 23:23:02.853086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.853208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.853235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.362 qpair failed and we were unable to recover it. 00:30:59.362 [2024-11-28 23:23:02.853340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.853453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.853479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.362 qpair failed and we were unable to recover it. 00:30:59.362 [2024-11-28 23:23:02.853570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.853744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.853771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.362 qpair failed and we were unable to recover it. 00:30:59.362 [2024-11-28 23:23:02.853905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.854049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.854074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.362 qpair failed and we were unable to recover it. 00:30:59.362 [2024-11-28 23:23:02.854194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.854347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.854375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.362 qpair failed and we were unable to recover it. 00:30:59.362 [2024-11-28 23:23:02.854510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.854603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.854629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.362 qpair failed and we were unable to recover it. 00:30:59.362 [2024-11-28 23:23:02.854752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.854873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.854899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.362 qpair failed and we were unable to recover it. 00:30:59.362 [2024-11-28 23:23:02.855020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.855102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.855127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.362 qpair failed and we were unable to recover it. 00:30:59.362 [2024-11-28 23:23:02.855211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.855324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.855365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.362 qpair failed and we were unable to recover it. 00:30:59.362 [2024-11-28 23:23:02.855501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.855595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.855620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.362 qpair failed and we were unable to recover it. 00:30:59.362 [2024-11-28 23:23:02.855701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.855788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.855813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.362 qpair failed and we were unable to recover it. 00:30:59.362 [2024-11-28 23:23:02.855930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.856017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.362 [2024-11-28 23:23:02.856061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.362 qpair failed and we were unable to recover it. 00:30:59.363 [2024-11-28 23:23:02.856177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.856273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.856298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.363 qpair failed and we were unable to recover it. 00:30:59.363 [2024-11-28 23:23:02.856445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.856555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.856582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.363 qpair failed and we were unable to recover it. 00:30:59.363 [2024-11-28 23:23:02.856753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.856880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.856909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.363 qpair failed and we were unable to recover it. 00:30:59.363 [2024-11-28 23:23:02.857008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.857125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.857151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.363 qpair failed and we were unable to recover it. 00:30:59.363 [2024-11-28 23:23:02.857246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.857375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.857409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.363 qpair failed and we were unable to recover it. 00:30:59.363 [2024-11-28 23:23:02.857523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.857649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.857679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.363 qpair failed and we were unable to recover it. 00:30:59.363 [2024-11-28 23:23:02.857819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.857906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.857932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.363 qpair failed and we were unable to recover it. 00:30:59.363 [2024-11-28 23:23:02.858059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.858154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.858181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.363 qpair failed and we were unable to recover it. 00:30:59.363 [2024-11-28 23:23:02.858315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.858415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.858449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.363 qpair failed and we were unable to recover it. 00:30:59.363 [2024-11-28 23:23:02.858567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.858682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.858707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.363 qpair failed and we were unable to recover it. 00:30:59.363 [2024-11-28 23:23:02.858852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.858980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.859007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.363 qpair failed and we were unable to recover it. 00:30:59.363 [2024-11-28 23:23:02.859160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.859256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.859282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.363 qpair failed and we were unable to recover it. 00:30:59.363 [2024-11-28 23:23:02.859413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.859506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.859532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.363 qpair failed and we were unable to recover it. 00:30:59.363 [2024-11-28 23:23:02.859646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.859739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.859766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.363 qpair failed and we were unable to recover it. 00:30:59.363 [2024-11-28 23:23:02.859858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.859954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.859980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.363 qpair failed and we were unable to recover it. 00:30:59.363 [2024-11-28 23:23:02.860118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.860213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.860239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.363 qpair failed and we were unable to recover it. 00:30:59.363 [2024-11-28 23:23:02.860332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.860476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.860502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.363 qpair failed and we were unable to recover it. 00:30:59.363 [2024-11-28 23:23:02.860641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.860806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.860835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.363 qpair failed and we were unable to recover it. 00:30:59.363 [2024-11-28 23:23:02.860968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.861084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.861110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.363 qpair failed and we were unable to recover it. 00:30:59.363 [2024-11-28 23:23:02.861256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.861424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.861452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.363 qpair failed and we were unable to recover it. 00:30:59.363 [2024-11-28 23:23:02.861538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.861674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.861702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.363 qpair failed and we were unable to recover it. 00:30:59.363 [2024-11-28 23:23:02.861815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.861956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.861982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.363 qpair failed and we were unable to recover it. 00:30:59.363 [2024-11-28 23:23:02.862148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.862244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.862274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.363 qpair failed and we were unable to recover it. 00:30:59.363 [2024-11-28 23:23:02.862436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.862563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.862591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.363 qpair failed and we were unable to recover it. 00:30:59.363 [2024-11-28 23:23:02.862743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.862884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.862926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.363 qpair failed and we were unable to recover it. 00:30:59.363 [2024-11-28 23:23:02.863062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.863218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.863245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.363 qpair failed and we were unable to recover it. 00:30:59.363 [2024-11-28 23:23:02.863382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.863500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.863531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.363 qpair failed and we were unable to recover it. 00:30:59.363 [2024-11-28 23:23:02.863645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.863734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.863760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.363 qpair failed and we were unable to recover it. 00:30:59.363 [2024-11-28 23:23:02.863912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.864103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.363 [2024-11-28 23:23:02.864132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.363 qpair failed and we were unable to recover it. 00:30:59.363 [2024-11-28 23:23:02.864259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.864421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.864448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.364 qpair failed and we were unable to recover it. 00:30:59.364 [2024-11-28 23:23:02.864561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.864680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.864704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.364 qpair failed and we were unable to recover it. 00:30:59.364 [2024-11-28 23:23:02.864802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.864932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.864959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.364 qpair failed and we were unable to recover it. 00:30:59.364 [2024-11-28 23:23:02.865116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.865240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.865267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.364 qpair failed and we were unable to recover it. 00:30:59.364 [2024-11-28 23:23:02.865421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.865544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.865569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.364 qpair failed and we were unable to recover it. 00:30:59.364 [2024-11-28 23:23:02.865670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.865827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.865855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.364 qpair failed and we were unable to recover it. 00:30:59.364 [2024-11-28 23:23:02.866000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.866116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.866141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.364 qpair failed and we were unable to recover it. 00:30:59.364 [2024-11-28 23:23:02.866227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.866344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.866369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.364 qpair failed and we were unable to recover it. 00:30:59.364 [2024-11-28 23:23:02.866487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.866637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.866665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.364 qpair failed and we were unable to recover it. 00:30:59.364 [2024-11-28 23:23:02.866781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.866908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.866937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.364 qpair failed and we were unable to recover it. 00:30:59.364 [2024-11-28 23:23:02.867066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.867211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.867237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.364 qpair failed and we were unable to recover it. 00:30:59.364 [2024-11-28 23:23:02.867378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.867482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.867511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.364 qpair failed and we were unable to recover it. 00:30:59.364 [2024-11-28 23:23:02.867639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.867758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.867785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.364 qpair failed and we were unable to recover it. 00:30:59.364 [2024-11-28 23:23:02.867905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.867994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.868019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.364 qpair failed and we were unable to recover it. 00:30:59.364 [2024-11-28 23:23:02.868157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.868297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.868321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.364 qpair failed and we were unable to recover it. 00:30:59.364 [2024-11-28 23:23:02.868428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.868532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.868559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.364 qpair failed and we were unable to recover it. 00:30:59.364 [2024-11-28 23:23:02.868696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.868806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.868831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.364 qpair failed and we were unable to recover it. 00:30:59.364 [2024-11-28 23:23:02.868987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.869103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.869128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.364 qpair failed and we were unable to recover it. 00:30:59.364 [2024-11-28 23:23:02.869282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.869384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.869418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.364 qpair failed and we were unable to recover it. 00:30:59.364 [2024-11-28 23:23:02.869533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.869645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.869670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.364 qpair failed and we were unable to recover it. 00:30:59.364 [2024-11-28 23:23:02.869836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.869960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.869988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.364 qpair failed and we were unable to recover it. 00:30:59.364 [2024-11-28 23:23:02.870113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.870206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.870234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.364 qpair failed and we were unable to recover it. 00:30:59.364 [2024-11-28 23:23:02.870339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.870461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.870487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.364 qpair failed and we were unable to recover it. 00:30:59.364 [2024-11-28 23:23:02.870615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.870733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.870760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.364 qpair failed and we were unable to recover it. 00:30:59.364 [2024-11-28 23:23:02.870929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.871043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.871068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.364 qpair failed and we were unable to recover it. 00:30:59.364 [2024-11-28 23:23:02.871175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.871288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.871313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.364 qpair failed and we were unable to recover it. 00:30:59.364 [2024-11-28 23:23:02.871492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.871644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.871683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.364 qpair failed and we were unable to recover it. 00:30:59.364 [2024-11-28 23:23:02.871838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.871962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.871989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.364 qpair failed and we were unable to recover it. 00:30:59.364 [2024-11-28 23:23:02.872136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.872223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.364 [2024-11-28 23:23:02.872247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.364 qpair failed and we were unable to recover it. 00:30:59.364 [2024-11-28 23:23:02.872411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.872514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.872542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.365 qpair failed and we were unable to recover it. 00:30:59.365 [2024-11-28 23:23:02.872639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.872766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.872793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.365 qpair failed and we were unable to recover it. 00:30:59.365 [2024-11-28 23:23:02.872924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.873039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.873064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.365 qpair failed and we were unable to recover it. 00:30:59.365 [2024-11-28 23:23:02.873221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.873347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.873372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.365 qpair failed and we were unable to recover it. 00:30:59.365 [2024-11-28 23:23:02.873506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.873621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.873646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.365 qpair failed and we were unable to recover it. 00:30:59.365 [2024-11-28 23:23:02.873813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.873908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.873933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.365 qpair failed and we were unable to recover it. 00:30:59.365 [2024-11-28 23:23:02.874104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.874240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.874268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.365 qpair failed and we were unable to recover it. 00:30:59.365 [2024-11-28 23:23:02.874364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.874517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.874545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.365 qpair failed and we were unable to recover it. 00:30:59.365 [2024-11-28 23:23:02.874721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.874835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.874861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.365 qpair failed and we were unable to recover it. 00:30:59.365 [2024-11-28 23:23:02.874993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.875118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.875146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.365 qpair failed and we were unable to recover it. 00:30:59.365 [2024-11-28 23:23:02.875271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.875407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.875436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.365 qpair failed and we were unable to recover it. 00:30:59.365 [2024-11-28 23:23:02.875573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.875686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.875711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.365 qpair failed and we were unable to recover it. 00:30:59.365 [2024-11-28 23:23:02.875856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.875960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.875987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.365 qpair failed and we were unable to recover it. 00:30:59.365 [2024-11-28 23:23:02.876114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.876238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.876279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.365 qpair failed and we were unable to recover it. 00:30:59.365 [2024-11-28 23:23:02.876403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.876496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.876520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.365 qpair failed and we were unable to recover it. 00:30:59.365 [2024-11-28 23:23:02.876660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.876752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.876778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.365 qpair failed and we were unable to recover it. 00:30:59.365 [2024-11-28 23:23:02.876873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.876970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.876998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.365 qpair failed and we were unable to recover it. 00:30:59.365 [2024-11-28 23:23:02.877108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.877202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.877227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.365 qpair failed and we were unable to recover it. 00:30:59.365 [2024-11-28 23:23:02.877369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.877510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.877539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.365 qpair failed and we were unable to recover it. 00:30:59.365 [2024-11-28 23:23:02.877639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.877758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.877786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.365 qpair failed and we were unable to recover it. 00:30:59.365 [2024-11-28 23:23:02.877923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.878007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.878033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.365 qpair failed and we were unable to recover it. 00:30:59.365 [2024-11-28 23:23:02.878159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.878282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.878307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.365 qpair failed and we were unable to recover it. 00:30:59.365 [2024-11-28 23:23:02.878470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.878568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.878597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.365 qpair failed and we were unable to recover it. 00:30:59.365 [2024-11-28 23:23:02.878736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.878848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.878873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.365 qpair failed and we were unable to recover it. 00:30:59.365 [2024-11-28 23:23:02.878982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.879121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.879145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.365 qpair failed and we were unable to recover it. 00:30:59.365 [2024-11-28 23:23:02.879301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.879412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.879446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.365 qpair failed and we were unable to recover it. 00:30:59.365 [2024-11-28 23:23:02.879576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.365 [2024-11-28 23:23:02.879665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.879690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.366 qpair failed and we were unable to recover it. 00:30:59.366 [2024-11-28 23:23:02.879781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.879937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.879964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.366 qpair failed and we were unable to recover it. 00:30:59.366 [2024-11-28 23:23:02.880092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.880214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.880242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.366 qpair failed and we were unable to recover it. 00:30:59.366 [2024-11-28 23:23:02.880386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.880537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.880563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.366 qpair failed and we were unable to recover it. 00:30:59.366 [2024-11-28 23:23:02.880697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.880791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.880820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.366 qpair failed and we were unable to recover it. 00:30:59.366 [2024-11-28 23:23:02.880950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.881069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.881098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.366 qpair failed and we were unable to recover it. 00:30:59.366 [2024-11-28 23:23:02.881216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.881358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.881383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.366 qpair failed and we were unable to recover it. 00:30:59.366 [2024-11-28 23:23:02.881540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.881643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.881670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.366 qpair failed and we were unable to recover it. 00:30:59.366 [2024-11-28 23:23:02.881795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.881946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.881973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.366 qpair failed and we were unable to recover it. 00:30:59.366 [2024-11-28 23:23:02.882104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.882221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.882246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.366 qpair failed and we were unable to recover it. 00:30:59.366 [2024-11-28 23:23:02.882363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.882518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.882547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.366 qpair failed and we were unable to recover it. 00:30:59.366 [2024-11-28 23:23:02.882674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.882806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.882833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.366 qpair failed and we were unable to recover it. 00:30:59.366 [2024-11-28 23:23:02.882941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.883062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.883087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.366 qpair failed and we were unable to recover it. 00:30:59.366 [2024-11-28 23:23:02.883204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.883312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.883336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.366 qpair failed and we were unable to recover it. 00:30:59.366 [2024-11-28 23:23:02.883497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.883639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.883674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.366 qpair failed and we were unable to recover it. 00:30:59.366 [2024-11-28 23:23:02.883765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.883843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.883876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.366 qpair failed and we were unable to recover it. 00:30:59.366 [2024-11-28 23:23:02.884016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.884118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.884146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.366 qpair failed and we were unable to recover it. 00:30:59.366 [2024-11-28 23:23:02.884302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.884436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.884465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.366 qpair failed and we were unable to recover it. 00:30:59.366 [2024-11-28 23:23:02.884606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.884694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.884718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.366 qpair failed and we were unable to recover it. 00:30:59.366 [2024-11-28 23:23:02.884865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.884974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.885004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.366 qpair failed and we were unable to recover it. 00:30:59.366 [2024-11-28 23:23:02.885153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.885266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.885290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.366 qpair failed and we were unable to recover it. 00:30:59.366 [2024-11-28 23:23:02.885379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.885502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.885528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.366 qpair failed and we were unable to recover it. 00:30:59.366 [2024-11-28 23:23:02.885674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.885771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.885802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.366 qpair failed and we were unable to recover it. 00:30:59.366 [2024-11-28 23:23:02.885934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.886091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.886119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.366 qpair failed and we were unable to recover it. 00:30:59.366 [2024-11-28 23:23:02.886219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.886332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.886357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.366 qpair failed and we were unable to recover it. 00:30:59.366 [2024-11-28 23:23:02.886511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.886646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.886681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.366 qpair failed and we were unable to recover it. 00:30:59.366 [2024-11-28 23:23:02.886772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.886871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.886898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.366 qpair failed and we were unable to recover it. 00:30:59.366 [2024-11-28 23:23:02.887011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.887128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.887152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.366 qpair failed and we were unable to recover it. 00:30:59.366 [2024-11-28 23:23:02.887259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.887343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.887369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.366 qpair failed and we were unable to recover it. 00:30:59.366 [2024-11-28 23:23:02.887500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.366 [2024-11-28 23:23:02.887584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.887609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.367 qpair failed and we were unable to recover it. 00:30:59.367 [2024-11-28 23:23:02.887738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.887881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.887905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.367 qpair failed and we were unable to recover it. 00:30:59.367 [2024-11-28 23:23:02.888025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.888185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.888213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.367 qpair failed and we were unable to recover it. 00:30:59.367 [2024-11-28 23:23:02.888347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.888495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.888523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.367 qpair failed and we were unable to recover it. 00:30:59.367 [2024-11-28 23:23:02.888670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.888755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.888779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.367 qpair failed and we were unable to recover it. 00:30:59.367 [2024-11-28 23:23:02.888878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.888989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.889018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.367 qpair failed and we were unable to recover it. 00:30:59.367 [2024-11-28 23:23:02.889121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.889259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.889284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.367 qpair failed and we were unable to recover it. 00:30:59.367 [2024-11-28 23:23:02.889400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.889524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.889548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.367 qpair failed and we were unable to recover it. 00:30:59.367 [2024-11-28 23:23:02.889726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.889852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.889894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.367 qpair failed and we were unable to recover it. 00:30:59.367 [2024-11-28 23:23:02.890037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.890129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.890154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.367 qpair failed and we were unable to recover it. 00:30:59.367 [2024-11-28 23:23:02.890248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.890364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.890390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.367 qpair failed and we were unable to recover it. 00:30:59.367 [2024-11-28 23:23:02.890536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.890689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.890717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.367 qpair failed and we were unable to recover it. 00:30:59.367 [2024-11-28 23:23:02.890823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.890974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.891002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.367 qpair failed and we were unable to recover it. 00:30:59.367 [2024-11-28 23:23:02.891173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.891266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.891292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.367 qpair failed and we were unable to recover it. 00:30:59.367 [2024-11-28 23:23:02.891437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.891562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.891590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.367 qpair failed and we were unable to recover it. 00:30:59.367 [2024-11-28 23:23:02.891732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.891813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.891838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.367 qpair failed and we were unable to recover it. 00:30:59.367 [2024-11-28 23:23:02.891947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.892063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.892088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.367 qpair failed and we were unable to recover it. 00:30:59.367 [2024-11-28 23:23:02.892208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.892362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.892390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.367 qpair failed and we were unable to recover it. 00:30:59.367 [2024-11-28 23:23:02.892548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.892671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.892695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.367 qpair failed and we were unable to recover it. 00:30:59.367 [2024-11-28 23:23:02.892808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.892921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.892946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.367 qpair failed and we were unable to recover it. 00:30:59.367 [2024-11-28 23:23:02.893094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.893187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.893215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.367 qpair failed and we were unable to recover it. 00:30:59.367 [2024-11-28 23:23:02.893342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.893479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.893507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.367 qpair failed and we were unable to recover it. 00:30:59.367 [2024-11-28 23:23:02.893623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.893740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.893765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.367 qpair failed and we were unable to recover it. 00:30:59.367 [2024-11-28 23:23:02.893861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.894010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.894034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.367 qpair failed and we were unable to recover it. 00:30:59.367 [2024-11-28 23:23:02.894140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.894279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.894307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.367 qpair failed and we were unable to recover it. 00:30:59.367 [2024-11-28 23:23:02.894457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.894606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.894631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.367 qpair failed and we were unable to recover it. 00:30:59.367 [2024-11-28 23:23:02.894817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.894942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.894971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.367 qpair failed and we were unable to recover it. 00:30:59.367 [2024-11-28 23:23:02.895128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.895284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.895311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.367 qpair failed and we were unable to recover it. 00:30:59.367 [2024-11-28 23:23:02.895490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.895585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.895609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.367 qpair failed and we were unable to recover it. 00:30:59.367 [2024-11-28 23:23:02.895768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.895888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.367 [2024-11-28 23:23:02.895915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.367 qpair failed and we were unable to recover it. 00:30:59.368 [2024-11-28 23:23:02.896069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.896204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.896229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.368 qpair failed and we were unable to recover it. 00:30:59.368 [2024-11-28 23:23:02.896346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.896449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.896476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.368 qpair failed and we were unable to recover it. 00:30:59.368 [2024-11-28 23:23:02.896636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.896761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.896789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.368 qpair failed and we were unable to recover it. 00:30:59.368 [2024-11-28 23:23:02.896919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.897042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.897070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.368 qpair failed and we were unable to recover it. 00:30:59.368 [2024-11-28 23:23:02.897204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.897296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.897326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.368 qpair failed and we were unable to recover it. 00:30:59.368 [2024-11-28 23:23:02.897465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.897596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.897624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.368 qpair failed and we were unable to recover it. 00:30:59.368 [2024-11-28 23:23:02.897732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.897856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.897884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.368 qpair failed and we were unable to recover it. 00:30:59.368 [2024-11-28 23:23:02.898059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.898198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.898240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.368 qpair failed and we were unable to recover it. 00:30:59.368 [2024-11-28 23:23:02.898371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.898473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.898502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.368 qpair failed and we were unable to recover it. 00:30:59.368 [2024-11-28 23:23:02.898640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.898738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.898764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.368 qpair failed and we were unable to recover it. 00:30:59.368 [2024-11-28 23:23:02.898875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.898992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.899018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.368 qpair failed and we were unable to recover it. 00:30:59.368 [2024-11-28 23:23:02.899157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.899262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.899291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.368 qpair failed and we were unable to recover it. 00:30:59.368 [2024-11-28 23:23:02.899474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.899618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.899644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.368 qpair failed and we were unable to recover it. 00:30:59.368 [2024-11-28 23:23:02.899736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.899844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.899870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.368 qpair failed and we were unable to recover it. 00:30:59.368 [2024-11-28 23:23:02.899997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.900099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.900128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.368 qpair failed and we were unable to recover it. 00:30:59.368 [2024-11-28 23:23:02.900290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.900425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.900454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.368 qpair failed and we were unable to recover it. 00:30:59.368 [2024-11-28 23:23:02.900590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.900732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.900757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.368 qpair failed and we were unable to recover it. 00:30:59.368 [2024-11-28 23:23:02.900867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.901020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.901048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.368 qpair failed and we were unable to recover it. 00:30:59.368 [2024-11-28 23:23:02.901149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.901248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.901276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.368 qpair failed and we were unable to recover it. 00:30:59.368 [2024-11-28 23:23:02.901464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.901585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.901626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.368 qpair failed and we were unable to recover it. 00:30:59.368 [2024-11-28 23:23:02.901775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.901892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.901917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.368 qpair failed and we were unable to recover it. 00:30:59.368 [2024-11-28 23:23:02.902033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.902136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.902164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.368 qpair failed and we were unable to recover it. 00:30:59.368 [2024-11-28 23:23:02.902272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.902385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.902417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.368 qpair failed and we were unable to recover it. 00:30:59.368 [2024-11-28 23:23:02.902531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.902675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.902702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.368 qpair failed and we were unable to recover it. 00:30:59.368 [2024-11-28 23:23:02.902845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.902961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.902989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.368 qpair failed and we were unable to recover it. 00:30:59.368 [2024-11-28 23:23:02.903134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.903281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.903306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.368 qpair failed and we were unable to recover it. 00:30:59.368 [2024-11-28 23:23:02.903467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.903616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.903644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.368 qpair failed and we were unable to recover it. 00:30:59.368 [2024-11-28 23:23:02.903766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.903911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.903938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.368 qpair failed and we were unable to recover it. 00:30:59.368 [2024-11-28 23:23:02.904072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.904152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.368 [2024-11-28 23:23:02.904177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.368 qpair failed and we were unable to recover it. 00:30:59.368 [2024-11-28 23:23:02.904288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.904460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.904489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.369 qpair failed and we were unable to recover it. 00:30:59.369 [2024-11-28 23:23:02.904588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.904725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.904753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.369 qpair failed and we were unable to recover it. 00:30:59.369 [2024-11-28 23:23:02.904859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.904974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.905000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.369 qpair failed and we were unable to recover it. 00:30:59.369 [2024-11-28 23:23:02.905134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.905257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.905285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.369 qpair failed and we were unable to recover it. 00:30:59.369 [2024-11-28 23:23:02.905409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.905538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.905566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.369 qpair failed and we were unable to recover it. 00:30:59.369 [2024-11-28 23:23:02.905685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.905769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.905795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.369 qpair failed and we were unable to recover it. 00:30:59.369 [2024-11-28 23:23:02.905948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.906076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.906104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.369 qpair failed and we were unable to recover it. 00:30:59.369 [2024-11-28 23:23:02.906191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.906319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.906347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.369 qpair failed and we were unable to recover it. 00:30:59.369 [2024-11-28 23:23:02.906514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.906638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.906663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.369 qpair failed and we were unable to recover it. 00:30:59.369 [2024-11-28 23:23:02.906756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.906916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.906944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.369 qpair failed and we were unable to recover it. 00:30:59.369 [2024-11-28 23:23:02.907076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.907231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.907258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.369 qpair failed and we were unable to recover it. 00:30:59.369 [2024-11-28 23:23:02.907409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.907502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.907526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.369 qpair failed and we were unable to recover it. 00:30:59.369 [2024-11-28 23:23:02.907673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.907813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.907839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.369 qpair failed and we were unable to recover it. 00:30:59.369 [2024-11-28 23:23:02.907938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.908027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.908052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.369 qpair failed and we were unable to recover it. 00:30:59.369 [2024-11-28 23:23:02.908194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.908281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.908306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.369 qpair failed and we were unable to recover it. 00:30:59.369 [2024-11-28 23:23:02.908402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.908497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.908523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.369 qpair failed and we were unable to recover it. 00:30:59.369 [2024-11-28 23:23:02.908657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.908792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.908820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.369 qpair failed and we were unable to recover it. 00:30:59.369 [2024-11-28 23:23:02.908947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.909035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.909062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.369 qpair failed and we were unable to recover it. 00:30:59.369 [2024-11-28 23:23:02.909170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.909319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.909347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.369 qpair failed and we were unable to recover it. 00:30:59.369 [2024-11-28 23:23:02.909474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.909573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.909600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.369 qpair failed and we were unable to recover it. 00:30:59.369 [2024-11-28 23:23:02.909719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.909838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.909863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.369 qpair failed and we were unable to recover it. 00:30:59.369 [2024-11-28 23:23:02.909960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.910103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.910132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.369 qpair failed and we were unable to recover it. 00:30:59.369 [2024-11-28 23:23:02.910236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.910372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.910405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.369 qpair failed and we were unable to recover it. 00:30:59.369 [2024-11-28 23:23:02.910537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.910624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.910650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.369 qpair failed and we were unable to recover it. 00:30:59.369 [2024-11-28 23:23:02.910790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.910887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.910915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.369 qpair failed and we were unable to recover it. 00:30:59.369 [2024-11-28 23:23:02.911020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.911118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.911146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.369 qpair failed and we were unable to recover it. 00:30:59.369 [2024-11-28 23:23:02.911292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.911369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.369 [2024-11-28 23:23:02.911422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.369 qpair failed and we were unable to recover it. 00:30:59.369 [2024-11-28 23:23:02.911533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.651 [2024-11-28 23:23:02.911674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.651 [2024-11-28 23:23:02.911703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.651 qpair failed and we were unable to recover it. 00:30:59.651 [2024-11-28 23:23:02.911857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.651 [2024-11-28 23:23:02.911980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.651 [2024-11-28 23:23:02.912007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.651 qpair failed and we were unable to recover it. 00:30:59.651 [2024-11-28 23:23:02.912122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.651 [2024-11-28 23:23:02.912237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.651 [2024-11-28 23:23:02.912262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.651 qpair failed and we were unable to recover it. 00:30:59.651 [2024-11-28 23:23:02.912358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.651 [2024-11-28 23:23:02.912458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.651 [2024-11-28 23:23:02.912484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.651 qpair failed and we were unable to recover it. 00:30:59.651 [2024-11-28 23:23:02.912622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.651 [2024-11-28 23:23:02.912741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.651 [2024-11-28 23:23:02.912769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.652 qpair failed and we were unable to recover it. 00:30:59.652 [2024-11-28 23:23:02.912878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.912999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.913024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.652 qpair failed and we were unable to recover it. 00:30:59.652 [2024-11-28 23:23:02.913155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.913238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.913266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.652 qpair failed and we were unable to recover it. 00:30:59.652 [2024-11-28 23:23:02.913364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.913497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.913525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.652 qpair failed and we were unable to recover it. 00:30:59.652 [2024-11-28 23:23:02.913702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.913787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.913812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.652 qpair failed and we were unable to recover it. 00:30:59.652 [2024-11-28 23:23:02.913914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.914003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.914030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.652 qpair failed and we were unable to recover it. 00:30:59.652 [2024-11-28 23:23:02.914118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.914210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.914239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.652 qpair failed and we were unable to recover it. 00:30:59.652 [2024-11-28 23:23:02.914377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.914481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.914507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.652 qpair failed and we were unable to recover it. 00:30:59.652 [2024-11-28 23:23:02.914588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.914742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.914767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.652 qpair failed and we were unable to recover it. 00:30:59.652 [2024-11-28 23:23:02.914884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.915017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.915046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.652 qpair failed and we were unable to recover it. 00:30:59.652 [2024-11-28 23:23:02.915190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.915299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.915324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.652 qpair failed and we were unable to recover it. 00:30:59.652 [2024-11-28 23:23:02.915500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.915615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.915640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.652 qpair failed and we were unable to recover it. 00:30:59.652 [2024-11-28 23:23:02.915775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.915926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.915954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.652 qpair failed and we were unable to recover it. 00:30:59.652 [2024-11-28 23:23:02.916084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.916170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.916194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.652 qpair failed and we were unable to recover it. 00:30:59.652 [2024-11-28 23:23:02.916328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.916412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.916441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.652 qpair failed and we were unable to recover it. 00:30:59.652 [2024-11-28 23:23:02.916545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.916664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.916705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.652 qpair failed and we were unable to recover it. 00:30:59.652 [2024-11-28 23:23:02.916819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.916960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.916984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.652 qpair failed and we were unable to recover it. 00:30:59.652 [2024-11-28 23:23:02.917096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.917210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.917234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.652 qpair failed and we were unable to recover it. 00:30:59.652 [2024-11-28 23:23:02.917319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.917439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.917464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.652 qpair failed and we were unable to recover it. 00:30:59.652 [2024-11-28 23:23:02.917603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.917729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.917757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.652 qpair failed and we were unable to recover it. 00:30:59.652 [2024-11-28 23:23:02.917919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.918009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.918037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.652 qpair failed and we were unable to recover it. 00:30:59.652 [2024-11-28 23:23:02.918160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.918288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.918315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.652 qpair failed and we were unable to recover it. 00:30:59.652 [2024-11-28 23:23:02.918458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.918579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.918605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.652 qpair failed and we were unable to recover it. 00:30:59.652 [2024-11-28 23:23:02.918736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.918835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.918862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.652 qpair failed and we were unable to recover it. 00:30:59.652 [2024-11-28 23:23:02.919012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.919134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.919162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.652 qpair failed and we were unable to recover it. 00:30:59.652 [2024-11-28 23:23:02.919270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.919383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.919417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.652 qpair failed and we were unable to recover it. 00:30:59.652 [2024-11-28 23:23:02.919529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.919695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.919723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.652 qpair failed and we were unable to recover it. 00:30:59.652 [2024-11-28 23:23:02.919931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.920029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.920057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.652 qpair failed and we were unable to recover it. 00:30:59.652 [2024-11-28 23:23:02.920163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.920246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.920270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.652 qpair failed and we were unable to recover it. 00:30:59.652 [2024-11-28 23:23:02.920417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.920538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.652 [2024-11-28 23:23:02.920563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.652 qpair failed and we were unable to recover it. 00:30:59.653 [2024-11-28 23:23:02.920682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.920796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.920820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.653 qpair failed and we were unable to recover it. 00:30:59.653 [2024-11-28 23:23:02.920938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.921028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.921052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.653 qpair failed and we were unable to recover it. 00:30:59.653 [2024-11-28 23:23:02.921173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.921296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.921323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.653 qpair failed and we were unable to recover it. 00:30:59.653 [2024-11-28 23:23:02.921441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.921561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.921586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.653 qpair failed and we were unable to recover it. 00:30:59.653 [2024-11-28 23:23:02.921667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.921811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.921835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.653 qpair failed and we were unable to recover it. 00:30:59.653 [2024-11-28 23:23:02.921978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.922106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.922133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.653 qpair failed and we were unable to recover it. 00:30:59.653 [2024-11-28 23:23:02.922228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.922352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.922380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.653 qpair failed and we were unable to recover it. 00:30:59.653 [2024-11-28 23:23:02.922497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.922580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.922604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.653 qpair failed and we were unable to recover it. 00:30:59.653 [2024-11-28 23:23:02.922695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.922803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.922843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.653 qpair failed and we were unable to recover it. 00:30:59.653 [2024-11-28 23:23:02.922938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.923062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.923089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.653 qpair failed and we were unable to recover it. 00:30:59.653 [2024-11-28 23:23:02.923261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.923405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.923447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.653 qpair failed and we were unable to recover it. 00:30:59.653 [2024-11-28 23:23:02.923548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.923700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.923727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.653 qpair failed and we were unable to recover it. 00:30:59.653 [2024-11-28 23:23:02.923852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.923983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.924009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.653 qpair failed and we were unable to recover it. 00:30:59.653 [2024-11-28 23:23:02.924173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.924265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.924290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.653 qpair failed and we were unable to recover it. 00:30:59.653 [2024-11-28 23:23:02.924420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.924538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.924563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.653 qpair failed and we were unable to recover it. 00:30:59.653 [2024-11-28 23:23:02.924693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.924845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.924873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.653 qpair failed and we were unable to recover it. 00:30:59.653 [2024-11-28 23:23:02.925030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.925143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.925175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.653 qpair failed and we were unable to recover it. 00:30:59.653 [2024-11-28 23:23:02.925327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.925446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.925474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.653 qpair failed and we were unable to recover it. 00:30:59.653 [2024-11-28 23:23:02.925578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.925696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.925723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.653 qpair failed and we were unable to recover it. 00:30:59.653 [2024-11-28 23:23:02.925863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.925974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.925999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.653 qpair failed and we were unable to recover it. 00:30:59.653 [2024-11-28 23:23:02.926124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.926223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.926251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.653 qpair failed and we were unable to recover it. 00:30:59.653 [2024-11-28 23:23:02.926384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.926552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.926577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.653 qpair failed and we were unable to recover it. 00:30:59.653 [2024-11-28 23:23:02.926665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.926814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.926839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.653 qpair failed and we were unable to recover it. 00:30:59.653 [2024-11-28 23:23:02.926973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.927096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.927124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.653 qpair failed and we were unable to recover it. 00:30:59.653 [2024-11-28 23:23:02.927278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.927407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.927435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.653 qpair failed and we were unable to recover it. 00:30:59.653 [2024-11-28 23:23:02.927577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.927663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.927687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.653 qpair failed and we were unable to recover it. 00:30:59.653 [2024-11-28 23:23:02.927816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.927915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.927943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.653 qpair failed and we were unable to recover it. 00:30:59.653 [2024-11-28 23:23:02.928065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.928161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.928191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.653 qpair failed and we were unable to recover it. 00:30:59.653 [2024-11-28 23:23:02.928347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.928464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.653 [2024-11-28 23:23:02.928491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.653 qpair failed and we were unable to recover it. 00:30:59.654 [2024-11-28 23:23:02.928636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.928771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.928798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.654 qpair failed and we were unable to recover it. 00:30:59.654 [2024-11-28 23:23:02.928954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.929078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.929105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.654 qpair failed and we were unable to recover it. 00:30:59.654 [2024-11-28 23:23:02.929208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.929287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.929311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.654 qpair failed and we were unable to recover it. 00:30:59.654 [2024-11-28 23:23:02.929434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.929525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.929550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.654 qpair failed and we were unable to recover it. 00:30:59.654 [2024-11-28 23:23:02.929688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.929782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.929809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.654 qpair failed and we were unable to recover it. 00:30:59.654 [2024-11-28 23:23:02.929973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.930056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.930081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.654 qpair failed and we were unable to recover it. 00:30:59.654 [2024-11-28 23:23:02.930193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.930346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.930375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.654 qpair failed and we were unable to recover it. 00:30:59.654 [2024-11-28 23:23:02.930504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.930631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.930658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.654 qpair failed and we were unable to recover it. 00:30:59.654 [2024-11-28 23:23:02.930824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.930970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.930995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.654 qpair failed and we were unable to recover it. 00:30:59.654 [2024-11-28 23:23:02.931126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.931256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.931284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.654 qpair failed and we were unable to recover it. 00:30:59.654 [2024-11-28 23:23:02.931413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.931567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.931595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.654 qpair failed and we were unable to recover it. 00:30:59.654 [2024-11-28 23:23:02.931679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.931815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.931840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.654 qpair failed and we were unable to recover it. 00:30:59.654 [2024-11-28 23:23:02.931979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.932140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.932168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.654 qpair failed and we were unable to recover it. 00:30:59.654 [2024-11-28 23:23:02.932301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.932428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.932456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.654 qpair failed and we were unable to recover it. 00:30:59.654 [2024-11-28 23:23:02.932569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.932690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.932714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.654 qpair failed and we were unable to recover it. 00:30:59.654 [2024-11-28 23:23:02.932807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.932948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.932991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.654 qpair failed and we were unable to recover it. 00:30:59.654 [2024-11-28 23:23:02.933099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.933257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.933281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.654 qpair failed and we were unable to recover it. 00:30:59.654 [2024-11-28 23:23:02.933419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.933508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.933532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.654 qpair failed and we were unable to recover it. 00:30:59.654 [2024-11-28 23:23:02.933705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.933811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.933838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.654 qpair failed and we were unable to recover it. 00:30:59.654 [2024-11-28 23:23:02.933967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.934088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.934116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.654 qpair failed and we were unable to recover it. 00:30:59.654 [2024-11-28 23:23:02.934256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.934405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.934432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.654 qpair failed and we were unable to recover it. 00:30:59.654 [2024-11-28 23:23:02.934605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.934736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.934765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.654 qpair failed and we were unable to recover it. 00:30:59.654 [2024-11-28 23:23:02.934886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.935040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.935067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.654 qpair failed and we were unable to recover it. 00:30:59.654 [2024-11-28 23:23:02.935185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.935347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.935376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.654 qpair failed and we were unable to recover it. 00:30:59.654 [2024-11-28 23:23:02.935517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.935673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.935701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.654 qpair failed and we were unable to recover it. 00:30:59.654 [2024-11-28 23:23:02.935827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.935956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.935984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.654 qpair failed and we were unable to recover it. 00:30:59.654 [2024-11-28 23:23:02.936114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.936261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.936285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.654 qpair failed and we were unable to recover it. 00:30:59.654 [2024-11-28 23:23:02.936484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.936577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.936603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.654 qpair failed and we were unable to recover it. 00:30:59.654 [2024-11-28 23:23:02.936689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.936798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.654 [2024-11-28 23:23:02.936827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.654 qpair failed and we were unable to recover it. 00:30:59.654 [2024-11-28 23:23:02.936942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.937053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.937079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.655 qpair failed and we were unable to recover it. 00:30:59.655 [2024-11-28 23:23:02.937236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.937359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.937387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.655 qpair failed and we were unable to recover it. 00:30:59.655 [2024-11-28 23:23:02.937498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.937619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.937648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.655 qpair failed and we were unable to recover it. 00:30:59.655 [2024-11-28 23:23:02.937764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.937852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.937879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.655 qpair failed and we were unable to recover it. 00:30:59.655 [2024-11-28 23:23:02.938047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.938165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.938194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.655 qpair failed and we were unable to recover it. 00:30:59.655 [2024-11-28 23:23:02.938326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.938448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.938476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.655 qpair failed and we were unable to recover it. 00:30:59.655 [2024-11-28 23:23:02.938606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.938723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.938747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.655 qpair failed and we were unable to recover it. 00:30:59.655 [2024-11-28 23:23:02.938848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.939009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.939037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.655 qpair failed and we were unable to recover it. 00:30:59.655 [2024-11-28 23:23:02.939164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.939294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.939322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.655 qpair failed and we were unable to recover it. 00:30:59.655 [2024-11-28 23:23:02.939459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.939570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.939596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.655 qpair failed and we were unable to recover it. 00:30:59.655 [2024-11-28 23:23:02.939702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.939818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.939846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.655 qpair failed and we were unable to recover it. 00:30:59.655 [2024-11-28 23:23:02.939975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.940105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.940147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.655 qpair failed and we were unable to recover it. 00:30:59.655 [2024-11-28 23:23:02.940232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.940310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.940335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.655 qpair failed and we were unable to recover it. 00:30:59.655 [2024-11-28 23:23:02.940483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.940620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.940648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.655 qpair failed and we were unable to recover it. 00:30:59.655 [2024-11-28 23:23:02.940742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.940878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.940904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.655 qpair failed and we were unable to recover it. 00:30:59.655 [2024-11-28 23:23:02.941020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.941140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.941165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.655 qpair failed and we were unable to recover it. 00:30:59.655 [2024-11-28 23:23:02.941262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.941340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.941366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.655 qpair failed and we were unable to recover it. 00:30:59.655 [2024-11-28 23:23:02.941528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.941636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.941661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.655 qpair failed and we were unable to recover it. 00:30:59.655 [2024-11-28 23:23:02.941802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.941883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.941907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.655 qpair failed and we were unable to recover it. 00:30:59.655 [2024-11-28 23:23:02.942023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.942145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.942174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.655 qpair failed and we were unable to recover it. 00:30:59.655 [2024-11-28 23:23:02.942302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.942433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.942459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.655 qpair failed and we were unable to recover it. 00:30:59.655 [2024-11-28 23:23:02.942572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.942689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.942714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.655 qpair failed and we were unable to recover it. 00:30:59.655 [2024-11-28 23:23:02.942800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.942942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.942967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.655 qpair failed and we were unable to recover it. 00:30:59.655 [2024-11-28 23:23:02.943075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.943205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.943234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.655 qpair failed and we were unable to recover it. 00:30:59.655 [2024-11-28 23:23:02.943321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.943434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.943460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.655 qpair failed and we were unable to recover it. 00:30:59.655 [2024-11-28 23:23:02.943545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.943675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.943703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.655 qpair failed and we were unable to recover it. 00:30:59.655 [2024-11-28 23:23:02.943809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.943936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.943963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.655 qpair failed and we were unable to recover it. 00:30:59.655 [2024-11-28 23:23:02.944108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.944250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.944275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.655 qpair failed and we were unable to recover it. 00:30:59.655 [2024-11-28 23:23:02.944421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.944561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.944586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.655 qpair failed and we were unable to recover it. 00:30:59.655 [2024-11-28 23:23:02.944706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.655 [2024-11-28 23:23:02.944840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.944868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.656 qpair failed and we were unable to recover it. 00:30:59.656 [2024-11-28 23:23:02.945036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.945157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.945182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.656 qpair failed and we were unable to recover it. 00:30:59.656 [2024-11-28 23:23:02.945308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.945423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.945453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.656 qpair failed and we were unable to recover it. 00:30:59.656 [2024-11-28 23:23:02.945549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.945642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.945669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.656 qpair failed and we were unable to recover it. 00:30:59.656 [2024-11-28 23:23:02.945777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.945888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.945912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.656 qpair failed and we were unable to recover it. 00:30:59.656 [2024-11-28 23:23:02.946073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.946203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.946230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.656 qpair failed and we were unable to recover it. 00:30:59.656 [2024-11-28 23:23:02.946325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.946441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.946466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.656 qpair failed and we were unable to recover it. 00:30:59.656 [2024-11-28 23:23:02.946612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.946732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.946757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.656 qpair failed and we were unable to recover it. 00:30:59.656 [2024-11-28 23:23:02.946869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.946992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.947019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.656 qpair failed and we were unable to recover it. 00:30:59.656 [2024-11-28 23:23:02.947177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.947302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.947330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.656 qpair failed and we were unable to recover it. 00:30:59.656 [2024-11-28 23:23:02.947488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.947580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.947606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.656 qpair failed and we were unable to recover it. 00:30:59.656 [2024-11-28 23:23:02.947747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.947835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.947863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.656 qpair failed and we were unable to recover it. 00:30:59.656 [2024-11-28 23:23:02.947990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.948075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.948103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.656 qpair failed and we were unable to recover it. 00:30:59.656 [2024-11-28 23:23:02.948246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.948343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.948372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.656 qpair failed and we were unable to recover it. 00:30:59.656 [2024-11-28 23:23:02.948482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.948572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.948596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.656 qpair failed and we were unable to recover it. 00:30:59.656 [2024-11-28 23:23:02.948726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.948847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.948875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.656 qpair failed and we were unable to recover it. 00:30:59.656 [2024-11-28 23:23:02.949042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.949162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.949187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.656 qpair failed and we were unable to recover it. 00:30:59.656 [2024-11-28 23:23:02.949277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.949400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.949425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.656 qpair failed and we were unable to recover it. 00:30:59.656 [2024-11-28 23:23:02.949571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.949713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.949737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.656 qpair failed and we were unable to recover it. 00:30:59.656 [2024-11-28 23:23:02.949834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.949973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.949998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.656 qpair failed and we were unable to recover it. 00:30:59.656 [2024-11-28 23:23:02.950091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.950196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.950223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.656 qpair failed and we were unable to recover it. 00:30:59.656 [2024-11-28 23:23:02.950353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.950465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.950495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.656 qpair failed and we were unable to recover it. 00:30:59.656 [2024-11-28 23:23:02.950640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.950758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.950799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.656 qpair failed and we were unable to recover it. 00:30:59.656 [2024-11-28 23:23:02.950901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.950995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.951023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.656 qpair failed and we were unable to recover it. 00:30:59.656 [2024-11-28 23:23:02.951152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.951253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.656 [2024-11-28 23:23:02.951282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.656 qpair failed and we were unable to recover it. 00:30:59.656 [2024-11-28 23:23:02.951424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.951564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.951590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.657 qpair failed and we were unable to recover it. 00:30:59.657 [2024-11-28 23:23:02.951734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.951901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.951926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.657 qpair failed and we were unable to recover it. 00:30:59.657 [2024-11-28 23:23:02.952064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.952175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.952200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.657 qpair failed and we were unable to recover it. 00:30:59.657 [2024-11-28 23:23:02.952356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.952481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.952506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.657 qpair failed and we were unable to recover it. 00:30:59.657 [2024-11-28 23:23:02.952597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.952714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.952739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.657 qpair failed and we were unable to recover it. 00:30:59.657 [2024-11-28 23:23:02.952874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.952960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.952987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.657 qpair failed and we were unable to recover it. 00:30:59.657 [2024-11-28 23:23:02.953090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.953170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.953194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.657 qpair failed and we were unable to recover it. 00:30:59.657 [2024-11-28 23:23:02.953315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.953432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.953460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.657 qpair failed and we were unable to recover it. 00:30:59.657 [2024-11-28 23:23:02.953588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.953724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.953748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.657 qpair failed and we were unable to recover it. 00:30:59.657 [2024-11-28 23:23:02.953884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.953999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.954024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.657 qpair failed and we were unable to recover it. 00:30:59.657 [2024-11-28 23:23:02.954138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.954235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.954262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.657 qpair failed and we were unable to recover it. 00:30:59.657 [2024-11-28 23:23:02.954418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.954548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.954577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.657 qpair failed and we were unable to recover it. 00:30:59.657 [2024-11-28 23:23:02.954693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.954833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.954858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.657 qpair failed and we were unable to recover it. 00:30:59.657 [2024-11-28 23:23:02.955034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.955158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.955184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.657 qpair failed and we were unable to recover it. 00:30:59.657 [2024-11-28 23:23:02.955350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.955490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.955518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.657 qpair failed and we were unable to recover it. 00:30:59.657 [2024-11-28 23:23:02.955637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.955778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.955803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.657 qpair failed and we were unable to recover it. 00:30:59.657 [2024-11-28 23:23:02.955919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.956021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.956048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.657 qpair failed and we were unable to recover it. 00:30:59.657 [2024-11-28 23:23:02.956187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.956309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.956336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.657 qpair failed and we were unable to recover it. 00:30:59.657 [2024-11-28 23:23:02.956457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.956545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.956570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.657 qpair failed and we were unable to recover it. 00:30:59.657 [2024-11-28 23:23:02.956666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.956843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.956867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.657 qpair failed and we were unable to recover it. 00:30:59.657 [2024-11-28 23:23:02.956992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.957105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.957132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.657 qpair failed and we were unable to recover it. 00:30:59.657 [2024-11-28 23:23:02.957295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.957419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.957445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.657 qpair failed and we were unable to recover it. 00:30:59.657 [2024-11-28 23:23:02.957590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.957731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.957756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.657 qpair failed and we were unable to recover it. 00:30:59.657 [2024-11-28 23:23:02.957915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.958042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.958071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.657 qpair failed and we were unable to recover it. 00:30:59.657 [2024-11-28 23:23:02.958178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.958295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.958319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.657 qpair failed and we were unable to recover it. 00:30:59.657 [2024-11-28 23:23:02.958459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.958618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.958646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.657 qpair failed and we were unable to recover it. 00:30:59.657 [2024-11-28 23:23:02.958746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.958837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.958864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.657 qpair failed and we were unable to recover it. 00:30:59.657 [2024-11-28 23:23:02.958979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.959101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.959125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.657 qpair failed and we were unable to recover it. 00:30:59.657 [2024-11-28 23:23:02.959233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.959387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.959433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.657 qpair failed and we were unable to recover it. 00:30:59.657 [2024-11-28 23:23:02.959565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.657 [2024-11-28 23:23:02.959659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.959686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.658 qpair failed and we were unable to recover it. 00:30:59.658 [2024-11-28 23:23:02.959807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.959947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.959971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.658 qpair failed and we were unable to recover it. 00:30:59.658 [2024-11-28 23:23:02.960053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.960170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.960195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.658 qpair failed and we were unable to recover it. 00:30:59.658 [2024-11-28 23:23:02.960324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.960463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.960492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.658 qpair failed and we were unable to recover it. 00:30:59.658 [2024-11-28 23:23:02.960629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.960715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.960741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.658 qpair failed and we were unable to recover it. 00:30:59.658 [2024-11-28 23:23:02.960827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.960963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.960991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.658 qpair failed and we were unable to recover it. 00:30:59.658 [2024-11-28 23:23:02.961118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.961216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.961244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.658 qpair failed and we were unable to recover it. 00:30:59.658 [2024-11-28 23:23:02.961378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.961469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.961494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.658 qpair failed and we were unable to recover it. 00:30:59.658 [2024-11-28 23:23:02.961622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.961718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.961746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.658 qpair failed and we were unable to recover it. 00:30:59.658 [2024-11-28 23:23:02.961881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.962036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.962064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.658 qpair failed and we were unable to recover it. 00:30:59.658 [2024-11-28 23:23:02.962196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.962314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.962339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.658 qpair failed and we were unable to recover it. 00:30:59.658 [2024-11-28 23:23:02.962455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.962581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.962608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.658 qpair failed and we were unable to recover it. 00:30:59.658 [2024-11-28 23:23:02.962762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.962885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.962913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.658 qpair failed and we were unable to recover it. 00:30:59.658 [2024-11-28 23:23:02.963012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.963103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.963128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.658 qpair failed and we were unable to recover it. 00:30:59.658 [2024-11-28 23:23:02.963227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.963344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.963369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.658 qpair failed and we were unable to recover it. 00:30:59.658 [2024-11-28 23:23:02.963461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.963556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.963580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.658 qpair failed and we were unable to recover it. 00:30:59.658 [2024-11-28 23:23:02.963693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.963812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.963838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.658 qpair failed and we were unable to recover it. 00:30:59.658 [2024-11-28 23:23:02.963972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.964094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.964133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.658 qpair failed and we were unable to recover it. 00:30:59.658 [2024-11-28 23:23:02.964278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.964412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.964445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.658 qpair failed and we were unable to recover it. 00:30:59.658 [2024-11-28 23:23:02.964593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.964681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.964706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.658 qpair failed and we were unable to recover it. 00:30:59.658 [2024-11-28 23:23:02.964826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.964933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.964975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.658 qpair failed and we were unable to recover it. 00:30:59.658 [2024-11-28 23:23:02.965076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.965238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.965267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.658 qpair failed and we were unable to recover it. 00:30:59.658 [2024-11-28 23:23:02.965408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.965520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.965545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.658 qpair failed and we were unable to recover it. 00:30:59.658 [2024-11-28 23:23:02.965715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.965857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.965882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.658 qpair failed and we were unable to recover it. 00:30:59.658 [2024-11-28 23:23:02.966001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.966114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.966139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.658 qpair failed and we were unable to recover it. 00:30:59.658 [2024-11-28 23:23:02.966226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.966318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.966343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.658 qpair failed and we were unable to recover it. 00:30:59.658 [2024-11-28 23:23:02.966464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.966593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.966621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.658 qpair failed and we were unable to recover it. 00:30:59.658 [2024-11-28 23:23:02.966791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.966902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.966927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.658 qpair failed and we were unable to recover it. 00:30:59.658 [2024-11-28 23:23:02.967019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.967142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.967168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.658 qpair failed and we were unable to recover it. 00:30:59.658 [2024-11-28 23:23:02.967305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.967430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.658 [2024-11-28 23:23:02.967459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.659 qpair failed and we were unable to recover it. 00:30:59.659 [2024-11-28 23:23:02.967587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.967689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.967717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.659 qpair failed and we were unable to recover it. 00:30:59.659 [2024-11-28 23:23:02.967854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.967997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.968021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.659 qpair failed and we were unable to recover it. 00:30:59.659 [2024-11-28 23:23:02.968148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.968285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.968313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.659 qpair failed and we were unable to recover it. 00:30:59.659 [2024-11-28 23:23:02.968449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.968591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.968615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.659 qpair failed and we were unable to recover it. 00:30:59.659 [2024-11-28 23:23:02.968737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.968855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.968880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.659 qpair failed and we were unable to recover it. 00:30:59.659 [2024-11-28 23:23:02.969050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.969147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.969175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.659 qpair failed and we were unable to recover it. 00:30:59.659 [2024-11-28 23:23:02.969300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.969453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.969482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.659 qpair failed and we were unable to recover it. 00:30:59.659 [2024-11-28 23:23:02.969631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.969742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.969767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.659 qpair failed and we were unable to recover it. 00:30:59.659 [2024-11-28 23:23:02.969890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.970033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.970058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.659 qpair failed and we were unable to recover it. 00:30:59.659 [2024-11-28 23:23:02.970170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.970297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.970326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.659 qpair failed and we were unable to recover it. 00:30:59.659 [2024-11-28 23:23:02.970435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.970553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.970579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.659 qpair failed and we were unable to recover it. 00:30:59.659 [2024-11-28 23:23:02.970703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.970861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.970888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.659 qpair failed and we were unable to recover it. 00:30:59.659 [2024-11-28 23:23:02.971026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.971151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.971180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.659 qpair failed and we were unable to recover it. 00:30:59.659 [2024-11-28 23:23:02.971296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.971377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.971428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.659 qpair failed and we were unable to recover it. 00:30:59.659 [2024-11-28 23:23:02.971532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.971671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.971695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.659 qpair failed and we were unable to recover it. 00:30:59.659 [2024-11-28 23:23:02.971793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.971912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.971941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.659 qpair failed and we were unable to recover it. 00:30:59.659 [2024-11-28 23:23:02.972083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.972189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.972215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.659 qpair failed and we were unable to recover it. 00:30:59.659 [2024-11-28 23:23:02.972390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.972540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.972567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.659 qpair failed and we were unable to recover it. 00:30:59.659 [2024-11-28 23:23:02.972721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.972875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.972902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.659 qpair failed and we were unable to recover it. 00:30:59.659 [2024-11-28 23:23:02.973044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.973169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.973194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.659 qpair failed and we were unable to recover it. 00:30:59.659 [2024-11-28 23:23:02.973325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.973456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.973481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.659 qpair failed and we were unable to recover it. 00:30:59.659 [2024-11-28 23:23:02.973574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.973696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.973721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.659 qpair failed and we were unable to recover it. 00:30:59.659 [2024-11-28 23:23:02.973838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.973981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.974005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.659 qpair failed and we were unable to recover it. 00:30:59.659 [2024-11-28 23:23:02.974136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.974226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.974254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.659 qpair failed and we were unable to recover it. 00:30:59.659 [2024-11-28 23:23:02.974376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.974481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.974509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.659 qpair failed and we were unable to recover it. 00:30:59.659 [2024-11-28 23:23:02.974621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.974709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.974733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.659 qpair failed and we were unable to recover it. 00:30:59.659 [2024-11-28 23:23:02.974862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.974952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.974978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.659 qpair failed and we were unable to recover it. 00:30:59.659 [2024-11-28 23:23:02.975073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.975193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.975233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.659 qpair failed and we were unable to recover it. 00:30:59.659 [2024-11-28 23:23:02.975386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.975509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.659 [2024-11-28 23:23:02.975534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.659 qpair failed and we were unable to recover it. 00:30:59.659 [2024-11-28 23:23:02.975651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.975816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.975847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.660 qpair failed and we were unable to recover it. 00:30:59.660 [2024-11-28 23:23:02.975980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.976074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.976102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.660 qpair failed and we were unable to recover it. 00:30:59.660 [2024-11-28 23:23:02.976248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.976358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.976383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.660 qpair failed and we were unable to recover it. 00:30:59.660 [2024-11-28 23:23:02.976540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.976635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.976662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.660 qpair failed and we were unable to recover it. 00:30:59.660 [2024-11-28 23:23:02.976762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.976919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.976943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.660 qpair failed and we were unable to recover it. 00:30:59.660 [2024-11-28 23:23:02.977061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.977176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.977203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.660 qpair failed and we were unable to recover it. 00:30:59.660 [2024-11-28 23:23:02.977313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.977439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.977468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.660 qpair failed and we were unable to recover it. 00:30:59.660 [2024-11-28 23:23:02.977557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.977686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.977714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.660 qpair failed and we were unable to recover it. 00:30:59.660 [2024-11-28 23:23:02.977843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.977943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.977968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.660 qpair failed and we were unable to recover it. 00:30:59.660 [2024-11-28 23:23:02.978085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.978241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.978282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.660 qpair failed and we were unable to recover it. 00:30:59.660 [2024-11-28 23:23:02.978368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.978502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.978530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.660 qpair failed and we were unable to recover it. 00:30:59.660 [2024-11-28 23:23:02.978667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.978788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.978813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.660 qpair failed and we were unable to recover it. 00:30:59.660 [2024-11-28 23:23:02.978957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.979083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.979113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.660 qpair failed and we were unable to recover it. 00:30:59.660 [2024-11-28 23:23:02.979269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.979425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.979465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.660 qpair failed and we were unable to recover it. 00:30:59.660 [2024-11-28 23:23:02.979574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.979667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.979693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.660 qpair failed and we were unable to recover it. 00:30:59.660 [2024-11-28 23:23:02.979792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.979937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.979962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.660 qpair failed and we were unable to recover it. 00:30:59.660 [2024-11-28 23:23:02.980048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.980192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.980220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.660 qpair failed and we were unable to recover it. 00:30:59.660 [2024-11-28 23:23:02.980340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.980423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.980450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.660 qpair failed and we were unable to recover it. 00:30:59.660 [2024-11-28 23:23:02.980537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.980631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.980660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.660 qpair failed and we were unable to recover it. 00:30:59.660 [2024-11-28 23:23:02.980763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.980858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.980885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.660 qpair failed and we were unable to recover it. 00:30:59.660 [2024-11-28 23:23:02.980995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.981102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.981127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.660 qpair failed and we were unable to recover it. 00:30:59.660 [2024-11-28 23:23:02.981271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.981399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.981428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.660 qpair failed and we were unable to recover it. 00:30:59.660 [2024-11-28 23:23:02.981522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.981646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.981676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.660 qpair failed and we were unable to recover it. 00:30:59.660 [2024-11-28 23:23:02.981795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.981938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.981964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.660 qpair failed and we were unable to recover it. 00:30:59.660 [2024-11-28 23:23:02.982055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.982197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.982226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.660 qpair failed and we were unable to recover it. 00:30:59.660 [2024-11-28 23:23:02.982326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.660 [2024-11-28 23:23:02.982484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.982513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.661 qpair failed and we were unable to recover it. 00:30:59.661 [2024-11-28 23:23:02.982654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.982769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.982794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.661 qpair failed and we were unable to recover it. 00:30:59.661 [2024-11-28 23:23:02.982918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.983044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.983073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.661 qpair failed and we were unable to recover it. 00:30:59.661 [2024-11-28 23:23:02.983192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.983315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.983343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.661 qpair failed and we were unable to recover it. 00:30:59.661 [2024-11-28 23:23:02.983539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.983677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.983705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.661 qpair failed and we were unable to recover it. 00:30:59.661 [2024-11-28 23:23:02.983827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.983993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.984018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.661 qpair failed and we were unable to recover it. 00:30:59.661 [2024-11-28 23:23:02.984190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.984281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.984310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.661 qpair failed and we were unable to recover it. 00:30:59.661 [2024-11-28 23:23:02.984475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.984592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.984618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.661 qpair failed and we were unable to recover it. 00:30:59.661 [2024-11-28 23:23:02.984759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.984919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.984947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.661 qpair failed and we were unable to recover it. 00:30:59.661 [2024-11-28 23:23:02.985079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.985194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.985222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.661 qpair failed and we were unable to recover it. 00:30:59.661 [2024-11-28 23:23:02.985363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.985476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.985502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.661 qpair failed and we were unable to recover it. 00:30:59.661 [2024-11-28 23:23:02.985619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.985748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.985773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.661 qpair failed and we were unable to recover it. 00:30:59.661 [2024-11-28 23:23:02.985864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.985979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.986005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.661 qpair failed and we were unable to recover it. 00:30:59.661 [2024-11-28 23:23:02.986083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.986190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.986215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.661 qpair failed and we were unable to recover it. 00:30:59.661 [2024-11-28 23:23:02.986305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.986469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.986498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.661 qpair failed and we were unable to recover it. 00:30:59.661 [2024-11-28 23:23:02.986619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.986722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.986749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.661 qpair failed and we were unable to recover it. 00:30:59.661 [2024-11-28 23:23:02.986882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.987006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.987031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.661 qpair failed and we were unable to recover it. 00:30:59.661 [2024-11-28 23:23:02.987173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.987298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.987325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.661 qpair failed and we were unable to recover it. 00:30:59.661 [2024-11-28 23:23:02.987431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.987567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.987594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.661 qpair failed and we were unable to recover it. 00:30:59.661 [2024-11-28 23:23:02.987734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.987851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.987876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.661 qpair failed and we were unable to recover it. 00:30:59.661 [2024-11-28 23:23:02.988047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.988198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.988225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.661 qpair failed and we were unable to recover it. 00:30:59.661 [2024-11-28 23:23:02.988358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.988522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.988551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.661 qpair failed and we were unable to recover it. 00:30:59.661 [2024-11-28 23:23:02.988692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.988806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.988831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.661 qpair failed and we were unable to recover it. 00:30:59.661 [2024-11-28 23:23:02.988958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.989059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.989086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.661 qpair failed and we were unable to recover it. 00:30:59.661 [2024-11-28 23:23:02.989213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.989310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.989339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.661 qpair failed and we were unable to recover it. 00:30:59.661 [2024-11-28 23:23:02.989473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.989595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.989619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.661 qpair failed and we were unable to recover it. 00:30:59.661 [2024-11-28 23:23:02.989716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.989804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.989833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.661 qpair failed and we were unable to recover it. 00:30:59.661 [2024-11-28 23:23:02.989918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.990003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.990027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.661 qpair failed and we were unable to recover it. 00:30:59.661 [2024-11-28 23:23:02.990120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.990234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.990259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.661 qpair failed and we were unable to recover it. 00:30:59.661 [2024-11-28 23:23:02.990406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.990523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.661 [2024-11-28 23:23:02.990547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.661 qpair failed and we were unable to recover it. 00:30:59.662 [2024-11-28 23:23:02.990662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.990754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.990778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.662 qpair failed and we were unable to recover it. 00:30:59.662 [2024-11-28 23:23:02.990898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.990989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.991013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.662 qpair failed and we were unable to recover it. 00:30:59.662 [2024-11-28 23:23:02.991150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.991271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.991299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.662 qpair failed and we were unable to recover it. 00:30:59.662 [2024-11-28 23:23:02.991427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.991537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.991562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.662 qpair failed and we were unable to recover it. 00:30:59.662 [2024-11-28 23:23:02.991682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.991802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.991826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.662 qpair failed and we were unable to recover it. 00:30:59.662 [2024-11-28 23:23:02.991925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.992014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.992039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.662 qpair failed and we were unable to recover it. 00:30:59.662 [2024-11-28 23:23:02.992151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.992270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.992295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.662 qpair failed and we were unable to recover it. 00:30:59.662 [2024-11-28 23:23:02.992398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.992510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.992535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.662 qpair failed and we were unable to recover it. 00:30:59.662 [2024-11-28 23:23:02.992695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.992842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.992868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.662 qpair failed and we were unable to recover it. 00:30:59.662 [2024-11-28 23:23:02.992982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.993073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.993098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.662 qpair failed and we were unable to recover it. 00:30:59.662 [2024-11-28 23:23:02.993217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.993330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.993355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.662 qpair failed and we were unable to recover it. 00:30:59.662 [2024-11-28 23:23:02.993556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.993654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.993694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.662 qpair failed and we were unable to recover it. 00:30:59.662 [2024-11-28 23:23:02.993794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.993881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.993904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.662 qpair failed and we were unable to recover it. 00:30:59.662 [2024-11-28 23:23:02.993995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.994107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.994132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.662 qpair failed and we were unable to recover it. 00:30:59.662 [2024-11-28 23:23:02.994247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.994328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.994352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.662 qpair failed and we were unable to recover it. 00:30:59.662 [2024-11-28 23:23:02.994476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.994570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.994595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.662 qpair failed and we were unable to recover it. 00:30:59.662 [2024-11-28 23:23:02.994683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.994802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.994826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.662 qpair failed and we were unable to recover it. 00:30:59.662 [2024-11-28 23:23:02.994917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.995007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.995032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.662 qpair failed and we were unable to recover it. 00:30:59.662 [2024-11-28 23:23:02.995122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.995237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.995261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.662 qpair failed and we were unable to recover it. 00:30:59.662 [2024-11-28 23:23:02.995354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.995479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.995504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.662 qpair failed and we were unable to recover it. 00:30:59.662 [2024-11-28 23:23:02.995593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.995723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.995749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.662 qpair failed and we were unable to recover it. 00:30:59.662 [2024-11-28 23:23:02.995875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.996013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.996037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.662 qpair failed and we were unable to recover it. 00:30:59.662 [2024-11-28 23:23:02.996129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.996242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.996267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.662 qpair failed and we were unable to recover it. 00:30:59.662 [2024-11-28 23:23:02.996356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.996491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.996517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.662 qpair failed and we were unable to recover it. 00:30:59.662 [2024-11-28 23:23:02.996606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.996686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.996711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.662 qpair failed and we were unable to recover it. 00:30:59.662 [2024-11-28 23:23:02.996829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.996944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.996968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.662 qpair failed and we were unable to recover it. 00:30:59.662 [2024-11-28 23:23:02.997062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.997148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.997173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.662 qpair failed and we were unable to recover it. 00:30:59.662 [2024-11-28 23:23:02.997260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.997368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.997403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.662 qpair failed and we were unable to recover it. 00:30:59.662 [2024-11-28 23:23:02.997538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.997624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.662 [2024-11-28 23:23:02.997648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.662 qpair failed and we were unable to recover it. 00:30:59.662 [2024-11-28 23:23:02.997743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:02.997827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:02.997851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.663 qpair failed and we were unable to recover it. 00:30:59.663 [2024-11-28 23:23:02.997947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:02.998056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:02.998082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.663 qpair failed and we were unable to recover it. 00:30:59.663 [2024-11-28 23:23:02.998172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:02.998255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:02.998280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.663 qpair failed and we were unable to recover it. 00:30:59.663 [2024-11-28 23:23:02.998408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:02.998552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:02.998577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.663 qpair failed and we were unable to recover it. 00:30:59.663 [2024-11-28 23:23:02.998661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:02.998772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:02.998797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.663 qpair failed and we were unable to recover it. 00:30:59.663 [2024-11-28 23:23:02.998884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:02.998973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:02.998997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.663 qpair failed and we were unable to recover it. 00:30:59.663 [2024-11-28 23:23:02.999158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:02.999251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:02.999295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.663 qpair failed and we were unable to recover it. 00:30:59.663 [2024-11-28 23:23:02.999423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:02.999517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:02.999541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.663 qpair failed and we were unable to recover it. 00:30:59.663 [2024-11-28 23:23:02.999634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:02.999747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:02.999771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.663 qpair failed and we were unable to recover it. 00:30:59.663 [2024-11-28 23:23:02.999938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:03.000094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:03.000119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.663 qpair failed and we were unable to recover it. 00:30:59.663 [2024-11-28 23:23:03.000205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:03.000295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:03.000320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.663 qpair failed and we were unable to recover it. 00:30:59.663 [2024-11-28 23:23:03.000441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:03.000525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:03.000549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.663 qpair failed and we were unable to recover it. 00:30:59.663 [2024-11-28 23:23:03.000641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:03.000752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:03.000776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.663 qpair failed and we were unable to recover it. 00:30:59.663 [2024-11-28 23:23:03.000940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:03.001033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:03.001060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.663 qpair failed and we were unable to recover it. 00:30:59.663 [2024-11-28 23:23:03.001205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:03.001290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:03.001315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.663 qpair failed and we were unable to recover it. 00:30:59.663 [2024-11-28 23:23:03.001428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:03.001517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:03.001542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.663 qpair failed and we were unable to recover it. 00:30:59.663 [2024-11-28 23:23:03.001636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:03.001742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:03.001767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.663 qpair failed and we were unable to recover it. 00:30:59.663 [2024-11-28 23:23:03.001882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:03.001998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:03.002022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.663 qpair failed and we were unable to recover it. 00:30:59.663 [2024-11-28 23:23:03.002145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:03.002239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:03.002269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.663 qpair failed and we were unable to recover it. 00:30:59.663 [2024-11-28 23:23:03.002359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:03.002457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:03.002482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.663 qpair failed and we were unable to recover it. 00:30:59.663 [2024-11-28 23:23:03.002598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:03.002682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:03.002707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.663 qpair failed and we were unable to recover it. 00:30:59.663 [2024-11-28 23:23:03.002805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:03.002915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:03.002940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.663 qpair failed and we were unable to recover it. 00:30:59.663 [2024-11-28 23:23:03.003029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:03.003121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:03.003146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.663 qpair failed and we were unable to recover it. 00:30:59.663 [2024-11-28 23:23:03.003256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:03.003370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:03.003401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.663 qpair failed and we were unable to recover it. 00:30:59.663 [2024-11-28 23:23:03.003552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:03.003710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:03.003737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.663 qpair failed and we were unable to recover it. 00:30:59.663 [2024-11-28 23:23:03.003831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:03.003955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:03.003983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.663 qpair failed and we were unable to recover it. 00:30:59.663 [2024-11-28 23:23:03.004089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:03.004183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:03.004208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.663 qpair failed and we were unable to recover it. 00:30:59.663 [2024-11-28 23:23:03.004324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:03.004445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:03.004470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.663 qpair failed and we were unable to recover it. 00:30:59.663 [2024-11-28 23:23:03.004589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:03.004689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:03.004715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.663 qpair failed and we were unable to recover it. 00:30:59.663 [2024-11-28 23:23:03.004803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.663 [2024-11-28 23:23:03.004889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.004913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.664 qpair failed and we were unable to recover it. 00:30:59.664 [2024-11-28 23:23:03.005007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.005120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.005147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.664 qpair failed and we were unable to recover it. 00:30:59.664 [2024-11-28 23:23:03.005276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.005419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.005444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.664 qpair failed and we were unable to recover it. 00:30:59.664 [2024-11-28 23:23:03.005563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.005658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.005683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.664 qpair failed and we were unable to recover it. 00:30:59.664 [2024-11-28 23:23:03.005772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.005931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.005955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.664 qpair failed and we were unable to recover it. 00:30:59.664 [2024-11-28 23:23:03.006052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.006127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.006151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.664 qpair failed and we were unable to recover it. 00:30:59.664 [2024-11-28 23:23:03.006267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.006357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.006381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.664 qpair failed and we were unable to recover it. 00:30:59.664 [2024-11-28 23:23:03.006499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.006586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.006611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.664 qpair failed and we were unable to recover it. 00:30:59.664 [2024-11-28 23:23:03.006734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.006826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.006869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.664 qpair failed and we were unable to recover it. 00:30:59.664 [2024-11-28 23:23:03.006976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.007119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.007143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.664 qpair failed and we were unable to recover it. 00:30:59.664 [2024-11-28 23:23:03.007247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.007361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.007387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.664 qpair failed and we were unable to recover it. 00:30:59.664 [2024-11-28 23:23:03.007497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.007577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.007601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.664 qpair failed and we were unable to recover it. 00:30:59.664 [2024-11-28 23:23:03.007716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.007832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.007858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.664 qpair failed and we were unable to recover it. 00:30:59.664 [2024-11-28 23:23:03.007938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.008051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.008075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.664 qpair failed and we were unable to recover it. 00:30:59.664 [2024-11-28 23:23:03.008166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.008280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.008305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.664 qpair failed and we were unable to recover it. 00:30:59.664 [2024-11-28 23:23:03.008390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.008492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.008516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.664 qpair failed and we were unable to recover it. 00:30:59.664 [2024-11-28 23:23:03.008669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.008762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.008787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.664 qpair failed and we were unable to recover it. 00:30:59.664 [2024-11-28 23:23:03.008874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.008991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.009018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.664 qpair failed and we were unable to recover it. 00:30:59.664 [2024-11-28 23:23:03.009158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.009244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.009268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.664 qpair failed and we were unable to recover it. 00:30:59.664 [2024-11-28 23:23:03.009386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.009541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.009566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.664 qpair failed and we were unable to recover it. 00:30:59.664 [2024-11-28 23:23:03.009681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.009773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.009797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.664 qpair failed and we were unable to recover it. 00:30:59.664 [2024-11-28 23:23:03.009891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.010003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.010027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.664 qpair failed and we were unable to recover it. 00:30:59.664 [2024-11-28 23:23:03.010146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.010313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.010338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.664 qpair failed and we were unable to recover it. 00:30:59.664 [2024-11-28 23:23:03.010429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.010513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.010538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.664 qpair failed and we were unable to recover it. 00:30:59.664 [2024-11-28 23:23:03.010641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.010764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.010788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.664 qpair failed and we were unable to recover it. 00:30:59.664 [2024-11-28 23:23:03.010883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.010973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.010998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.664 qpair failed and we were unable to recover it. 00:30:59.664 [2024-11-28 23:23:03.011078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.011195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.011221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.664 qpair failed and we were unable to recover it. 00:30:59.664 [2024-11-28 23:23:03.011303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.011420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.011445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.664 qpair failed and we were unable to recover it. 00:30:59.664 [2024-11-28 23:23:03.011538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.011656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.011681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.664 qpair failed and we were unable to recover it. 00:30:59.664 [2024-11-28 23:23:03.011770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.011914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.664 [2024-11-28 23:23:03.011938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.664 qpair failed and we were unable to recover it. 00:30:59.665 [2024-11-28 23:23:03.012052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.012172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.012200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.665 qpair failed and we were unable to recover it. 00:30:59.665 [2024-11-28 23:23:03.012291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.012382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.012412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.665 qpair failed and we were unable to recover it. 00:30:59.665 [2024-11-28 23:23:03.012532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.012617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.012641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.665 qpair failed and we were unable to recover it. 00:30:59.665 [2024-11-28 23:23:03.012730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.012851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.012878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.665 qpair failed and we were unable to recover it. 00:30:59.665 [2024-11-28 23:23:03.012991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.013087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.013115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.665 qpair failed and we were unable to recover it. 00:30:59.665 [2024-11-28 23:23:03.013236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.013378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.013410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.665 qpair failed and we were unable to recover it. 00:30:59.665 [2024-11-28 23:23:03.013505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.013590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.013615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.665 qpair failed and we were unable to recover it. 00:30:59.665 [2024-11-28 23:23:03.013704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.013821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.013846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.665 qpair failed and we were unable to recover it. 00:30:59.665 [2024-11-28 23:23:03.013972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.014067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.014094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.665 qpair failed and we were unable to recover it. 00:30:59.665 [2024-11-28 23:23:03.014205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.014319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.014343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.665 qpair failed and we were unable to recover it. 00:30:59.665 [2024-11-28 23:23:03.014474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.014563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.014587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.665 qpair failed and we were unable to recover it. 00:30:59.665 [2024-11-28 23:23:03.014681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.014761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.014785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.665 qpair failed and we were unable to recover it. 00:30:59.665 [2024-11-28 23:23:03.014869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.014964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.014988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.665 qpair failed and we were unable to recover it. 00:30:59.665 [2024-11-28 23:23:03.015120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.015215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.015239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.665 qpair failed and we were unable to recover it. 00:30:59.665 [2024-11-28 23:23:03.015340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.015479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.015506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.665 qpair failed and we were unable to recover it. 00:30:59.665 [2024-11-28 23:23:03.015592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.015683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.015708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.665 qpair failed and we were unable to recover it. 00:30:59.665 [2024-11-28 23:23:03.015827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.015954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.015982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.665 qpair failed and we were unable to recover it. 00:30:59.665 [2024-11-28 23:23:03.016093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.016178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.016204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.665 qpair failed and we were unable to recover it. 00:30:59.665 [2024-11-28 23:23:03.016296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.016414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.016446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.665 qpair failed and we were unable to recover it. 00:30:59.665 [2024-11-28 23:23:03.016550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.016646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.016670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.665 qpair failed and we were unable to recover it. 00:30:59.665 [2024-11-28 23:23:03.016763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.016843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.016868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.665 qpair failed and we were unable to recover it. 00:30:59.665 [2024-11-28 23:23:03.016985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.017063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.017087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.665 qpair failed and we were unable to recover it. 00:30:59.665 [2024-11-28 23:23:03.017182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.017290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.017316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.665 qpair failed and we were unable to recover it. 00:30:59.665 [2024-11-28 23:23:03.017411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.017528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.017553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.665 qpair failed and we were unable to recover it. 00:30:59.665 [2024-11-28 23:23:03.017646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.017761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.017787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.665 qpair failed and we were unable to recover it. 00:30:59.665 [2024-11-28 23:23:03.017927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.018027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.665 [2024-11-28 23:23:03.018056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.665 qpair failed and we were unable to recover it. 00:30:59.666 [2024-11-28 23:23:03.018162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.018290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.018332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.666 qpair failed and we were unable to recover it. 00:30:59.666 [2024-11-28 23:23:03.018480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.018572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.018598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.666 qpair failed and we were unable to recover it. 00:30:59.666 [2024-11-28 23:23:03.018695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.018816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.018841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.666 qpair failed and we were unable to recover it. 00:30:59.666 [2024-11-28 23:23:03.018934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.019017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.019041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.666 qpair failed and we were unable to recover it. 00:30:59.666 [2024-11-28 23:23:03.019129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.019242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.019267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.666 qpair failed and we were unable to recover it. 00:30:59.666 [2024-11-28 23:23:03.019384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.019474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.019499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.666 qpair failed and we were unable to recover it. 00:30:59.666 [2024-11-28 23:23:03.019638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.019793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.019821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.666 qpair failed and we were unable to recover it. 00:30:59.666 [2024-11-28 23:23:03.019930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.020045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.020070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.666 qpair failed and we were unable to recover it. 00:30:59.666 [2024-11-28 23:23:03.020182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.020268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.020292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.666 qpair failed and we were unable to recover it. 00:30:59.666 [2024-11-28 23:23:03.020379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.020479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.020504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.666 qpair failed and we were unable to recover it. 00:30:59.666 [2024-11-28 23:23:03.020588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.020701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.020726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.666 qpair failed and we were unable to recover it. 00:30:59.666 [2024-11-28 23:23:03.020862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.020986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.021014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.666 qpair failed and we were unable to recover it. 00:30:59.666 [2024-11-28 23:23:03.021107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.021209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.021234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.666 qpair failed and we were unable to recover it. 00:30:59.666 [2024-11-28 23:23:03.021331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.021426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.021452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.666 qpair failed and we were unable to recover it. 00:30:59.666 [2024-11-28 23:23:03.021547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.021685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.021710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.666 qpair failed and we were unable to recover it. 00:30:59.666 [2024-11-28 23:23:03.021798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.021937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.021965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.666 qpair failed and we were unable to recover it. 00:30:59.666 [2024-11-28 23:23:03.022104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.022219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.022244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.666 qpair failed and we were unable to recover it. 00:30:59.666 [2024-11-28 23:23:03.022331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.022434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.022460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.666 qpair failed and we were unable to recover it. 00:30:59.666 [2024-11-28 23:23:03.022559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.022703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.022728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.666 qpair failed and we were unable to recover it. 00:30:59.666 [2024-11-28 23:23:03.022819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.022932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.022958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.666 qpair failed and we were unable to recover it. 00:30:59.666 [2024-11-28 23:23:03.023100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.023203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.023228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.666 qpair failed and we were unable to recover it. 00:30:59.666 [2024-11-28 23:23:03.023315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.023455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.023481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.666 qpair failed and we were unable to recover it. 00:30:59.666 [2024-11-28 23:23:03.023591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.023675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.023699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.666 qpair failed and we were unable to recover it. 00:30:59.666 [2024-11-28 23:23:03.023804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.023923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.023951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.666 qpair failed and we were unable to recover it. 00:30:59.666 [2024-11-28 23:23:03.024075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.024183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.024207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.666 qpair failed and we were unable to recover it. 00:30:59.666 [2024-11-28 23:23:03.024290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.024376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.024412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.666 qpair failed and we were unable to recover it. 00:30:59.666 [2024-11-28 23:23:03.024498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.024625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.024653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.666 qpair failed and we were unable to recover it. 00:30:59.666 [2024-11-28 23:23:03.024815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.024916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.024944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.666 qpair failed and we were unable to recover it. 00:30:59.666 [2024-11-28 23:23:03.025045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.025137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.025163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.666 qpair failed and we were unable to recover it. 00:30:59.666 [2024-11-28 23:23:03.025251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.666 [2024-11-28 23:23:03.025332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.025357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.667 qpair failed and we were unable to recover it. 00:30:59.667 [2024-11-28 23:23:03.025476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.025613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.025641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.667 qpair failed and we were unable to recover it. 00:30:59.667 [2024-11-28 23:23:03.025743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.025854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.025879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.667 qpair failed and we were unable to recover it. 00:30:59.667 [2024-11-28 23:23:03.025980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.026075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.026100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.667 qpair failed and we were unable to recover it. 00:30:59.667 [2024-11-28 23:23:03.026212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.026336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.026362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.667 qpair failed and we were unable to recover it. 00:30:59.667 [2024-11-28 23:23:03.026455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.026574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.026599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.667 qpair failed and we were unable to recover it. 00:30:59.667 [2024-11-28 23:23:03.026694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.026774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.026799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.667 qpair failed and we were unable to recover it. 00:30:59.667 [2024-11-28 23:23:03.026884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.026995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.027019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.667 qpair failed and we were unable to recover it. 00:30:59.667 [2024-11-28 23:23:03.027136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.027221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.027246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.667 qpair failed and we were unable to recover it. 00:30:59.667 [2024-11-28 23:23:03.027362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.027484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.027527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.667 qpair failed and we were unable to recover it. 00:30:59.667 [2024-11-28 23:23:03.027649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.027765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.027805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.667 qpair failed and we were unable to recover it. 00:30:59.667 [2024-11-28 23:23:03.027896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.028011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.028036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.667 qpair failed and we were unable to recover it. 00:30:59.667 [2024-11-28 23:23:03.028126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.028206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.028232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.667 qpair failed and we were unable to recover it. 00:30:59.667 [2024-11-28 23:23:03.028307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.028430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.028457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.667 qpair failed and we were unable to recover it. 00:30:59.667 [2024-11-28 23:23:03.028544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.028657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.028681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.667 qpair failed and we were unable to recover it. 00:30:59.667 [2024-11-28 23:23:03.028772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.028860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.028885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.667 qpair failed and we were unable to recover it. 00:30:59.667 [2024-11-28 23:23:03.028983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.029076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.029101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.667 qpair failed and we were unable to recover it. 00:30:59.667 [2024-11-28 23:23:03.029193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.029308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.029332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.667 qpair failed and we were unable to recover it. 00:30:59.667 [2024-11-28 23:23:03.029421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.029582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.029606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.667 qpair failed and we were unable to recover it. 00:30:59.667 [2024-11-28 23:23:03.029745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.029839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.029864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.667 qpair failed and we were unable to recover it. 00:30:59.667 [2024-11-28 23:23:03.029959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.030071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.030095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.667 qpair failed and we were unable to recover it. 00:30:59.667 [2024-11-28 23:23:03.030191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.030280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.030322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.667 qpair failed and we were unable to recover it. 00:30:59.667 [2024-11-28 23:23:03.030424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.030555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.030582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.667 qpair failed and we were unable to recover it. 00:30:59.667 [2024-11-28 23:23:03.030691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.030787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.030811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.667 qpair failed and we were unable to recover it. 00:30:59.667 [2024-11-28 23:23:03.030933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.031063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.031089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.667 qpair failed and we were unable to recover it. 00:30:59.667 [2024-11-28 23:23:03.031180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.031271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.031296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.667 qpair failed and we were unable to recover it. 00:30:59.667 [2024-11-28 23:23:03.031385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.031474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.031499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.667 qpair failed and we were unable to recover it. 00:30:59.667 [2024-11-28 23:23:03.031618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.031763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.031788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.667 qpair failed and we were unable to recover it. 00:30:59.667 [2024-11-28 23:23:03.031914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.031998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.032023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.667 qpair failed and we were unable to recover it. 00:30:59.667 [2024-11-28 23:23:03.032139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.667 [2024-11-28 23:23:03.032223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.032247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.668 qpair failed and we were unable to recover it. 00:30:59.668 [2024-11-28 23:23:03.032347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.032488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.032515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.668 qpair failed and we were unable to recover it. 00:30:59.668 [2024-11-28 23:23:03.032606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.032710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.032735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.668 qpair failed and we were unable to recover it. 00:30:59.668 [2024-11-28 23:23:03.032848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.032927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.032951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.668 qpair failed and we were unable to recover it. 00:30:59.668 [2024-11-28 23:23:03.033074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.033209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.033236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.668 qpair failed and we were unable to recover it. 00:30:59.668 [2024-11-28 23:23:03.033372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.033477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.033505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.668 qpair failed and we were unable to recover it. 00:30:59.668 [2024-11-28 23:23:03.033639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.033752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.033777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.668 qpair failed and we were unable to recover it. 00:30:59.668 [2024-11-28 23:23:03.033895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.033978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.034002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.668 qpair failed and we were unable to recover it. 00:30:59.668 [2024-11-28 23:23:03.034121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.034209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.034234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.668 qpair failed and we were unable to recover it. 00:30:59.668 [2024-11-28 23:23:03.034323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.034419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.034446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.668 qpair failed and we were unable to recover it. 00:30:59.668 [2024-11-28 23:23:03.034539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.034628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.034671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.668 qpair failed and we were unable to recover it. 00:30:59.668 [2024-11-28 23:23:03.034775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.034895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.034924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.668 qpair failed and we were unable to recover it. 00:30:59.668 [2024-11-28 23:23:03.035062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.035174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.035199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.668 qpair failed and we were unable to recover it. 00:30:59.668 [2024-11-28 23:23:03.035313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.035405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.035431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.668 qpair failed and we were unable to recover it. 00:30:59.668 [2024-11-28 23:23:03.035548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.035661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.035689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.668 qpair failed and we were unable to recover it. 00:30:59.668 [2024-11-28 23:23:03.035809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.035926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.035952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.668 qpair failed and we were unable to recover it. 00:30:59.668 [2024-11-28 23:23:03.036077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.036194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.036219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.668 qpair failed and we were unable to recover it. 00:30:59.668 [2024-11-28 23:23:03.036303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.036381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.036412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.668 qpair failed and we were unable to recover it. 00:30:59.668 [2024-11-28 23:23:03.036524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.036616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.036645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.668 qpair failed and we were unable to recover it. 00:30:59.668 [2024-11-28 23:23:03.036755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.036837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.036862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.668 qpair failed and we were unable to recover it. 00:30:59.668 [2024-11-28 23:23:03.036949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.037035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.037061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.668 qpair failed and we were unable to recover it. 00:30:59.668 [2024-11-28 23:23:03.037184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.037266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.037291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.668 qpair failed and we were unable to recover it. 00:30:59.668 [2024-11-28 23:23:03.037437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.037564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.037592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.668 qpair failed and we were unable to recover it. 00:30:59.668 [2024-11-28 23:23:03.037689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.037809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.037837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.668 qpair failed and we were unable to recover it. 00:30:59.668 [2024-11-28 23:23:03.037946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.038027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.038052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.668 qpair failed and we were unable to recover it. 00:30:59.668 [2024-11-28 23:23:03.038170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.038265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.038289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.668 qpair failed and we were unable to recover it. 00:30:59.668 [2024-11-28 23:23:03.038432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.038527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.038551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.668 qpair failed and we were unable to recover it. 00:30:59.668 [2024-11-28 23:23:03.038675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.038791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.038816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.668 qpair failed and we were unable to recover it. 00:30:59.668 [2024-11-28 23:23:03.038936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.039019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.039043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.668 qpair failed and we were unable to recover it. 00:30:59.668 [2024-11-28 23:23:03.039163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.039246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.668 [2024-11-28 23:23:03.039271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.669 qpair failed and we were unable to recover it. 00:30:59.669 [2024-11-28 23:23:03.039388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.039517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.039541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.669 qpair failed and we were unable to recover it. 00:30:59.669 [2024-11-28 23:23:03.039664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.039799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.039824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.669 qpair failed and we were unable to recover it. 00:30:59.669 [2024-11-28 23:23:03.039918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.040015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.040040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.669 qpair failed and we were unable to recover it. 00:30:59.669 [2024-11-28 23:23:03.040118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.040228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.040253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.669 qpair failed and we were unable to recover it. 00:30:59.669 [2024-11-28 23:23:03.040347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.040440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.040467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.669 qpair failed and we were unable to recover it. 00:30:59.669 [2024-11-28 23:23:03.040558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.040674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.040699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.669 qpair failed and we were unable to recover it. 00:30:59.669 [2024-11-28 23:23:03.040817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.040899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.040924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.669 qpair failed and we were unable to recover it. 00:30:59.669 [2024-11-28 23:23:03.041043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.041126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.041152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.669 qpair failed and we were unable to recover it. 00:30:59.669 [2024-11-28 23:23:03.041250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.041334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.041358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.669 qpair failed and we were unable to recover it. 00:30:59.669 [2024-11-28 23:23:03.041488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.041599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.041624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.669 qpair failed and we were unable to recover it. 00:30:59.669 [2024-11-28 23:23:03.041745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.041835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.041859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.669 qpair failed and we were unable to recover it. 00:30:59.669 [2024-11-28 23:23:03.041972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.042054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.042079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.669 qpair failed and we were unable to recover it. 00:30:59.669 [2024-11-28 23:23:03.042198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.042314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.042339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.669 qpair failed and we were unable to recover it. 00:30:59.669 [2024-11-28 23:23:03.042431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.042517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.042542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.669 qpair failed and we were unable to recover it. 00:30:59.669 [2024-11-28 23:23:03.042627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.042746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.042771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.669 qpair failed and we were unable to recover it. 00:30:59.669 [2024-11-28 23:23:03.042872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.042955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.042979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.669 qpair failed and we were unable to recover it. 00:30:59.669 [2024-11-28 23:23:03.043078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.043222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.043246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.669 qpair failed and we were unable to recover it. 00:30:59.669 [2024-11-28 23:23:03.043389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.043521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.043548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.669 qpair failed and we were unable to recover it. 00:30:59.669 [2024-11-28 23:23:03.043664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.043753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.043777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.669 qpair failed and we were unable to recover it. 00:30:59.669 [2024-11-28 23:23:03.043870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.043994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.044019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.669 qpair failed and we were unable to recover it. 00:30:59.669 [2024-11-28 23:23:03.044101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.044187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.044211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.669 qpair failed and we were unable to recover it. 00:30:59.669 [2024-11-28 23:23:03.044296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.044379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.044412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.669 qpair failed and we were unable to recover it. 00:30:59.669 [2024-11-28 23:23:03.044503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.044589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.044614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.669 qpair failed and we were unable to recover it. 00:30:59.669 [2024-11-28 23:23:03.044714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.044832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.044856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.669 qpair failed and we were unable to recover it. 00:30:59.669 [2024-11-28 23:23:03.044968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.045054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.669 [2024-11-28 23:23:03.045078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.669 qpair failed and we were unable to recover it. 00:30:59.669 [2024-11-28 23:23:03.045201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.045290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.045332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.670 qpair failed and we were unable to recover it. 00:30:59.670 [2024-11-28 23:23:03.045427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.045526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.045554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.670 qpair failed and we were unable to recover it. 00:30:59.670 [2024-11-28 23:23:03.045654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.045773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.045797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.670 qpair failed and we were unable to recover it. 00:30:59.670 [2024-11-28 23:23:03.045891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.046005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.046029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.670 qpair failed and we were unable to recover it. 00:30:59.670 [2024-11-28 23:23:03.046145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.046227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.046256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.670 qpair failed and we were unable to recover it. 00:30:59.670 [2024-11-28 23:23:03.046372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.046482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.046508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.670 qpair failed and we were unable to recover it. 00:30:59.670 [2024-11-28 23:23:03.046668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.046808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.046833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.670 qpair failed and we were unable to recover it. 00:30:59.670 [2024-11-28 23:23:03.046952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.047070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.047095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.670 qpair failed and we were unable to recover it. 00:30:59.670 [2024-11-28 23:23:03.047177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.047291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.047315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.670 qpair failed and we were unable to recover it. 00:30:59.670 [2024-11-28 23:23:03.047409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.047497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.047523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.670 qpair failed and we were unable to recover it. 00:30:59.670 [2024-11-28 23:23:03.047612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.047727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.047752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.670 qpair failed and we were unable to recover it. 00:30:59.670 [2024-11-28 23:23:03.047836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.047953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.047980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.670 qpair failed and we were unable to recover it. 00:30:59.670 [2024-11-28 23:23:03.048102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.048220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.048244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.670 qpair failed and we were unable to recover it. 00:30:59.670 [2024-11-28 23:23:03.048333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.048448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.048473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.670 qpair failed and we were unable to recover it. 00:30:59.670 [2024-11-28 23:23:03.048586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.048681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.048706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.670 qpair failed and we were unable to recover it. 00:30:59.670 [2024-11-28 23:23:03.048802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.048913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.048939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.670 qpair failed and we were unable to recover it. 00:30:59.670 [2024-11-28 23:23:03.049030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.049113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.049155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.670 qpair failed and we were unable to recover it. 00:30:59.670 [2024-11-28 23:23:03.049281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.049364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.049389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.670 qpair failed and we were unable to recover it. 00:30:59.670 [2024-11-28 23:23:03.049517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.049612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.049637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.670 qpair failed and we were unable to recover it. 00:30:59.670 [2024-11-28 23:23:03.049726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.049845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.049869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.670 qpair failed and we were unable to recover it. 00:30:59.670 [2024-11-28 23:23:03.049985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.050073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.050098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.670 qpair failed and we were unable to recover it. 00:30:59.670 [2024-11-28 23:23:03.050196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.050285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.050309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.670 qpair failed and we were unable to recover it. 00:30:59.670 [2024-11-28 23:23:03.050416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.050504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.050528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.670 qpair failed and we were unable to recover it. 00:30:59.670 [2024-11-28 23:23:03.050640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.050732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.050758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.670 qpair failed and we were unable to recover it. 00:30:59.670 [2024-11-28 23:23:03.050878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.051009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.051037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.670 qpair failed and we were unable to recover it. 00:30:59.670 [2024-11-28 23:23:03.051182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.051300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.051324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.670 qpair failed and we were unable to recover it. 00:30:59.670 [2024-11-28 23:23:03.051409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.051502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.051527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.670 qpair failed and we were unable to recover it. 00:30:59.670 [2024-11-28 23:23:03.051666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.051800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.051827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.670 qpair failed and we were unable to recover it. 00:30:59.670 [2024-11-28 23:23:03.051966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.052054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.052079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.670 qpair failed and we were unable to recover it. 00:30:59.670 [2024-11-28 23:23:03.052198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.670 [2024-11-28 23:23:03.052296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.052320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.671 qpair failed and we were unable to recover it. 00:30:59.671 [2024-11-28 23:23:03.052438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.052555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.052580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.671 qpair failed and we were unable to recover it. 00:30:59.671 [2024-11-28 23:23:03.052677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.052796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.052823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.671 qpair failed and we were unable to recover it. 00:30:59.671 [2024-11-28 23:23:03.052966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.053079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.053104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.671 qpair failed and we were unable to recover it. 00:30:59.671 [2024-11-28 23:23:03.053204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.053292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.053317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.671 qpair failed and we were unable to recover it. 00:30:59.671 [2024-11-28 23:23:03.053404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.053519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.053544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.671 qpair failed and we were unable to recover it. 00:30:59.671 [2024-11-28 23:23:03.053671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.053786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.053811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.671 qpair failed and we were unable to recover it. 00:30:59.671 [2024-11-28 23:23:03.053957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.054070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.054096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.671 qpair failed and we were unable to recover it. 00:30:59.671 [2024-11-28 23:23:03.054184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.054271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.054295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.671 qpair failed and we were unable to recover it. 00:30:59.671 [2024-11-28 23:23:03.054408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.054520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.054546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.671 qpair failed and we were unable to recover it. 00:30:59.671 [2024-11-28 23:23:03.054640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.054758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.054783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.671 qpair failed and we were unable to recover it. 00:30:59.671 [2024-11-28 23:23:03.054933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.055013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.055037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.671 qpair failed and we were unable to recover it. 00:30:59.671 [2024-11-28 23:23:03.055145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.055228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.055253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.671 qpair failed and we were unable to recover it. 00:30:59.671 [2024-11-28 23:23:03.055364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.055459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.055484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.671 qpair failed and we were unable to recover it. 00:30:59.671 [2024-11-28 23:23:03.055573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.055659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.055684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.671 qpair failed and we were unable to recover it. 00:30:59.671 [2024-11-28 23:23:03.055777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.055867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.055892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.671 qpair failed and we were unable to recover it. 00:30:59.671 [2024-11-28 23:23:03.056006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.056131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.056158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.671 qpair failed and we were unable to recover it. 00:30:59.671 [2024-11-28 23:23:03.056284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.056391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.056423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.671 qpair failed and we were unable to recover it. 00:30:59.671 [2024-11-28 23:23:03.056539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.056651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.056676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.671 qpair failed and we were unable to recover it. 00:30:59.671 [2024-11-28 23:23:03.056773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.056914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.056939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.671 qpair failed and we were unable to recover it. 00:30:59.671 [2024-11-28 23:23:03.057030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.057143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.057168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.671 qpair failed and we were unable to recover it. 00:30:59.671 [2024-11-28 23:23:03.057256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.057398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.057423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.671 qpair failed and we were unable to recover it. 00:30:59.671 [2024-11-28 23:23:03.057542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.057675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.057715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.671 qpair failed and we were unable to recover it. 00:30:59.671 [2024-11-28 23:23:03.057829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.057914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.057940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.671 qpair failed and we were unable to recover it. 00:30:59.671 [2024-11-28 23:23:03.058046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.058136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.058160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.671 qpair failed and we were unable to recover it. 00:30:59.671 [2024-11-28 23:23:03.058245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.058354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.058379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.671 qpair failed and we were unable to recover it. 00:30:59.671 [2024-11-28 23:23:03.058516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.058607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.058636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.671 qpair failed and we were unable to recover it. 00:30:59.671 [2024-11-28 23:23:03.058725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.058864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.058889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.671 qpair failed and we were unable to recover it. 00:30:59.671 [2024-11-28 23:23:03.059039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.059138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.059163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.671 qpair failed and we were unable to recover it. 00:30:59.671 [2024-11-28 23:23:03.059247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.671 [2024-11-28 23:23:03.059329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.059355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.672 qpair failed and we were unable to recover it. 00:30:59.672 [2024-11-28 23:23:03.059482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.059560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.059585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.672 qpair failed and we were unable to recover it. 00:30:59.672 [2024-11-28 23:23:03.059705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.059816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.059841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.672 qpair failed and we were unable to recover it. 00:30:59.672 [2024-11-28 23:23:03.059922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.060034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.060058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.672 qpair failed and we were unable to recover it. 00:30:59.672 [2024-11-28 23:23:03.060144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.060222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.060247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.672 qpair failed and we were unable to recover it. 00:30:59.672 [2024-11-28 23:23:03.060407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.060537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.060565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.672 qpair failed and we were unable to recover it. 00:30:59.672 [2024-11-28 23:23:03.060670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.060776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.060801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.672 qpair failed and we were unable to recover it. 00:30:59.672 [2024-11-28 23:23:03.060886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.060970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.060995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.672 qpair failed and we were unable to recover it. 00:30:59.672 [2024-11-28 23:23:03.061084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.061215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.061243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.672 qpair failed and we were unable to recover it. 00:30:59.672 [2024-11-28 23:23:03.061341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.061510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.061536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.672 qpair failed and we were unable to recover it. 00:30:59.672 [2024-11-28 23:23:03.061658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.061774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.061799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.672 qpair failed and we were unable to recover it. 00:30:59.672 [2024-11-28 23:23:03.061888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.061976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.062001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.672 qpair failed and we were unable to recover it. 00:30:59.672 [2024-11-28 23:23:03.062095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.062206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.062231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.672 qpair failed and we were unable to recover it. 00:30:59.672 [2024-11-28 23:23:03.062361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.062461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.062488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.672 qpair failed and we were unable to recover it. 00:30:59.672 [2024-11-28 23:23:03.062606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.062694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.062718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.672 qpair failed and we were unable to recover it. 00:30:59.672 [2024-11-28 23:23:03.062800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.062882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.062907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.672 qpair failed and we were unable to recover it. 00:30:59.672 [2024-11-28 23:23:03.063015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.063135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.063160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.672 qpair failed and we were unable to recover it. 00:30:59.672 [2024-11-28 23:23:03.063266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.063360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.063410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.672 qpair failed and we were unable to recover it. 00:30:59.672 [2024-11-28 23:23:03.063536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.063653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.063677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.672 qpair failed and we were unable to recover it. 00:30:59.672 [2024-11-28 23:23:03.063797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.063883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.063908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.672 qpair failed and we were unable to recover it. 00:30:59.672 [2024-11-28 23:23:03.064019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.064133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.064158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.672 qpair failed and we were unable to recover it. 00:30:59.672 [2024-11-28 23:23:03.064240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.064351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.064375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.672 qpair failed and we were unable to recover it. 00:30:59.672 [2024-11-28 23:23:03.064475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.064575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.064600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.672 qpair failed and we were unable to recover it. 00:30:59.672 [2024-11-28 23:23:03.064683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.064779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.064804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.672 qpair failed and we were unable to recover it. 00:30:59.672 [2024-11-28 23:23:03.064913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.065022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.065048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.672 qpair failed and we were unable to recover it. 00:30:59.672 [2024-11-28 23:23:03.065196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.065351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.065380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.672 qpair failed and we were unable to recover it. 00:30:59.672 [2024-11-28 23:23:03.065517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.065606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.065633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.672 qpair failed and we were unable to recover it. 00:30:59.672 [2024-11-28 23:23:03.065751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.065837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.065863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:30:59.672 qpair failed and we were unable to recover it. 00:30:59.672 [2024-11-28 23:23:03.066020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.066115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.066141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.672 qpair failed and we were unable to recover it. 00:30:59.672 [2024-11-28 23:23:03.066229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.066341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.672 [2024-11-28 23:23:03.066366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.672 qpair failed and we were unable to recover it. 00:30:59.673 [2024-11-28 23:23:03.066490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.066576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.066602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.673 qpair failed and we were unable to recover it. 00:30:59.673 [2024-11-28 23:23:03.066730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.066819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.066846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.673 qpair failed and we were unable to recover it. 00:30:59.673 [2024-11-28 23:23:03.066947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.067056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.067081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.673 qpair failed and we were unable to recover it. 00:30:59.673 [2024-11-28 23:23:03.067233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.067335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.067359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.673 qpair failed and we were unable to recover it. 00:30:59.673 [2024-11-28 23:23:03.067463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.067576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.067600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.673 qpair failed and we were unable to recover it. 00:30:59.673 [2024-11-28 23:23:03.067744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.067861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.067888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.673 qpair failed and we were unable to recover it. 00:30:59.673 [2024-11-28 23:23:03.067983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.068072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.068099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.673 qpair failed and we were unable to recover it. 00:30:59.673 [2024-11-28 23:23:03.068199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.068345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.068371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.673 qpair failed and we were unable to recover it. 00:30:59.673 [2024-11-28 23:23:03.068529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.068692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.068720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.673 qpair failed and we were unable to recover it. 00:30:59.673 [2024-11-28 23:23:03.068848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.069002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.069031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.673 qpair failed and we were unable to recover it. 00:30:59.673 [2024-11-28 23:23:03.069161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.069289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.069313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.673 qpair failed and we were unable to recover it. 00:30:59.673 [2024-11-28 23:23:03.069405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.069518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.069544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.673 qpair failed and we were unable to recover it. 00:30:59.673 [2024-11-28 23:23:03.069620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.069782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.069810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.673 qpair failed and we were unable to recover it. 00:30:59.673 [2024-11-28 23:23:03.069971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.070068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.070097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.673 qpair failed and we were unable to recover it. 00:30:59.673 [2024-11-28 23:23:03.070227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.070365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.070389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.673 qpair failed and we were unable to recover it. 00:30:59.673 [2024-11-28 23:23:03.070481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.070569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.070593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.673 qpair failed and we were unable to recover it. 00:30:59.673 [2024-11-28 23:23:03.070720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.070821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.070849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.673 qpair failed and we were unable to recover it. 00:30:59.673 [2024-11-28 23:23:03.070948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.071098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.071125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.673 qpair failed and we were unable to recover it. 00:30:59.673 [2024-11-28 23:23:03.071234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.071327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.071357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.673 qpair failed and we were unable to recover it. 00:30:59.673 [2024-11-28 23:23:03.071480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.071560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.071601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.673 qpair failed and we were unable to recover it. 00:30:59.673 [2024-11-28 23:23:03.071728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.071822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.071850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.673 qpair failed and we were unable to recover it. 00:30:59.673 [2024-11-28 23:23:03.071945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.072044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.072068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.673 qpair failed and we were unable to recover it. 00:30:59.673 [2024-11-28 23:23:03.072216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.072335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.072360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.673 qpair failed and we were unable to recover it. 00:30:59.673 [2024-11-28 23:23:03.072487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.072601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.072629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.673 qpair failed and we were unable to recover it. 00:30:59.673 [2024-11-28 23:23:03.072759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.072851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.072879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.673 qpair failed and we were unable to recover it. 00:30:59.673 [2024-11-28 23:23:03.072995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.073091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.073119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.673 qpair failed and we were unable to recover it. 00:30:59.673 [2024-11-28 23:23:03.073261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.073379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.073411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.673 qpair failed and we were unable to recover it. 00:30:59.673 [2024-11-28 23:23:03.073494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.073656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.073684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.673 qpair failed and we were unable to recover it. 00:30:59.673 [2024-11-28 23:23:03.073865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.073963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.673 [2024-11-28 23:23:03.073992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.673 qpair failed and we were unable to recover it. 00:30:59.674 [2024-11-28 23:23:03.074094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.074192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.074233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.674 qpair failed and we were unable to recover it. 00:30:59.674 [2024-11-28 23:23:03.074322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.074445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.074470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.674 qpair failed and we were unable to recover it. 00:30:59.674 [2024-11-28 23:23:03.074643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.074775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.074803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.674 qpair failed and we were unable to recover it. 00:30:59.674 [2024-11-28 23:23:03.074973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.075097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.075124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.674 qpair failed and we were unable to recover it. 00:30:59.674 [2024-11-28 23:23:03.075227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.075351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.075407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.674 qpair failed and we were unable to recover it. 00:30:59.674 [2024-11-28 23:23:03.075500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.075587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.075611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.674 qpair failed and we were unable to recover it. 00:30:59.674 [2024-11-28 23:23:03.075734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.075819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.075843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.674 qpair failed and we were unable to recover it. 00:30:59.674 [2024-11-28 23:23:03.075958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.076060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.076089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.674 qpair failed and we were unable to recover it. 00:30:59.674 [2024-11-28 23:23:03.076195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.076340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.076365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.674 qpair failed and we were unable to recover it. 00:30:59.674 [2024-11-28 23:23:03.076514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.076653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.076681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.674 qpair failed and we were unable to recover it. 00:30:59.674 [2024-11-28 23:23:03.076817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.076930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.076957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.674 qpair failed and we were unable to recover it. 00:30:59.674 [2024-11-28 23:23:03.077059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.077198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.077223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.674 qpair failed and we were unable to recover it. 00:30:59.674 [2024-11-28 23:23:03.077339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.077458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.077483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.674 qpair failed and we were unable to recover it. 00:30:59.674 [2024-11-28 23:23:03.077587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.077719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.077747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.674 qpair failed and we were unable to recover it. 00:30:59.674 [2024-11-28 23:23:03.077861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.077975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.077999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.674 qpair failed and we were unable to recover it. 00:30:59.674 [2024-11-28 23:23:03.078117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.078200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.078224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.674 qpair failed and we were unable to recover it. 00:30:59.674 [2024-11-28 23:23:03.078302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.078418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.078447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.674 qpair failed and we were unable to recover it. 00:30:59.674 [2024-11-28 23:23:03.078566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.078659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.078684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.674 qpair failed and we were unable to recover it. 00:30:59.674 [2024-11-28 23:23:03.078797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.078960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.078985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.674 qpair failed and we were unable to recover it. 00:30:59.674 [2024-11-28 23:23:03.079082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.079199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.079224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.674 qpair failed and we were unable to recover it. 00:30:59.674 [2024-11-28 23:23:03.079319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.079414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.079440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.674 qpair failed and we were unable to recover it. 00:30:59.674 [2024-11-28 23:23:03.079523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.079694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.079721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.674 qpair failed and we were unable to recover it. 00:30:59.674 [2024-11-28 23:23:03.079862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.079943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.079968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.674 qpair failed and we were unable to recover it. 00:30:59.674 [2024-11-28 23:23:03.080056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.080148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.080174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.674 qpair failed and we were unable to recover it. 00:30:59.674 [2024-11-28 23:23:03.080270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.080352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.080376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.674 qpair failed and we were unable to recover it. 00:30:59.674 [2024-11-28 23:23:03.080470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.080605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.674 [2024-11-28 23:23:03.080634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.674 qpair failed and we were unable to recover it. 00:30:59.674 [2024-11-28 23:23:03.080746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.080835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.080859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.675 qpair failed and we were unable to recover it. 00:30:59.675 [2024-11-28 23:23:03.080981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.081068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.081093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.675 qpair failed and we were unable to recover it. 00:30:59.675 [2024-11-28 23:23:03.081189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.081323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.081350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.675 qpair failed and we were unable to recover it. 00:30:59.675 [2024-11-28 23:23:03.081515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.081606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.081631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.675 qpair failed and we were unable to recover it. 00:30:59.675 [2024-11-28 23:23:03.081727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.081809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.081838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.675 qpair failed and we were unable to recover it. 00:30:59.675 [2024-11-28 23:23:03.081923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.082039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.082063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.675 qpair failed and we were unable to recover it. 00:30:59.675 [2024-11-28 23:23:03.082151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.082230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.082254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.675 qpair failed and we were unable to recover it. 00:30:59.675 [2024-11-28 23:23:03.082372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.082503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.082528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.675 qpair failed and we were unable to recover it. 00:30:59.675 [2024-11-28 23:23:03.082612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.082690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.082714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.675 qpair failed and we were unable to recover it. 00:30:59.675 [2024-11-28 23:23:03.082837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.082950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.082974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.675 qpair failed and we were unable to recover it. 00:30:59.675 [2024-11-28 23:23:03.083062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.083164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.083189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.675 qpair failed and we were unable to recover it. 00:30:59.675 [2024-11-28 23:23:03.083284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.083439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.083466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.675 qpair failed and we were unable to recover it. 00:30:59.675 [2024-11-28 23:23:03.083556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.083645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.083670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.675 qpair failed and we were unable to recover it. 00:30:59.675 [2024-11-28 23:23:03.083765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.083855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.083880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.675 qpair failed and we were unable to recover it. 00:30:59.675 [2024-11-28 23:23:03.083966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.084060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.084091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.675 qpair failed and we were unable to recover it. 00:30:59.675 [2024-11-28 23:23:03.084185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.084297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.084323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.675 qpair failed and we were unable to recover it. 00:30:59.675 [2024-11-28 23:23:03.084433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.084532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.084558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.675 qpair failed and we were unable to recover it. 00:30:59.675 [2024-11-28 23:23:03.084675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.084768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.084793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.675 qpair failed and we were unable to recover it. 00:30:59.675 [2024-11-28 23:23:03.084873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.084968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.084992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.675 qpair failed and we were unable to recover it. 00:30:59.675 [2024-11-28 23:23:03.085086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.085188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.085215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.675 qpair failed and we were unable to recover it. 00:30:59.675 [2024-11-28 23:23:03.085332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.085448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.085473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.675 qpair failed and we were unable to recover it. 00:30:59.675 [2024-11-28 23:23:03.085560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.085679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.085703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.675 qpair failed and we were unable to recover it. 00:30:59.675 [2024-11-28 23:23:03.085826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.085908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.085932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.675 qpair failed and we were unable to recover it. 00:30:59.675 [2024-11-28 23:23:03.086051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.086134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.086158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.675 qpair failed and we were unable to recover it. 00:30:59.675 [2024-11-28 23:23:03.086241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.086325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.086351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.675 qpair failed and we were unable to recover it. 00:30:59.675 [2024-11-28 23:23:03.086473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.086553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.086578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.675 qpair failed and we were unable to recover it. 00:30:59.675 [2024-11-28 23:23:03.086666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.086753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.086778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.675 qpair failed and we were unable to recover it. 00:30:59.675 [2024-11-28 23:23:03.086892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.086976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.087001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.675 qpair failed and we were unable to recover it. 00:30:59.675 [2024-11-28 23:23:03.087124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.087240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.675 [2024-11-28 23:23:03.087264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.675 qpair failed and we were unable to recover it. 00:30:59.675 [2024-11-28 23:23:03.087346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.087437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.087462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.676 qpair failed and we were unable to recover it. 00:30:59.676 [2024-11-28 23:23:03.087550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.087668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.087694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.676 qpair failed and we were unable to recover it. 00:30:59.676 [2024-11-28 23:23:03.087806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.087905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.087933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.676 qpair failed and we were unable to recover it. 00:30:59.676 [2024-11-28 23:23:03.088071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.088163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.088188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.676 qpair failed and we were unable to recover it. 00:30:59.676 [2024-11-28 23:23:03.088273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.088397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.088423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.676 qpair failed and we were unable to recover it. 00:30:59.676 [2024-11-28 23:23:03.088547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.088636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.088660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.676 qpair failed and we were unable to recover it. 00:30:59.676 [2024-11-28 23:23:03.088788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.088887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.088914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.676 qpair failed and we were unable to recover it. 00:30:59.676 [2024-11-28 23:23:03.089021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.089108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.089132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.676 qpair failed and we were unable to recover it. 00:30:59.676 [2024-11-28 23:23:03.089225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.089338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.089363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.676 qpair failed and we were unable to recover it. 00:30:59.676 [2024-11-28 23:23:03.089463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.089585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.089610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.676 qpair failed and we were unable to recover it. 00:30:59.676 [2024-11-28 23:23:03.089710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.089821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.089846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.676 qpair failed and we were unable to recover it. 00:30:59.676 [2024-11-28 23:23:03.089934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.090024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.090049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.676 qpair failed and we were unable to recover it. 00:30:59.676 [2024-11-28 23:23:03.090138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.090224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.090249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.676 qpair failed and we were unable to recover it. 00:30:59.676 [2024-11-28 23:23:03.090337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.090425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.090451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.676 qpair failed and we were unable to recover it. 00:30:59.676 [2024-11-28 23:23:03.090614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.090745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.090771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.676 qpair failed and we were unable to recover it. 00:30:59.676 [2024-11-28 23:23:03.090867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.090951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.090975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.676 qpair failed and we were unable to recover it. 00:30:59.676 [2024-11-28 23:23:03.091069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.091215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.091240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.676 qpair failed and we were unable to recover it. 00:30:59.676 [2024-11-28 23:23:03.091336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.091470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.091499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.676 qpair failed and we were unable to recover it. 00:30:59.676 [2024-11-28 23:23:03.091657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.091771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.091795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.676 qpair failed and we were unable to recover it. 00:30:59.676 [2024-11-28 23:23:03.091887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.092001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.092025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.676 qpair failed and we were unable to recover it. 00:30:59.676 [2024-11-28 23:23:03.092140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.092232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.092256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.676 qpair failed and we were unable to recover it. 00:30:59.676 [2024-11-28 23:23:03.092368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.092491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.092519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.676 qpair failed and we were unable to recover it. 00:30:59.676 [2024-11-28 23:23:03.092626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.092718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.092742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.676 qpair failed and we were unable to recover it. 00:30:59.676 [2024-11-28 23:23:03.092861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.092997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.093021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.676 qpair failed and we were unable to recover it. 00:30:59.676 [2024-11-28 23:23:03.093138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.093254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.093278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.676 qpair failed and we were unable to recover it. 00:30:59.676 [2024-11-28 23:23:03.093368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.093447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.093473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.676 qpair failed and we were unable to recover it. 00:30:59.676 [2024-11-28 23:23:03.093599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.093693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.093721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.676 qpair failed and we were unable to recover it. 00:30:59.676 [2024-11-28 23:23:03.093807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.093893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.093918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.676 qpair failed and we were unable to recover it. 00:30:59.676 [2024-11-28 23:23:03.094021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.094112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.094137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.676 qpair failed and we were unable to recover it. 00:30:59.676 [2024-11-28 23:23:03.094252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.676 [2024-11-28 23:23:03.094369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.094400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.677 qpair failed and we were unable to recover it. 00:30:59.677 [2024-11-28 23:23:03.094508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.094623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.094648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.677 qpair failed and we were unable to recover it. 00:30:59.677 [2024-11-28 23:23:03.094741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.094832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.094856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.677 qpair failed and we were unable to recover it. 00:30:59.677 [2024-11-28 23:23:03.094981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.095062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.095086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.677 qpair failed and we were unable to recover it. 00:30:59.677 [2024-11-28 23:23:03.095176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.095259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.095284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.677 qpair failed and we were unable to recover it. 00:30:59.677 [2024-11-28 23:23:03.095374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.095503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.095528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.677 qpair failed and we were unable to recover it. 00:30:59.677 [2024-11-28 23:23:03.095642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.095761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.095785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.677 qpair failed and we were unable to recover it. 00:30:59.677 [2024-11-28 23:23:03.095874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.095959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.095983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.677 qpair failed and we were unable to recover it. 00:30:59.677 [2024-11-28 23:23:03.096068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.096179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.096203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.677 qpair failed and we were unable to recover it. 00:30:59.677 [2024-11-28 23:23:03.096297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.096385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.096417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.677 qpair failed and we were unable to recover it. 00:30:59.677 [2024-11-28 23:23:03.096501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.096590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.096614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.677 qpair failed and we were unable to recover it. 00:30:59.677 [2024-11-28 23:23:03.096727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.096822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.096846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.677 qpair failed and we were unable to recover it. 00:30:59.677 [2024-11-28 23:23:03.096985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.097081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.097108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.677 qpair failed and we were unable to recover it. 00:30:59.677 [2024-11-28 23:23:03.097216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.097337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.097361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.677 qpair failed and we were unable to recover it. 00:30:59.677 [2024-11-28 23:23:03.097451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.097571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.097596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.677 qpair failed and we were unable to recover it. 00:30:59.677 [2024-11-28 23:23:03.097686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.097822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.097848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.677 qpair failed and we were unable to recover it. 00:30:59.677 [2024-11-28 23:23:03.097940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.098064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.098106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.677 qpair failed and we were unable to recover it. 00:30:59.677 [2024-11-28 23:23:03.098224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.098334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.098358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.677 qpair failed and we were unable to recover it. 00:30:59.677 [2024-11-28 23:23:03.098458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.098553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.098578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.677 qpair failed and we were unable to recover it. 00:30:59.677 [2024-11-28 23:23:03.098713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.098840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.098869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.677 qpair failed and we were unable to recover it. 00:30:59.677 [2024-11-28 23:23:03.099008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.099100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.099125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.677 qpair failed and we were unable to recover it. 00:30:59.677 [2024-11-28 23:23:03.099223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.099306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.099331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.677 qpair failed and we were unable to recover it. 00:30:59.677 [2024-11-28 23:23:03.099423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.099513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.099538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.677 qpair failed and we were unable to recover it. 00:30:59.677 [2024-11-28 23:23:03.099648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.099734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.099760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.677 qpair failed and we were unable to recover it. 00:30:59.677 [2024-11-28 23:23:03.099875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.099962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.099987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.677 qpair failed and we were unable to recover it. 00:30:59.677 [2024-11-28 23:23:03.100075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.100189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.100214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.677 qpair failed and we were unable to recover it. 00:30:59.677 [2024-11-28 23:23:03.100301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.100415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.100441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.677 qpair failed and we were unable to recover it. 00:30:59.677 [2024-11-28 23:23:03.100550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.100638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.100666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.677 qpair failed and we were unable to recover it. 00:30:59.677 [2024-11-28 23:23:03.100770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.100856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.100881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.677 qpair failed and we were unable to recover it. 00:30:59.677 [2024-11-28 23:23:03.100997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.101086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.677 [2024-11-28 23:23:03.101111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.677 qpair failed and we were unable to recover it. 00:30:59.678 [2024-11-28 23:23:03.101211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.101328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.101353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.678 qpair failed and we were unable to recover it. 00:30:59.678 [2024-11-28 23:23:03.101471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.101562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.101591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.678 qpair failed and we were unable to recover it. 00:30:59.678 [2024-11-28 23:23:03.101707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.101823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.101848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.678 qpair failed and we were unable to recover it. 00:30:59.678 [2024-11-28 23:23:03.101933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.102018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.102042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.678 qpair failed and we were unable to recover it. 00:30:59.678 [2024-11-28 23:23:03.102156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.102272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.102299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.678 qpair failed and we were unable to recover it. 00:30:59.678 [2024-11-28 23:23:03.102425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.102541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.102565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.678 qpair failed and we were unable to recover it. 00:30:59.678 [2024-11-28 23:23:03.102649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.102766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.102791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.678 qpair failed and we were unable to recover it. 00:30:59.678 [2024-11-28 23:23:03.102876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.102963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.102988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.678 qpair failed and we were unable to recover it. 00:30:59.678 [2024-11-28 23:23:03.103100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.103197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.103222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.678 qpair failed and we were unable to recover it. 00:30:59.678 [2024-11-28 23:23:03.103355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.103531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.103557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.678 qpair failed and we were unable to recover it. 00:30:59.678 [2024-11-28 23:23:03.103672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.103772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.103796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.678 qpair failed and we were unable to recover it. 00:30:59.678 [2024-11-28 23:23:03.103884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.104002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.104027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.678 qpair failed and we were unable to recover it. 00:30:59.678 [2024-11-28 23:23:03.104109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.104268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.104296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.678 qpair failed and we were unable to recover it. 00:30:59.678 [2024-11-28 23:23:03.104463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.104557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.104582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.678 qpair failed and we were unable to recover it. 00:30:59.678 [2024-11-28 23:23:03.104723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.104812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.104837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.678 qpair failed and we were unable to recover it. 00:30:59.678 [2024-11-28 23:23:03.104926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.105033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.105058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.678 qpair failed and we were unable to recover it. 00:30:59.678 [2024-11-28 23:23:03.105195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.105336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.105362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.678 qpair failed and we were unable to recover it. 00:30:59.678 [2024-11-28 23:23:03.105460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.105578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.105604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.678 qpair failed and we were unable to recover it. 00:30:59.678 [2024-11-28 23:23:03.105703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.105807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.105840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.678 qpair failed and we were unable to recover it. 00:30:59.678 [2024-11-28 23:23:03.105967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.106067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.106095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.678 qpair failed and we were unable to recover it. 00:30:59.678 [2024-11-28 23:23:03.106210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.106351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.106376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.678 qpair failed and we were unable to recover it. 00:30:59.678 [2024-11-28 23:23:03.106483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.106570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.106595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.678 qpair failed and we were unable to recover it. 00:30:59.678 [2024-11-28 23:23:03.106707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.106793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.106818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.678 qpair failed and we were unable to recover it. 00:30:59.678 [2024-11-28 23:23:03.106940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.107028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.107053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.678 qpair failed and we were unable to recover it. 00:30:59.678 [2024-11-28 23:23:03.107179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.107300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.107326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.678 qpair failed and we were unable to recover it. 00:30:59.678 [2024-11-28 23:23:03.107450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.107562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.678 [2024-11-28 23:23:03.107588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.678 qpair failed and we were unable to recover it. 00:30:59.679 [2024-11-28 23:23:03.107705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.107802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.107827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.679 qpair failed and we were unable to recover it. 00:30:59.679 [2024-11-28 23:23:03.107976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.108085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.108109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.679 qpair failed and we were unable to recover it. 00:30:59.679 [2024-11-28 23:23:03.108236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.108324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.108349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.679 qpair failed and we were unable to recover it. 00:30:59.679 [2024-11-28 23:23:03.108478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.108573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.108597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.679 qpair failed and we were unable to recover it. 00:30:59.679 [2024-11-28 23:23:03.108730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.108821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.108845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.679 qpair failed and we were unable to recover it. 00:30:59.679 [2024-11-28 23:23:03.108958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.109046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.109070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.679 qpair failed and we were unable to recover it. 00:30:59.679 [2024-11-28 23:23:03.109184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.109277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.109301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.679 qpair failed and we were unable to recover it. 00:30:59.679 [2024-11-28 23:23:03.109423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.109541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.109567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.679 qpair failed and we were unable to recover it. 00:30:59.679 [2024-11-28 23:23:03.109664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.109763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.109790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.679 qpair failed and we were unable to recover it. 00:30:59.679 [2024-11-28 23:23:03.109944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.110034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.110059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.679 qpair failed and we were unable to recover it. 00:30:59.679 [2024-11-28 23:23:03.110148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.110239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.110264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.679 qpair failed and we were unable to recover it. 00:30:59.679 [2024-11-28 23:23:03.110378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.110513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.110542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.679 qpair failed and we were unable to recover it. 00:30:59.679 [2024-11-28 23:23:03.110658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.110776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.110800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.679 qpair failed and we were unable to recover it. 00:30:59.679 [2024-11-28 23:23:03.110925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.111004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.111030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.679 qpair failed and we were unable to recover it. 00:30:59.679 [2024-11-28 23:23:03.111154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.111246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.111271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.679 qpair failed and we were unable to recover it. 00:30:59.679 [2024-11-28 23:23:03.111363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.111460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.111484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.679 qpair failed and we were unable to recover it. 00:30:59.679 [2024-11-28 23:23:03.111576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.111689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.111715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.679 qpair failed and we were unable to recover it. 00:30:59.679 [2024-11-28 23:23:03.111839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.111954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.111979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.679 qpair failed and we were unable to recover it. 00:30:59.679 [2024-11-28 23:23:03.112071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.112178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.112203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.679 qpair failed and we were unable to recover it. 00:30:59.679 [2024-11-28 23:23:03.112303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.112383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.112413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.679 qpair failed and we were unable to recover it. 00:30:59.679 [2024-11-28 23:23:03.112501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.112607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.112635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.679 qpair failed and we were unable to recover it. 00:30:59.679 [2024-11-28 23:23:03.112740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.112823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.112847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.679 qpair failed and we were unable to recover it. 00:30:59.679 [2024-11-28 23:23:03.112966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.113090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.113114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.679 qpair failed and we were unable to recover it. 00:30:59.679 [2024-11-28 23:23:03.113199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.113348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.113373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.679 qpair failed and we were unable to recover it. 00:30:59.679 [2024-11-28 23:23:03.113501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.113581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.113606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.679 qpair failed and we were unable to recover it. 00:30:59.679 [2024-11-28 23:23:03.113708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.113826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.113850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.679 qpair failed and we were unable to recover it. 00:30:59.679 [2024-11-28 23:23:03.113939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.114028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.114053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.679 qpair failed and we were unable to recover it. 00:30:59.679 [2024-11-28 23:23:03.114166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.114273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.114300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.679 qpair failed and we were unable to recover it. 00:30:59.679 [2024-11-28 23:23:03.114439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.114548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.679 [2024-11-28 23:23:03.114574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.679 qpair failed and we were unable to recover it. 00:30:59.679 [2024-11-28 23:23:03.114691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.114776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.114801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.680 qpair failed and we were unable to recover it. 00:30:59.680 [2024-11-28 23:23:03.114899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.114982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.115006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.680 qpair failed and we were unable to recover it. 00:30:59.680 [2024-11-28 23:23:03.115167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.115258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.115286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.680 qpair failed and we were unable to recover it. 00:30:59.680 [2024-11-28 23:23:03.115411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.115529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.115554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.680 qpair failed and we were unable to recover it. 00:30:59.680 [2024-11-28 23:23:03.115674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.115810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.115840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.680 qpair failed and we were unable to recover it. 00:30:59.680 [2024-11-28 23:23:03.115960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.116063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.116090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.680 qpair failed and we were unable to recover it. 00:30:59.680 [2024-11-28 23:23:03.116185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.116311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.116339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.680 qpair failed and we were unable to recover it. 00:30:59.680 [2024-11-28 23:23:03.116451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.116544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.116568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.680 qpair failed and we were unable to recover it. 00:30:59.680 [2024-11-28 23:23:03.116682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.116773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.116797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.680 qpair failed and we were unable to recover it. 00:30:59.680 [2024-11-28 23:23:03.116887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.117006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.117030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.680 qpair failed and we were unable to recover it. 00:30:59.680 [2024-11-28 23:23:03.117141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.117239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.117263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.680 qpair failed and we were unable to recover it. 00:30:59.680 [2024-11-28 23:23:03.117408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.117498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.117522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.680 qpair failed and we were unable to recover it. 00:30:59.680 [2024-11-28 23:23:03.117640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.117733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.117757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.680 qpair failed and we were unable to recover it. 00:30:59.680 [2024-11-28 23:23:03.117870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.117982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.118007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.680 qpair failed and we were unable to recover it. 00:30:59.680 [2024-11-28 23:23:03.118095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.118188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.118217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.680 qpair failed and we were unable to recover it. 00:30:59.680 [2024-11-28 23:23:03.118306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.118448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.118477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.680 qpair failed and we were unable to recover it. 00:30:59.680 [2024-11-28 23:23:03.118594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.118715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.118740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.680 qpair failed and we were unable to recover it. 00:30:59.680 [2024-11-28 23:23:03.118833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.118928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.118953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.680 qpair failed and we were unable to recover it. 00:30:59.680 [2024-11-28 23:23:03.119041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.119132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.119158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.680 qpair failed and we were unable to recover it. 00:30:59.680 [2024-11-28 23:23:03.119246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.119341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.119366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.680 qpair failed and we were unable to recover it. 00:30:59.680 [2024-11-28 23:23:03.119489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.119581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.119607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.680 qpair failed and we were unable to recover it. 00:30:59.680 [2024-11-28 23:23:03.119713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.119801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.119825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.680 qpair failed and we were unable to recover it. 00:30:59.680 [2024-11-28 23:23:03.119917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.120032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.120056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.680 qpair failed and we were unable to recover it. 00:30:59.680 [2024-11-28 23:23:03.120174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.120286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.120312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.680 qpair failed and we were unable to recover it. 00:30:59.680 [2024-11-28 23:23:03.120402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.120503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.120528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.680 qpair failed and we were unable to recover it. 00:30:59.680 [2024-11-28 23:23:03.120618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.120699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.120724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.680 qpair failed and we were unable to recover it. 00:30:59.680 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 2582397 Killed "${NVMF_APP[@]}" "$@" 00:30:59.680 [2024-11-28 23:23:03.120841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.120927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.120951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.680 qpair failed and we were unable to recover it. 00:30:59.680 [2024-11-28 23:23:03.121051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 23:23:03 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:30:59.680 [2024-11-28 23:23:03.121133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.121157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.680 qpair failed and we were unable to recover it. 00:30:59.680 23:23:03 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:30:59.680 [2024-11-28 23:23:03.121272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.680 [2024-11-28 23:23:03.121357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.121382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.681 qpair failed and we were unable to recover it. 00:30:59.681 23:23:03 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:59.681 [2024-11-28 23:23:03.121512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 23:23:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:59.681 [2024-11-28 23:23:03.121619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.121643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.681 qpair failed and we were unable to recover it. 00:30:59.681 23:23:03 -- common/autotest_common.sh@10 -- # set +x 00:30:59.681 [2024-11-28 23:23:03.121737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.121815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.121839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.681 qpair failed and we were unable to recover it. 00:30:59.681 [2024-11-28 23:23:03.121931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.122045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.122071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.681 qpair failed and we were unable to recover it. 00:30:59.681 [2024-11-28 23:23:03.122169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.122285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.122310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.681 qpair failed and we were unable to recover it. 00:30:59.681 [2024-11-28 23:23:03.122403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.122493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.122519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.681 qpair failed and we were unable to recover it. 00:30:59.681 [2024-11-28 23:23:03.122611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.122728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.122752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.681 qpair failed and we were unable to recover it. 00:30:59.681 [2024-11-28 23:23:03.122870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.123039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.123065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.681 qpair failed and we were unable to recover it. 00:30:59.681 [2024-11-28 23:23:03.123150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.123239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.123263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.681 qpair failed and we were unable to recover it. 00:30:59.681 [2024-11-28 23:23:03.123406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.123510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.123535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.681 qpair failed and we were unable to recover it. 00:30:59.681 [2024-11-28 23:23:03.123623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.123717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.123742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.681 qpair failed and we were unable to recover it. 00:30:59.681 [2024-11-28 23:23:03.123862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.124015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.124039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.681 qpair failed and we were unable to recover it. 00:30:59.681 [2024-11-28 23:23:03.124119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.124228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.124253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.681 qpair failed and we were unable to recover it. 00:30:59.681 [2024-11-28 23:23:03.124376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.124504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.124529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.681 qpair failed and we were unable to recover it. 00:30:59.681 [2024-11-28 23:23:03.124618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.124760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.124787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.681 qpair failed and we were unable to recover it. 00:30:59.681 [2024-11-28 23:23:03.124898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.125017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.125045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.681 qpair failed and we were unable to recover it. 00:30:59.681 [2024-11-28 23:23:03.125141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.125265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.125289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.681 qpair failed and we were unable to recover it. 00:30:59.681 [2024-11-28 23:23:03.125384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.125494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.125523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.681 qpair failed and we were unable to recover it. 00:30:59.681 [2024-11-28 23:23:03.125665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.125752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.125777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.681 qpair failed and we were unable to recover it. 00:30:59.681 [2024-11-28 23:23:03.125871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.125956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.125980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.681 qpair failed and we were unable to recover it. 00:30:59.681 [2024-11-28 23:23:03.126093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.126183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.126209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.681 qpair failed and we were unable to recover it. 00:30:59.681 [2024-11-28 23:23:03.126319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.126406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.126443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.681 qpair failed and we were unable to recover it. 00:30:59.681 [2024-11-28 23:23:03.126536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.126617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.126641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.681 qpair failed and we were unable to recover it. 00:30:59.681 [2024-11-28 23:23:03.126736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.126844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.126869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.681 qpair failed and we were unable to recover it. 00:30:59.681 23:23:03 -- nvmf/common.sh@469 -- # nvmfpid=2583092 00:30:59.681 [2024-11-28 23:23:03.126957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 23:23:03 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:30:59.681 [2024-11-28 23:23:03.127051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.127077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.681 23:23:03 -- nvmf/common.sh@470 -- # waitforlisten 2583092 00:30:59.681 qpair failed and we were unable to recover it. 00:30:59.681 [2024-11-28 23:23:03.127169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.127282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.127312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.681 qpair failed and we were unable to recover it. 00:30:59.681 23:23:03 -- common/autotest_common.sh@829 -- # '[' -z 2583092 ']' 00:30:59.681 [2024-11-28 23:23:03.127419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 23:23:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:59.681 [2024-11-28 23:23:03.127568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.127597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.681 qpair failed and we were unable to recover it. 00:30:59.681 23:23:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:59.681 [2024-11-28 23:23:03.127709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 [2024-11-28 23:23:03.127829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.681 23:23:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:59.681 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:59.682 [2024-11-28 23:23:03.127855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.682 qpair failed and we were unable to recover it. 00:30:59.682 [2024-11-28 23:23:03.127951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 23:23:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:59.682 [2024-11-28 23:23:03.128094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 23:23:03 -- common/autotest_common.sh@10 -- # set +x 00:30:59.682 [2024-11-28 23:23:03.128121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.682 qpair failed and we were unable to recover it. 00:30:59.682 [2024-11-28 23:23:03.128236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.128322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.128347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.682 qpair failed and we were unable to recover it. 00:30:59.682 [2024-11-28 23:23:03.128441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.128529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.128554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.682 qpair failed and we were unable to recover it. 00:30:59.682 [2024-11-28 23:23:03.128657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.128749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.128776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.682 qpair failed and we were unable to recover it. 00:30:59.682 [2024-11-28 23:23:03.128908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.129001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.129028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.682 qpair failed and we were unable to recover it. 00:30:59.682 [2024-11-28 23:23:03.129144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.129262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.129287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.682 qpair failed and we were unable to recover it. 00:30:59.682 [2024-11-28 23:23:03.129428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.129571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.129601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.682 qpair failed and we were unable to recover it. 00:30:59.682 [2024-11-28 23:23:03.129717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.129814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.129840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.682 qpair failed and we were unable to recover it. 00:30:59.682 [2024-11-28 23:23:03.129934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.130078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.130103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.682 qpair failed and we were unable to recover it. 00:30:59.682 [2024-11-28 23:23:03.130251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.130342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.130368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.682 qpair failed and we were unable to recover it. 00:30:59.682 [2024-11-28 23:23:03.130496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.130577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.130601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.682 qpair failed and we were unable to recover it. 00:30:59.682 [2024-11-28 23:23:03.130689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.130805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.130829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.682 qpair failed and we were unable to recover it. 00:30:59.682 [2024-11-28 23:23:03.130952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.131050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.131075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.682 qpair failed and we were unable to recover it. 00:30:59.682 [2024-11-28 23:23:03.131224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.131344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.131387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.682 qpair failed and we were unable to recover it. 00:30:59.682 [2024-11-28 23:23:03.131488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.131600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.131624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.682 qpair failed and we were unable to recover it. 00:30:59.682 [2024-11-28 23:23:03.131747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.131842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.131866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.682 qpair failed and we were unable to recover it. 00:30:59.682 [2024-11-28 23:23:03.132007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.132109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.132141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.682 qpair failed and we were unable to recover it. 00:30:59.682 [2024-11-28 23:23:03.132252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.132390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.132423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.682 qpair failed and we were unable to recover it. 00:30:59.682 [2024-11-28 23:23:03.132573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.132666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.132690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.682 qpair failed and we were unable to recover it. 00:30:59.682 [2024-11-28 23:23:03.132777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.132892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.132916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.682 qpair failed and we were unable to recover it. 00:30:59.682 [2024-11-28 23:23:03.133065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.133189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.133213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.682 qpair failed and we were unable to recover it. 00:30:59.682 [2024-11-28 23:23:03.133317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.133405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.133431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.682 qpair failed and we were unable to recover it. 00:30:59.682 [2024-11-28 23:23:03.133548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.133636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.133660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.682 qpair failed and we were unable to recover it. 00:30:59.682 [2024-11-28 23:23:03.133744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.133830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.133855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.682 qpair failed and we were unable to recover it. 00:30:59.682 [2024-11-28 23:23:03.133970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.134129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.134157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.682 qpair failed and we were unable to recover it. 00:30:59.682 [2024-11-28 23:23:03.134270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.134362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.134387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.682 qpair failed and we were unable to recover it. 00:30:59.682 [2024-11-28 23:23:03.134493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.134610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.134635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.682 qpair failed and we were unable to recover it. 00:30:59.682 [2024-11-28 23:23:03.134737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.134875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.682 [2024-11-28 23:23:03.134904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.682 qpair failed and we were unable to recover it. 00:30:59.683 [2024-11-28 23:23:03.135034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.135128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.135157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.683 qpair failed and we were unable to recover it. 00:30:59.683 [2024-11-28 23:23:03.135267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.135381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.135416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.683 qpair failed and we were unable to recover it. 00:30:59.683 [2024-11-28 23:23:03.135513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.135603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.135630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.683 qpair failed and we were unable to recover it. 00:30:59.683 [2024-11-28 23:23:03.135743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.135828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.135869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.683 qpair failed and we were unable to recover it. 00:30:59.683 [2024-11-28 23:23:03.135984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.136073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.136097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.683 qpair failed and we were unable to recover it. 00:30:59.683 [2024-11-28 23:23:03.136200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.136279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.136304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.683 qpair failed and we were unable to recover it. 00:30:59.683 [2024-11-28 23:23:03.136448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.136613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.136639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.683 qpair failed and we were unable to recover it. 00:30:59.683 [2024-11-28 23:23:03.136733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.136849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.136875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.683 qpair failed and we were unable to recover it. 00:30:59.683 [2024-11-28 23:23:03.137007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.137164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.137193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.683 qpair failed and we were unable to recover it. 00:30:59.683 [2024-11-28 23:23:03.137287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.137373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.137407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.683 qpair failed and we were unable to recover it. 00:30:59.683 [2024-11-28 23:23:03.137552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.137641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.137667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.683 qpair failed and we were unable to recover it. 00:30:59.683 [2024-11-28 23:23:03.137787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.137870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.137896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.683 qpair failed and we were unable to recover it. 00:30:59.683 [2024-11-28 23:23:03.138066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.138159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.138183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.683 qpair failed and we were unable to recover it. 00:30:59.683 [2024-11-28 23:23:03.138265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.138351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.138375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.683 qpair failed and we were unable to recover it. 00:30:59.683 [2024-11-28 23:23:03.138482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.138568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.138593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.683 qpair failed and we were unable to recover it. 00:30:59.683 [2024-11-28 23:23:03.138732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.138859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.138883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.683 qpair failed and we were unable to recover it. 00:30:59.683 [2024-11-28 23:23:03.138995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.139092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.139116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.683 qpair failed and we were unable to recover it. 00:30:59.683 [2024-11-28 23:23:03.139211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.139288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.139313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.683 qpair failed and we were unable to recover it. 00:30:59.683 [2024-11-28 23:23:03.139406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.139490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.139532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.683 qpair failed and we were unable to recover it. 00:30:59.683 [2024-11-28 23:23:03.139648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.139763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.139788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.683 qpair failed and we were unable to recover it. 00:30:59.683 [2024-11-28 23:23:03.139883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.139968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.139992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.683 qpair failed and we were unable to recover it. 00:30:59.683 [2024-11-28 23:23:03.140079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.140164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.140190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.683 qpair failed and we were unable to recover it. 00:30:59.683 [2024-11-28 23:23:03.140272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.140398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.140424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.683 qpair failed and we were unable to recover it. 00:30:59.683 [2024-11-28 23:23:03.140574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.140660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.140684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.683 qpair failed and we were unable to recover it. 00:30:59.683 [2024-11-28 23:23:03.140763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.140871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.140895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.683 qpair failed and we were unable to recover it. 00:30:59.683 [2024-11-28 23:23:03.140989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.141069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.683 [2024-11-28 23:23:03.141095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.683 qpair failed and we were unable to recover it. 00:30:59.684 [2024-11-28 23:23:03.141186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.141263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.141287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.684 qpair failed and we were unable to recover it. 00:30:59.684 [2024-11-28 23:23:03.141377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.141471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.141497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.684 qpair failed and we were unable to recover it. 00:30:59.684 [2024-11-28 23:23:03.141630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.141751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.141777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.684 qpair failed and we were unable to recover it. 00:30:59.684 [2024-11-28 23:23:03.141895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.141977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.142007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.684 qpair failed and we were unable to recover it. 00:30:59.684 [2024-11-28 23:23:03.142099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.142188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.142213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.684 qpair failed and we were unable to recover it. 00:30:59.684 [2024-11-28 23:23:03.142329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.142426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.142451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.684 qpair failed and we were unable to recover it. 00:30:59.684 [2024-11-28 23:23:03.142537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.142657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.142682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.684 qpair failed and we were unable to recover it. 00:30:59.684 [2024-11-28 23:23:03.142771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.142857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.142882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.684 qpair failed and we were unable to recover it. 00:30:59.684 [2024-11-28 23:23:03.143007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.143094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.143118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.684 qpair failed and we were unable to recover it. 00:30:59.684 [2024-11-28 23:23:03.143232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.143370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.143405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.684 qpair failed and we were unable to recover it. 00:30:59.684 [2024-11-28 23:23:03.143498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.143599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.143624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.684 qpair failed and we were unable to recover it. 00:30:59.684 [2024-11-28 23:23:03.143705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.143797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.143821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.684 qpair failed and we were unable to recover it. 00:30:59.684 [2024-11-28 23:23:03.143922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.144066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.144091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.684 qpair failed and we were unable to recover it. 00:30:59.684 [2024-11-28 23:23:03.144230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.144325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.144353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.684 qpair failed and we were unable to recover it. 00:30:59.684 [2024-11-28 23:23:03.144483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.144597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.144622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.684 qpair failed and we were unable to recover it. 00:30:59.684 [2024-11-28 23:23:03.144717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.144813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.144838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.684 qpair failed and we were unable to recover it. 00:30:59.684 [2024-11-28 23:23:03.144948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.145039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.145064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.684 qpair failed and we were unable to recover it. 00:30:59.684 [2024-11-28 23:23:03.145146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.145226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.145251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.684 qpair failed and we were unable to recover it. 00:30:59.684 [2024-11-28 23:23:03.145345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.145437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.145462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.684 qpair failed and we were unable to recover it. 00:30:59.684 [2024-11-28 23:23:03.145577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.145662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.145687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.684 qpair failed and we were unable to recover it. 00:30:59.684 [2024-11-28 23:23:03.145774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.145887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.145912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.684 qpair failed and we were unable to recover it. 00:30:59.684 [2024-11-28 23:23:03.146031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.146167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.146193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.684 qpair failed and we were unable to recover it. 00:30:59.684 [2024-11-28 23:23:03.146291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.146405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.146431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.684 qpair failed and we were unable to recover it. 00:30:59.684 [2024-11-28 23:23:03.146518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.146601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.146626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.684 qpair failed and we were unable to recover it. 00:30:59.684 [2024-11-28 23:23:03.146778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.146922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.146947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.684 qpair failed and we were unable to recover it. 00:30:59.684 [2024-11-28 23:23:03.147034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.147128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.147154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.684 qpair failed and we were unable to recover it. 00:30:59.684 [2024-11-28 23:23:03.147247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.147357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.147381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.684 qpair failed and we were unable to recover it. 00:30:59.684 [2024-11-28 23:23:03.147487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.147570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.147595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.684 qpair failed and we were unable to recover it. 00:30:59.684 [2024-11-28 23:23:03.147675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.147774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.684 [2024-11-28 23:23:03.147801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.684 qpair failed and we were unable to recover it. 00:30:59.684 [2024-11-28 23:23:03.147965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.148044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.148069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.685 qpair failed and we were unable to recover it. 00:30:59.685 [2024-11-28 23:23:03.148160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.148243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.148268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.685 qpair failed and we were unable to recover it. 00:30:59.685 [2024-11-28 23:23:03.148382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.148486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.148514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.685 qpair failed and we were unable to recover it. 00:30:59.685 [2024-11-28 23:23:03.148617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.148754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.148780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.685 qpair failed and we were unable to recover it. 00:30:59.685 [2024-11-28 23:23:03.148916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.149008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.149049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.685 qpair failed and we were unable to recover it. 00:30:59.685 [2024-11-28 23:23:03.149139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.149249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.149275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.685 qpair failed and we were unable to recover it. 00:30:59.685 [2024-11-28 23:23:03.149359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.149483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.149510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.685 qpair failed and we were unable to recover it. 00:30:59.685 [2024-11-28 23:23:03.149600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.149738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.149767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.685 qpair failed and we were unable to recover it. 00:30:59.685 [2024-11-28 23:23:03.149866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.150017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.150042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.685 qpair failed and we were unable to recover it. 00:30:59.685 [2024-11-28 23:23:03.150132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.150223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.150247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.685 qpair failed and we were unable to recover it. 00:30:59.685 [2024-11-28 23:23:03.150341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.150461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.150506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.685 qpair failed and we were unable to recover it. 00:30:59.685 [2024-11-28 23:23:03.150613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.150762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.150791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.685 qpair failed and we were unable to recover it. 00:30:59.685 [2024-11-28 23:23:03.150896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.151007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.151032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.685 qpair failed and we were unable to recover it. 00:30:59.685 [2024-11-28 23:23:03.151152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.151234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.151258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.685 qpair failed and we were unable to recover it. 00:30:59.685 [2024-11-28 23:23:03.151426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.151577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.151606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.685 qpair failed and we were unable to recover it. 00:30:59.685 [2024-11-28 23:23:03.151723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.151813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.151837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.685 qpair failed and we were unable to recover it. 00:30:59.685 [2024-11-28 23:23:03.151930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.152069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.152093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.685 qpair failed and we were unable to recover it. 00:30:59.685 [2024-11-28 23:23:03.152185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.152269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.152295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.685 qpair failed and we were unable to recover it. 00:30:59.685 [2024-11-28 23:23:03.152413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.152504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.152530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.685 qpair failed and we were unable to recover it. 00:30:59.685 [2024-11-28 23:23:03.152653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.152747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.152772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.685 qpair failed and we were unable to recover it. 00:30:59.685 [2024-11-28 23:23:03.152881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.153030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.153054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.685 qpair failed and we were unable to recover it. 00:30:59.685 [2024-11-28 23:23:03.153137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.153255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.153280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.685 qpair failed and we were unable to recover it. 00:30:59.685 [2024-11-28 23:23:03.153440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.153538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.153566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.685 qpair failed and we were unable to recover it. 00:30:59.685 [2024-11-28 23:23:03.153672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.153768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.153794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.685 qpair failed and we were unable to recover it. 00:30:59.685 [2024-11-28 23:23:03.153936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.154061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.154087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.685 qpair failed and we were unable to recover it. 00:30:59.685 [2024-11-28 23:23:03.154205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.154377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.154419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.685 qpair failed and we were unable to recover it. 00:30:59.685 [2024-11-28 23:23:03.154540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.154657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.154683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.685 qpair failed and we were unable to recover it. 00:30:59.685 [2024-11-28 23:23:03.154783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.154869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.154894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.685 qpair failed and we were unable to recover it. 00:30:59.685 [2024-11-28 23:23:03.154987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.155106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.155131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.685 qpair failed and we were unable to recover it. 00:30:59.685 [2024-11-28 23:23:03.155246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.685 [2024-11-28 23:23:03.155336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.155361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.686 qpair failed and we were unable to recover it. 00:30:59.686 [2024-11-28 23:23:03.155475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.155565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.155591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.686 qpair failed and we were unable to recover it. 00:30:59.686 [2024-11-28 23:23:03.155714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.155828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.155853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.686 qpair failed and we were unable to recover it. 00:30:59.686 [2024-11-28 23:23:03.155969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.156082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.156110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.686 qpair failed and we were unable to recover it. 00:30:59.686 [2024-11-28 23:23:03.156225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.156320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.156345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.686 qpair failed and we were unable to recover it. 00:30:59.686 [2024-11-28 23:23:03.156432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.156521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.156545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.686 qpair failed and we were unable to recover it. 00:30:59.686 [2024-11-28 23:23:03.156636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.156717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.156743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.686 qpair failed and we were unable to recover it. 00:30:59.686 [2024-11-28 23:23:03.156844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.156961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.156985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.686 qpair failed and we were unable to recover it. 00:30:59.686 [2024-11-28 23:23:03.157075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.157162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.157186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.686 qpair failed and we were unable to recover it. 00:30:59.686 [2024-11-28 23:23:03.157272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.157391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.157442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.686 qpair failed and we were unable to recover it. 00:30:59.686 [2024-11-28 23:23:03.157588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.157690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.157715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.686 qpair failed and we were unable to recover it. 00:30:59.686 [2024-11-28 23:23:03.157843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.157939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.157964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.686 qpair failed and we were unable to recover it. 00:30:59.686 [2024-11-28 23:23:03.158081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.158167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.158192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.686 qpair failed and we were unable to recover it. 00:30:59.686 [2024-11-28 23:23:03.158276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.158390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.158425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.686 qpair failed and we were unable to recover it. 00:30:59.686 [2024-11-28 23:23:03.158572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.158656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.158680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.686 qpair failed and we were unable to recover it. 00:30:59.686 [2024-11-28 23:23:03.158776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.158862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.158887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.686 qpair failed and we were unable to recover it. 00:30:59.686 [2024-11-28 23:23:03.159002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.159090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.159115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.686 qpair failed and we were unable to recover it. 00:30:59.686 [2024-11-28 23:23:03.159259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.159401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.159426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.686 qpair failed and we were unable to recover it. 00:30:59.686 [2024-11-28 23:23:03.159536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.159620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.159644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.686 qpair failed and we were unable to recover it. 00:30:59.686 [2024-11-28 23:23:03.159737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.159820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.159845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.686 qpair failed and we were unable to recover it. 00:30:59.686 [2024-11-28 23:23:03.159934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.160047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.160071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.686 qpair failed and we were unable to recover it. 00:30:59.686 [2024-11-28 23:23:03.160153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.160260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.160288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.686 qpair failed and we were unable to recover it. 00:30:59.686 [2024-11-28 23:23:03.160438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.160528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.160552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.686 qpair failed and we were unable to recover it. 00:30:59.686 [2024-11-28 23:23:03.160697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.160822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.160850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.686 qpair failed and we were unable to recover it. 00:30:59.686 [2024-11-28 23:23:03.160941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.161038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.161066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.686 qpair failed and we were unable to recover it. 00:30:59.686 [2024-11-28 23:23:03.161226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.161340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.161365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.686 qpair failed and we were unable to recover it. 00:30:59.686 [2024-11-28 23:23:03.161506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.161608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.161637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.686 qpair failed and we were unable to recover it. 00:30:59.686 [2024-11-28 23:23:03.161807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.161897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.161922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.686 qpair failed and we were unable to recover it. 00:30:59.686 [2024-11-28 23:23:03.162033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.162116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.162141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.686 qpair failed and we were unable to recover it. 00:30:59.686 [2024-11-28 23:23:03.162309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.686 [2024-11-28 23:23:03.162430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.162458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.687 qpair failed and we were unable to recover it. 00:30:59.687 [2024-11-28 23:23:03.162571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.162665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.162690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.687 qpair failed and we were unable to recover it. 00:30:59.687 [2024-11-28 23:23:03.162841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.162954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.162979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.687 qpair failed and we were unable to recover it. 00:30:59.687 [2024-11-28 23:23:03.163100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.163249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.163277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.687 qpair failed and we were unable to recover it. 00:30:59.687 [2024-11-28 23:23:03.163405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.163553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.163577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.687 qpair failed and we were unable to recover it. 00:30:59.687 [2024-11-28 23:23:03.163720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.163815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.163840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.687 qpair failed and we were unable to recover it. 00:30:59.687 [2024-11-28 23:23:03.163965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.164100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.164129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.687 qpair failed and we were unable to recover it. 00:30:59.687 [2024-11-28 23:23:03.164255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.164413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.164442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.687 qpair failed and we were unable to recover it. 00:30:59.687 [2024-11-28 23:23:03.164553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.164639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.164671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.687 qpair failed and we were unable to recover it. 00:30:59.687 [2024-11-28 23:23:03.164793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.164894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.164921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.687 qpair failed and we were unable to recover it. 00:30:59.687 [2024-11-28 23:23:03.165066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.165183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.165208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.687 qpair failed and we were unable to recover it. 00:30:59.687 [2024-11-28 23:23:03.165292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.165381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.165443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.687 qpair failed and we were unable to recover it. 00:30:59.687 [2024-11-28 23:23:03.165587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.165736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.165764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.687 qpair failed and we were unable to recover it. 00:30:59.687 [2024-11-28 23:23:03.165894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.166014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.166054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.687 qpair failed and we were unable to recover it. 00:30:59.687 [2024-11-28 23:23:03.166170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.166245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.166270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.687 qpair failed and we were unable to recover it. 00:30:59.687 [2024-11-28 23:23:03.166357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.166453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.166478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.687 qpair failed and we were unable to recover it. 00:30:59.687 [2024-11-28 23:23:03.166588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.166696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.166725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.687 qpair failed and we were unable to recover it. 00:30:59.687 [2024-11-28 23:23:03.166835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.166919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.166946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.687 qpair failed and we were unable to recover it. 00:30:59.687 [2024-11-28 23:23:03.167071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.167168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.167196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.687 qpair failed and we were unable to recover it. 00:30:59.687 [2024-11-28 23:23:03.167324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.167426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.167455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.687 qpair failed and we were unable to recover it. 00:30:59.687 [2024-11-28 23:23:03.167618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.167761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.167802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.687 qpair failed and we were unable to recover it. 00:30:59.687 [2024-11-28 23:23:03.167935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.168087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.168115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.687 qpair failed and we were unable to recover it. 00:30:59.687 [2024-11-28 23:23:03.168267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.168390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.168435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.687 qpair failed and we were unable to recover it. 00:30:59.687 [2024-11-28 23:23:03.168554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.168677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.168702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.687 qpair failed and we were unable to recover it. 00:30:59.687 [2024-11-28 23:23:03.168846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.168981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.169006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.687 qpair failed and we were unable to recover it. 00:30:59.687 [2024-11-28 23:23:03.169180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.169299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.169327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.687 qpair failed and we were unable to recover it. 00:30:59.687 [2024-11-28 23:23:03.169470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.169585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.169610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.687 qpair failed and we were unable to recover it. 00:30:59.687 [2024-11-28 23:23:03.169757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.687 [2024-11-28 23:23:03.169907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.169936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.688 qpair failed and we were unable to recover it. 00:30:59.688 [2024-11-28 23:23:03.170087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.170217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.170245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.688 qpair failed and we were unable to recover it. 00:30:59.688 [2024-11-28 23:23:03.170386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.170480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.170506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.688 qpair failed and we were unable to recover it. 00:30:59.688 [2024-11-28 23:23:03.170590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.170693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.170722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.688 qpair failed and we were unable to recover it. 00:30:59.688 [2024-11-28 23:23:03.170850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.170939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.170967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.688 qpair failed and we were unable to recover it. 00:30:59.688 [2024-11-28 23:23:03.171074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.171158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.171149] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:59.688 [2024-11-28 23:23:03.171184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.688 qpair failed and we were unable to recover it. 00:30:59.688 [2024-11-28 23:23:03.171221] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:59.688 [2024-11-28 23:23:03.171298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.171466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.171494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.688 qpair failed and we were unable to recover it. 00:30:59.688 [2024-11-28 23:23:03.171579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.171702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.171729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.688 qpair failed and we were unable to recover it. 00:30:59.688 [2024-11-28 23:23:03.171814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.171895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.171923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.688 qpair failed and we were unable to recover it. 00:30:59.688 [2024-11-28 23:23:03.172021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.172129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.172158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.688 qpair failed and we were unable to recover it. 00:30:59.688 [2024-11-28 23:23:03.172254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.172405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.172431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.688 qpair failed and we were unable to recover it. 00:30:59.688 [2024-11-28 23:23:03.172566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.172656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.172685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.688 qpair failed and we were unable to recover it. 00:30:59.688 [2024-11-28 23:23:03.172813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.172952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.172977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.688 qpair failed and we were unable to recover it. 00:30:59.688 [2024-11-28 23:23:03.173081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.173236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.173263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.688 qpair failed and we were unable to recover it. 00:30:59.688 [2024-11-28 23:23:03.173362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.173477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.173506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.688 qpair failed and we were unable to recover it. 00:30:59.688 [2024-11-28 23:23:03.173644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.173740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.173765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.688 qpair failed and we were unable to recover it. 00:30:59.688 [2024-11-28 23:23:03.173856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.173999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.174024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.688 qpair failed and we were unable to recover it. 00:30:59.688 [2024-11-28 23:23:03.174106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.174265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.174292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.688 qpair failed and we were unable to recover it. 00:30:59.688 [2024-11-28 23:23:03.174416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.174513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.174539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.688 qpair failed and we were unable to recover it. 00:30:59.688 [2024-11-28 23:23:03.174701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.174825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.174852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.688 qpair failed and we were unable to recover it. 00:30:59.688 [2024-11-28 23:23:03.174976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.175107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.175136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.688 qpair failed and we were unable to recover it. 00:30:59.688 [2024-11-28 23:23:03.175267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.175384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.175420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.688 qpair failed and we were unable to recover it. 00:30:59.688 [2024-11-28 23:23:03.175533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.175685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.175712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.688 qpair failed and we were unable to recover it. 00:30:59.688 [2024-11-28 23:23:03.175835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.175968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.175996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.688 qpair failed and we were unable to recover it. 00:30:59.688 [2024-11-28 23:23:03.176107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.176250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.176275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.688 qpair failed and we were unable to recover it. 00:30:59.688 [2024-11-28 23:23:03.176386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.176525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.176553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.688 qpair failed and we were unable to recover it. 00:30:59.688 [2024-11-28 23:23:03.176688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.176818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.176845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.688 qpair failed and we were unable to recover it. 00:30:59.688 [2024-11-28 23:23:03.176950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.177064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.688 [2024-11-28 23:23:03.177089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.689 qpair failed and we were unable to recover it. 00:30:59.689 [2024-11-28 23:23:03.177227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.177353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.177382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.689 qpair failed and we were unable to recover it. 00:30:59.689 [2024-11-28 23:23:03.177532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.177650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.177678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.689 qpair failed and we were unable to recover it. 00:30:59.689 [2024-11-28 23:23:03.177787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.177878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.177904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.689 qpair failed and we were unable to recover it. 00:30:59.689 [2024-11-28 23:23:03.178044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.178139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.178168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.689 qpair failed and we were unable to recover it. 00:30:59.689 [2024-11-28 23:23:03.178253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.178364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.178391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.689 qpair failed and we were unable to recover it. 00:30:59.689 [2024-11-28 23:23:03.178550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.178693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.178718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.689 qpair failed and we were unable to recover it. 00:30:59.689 [2024-11-28 23:23:03.178861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.178990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.179017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.689 qpair failed and we were unable to recover it. 00:30:59.689 [2024-11-28 23:23:03.179119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.179213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.179240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.689 qpair failed and we were unable to recover it. 00:30:59.689 [2024-11-28 23:23:03.179370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.179490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.179515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.689 qpair failed and we were unable to recover it. 00:30:59.689 [2024-11-28 23:23:03.179629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.179716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.179743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.689 qpair failed and we were unable to recover it. 00:30:59.689 [2024-11-28 23:23:03.179882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.179961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.179985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.689 qpair failed and we were unable to recover it. 00:30:59.689 [2024-11-28 23:23:03.180130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.180267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.180308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.689 qpair failed and we were unable to recover it. 00:30:59.689 [2024-11-28 23:23:03.180450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.180578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.180606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.689 qpair failed and we were unable to recover it. 00:30:59.689 [2024-11-28 23:23:03.180774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.180888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.180912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.689 qpair failed and we were unable to recover it. 00:30:59.689 [2024-11-28 23:23:03.181037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.181175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.181200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.689 qpair failed and we were unable to recover it. 00:30:59.689 [2024-11-28 23:23:03.181373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.181487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.181521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.689 qpair failed and we were unable to recover it. 00:30:59.689 [2024-11-28 23:23:03.181666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.181791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.181828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.689 qpair failed and we were unable to recover it. 00:30:59.689 [2024-11-28 23:23:03.182009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.182129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.182153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.689 qpair failed and we were unable to recover it. 00:30:59.689 [2024-11-28 23:23:03.182277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.182441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.182482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.689 qpair failed and we were unable to recover it. 00:30:59.689 [2024-11-28 23:23:03.182600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.182748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.182776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.689 qpair failed and we were unable to recover it. 00:30:59.689 [2024-11-28 23:23:03.182949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.183059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.183084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.689 qpair failed and we were unable to recover it. 00:30:59.689 [2024-11-28 23:23:03.183228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.183354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.183381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.689 qpair failed and we were unable to recover it. 00:30:59.689 [2024-11-28 23:23:03.183514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.183640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.183664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.689 qpair failed and we were unable to recover it. 00:30:59.689 [2024-11-28 23:23:03.183742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.183824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.183848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.689 qpair failed and we were unable to recover it. 00:30:59.689 [2024-11-28 23:23:03.183931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.184042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.184067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.689 qpair failed and we were unable to recover it. 00:30:59.689 [2024-11-28 23:23:03.184150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.184271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.184297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.689 qpair failed and we were unable to recover it. 00:30:59.689 [2024-11-28 23:23:03.184477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.184560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.184585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.689 qpair failed and we were unable to recover it. 00:30:59.689 [2024-11-28 23:23:03.184741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.184892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.184917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.689 qpair failed and we were unable to recover it. 00:30:59.689 [2024-11-28 23:23:03.185027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.185152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.689 [2024-11-28 23:23:03.185179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.689 qpair failed and we were unable to recover it. 00:30:59.689 [2024-11-28 23:23:03.185343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.185474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.185499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.690 qpair failed and we were unable to recover it. 00:30:59.690 [2024-11-28 23:23:03.185669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.185826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.185854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.690 qpair failed and we were unable to recover it. 00:30:59.690 [2024-11-28 23:23:03.185982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.186103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.186133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.690 qpair failed and we were unable to recover it. 00:30:59.690 [2024-11-28 23:23:03.186271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.186386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.186417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.690 qpair failed and we were unable to recover it. 00:30:59.690 [2024-11-28 23:23:03.186544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.186641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.186668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.690 qpair failed and we were unable to recover it. 00:30:59.690 [2024-11-28 23:23:03.186829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.186921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.186947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.690 qpair failed and we were unable to recover it. 00:30:59.690 [2024-11-28 23:23:03.187067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.187156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.187180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.690 qpair failed and we were unable to recover it. 00:30:59.690 [2024-11-28 23:23:03.187322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.187484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.187513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.690 qpair failed and we were unable to recover it. 00:30:59.690 [2024-11-28 23:23:03.187646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.187767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.187794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.690 qpair failed and we were unable to recover it. 00:30:59.690 [2024-11-28 23:23:03.187899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.187992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.188017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.690 qpair failed and we were unable to recover it. 00:30:59.690 [2024-11-28 23:23:03.188133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.188242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.188268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.690 qpair failed and we were unable to recover it. 00:30:59.690 [2024-11-28 23:23:03.188389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.188554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.188582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.690 qpair failed and we were unable to recover it. 00:30:59.690 [2024-11-28 23:23:03.188707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.188829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.188854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.690 qpair failed and we were unable to recover it. 00:30:59.690 [2024-11-28 23:23:03.188969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.189068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.189095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.690 qpair failed and we were unable to recover it. 00:30:59.690 [2024-11-28 23:23:03.189222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.189347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.189375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.690 qpair failed and we were unable to recover it. 00:30:59.690 [2024-11-28 23:23:03.189521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.189615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.189653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.690 qpair failed and we were unable to recover it. 00:30:59.690 [2024-11-28 23:23:03.189767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.189855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.189895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.690 qpair failed and we were unable to recover it. 00:30:59.690 [2024-11-28 23:23:03.190049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.190176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.190205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.690 qpair failed and we were unable to recover it. 00:30:59.690 [2024-11-28 23:23:03.190344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.190461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.190485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.690 qpair failed and we were unable to recover it. 00:30:59.690 [2024-11-28 23:23:03.190646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.190793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.190818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.690 qpair failed and we were unable to recover it. 00:30:59.690 [2024-11-28 23:23:03.190977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.191108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.191135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.690 qpair failed and we were unable to recover it. 00:30:59.690 [2024-11-28 23:23:03.191254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.191330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.191355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.690 qpair failed and we were unable to recover it. 00:30:59.690 [2024-11-28 23:23:03.191484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.191648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.191676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.690 qpair failed and we were unable to recover it. 00:30:59.690 [2024-11-28 23:23:03.191818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.191899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.191924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.690 qpair failed and we were unable to recover it. 00:30:59.690 [2024-11-28 23:23:03.192040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.192146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.192171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.690 qpair failed and we were unable to recover it. 00:30:59.690 [2024-11-28 23:23:03.192309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.192439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.192466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.690 qpair failed and we were unable to recover it. 00:30:59.690 [2024-11-28 23:23:03.192572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.192697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.192724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.690 qpair failed and we were unable to recover it. 00:30:59.690 [2024-11-28 23:23:03.192822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.192934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.192958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.690 qpair failed and we were unable to recover it. 00:30:59.690 [2024-11-28 23:23:03.193080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.193262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.193286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.690 qpair failed and we were unable to recover it. 00:30:59.690 [2024-11-28 23:23:03.193404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.690 [2024-11-28 23:23:03.193518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.193544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.691 qpair failed and we were unable to recover it. 00:30:59.691 [2024-11-28 23:23:03.193660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.193743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.193767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.691 qpair failed and we were unable to recover it. 00:30:59.691 [2024-11-28 23:23:03.193891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.194019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.194047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.691 qpair failed and we were unable to recover it. 00:30:59.691 [2024-11-28 23:23:03.194177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.194278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.194306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.691 qpair failed and we were unable to recover it. 00:30:59.691 [2024-11-28 23:23:03.194415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.194567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.194593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.691 qpair failed and we were unable to recover it. 00:30:59.691 [2024-11-28 23:23:03.194735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.194893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.194918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.691 qpair failed and we were unable to recover it. 00:30:59.691 [2024-11-28 23:23:03.195052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.195150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.195178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.691 qpair failed and we were unable to recover it. 00:30:59.691 [2024-11-28 23:23:03.195323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.195415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.195442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.691 qpair failed and we were unable to recover it. 00:30:59.691 [2024-11-28 23:23:03.195599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.195732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.195760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.691 qpair failed and we were unable to recover it. 00:30:59.691 [2024-11-28 23:23:03.195880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.195986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.196026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.691 qpair failed and we were unable to recover it. 00:30:59.691 [2024-11-28 23:23:03.196146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.196230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.196255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.691 qpair failed and we were unable to recover it. 00:30:59.691 [2024-11-28 23:23:03.196366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.196530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.196571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.691 qpair failed and we were unable to recover it. 00:30:59.691 [2024-11-28 23:23:03.196722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.196882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.196910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.691 qpair failed and we were unable to recover it. 00:30:59.691 [2024-11-28 23:23:03.197073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.197158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.197183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.691 qpair failed and we were unable to recover it. 00:30:59.691 [2024-11-28 23:23:03.197331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.197425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.197467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.691 qpair failed and we were unable to recover it. 00:30:59.691 [2024-11-28 23:23:03.197602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.197737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.197764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.691 qpair failed and we were unable to recover it. 00:30:59.691 [2024-11-28 23:23:03.197874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.198018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.198042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.691 qpair failed and we were unable to recover it. 00:30:59.691 [2024-11-28 23:23:03.198159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.198285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.198313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.691 qpair failed and we were unable to recover it. 00:30:59.691 [2024-11-28 23:23:03.198434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.198591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.198618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.691 qpair failed and we were unable to recover it. 00:30:59.691 [2024-11-28 23:23:03.198759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.198855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.198879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.691 qpair failed and we were unable to recover it. 00:30:59.691 [2024-11-28 23:23:03.198974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.199083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.199108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.691 qpair failed and we were unable to recover it. 00:30:59.691 [2024-11-28 23:23:03.199255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.199379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.199415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.691 qpair failed and we were unable to recover it. 00:30:59.691 [2024-11-28 23:23:03.199560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.199709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.199734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.691 qpair failed and we were unable to recover it. 00:30:59.691 [2024-11-28 23:23:03.199873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.200025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.200053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.691 qpair failed and we were unable to recover it. 00:30:59.691 [2024-11-28 23:23:03.200145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.200273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.200301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.691 qpair failed and we were unable to recover it. 00:30:59.691 [2024-11-28 23:23:03.200446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.200560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.200585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.691 qpair failed and we were unable to recover it. 00:30:59.691 [2024-11-28 23:23:03.200701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.200834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.200862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.691 qpair failed and we were unable to recover it. 00:30:59.691 [2024-11-28 23:23:03.201018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.201169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.201196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.691 qpair failed and we were unable to recover it. 00:30:59.691 [2024-11-28 23:23:03.201349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.201453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.201479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.691 qpair failed and we were unable to recover it. 00:30:59.691 [2024-11-28 23:23:03.201648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.201800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.691 [2024-11-28 23:23:03.201828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.692 qpair failed and we were unable to recover it. 00:30:59.692 [2024-11-28 23:23:03.201932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.202100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.202125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.692 qpair failed and we were unable to recover it. 00:30:59.692 [2024-11-28 23:23:03.202235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.202331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.202355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.692 qpair failed and we were unable to recover it. 00:30:59.692 [2024-11-28 23:23:03.202479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.202566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.202605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.692 qpair failed and we were unable to recover it. 00:30:59.692 [2024-11-28 23:23:03.202720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.202801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.202825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.692 qpair failed and we were unable to recover it. 00:30:59.692 [2024-11-28 23:23:03.202944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.203066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.203091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.692 qpair failed and we were unable to recover it. 00:30:59.692 [2024-11-28 23:23:03.203238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.203359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.203388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.692 qpair failed and we were unable to recover it. 00:30:59.692 [2024-11-28 23:23:03.203522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.203612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.203640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.692 qpair failed and we were unable to recover it. 00:30:59.692 [2024-11-28 23:23:03.203773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.203863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.203892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.692 qpair failed and we were unable to recover it. 00:30:59.692 [2024-11-28 23:23:03.203989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.204074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.204105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.692 qpair failed and we were unable to recover it. 00:30:59.692 [2024-11-28 23:23:03.204220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.204330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.204373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.692 qpair failed and we were unable to recover it. 00:30:59.692 [2024-11-28 23:23:03.204531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.204651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.204675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.692 qpair failed and we were unable to recover it. 00:30:59.692 [2024-11-28 23:23:03.204789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.204960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.204988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.692 qpair failed and we were unable to recover it. 00:30:59.692 [2024-11-28 23:23:03.205151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.205252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.205281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.692 qpair failed and we were unable to recover it. 00:30:59.692 [2024-11-28 23:23:03.205425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.205518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.205543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.692 qpair failed and we were unable to recover it. 00:30:59.692 [2024-11-28 23:23:03.205638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.205719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.205744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.692 qpair failed and we were unable to recover it. 00:30:59.692 [2024-11-28 23:23:03.205883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.206010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.206037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.692 qpair failed and we were unable to recover it. 00:30:59.692 EAL: No free 2048 kB hugepages reported on node 1 00:30:59.692 [2024-11-28 23:23:03.206147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.206234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.206259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.692 qpair failed and we were unable to recover it. 00:30:59.692 [2024-11-28 23:23:03.206378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.206496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.206522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.692 qpair failed and we were unable to recover it. 00:30:59.692 [2024-11-28 23:23:03.206644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.206758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.206786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.692 qpair failed and we were unable to recover it. 00:30:59.692 [2024-11-28 23:23:03.206892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.207030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.207054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.692 qpair failed and we were unable to recover it. 00:30:59.692 [2024-11-28 23:23:03.207196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.207303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.207330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.692 qpair failed and we were unable to recover it. 00:30:59.692 [2024-11-28 23:23:03.207432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.207524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.207553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.692 qpair failed and we were unable to recover it. 00:30:59.692 [2024-11-28 23:23:03.207664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.207781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.207805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.692 qpair failed and we were unable to recover it. 00:30:59.692 [2024-11-28 23:23:03.207928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.208064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.208092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.692 qpair failed and we were unable to recover it. 00:30:59.692 [2024-11-28 23:23:03.208222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.208346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.208373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.692 qpair failed and we were unable to recover it. 00:30:59.692 [2024-11-28 23:23:03.208487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.692 [2024-11-28 23:23:03.208575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.208600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.693 qpair failed and we were unable to recover it. 00:30:59.693 [2024-11-28 23:23:03.208723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.208829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.208856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.693 qpair failed and we were unable to recover it. 00:30:59.693 [2024-11-28 23:23:03.208991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.209150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.209178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.693 qpair failed and we were unable to recover it. 00:30:59.693 [2024-11-28 23:23:03.209301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.209391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.209423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.693 qpair failed and we were unable to recover it. 00:30:59.693 [2024-11-28 23:23:03.209543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.209639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.209663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.693 qpair failed and we were unable to recover it. 00:30:59.693 [2024-11-28 23:23:03.209759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.209849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.209873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.693 qpair failed and we were unable to recover it. 00:30:59.693 [2024-11-28 23:23:03.209991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.210103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.210128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.693 qpair failed and we were unable to recover it. 00:30:59.693 [2024-11-28 23:23:03.210247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.210359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.210383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.693 qpair failed and we were unable to recover it. 00:30:59.693 [2024-11-28 23:23:03.210533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.210654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.210678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.693 qpair failed and we were unable to recover it. 00:30:59.693 [2024-11-28 23:23:03.210817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.210936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.210961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.693 qpair failed and we were unable to recover it. 00:30:59.693 [2024-11-28 23:23:03.211079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.211174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.211198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.693 qpair failed and we were unable to recover it. 00:30:59.693 [2024-11-28 23:23:03.211316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.211410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.211436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.693 qpair failed and we were unable to recover it. 00:30:59.693 [2024-11-28 23:23:03.211530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.211645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.211669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.693 qpair failed and we were unable to recover it. 00:30:59.693 [2024-11-28 23:23:03.211792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.211935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.211959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.693 qpair failed and we were unable to recover it. 00:30:59.693 [2024-11-28 23:23:03.212049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.212130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.212154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.693 qpair failed and we were unable to recover it. 00:30:59.693 [2024-11-28 23:23:03.212239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.212384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.212415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.693 qpair failed and we were unable to recover it. 00:30:59.693 [2024-11-28 23:23:03.212514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.212629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.212654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.693 qpair failed and we were unable to recover it. 00:30:59.693 [2024-11-28 23:23:03.212741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.212886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.212910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.693 qpair failed and we were unable to recover it. 00:30:59.693 [2024-11-28 23:23:03.212992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.213113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.213137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.693 qpair failed and we were unable to recover it. 00:30:59.693 [2024-11-28 23:23:03.213286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.213426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.213452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.693 qpair failed and we were unable to recover it. 00:30:59.693 [2024-11-28 23:23:03.213551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.213692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.213716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.693 qpair failed and we were unable to recover it. 00:30:59.693 [2024-11-28 23:23:03.213834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.213925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.213949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.693 qpair failed and we were unable to recover it. 00:30:59.693 [2024-11-28 23:23:03.214073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.214182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.214206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.693 qpair failed and we were unable to recover it. 00:30:59.693 [2024-11-28 23:23:03.214318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.214467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.214492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.693 qpair failed and we were unable to recover it. 00:30:59.693 [2024-11-28 23:23:03.214616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.214726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.214751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.693 qpair failed and we were unable to recover it. 00:30:59.693 [2024-11-28 23:23:03.214843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.214959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.214984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.693 qpair failed and we were unable to recover it. 00:30:59.693 [2024-11-28 23:23:03.215076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.215191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.215216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.693 qpair failed and we were unable to recover it. 00:30:59.693 [2024-11-28 23:23:03.215311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.215427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.215454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.693 qpair failed and we were unable to recover it. 00:30:59.693 [2024-11-28 23:23:03.215550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.215666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.215703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.693 qpair failed and we were unable to recover it. 00:30:59.693 [2024-11-28 23:23:03.215795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.693 [2024-11-28 23:23:03.215939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.215965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.694 qpair failed and we were unable to recover it. 00:30:59.694 [2024-11-28 23:23:03.216078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.216195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.216219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.694 qpair failed and we were unable to recover it. 00:30:59.694 [2024-11-28 23:23:03.216331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.216419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.216445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.694 qpair failed and we were unable to recover it. 00:30:59.694 [2024-11-28 23:23:03.216533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.216647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.216672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.694 qpair failed and we were unable to recover it. 00:30:59.694 [2024-11-28 23:23:03.216764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.216909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.216938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.694 qpair failed and we were unable to recover it. 00:30:59.694 [2024-11-28 23:23:03.217025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.217136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.217161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.694 qpair failed and we were unable to recover it. 00:30:59.694 [2024-11-28 23:23:03.217281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.217365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.217391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.694 qpair failed and we were unable to recover it. 00:30:59.694 [2024-11-28 23:23:03.217489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.217571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.217595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.694 qpair failed and we were unable to recover it. 00:30:59.694 [2024-11-28 23:23:03.217690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.217798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.217823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.694 qpair failed and we were unable to recover it. 00:30:59.694 [2024-11-28 23:23:03.217941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.218027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.218051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.694 qpair failed and we were unable to recover it. 00:30:59.694 [2024-11-28 23:23:03.218184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.218299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.218323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.694 qpair failed and we were unable to recover it. 00:30:59.694 [2024-11-28 23:23:03.218444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.218558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.218583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.694 qpair failed and we were unable to recover it. 00:30:59.694 [2024-11-28 23:23:03.218676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.218816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.218840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.694 qpair failed and we were unable to recover it. 00:30:59.694 [2024-11-28 23:23:03.218985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.219097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.219121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.694 qpair failed and we were unable to recover it. 00:30:59.694 [2024-11-28 23:23:03.219214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.219304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.219329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.694 qpair failed and we were unable to recover it. 00:30:59.694 [2024-11-28 23:23:03.219477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.219566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.219591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.694 qpair failed and we were unable to recover it. 00:30:59.694 [2024-11-28 23:23:03.219721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.219839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.219863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.694 qpair failed and we were unable to recover it. 00:30:59.694 [2024-11-28 23:23:03.219957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.220039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.220064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.694 qpair failed and we were unable to recover it. 00:30:59.694 [2024-11-28 23:23:03.220184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.220301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.220327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.694 qpair failed and we were unable to recover it. 00:30:59.694 [2024-11-28 23:23:03.220431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.220513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.220538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.694 qpair failed and we were unable to recover it. 00:30:59.694 [2024-11-28 23:23:03.220685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.220811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.220836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.694 qpair failed and we were unable to recover it. 00:30:59.694 [2024-11-28 23:23:03.220927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.221015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.221041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.694 qpair failed and we were unable to recover it. 00:30:59.694 [2024-11-28 23:23:03.221140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.221255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.221279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.694 qpair failed and we were unable to recover it. 00:30:59.694 [2024-11-28 23:23:03.221421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.221515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.221540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.694 qpair failed and we were unable to recover it. 00:30:59.694 [2024-11-28 23:23:03.221631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.221717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.221742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.694 qpair failed and we were unable to recover it. 00:30:59.694 [2024-11-28 23:23:03.221868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.221968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.221993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.694 qpair failed and we were unable to recover it. 00:30:59.694 [2024-11-28 23:23:03.222137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.222282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.222307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.694 qpair failed and we were unable to recover it. 00:30:59.694 [2024-11-28 23:23:03.222410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.222522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.222548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.694 qpair failed and we were unable to recover it. 00:30:59.694 [2024-11-28 23:23:03.222641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.222786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.222810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.694 qpair failed and we were unable to recover it. 00:30:59.694 [2024-11-28 23:23:03.222954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.694 [2024-11-28 23:23:03.223042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.223067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.695 qpair failed and we were unable to recover it. 00:30:59.695 [2024-11-28 23:23:03.223148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.223263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.223289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.695 qpair failed and we were unable to recover it. 00:30:59.695 [2024-11-28 23:23:03.223433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.223545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.223570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.695 qpair failed and we were unable to recover it. 00:30:59.695 [2024-11-28 23:23:03.223693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.223775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.223801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.695 qpair failed and we were unable to recover it. 00:30:59.695 [2024-11-28 23:23:03.223909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.223991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.224016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.695 qpair failed and we were unable to recover it. 00:30:59.695 [2024-11-28 23:23:03.224108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.224183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.224208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.695 qpair failed and we were unable to recover it. 00:30:59.695 [2024-11-28 23:23:03.224332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.224493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.224518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.695 qpair failed and we were unable to recover it. 00:30:59.695 [2024-11-28 23:23:03.224646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.224728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.224753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.695 qpair failed and we were unable to recover it. 00:30:59.695 [2024-11-28 23:23:03.224846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.224936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.224960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.695 qpair failed and we were unable to recover it. 00:30:59.695 [2024-11-28 23:23:03.225042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.225154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.225179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.695 qpair failed and we were unable to recover it. 00:30:59.695 [2024-11-28 23:23:03.225258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.225371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.225419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.695 qpair failed and we were unable to recover it. 00:30:59.695 [2024-11-28 23:23:03.225512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.225626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.225652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.695 qpair failed and we were unable to recover it. 00:30:59.695 [2024-11-28 23:23:03.225797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.225882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.225907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.695 qpair failed and we were unable to recover it. 00:30:59.695 [2024-11-28 23:23:03.225991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.226088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.226113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.695 qpair failed and we were unable to recover it. 00:30:59.695 [2024-11-28 23:23:03.226227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.226310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.226335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.695 qpair failed and we were unable to recover it. 00:30:59.695 [2024-11-28 23:23:03.226436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.226545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.226570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.695 qpair failed and we were unable to recover it. 00:30:59.695 [2024-11-28 23:23:03.226679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.226765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.226790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.695 qpair failed and we were unable to recover it. 00:30:59.695 [2024-11-28 23:23:03.226877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.226992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.227017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.695 qpair failed and we were unable to recover it. 00:30:59.695 [2024-11-28 23:23:03.227110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.227225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.227250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.695 qpair failed and we were unable to recover it. 00:30:59.695 [2024-11-28 23:23:03.227409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.227494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.227521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.695 qpair failed and we were unable to recover it. 00:30:59.695 [2024-11-28 23:23:03.227645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.227724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.227750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.695 qpair failed and we were unable to recover it. 00:30:59.695 [2024-11-28 23:23:03.227870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.227955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.227980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.695 qpair failed and we were unable to recover it. 00:30:59.695 [2024-11-28 23:23:03.228125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.228242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.228267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.695 qpair failed and we were unable to recover it. 00:30:59.695 [2024-11-28 23:23:03.228415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.228535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.228561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.695 qpair failed and we were unable to recover it. 00:30:59.695 [2024-11-28 23:23:03.228653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.228760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.228786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.695 qpair failed and we were unable to recover it. 00:30:59.695 [2024-11-28 23:23:03.228865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.228988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.229013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.695 qpair failed and we were unable to recover it. 00:30:59.695 [2024-11-28 23:23:03.229137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.229248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.229277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.695 qpair failed and we were unable to recover it. 00:30:59.695 [2024-11-28 23:23:03.229364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.229449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.229475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.695 qpair failed and we were unable to recover it. 00:30:59.695 [2024-11-28 23:23:03.229568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.229677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.229702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.695 qpair failed and we were unable to recover it. 00:30:59.695 [2024-11-28 23:23:03.229790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.229933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.229958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.695 qpair failed and we were unable to recover it. 00:30:59.695 [2024-11-28 23:23:03.230047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.230166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.230191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.695 qpair failed and we were unable to recover it. 00:30:59.695 [2024-11-28 23:23:03.230304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.230398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.695 [2024-11-28 23:23:03.230424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.695 qpair failed and we were unable to recover it. 00:30:59.695 [2024-11-28 23:23:03.230510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.696 [2024-11-28 23:23:03.230595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.696 [2024-11-28 23:23:03.230620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.696 qpair failed and we were unable to recover it. 00:30:59.696 [2024-11-28 23:23:03.230713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.696 [2024-11-28 23:23:03.230826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.696 [2024-11-28 23:23:03.230851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.696 qpair failed and we were unable to recover it. 00:30:59.696 [2024-11-28 23:23:03.230942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.696 [2024-11-28 23:23:03.231026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.696 [2024-11-28 23:23:03.231051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.696 qpair failed and we were unable to recover it. 00:30:59.696 [2024-11-28 23:23:03.231141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.696 [2024-11-28 23:23:03.231229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.696 [2024-11-28 23:23:03.231254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.696 qpair failed and we were unable to recover it. 00:30:59.696 [2024-11-28 23:23:03.231340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.696 [2024-11-28 23:23:03.231464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.696 [2024-11-28 23:23:03.231489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.696 qpair failed and we were unable to recover it. 00:30:59.696 [2024-11-28 23:23:03.231635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.696 [2024-11-28 23:23:03.231749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.696 [2024-11-28 23:23:03.231774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.696 qpair failed and we were unable to recover it. 00:30:59.696 [2024-11-28 23:23:03.231859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.696 [2024-11-28 23:23:03.231935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.696 [2024-11-28 23:23:03.231961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.696 qpair failed and we were unable to recover it. 00:30:59.696 [2024-11-28 23:23:03.232080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.696 [2024-11-28 23:23:03.232190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.696 [2024-11-28 23:23:03.232216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.696 qpair failed and we were unable to recover it. 00:30:59.696 [2024-11-28 23:23:03.232327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.696 [2024-11-28 23:23:03.232419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.696 [2024-11-28 23:23:03.232445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.696 qpair failed and we were unable to recover it. 00:30:59.696 [2024-11-28 23:23:03.232527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.696 [2024-11-28 23:23:03.232642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.696 [2024-11-28 23:23:03.232668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.985 qpair failed and we were unable to recover it. 00:30:59.985 [2024-11-28 23:23:03.232756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.985 [2024-11-28 23:23:03.232870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.985 [2024-11-28 23:23:03.232895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.985 qpair failed and we were unable to recover it. 00:30:59.985 [2024-11-28 23:23:03.232991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.985 [2024-11-28 23:23:03.233134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.985 [2024-11-28 23:23:03.233159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.985 qpair failed and we were unable to recover it. 00:30:59.985 [2024-11-28 23:23:03.233244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.985 [2024-11-28 23:23:03.233336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.985 [2024-11-28 23:23:03.233361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.985 qpair failed and we were unable to recover it. 00:30:59.985 [2024-11-28 23:23:03.233481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.985 [2024-11-28 23:23:03.233577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.985 [2024-11-28 23:23:03.233602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.985 qpair failed and we were unable to recover it. 00:30:59.985 [2024-11-28 23:23:03.233694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.985 [2024-11-28 23:23:03.233782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.985 [2024-11-28 23:23:03.233808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.985 qpair failed and we were unable to recover it. 00:30:59.985 [2024-11-28 23:23:03.233956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.985 [2024-11-28 23:23:03.234032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.985 [2024-11-28 23:23:03.234057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.985 qpair failed and we were unable to recover it. 00:30:59.985 [2024-11-28 23:23:03.234176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.985 [2024-11-28 23:23:03.234268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.985 [2024-11-28 23:23:03.234294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.985 qpair failed and we were unable to recover it. 00:30:59.985 [2024-11-28 23:23:03.234376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.985 [2024-11-28 23:23:03.234468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.985 [2024-11-28 23:23:03.234494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.985 qpair failed and we were unable to recover it. 00:30:59.985 [2024-11-28 23:23:03.234575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.985 [2024-11-28 23:23:03.234702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.985 [2024-11-28 23:23:03.234727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.985 qpair failed and we were unable to recover it. 00:30:59.985 [2024-11-28 23:23:03.234824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.985 [2024-11-28 23:23:03.234930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.985 [2024-11-28 23:23:03.234955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.985 qpair failed and we were unable to recover it. 00:30:59.986 [2024-11-28 23:23:03.235064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.235175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.235200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.986 qpair failed and we were unable to recover it. 00:30:59.986 [2024-11-28 23:23:03.235293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.235407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.235433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.986 qpair failed and we were unable to recover it. 00:30:59.986 [2024-11-28 23:23:03.235524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.235636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.235661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.986 qpair failed and we were unable to recover it. 00:30:59.986 [2024-11-28 23:23:03.235775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.235890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.235916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.986 qpair failed and we were unable to recover it. 00:30:59.986 [2024-11-28 23:23:03.236007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.236086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.236111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.986 qpair failed and we were unable to recover it. 00:30:59.986 [2024-11-28 23:23:03.236198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.236345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.236370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.986 qpair failed and we were unable to recover it. 00:30:59.986 [2024-11-28 23:23:03.236460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.236601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.236626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.986 qpair failed and we were unable to recover it. 00:30:59.986 [2024-11-28 23:23:03.236722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.236810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.236835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.986 qpair failed and we were unable to recover it. 00:30:59.986 [2024-11-28 23:23:03.236955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.237037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.237063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.986 qpair failed and we were unable to recover it. 00:30:59.986 [2024-11-28 23:23:03.237142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.237284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.237308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.986 qpair failed and we were unable to recover it. 00:30:59.986 [2024-11-28 23:23:03.237391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.237486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.237512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.986 qpair failed and we were unable to recover it. 00:30:59.986 [2024-11-28 23:23:03.237610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.237731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.237756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.986 qpair failed and we were unable to recover it. 00:30:59.986 [2024-11-28 23:23:03.237848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.237936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.237961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.986 qpair failed and we were unable to recover it. 00:30:59.986 [2024-11-28 23:23:03.238081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.238168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.238192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.986 qpair failed and we were unable to recover it. 00:30:59.986 [2024-11-28 23:23:03.238293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.238376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.238406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.986 qpair failed and we were unable to recover it. 00:30:59.986 [2024-11-28 23:23:03.238525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.238614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.238644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.986 qpair failed and we were unable to recover it. 00:30:59.986 [2024-11-28 23:23:03.238766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.238873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.238898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.986 qpair failed and we were unable to recover it. 00:30:59.986 [2024-11-28 23:23:03.238991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.239076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.239101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.986 qpair failed and we were unable to recover it. 00:30:59.986 [2024-11-28 23:23:03.239221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.239308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.239332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.986 qpair failed and we were unable to recover it. 00:30:59.986 [2024-11-28 23:23:03.239416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.239524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.239550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.986 qpair failed and we were unable to recover it. 00:30:59.986 [2024-11-28 23:23:03.239638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.239749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.239774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.986 qpair failed and we were unable to recover it. 00:30:59.986 [2024-11-28 23:23:03.239865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.239950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.239975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.986 qpair failed and we were unable to recover it. 00:30:59.986 [2024-11-28 23:23:03.240090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.240199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.240223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.986 qpair failed and we were unable to recover it. 00:30:59.986 [2024-11-28 23:23:03.240303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.240404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.240430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.986 qpair failed and we were unable to recover it. 00:30:59.986 [2024-11-28 23:23:03.240539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.240552] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:59.986 [2024-11-28 23:23:03.240631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.240656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.986 qpair failed and we were unable to recover it. 00:30:59.986 [2024-11-28 23:23:03.240744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.240829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.240858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.986 qpair failed and we were unable to recover it. 00:30:59.986 [2024-11-28 23:23:03.240961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.241046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.241072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.986 qpair failed and we were unable to recover it. 00:30:59.986 [2024-11-28 23:23:03.241162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.241254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.241280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.986 qpair failed and we were unable to recover it. 00:30:59.986 [2024-11-28 23:23:03.241419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.241530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.986 [2024-11-28 23:23:03.241555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.987 qpair failed and we were unable to recover it. 00:30:59.987 [2024-11-28 23:23:03.241635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.241722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.241747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.987 qpair failed and we were unable to recover it. 00:30:59.987 [2024-11-28 23:23:03.241847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.241961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.241986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.987 qpair failed and we were unable to recover it. 00:30:59.987 [2024-11-28 23:23:03.242100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.242230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.242255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.987 qpair failed and we were unable to recover it. 00:30:59.987 [2024-11-28 23:23:03.242373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.242465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.242490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.987 qpair failed and we were unable to recover it. 00:30:59.987 [2024-11-28 23:23:03.242581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.242663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.242687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.987 qpair failed and we were unable to recover it. 00:30:59.987 [2024-11-28 23:23:03.242775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.242894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.242919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.987 qpair failed and we were unable to recover it. 00:30:59.987 [2024-11-28 23:23:03.243038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.243122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.243149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.987 qpair failed and we were unable to recover it. 00:30:59.987 [2024-11-28 23:23:03.243249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.243375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.243408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.987 qpair failed and we were unable to recover it. 00:30:59.987 [2024-11-28 23:23:03.243498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.243606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.243630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.987 qpair failed and we were unable to recover it. 00:30:59.987 [2024-11-28 23:23:03.243723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.243840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.243865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.987 qpair failed and we were unable to recover it. 00:30:59.987 [2024-11-28 23:23:03.243979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.244057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.244082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.987 qpair failed and we were unable to recover it. 00:30:59.987 [2024-11-28 23:23:03.244176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.244274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.244299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.987 qpair failed and we were unable to recover it. 00:30:59.987 [2024-11-28 23:23:03.244398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.244509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.244534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.987 qpair failed and we were unable to recover it. 00:30:59.987 [2024-11-28 23:23:03.244621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.244723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.244748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.987 qpair failed and we were unable to recover it. 00:30:59.987 [2024-11-28 23:23:03.244838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.244923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.244948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.987 qpair failed and we were unable to recover it. 00:30:59.987 [2024-11-28 23:23:03.245068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.245187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.245212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.987 qpair failed and we were unable to recover it. 00:30:59.987 [2024-11-28 23:23:03.245307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.245430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.245456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.987 qpair failed and we were unable to recover it. 00:30:59.987 [2024-11-28 23:23:03.245549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.245639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.245664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.987 qpair failed and we were unable to recover it. 00:30:59.987 [2024-11-28 23:23:03.245788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.245869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.245894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.987 qpair failed and we were unable to recover it. 00:30:59.987 [2024-11-28 23:23:03.245989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.246072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.246097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.987 qpair failed and we were unable to recover it. 00:30:59.987 [2024-11-28 23:23:03.246188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.246300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.246325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.987 qpair failed and we were unable to recover it. 00:30:59.987 [2024-11-28 23:23:03.246452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.246571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.246596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.987 qpair failed and we were unable to recover it. 00:30:59.987 [2024-11-28 23:23:03.246685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.246791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.246816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.987 qpair failed and we were unable to recover it. 00:30:59.987 [2024-11-28 23:23:03.246935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.247053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.247078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.987 qpair failed and we were unable to recover it. 00:30:59.987 [2024-11-28 23:23:03.247161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.247242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.247267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.987 qpair failed and we were unable to recover it. 00:30:59.987 [2024-11-28 23:23:03.247387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.247483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.247508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.987 qpair failed and we were unable to recover it. 00:30:59.987 [2024-11-28 23:23:03.247605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.247707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.247732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.987 qpair failed and we were unable to recover it. 00:30:59.987 [2024-11-28 23:23:03.247858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.247941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.247966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.987 qpair failed and we were unable to recover it. 00:30:59.987 [2024-11-28 23:23:03.248090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.248220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.987 [2024-11-28 23:23:03.248245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.988 qpair failed and we were unable to recover it. 00:30:59.988 [2024-11-28 23:23:03.248333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.988 [2024-11-28 23:23:03.248476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.988 [2024-11-28 23:23:03.248502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.988 qpair failed and we were unable to recover it. 00:30:59.988 [2024-11-28 23:23:03.248621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.988 [2024-11-28 23:23:03.248704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.988 [2024-11-28 23:23:03.248730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.988 qpair failed and we were unable to recover it. 00:30:59.988 [2024-11-28 23:23:03.248822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.988 [2024-11-28 23:23:03.248919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.988 [2024-11-28 23:23:03.248944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.988 qpair failed and we were unable to recover it. 00:30:59.988 [2024-11-28 23:23:03.249024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.988 [2024-11-28 23:23:03.249136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.988 [2024-11-28 23:23:03.249161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.988 qpair failed and we were unable to recover it. 00:30:59.988 [2024-11-28 23:23:03.249307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.988 [2024-11-28 23:23:03.249401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.988 [2024-11-28 23:23:03.249428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.988 qpair failed and we were unable to recover it. 00:30:59.988 [2024-11-28 23:23:03.249521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.988 [2024-11-28 23:23:03.249611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.988 [2024-11-28 23:23:03.249635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.988 qpair failed and we were unable to recover it. 00:30:59.988 [2024-11-28 23:23:03.249733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.988 [2024-11-28 23:23:03.249822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.988 [2024-11-28 23:23:03.249849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.988 qpair failed and we were unable to recover it. 00:30:59.988 [2024-11-28 23:23:03.249935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.988 [2024-11-28 23:23:03.250049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.988 [2024-11-28 23:23:03.250074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.988 qpair failed and we were unable to recover it. 00:30:59.988 [2024-11-28 23:23:03.250191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.988 [2024-11-28 23:23:03.250285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.988 [2024-11-28 23:23:03.250311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.988 qpair failed and we were unable to recover it. 00:30:59.988 [2024-11-28 23:23:03.250401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.988 [2024-11-28 23:23:03.250524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.988 [2024-11-28 23:23:03.250549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.988 qpair failed and we were unable to recover it. 00:30:59.988 [2024-11-28 23:23:03.250646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.988 [2024-11-28 23:23:03.250733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.988 [2024-11-28 23:23:03.250758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.988 qpair failed and we were unable to recover it. 00:30:59.988 [2024-11-28 23:23:03.250861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.988 [2024-11-28 23:23:03.250974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.988 [2024-11-28 23:23:03.250999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.988 qpair failed and we were unable to recover it. 00:30:59.988 [2024-11-28 23:23:03.251081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.988 [2024-11-28 23:23:03.251161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.988 [2024-11-28 23:23:03.251186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.988 qpair failed and we were unable to recover it. 00:30:59.988 [2024-11-28 23:23:03.251280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.988 [2024-11-28 23:23:03.251375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.988 [2024-11-28 23:23:03.251407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.988 qpair failed and we were unable to recover it. 00:30:59.988 [2024-11-28 23:23:03.251503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.988 [2024-11-28 23:23:03.251619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.988 [2024-11-28 23:23:03.251644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.988 qpair failed and we were unable to recover it. 00:30:59.988 [2024-11-28 23:23:03.251741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.988 [2024-11-28 23:23:03.251851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.988 [2024-11-28 23:23:03.251877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.988 qpair failed and we were unable to recover it. 00:30:59.988 [2024-11-28 23:23:03.251964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.988 [2024-11-28 23:23:03.252080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.988 [2024-11-28 23:23:03.252105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.988 qpair failed and we were unable to recover it. 00:30:59.988 [2024-11-28 23:23:03.252224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.988 [2024-11-28 23:23:03.252335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.988 [2024-11-28 23:23:03.252361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.988 qpair failed and we were unable to recover it. 00:30:59.988 [2024-11-28 23:23:03.252486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.988 [2024-11-28 23:23:03.252571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.988 [2024-11-28 23:23:03.252601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.988 qpair failed and we were unable to recover it. 00:30:59.988 [2024-11-28 23:23:03.252725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.988 [2024-11-28 23:23:03.252866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.988 [2024-11-28 23:23:03.252891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.988 qpair failed and we were unable to recover it. 00:30:59.988 [2024-11-28 23:23:03.252980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.988 [2024-11-28 23:23:03.253103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.988 [2024-11-28 23:23:03.253129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.988 qpair failed and we were unable to recover it. 00:30:59.988 [2024-11-28 23:23:03.253209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.988 [2024-11-28 23:23:03.253289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.988 [2024-11-28 23:23:03.253314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.988 qpair failed and we were unable to recover it. 00:30:59.988 [2024-11-28 23:23:03.253437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.988 [2024-11-28 23:23:03.253551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.253576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.989 qpair failed and we were unable to recover it. 00:30:59.989 [2024-11-28 23:23:03.253663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.253749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.253774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.989 qpair failed and we were unable to recover it. 00:30:59.989 [2024-11-28 23:23:03.253887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.253977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.254003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.989 qpair failed and we were unable to recover it. 00:30:59.989 [2024-11-28 23:23:03.254087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.254198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.254222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.989 qpair failed and we were unable to recover it. 00:30:59.989 [2024-11-28 23:23:03.254303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.254383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.254416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.989 qpair failed and we were unable to recover it. 00:30:59.989 [2024-11-28 23:23:03.254508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.254598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.254622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.989 qpair failed and we were unable to recover it. 00:30:59.989 [2024-11-28 23:23:03.254707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.254791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.254816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.989 qpair failed and we were unable to recover it. 00:30:59.989 [2024-11-28 23:23:03.254944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.255032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.255058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.989 qpair failed and we were unable to recover it. 00:30:59.989 [2024-11-28 23:23:03.255145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.255238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.255263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.989 qpair failed and we were unable to recover it. 00:30:59.989 [2024-11-28 23:23:03.255385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.255510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.255535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.989 qpair failed and we were unable to recover it. 00:30:59.989 [2024-11-28 23:23:03.255635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.255722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.255747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.989 qpair failed and we were unable to recover it. 00:30:59.989 [2024-11-28 23:23:03.255879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.255968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.255992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.989 qpair failed and we were unable to recover it. 00:30:59.989 [2024-11-28 23:23:03.256089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.256174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.256199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.989 qpair failed and we were unable to recover it. 00:30:59.989 [2024-11-28 23:23:03.256289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.256373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.256413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.989 qpair failed and we were unable to recover it. 00:30:59.989 [2024-11-28 23:23:03.256533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.256618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.256642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.989 qpair failed and we were unable to recover it. 00:30:59.989 [2024-11-28 23:23:03.256791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.256884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.256911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.989 qpair failed and we were unable to recover it. 00:30:59.989 [2024-11-28 23:23:03.256989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.257073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.257098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.989 qpair failed and we were unable to recover it. 00:30:59.989 [2024-11-28 23:23:03.257216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.257309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.257334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.989 qpair failed and we were unable to recover it. 00:30:59.989 [2024-11-28 23:23:03.257425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.257509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.257536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.989 qpair failed and we were unable to recover it. 00:30:59.989 [2024-11-28 23:23:03.257657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.257756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.257782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.989 qpair failed and we were unable to recover it. 00:30:59.989 [2024-11-28 23:23:03.257904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.258003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.258028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.989 qpair failed and we were unable to recover it. 00:30:59.989 [2024-11-28 23:23:03.258119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.258238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.258264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.989 qpair failed and we were unable to recover it. 00:30:59.989 [2024-11-28 23:23:03.258348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.258444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.258469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.989 qpair failed and we were unable to recover it. 00:30:59.989 [2024-11-28 23:23:03.258553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.258634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.258660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.989 qpair failed and we were unable to recover it. 00:30:59.989 [2024-11-28 23:23:03.258765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.258851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.258875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.989 qpair failed and we were unable to recover it. 00:30:59.989 [2024-11-28 23:23:03.258996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.259088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.259113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.989 qpair failed and we were unable to recover it. 00:30:59.989 [2024-11-28 23:23:03.259231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.259313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.259338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.989 qpair failed and we were unable to recover it. 00:30:59.989 [2024-11-28 23:23:03.259445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.259540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.259566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.989 qpair failed and we were unable to recover it. 00:30:59.989 [2024-11-28 23:23:03.259684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.259806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.989 [2024-11-28 23:23:03.259832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.989 qpair failed and we were unable to recover it. 00:30:59.990 [2024-11-28 23:23:03.259923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.990 [2024-11-28 23:23:03.260036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.990 [2024-11-28 23:23:03.260061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.990 qpair failed and we were unable to recover it. 00:30:59.990 [2024-11-28 23:23:03.260147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.990 [2024-11-28 23:23:03.260258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.990 [2024-11-28 23:23:03.260288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.990 qpair failed and we were unable to recover it. 00:30:59.990 [2024-11-28 23:23:03.260399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.990 [2024-11-28 23:23:03.260495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.990 [2024-11-28 23:23:03.260520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.990 qpair failed and we were unable to recover it. 00:30:59.990 [2024-11-28 23:23:03.260612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.990 [2024-11-28 23:23:03.260726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.990 [2024-11-28 23:23:03.260751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.990 qpair failed and we were unable to recover it. 00:30:59.990 [2024-11-28 23:23:03.260848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.990 [2024-11-28 23:23:03.260941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.990 [2024-11-28 23:23:03.260966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.990 qpair failed and we were unable to recover it. 00:30:59.990 [2024-11-28 23:23:03.261048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.990 [2024-11-28 23:23:03.261132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.990 [2024-11-28 23:23:03.261157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.990 qpair failed and we were unable to recover it. 00:30:59.990 [2024-11-28 23:23:03.261273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.990 [2024-11-28 23:23:03.261369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.990 [2024-11-28 23:23:03.261402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.990 qpair failed and we were unable to recover it. 00:30:59.990 [2024-11-28 23:23:03.261504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.990 [2024-11-28 23:23:03.261597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.990 [2024-11-28 23:23:03.261622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.990 qpair failed and we were unable to recover it. 00:30:59.990 [2024-11-28 23:23:03.261733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.990 [2024-11-28 23:23:03.261834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.990 [2024-11-28 23:23:03.261859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.990 qpair failed and we were unable to recover it. 00:30:59.990 [2024-11-28 23:23:03.261948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.990 [2024-11-28 23:23:03.262058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.990 [2024-11-28 23:23:03.262083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.990 qpair failed and we were unable to recover it. 00:30:59.990 [2024-11-28 23:23:03.262183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.990 [2024-11-28 23:23:03.262292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.990 [2024-11-28 23:23:03.262318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.990 qpair failed and we were unable to recover it. 00:30:59.990 [2024-11-28 23:23:03.262430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.990 [2024-11-28 23:23:03.262542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.990 [2024-11-28 23:23:03.262568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.990 qpair failed and we were unable to recover it. 00:30:59.990 [2024-11-28 23:23:03.262665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.990 [2024-11-28 23:23:03.262748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.990 [2024-11-28 23:23:03.262778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.990 qpair failed and we were unable to recover it. 00:30:59.990 [2024-11-28 23:23:03.262896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.990 [2024-11-28 23:23:03.262982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.990 [2024-11-28 23:23:03.263008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.990 qpair failed and we were unable to recover it. 00:30:59.990 [2024-11-28 23:23:03.263131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.990 [2024-11-28 23:23:03.263214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.990 [2024-11-28 23:23:03.263240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.990 qpair failed and we were unable to recover it. 00:30:59.990 [2024-11-28 23:23:03.263324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.990 [2024-11-28 23:23:03.263440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.990 [2024-11-28 23:23:03.263467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.990 qpair failed and we were unable to recover it. 00:30:59.990 [2024-11-28 23:23:03.263561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.990 [2024-11-28 23:23:03.263648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.990 [2024-11-28 23:23:03.263674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.990 qpair failed and we were unable to recover it. 00:30:59.990 [2024-11-28 23:23:03.263777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.990 [2024-11-28 23:23:03.263889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.990 [2024-11-28 23:23:03.263913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.990 qpair failed and we were unable to recover it. 00:30:59.990 [2024-11-28 23:23:03.264002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.990 [2024-11-28 23:23:03.264091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.990 [2024-11-28 23:23:03.264122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.990 qpair failed and we were unable to recover it. 00:30:59.990 [2024-11-28 23:23:03.264251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.990 [2024-11-28 23:23:03.264367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.990 [2024-11-28 23:23:03.264398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.990 qpair failed and we were unable to recover it. 00:30:59.990 [2024-11-28 23:23:03.264487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.990 [2024-11-28 23:23:03.264573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.990 [2024-11-28 23:23:03.264599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.990 qpair failed and we were unable to recover it. 00:30:59.990 [2024-11-28 23:23:03.264689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.990 [2024-11-28 23:23:03.264780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.990 [2024-11-28 23:23:03.264806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.990 qpair failed and we were unable to recover it. 00:30:59.990 [2024-11-28 23:23:03.264897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.990 [2024-11-28 23:23:03.264986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.990 [2024-11-28 23:23:03.265012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.990 qpair failed and we were unable to recover it. 00:30:59.990 [2024-11-28 23:23:03.265094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.990 [2024-11-28 23:23:03.265176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.265200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.991 qpair failed and we were unable to recover it. 00:30:59.991 [2024-11-28 23:23:03.265317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.265437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.265463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.991 qpair failed and we were unable to recover it. 00:30:59.991 [2024-11-28 23:23:03.265561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.265662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.265688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.991 qpair failed and we were unable to recover it. 00:30:59.991 [2024-11-28 23:23:03.265792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.265933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.265958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.991 qpair failed and we were unable to recover it. 00:30:59.991 [2024-11-28 23:23:03.266046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.266163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.266189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.991 qpair failed and we were unable to recover it. 00:30:59.991 [2024-11-28 23:23:03.266307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.266431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.266458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.991 qpair failed and we were unable to recover it. 00:30:59.991 [2024-11-28 23:23:03.266553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.266637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.266661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.991 qpair failed and we were unable to recover it. 00:30:59.991 [2024-11-28 23:23:03.266744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.266829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.266855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.991 qpair failed and we were unable to recover it. 00:30:59.991 [2024-11-28 23:23:03.266982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.267093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.267119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.991 qpair failed and we were unable to recover it. 00:30:59.991 [2024-11-28 23:23:03.267207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.267288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.267314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.991 qpair failed and we were unable to recover it. 00:30:59.991 [2024-11-28 23:23:03.267433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.267519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.267543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.991 qpair failed and we were unable to recover it. 00:30:59.991 [2024-11-28 23:23:03.267631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.267723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.267750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.991 qpair failed and we were unable to recover it. 00:30:59.991 [2024-11-28 23:23:03.267869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.267979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.268004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.991 qpair failed and we were unable to recover it. 00:30:59.991 [2024-11-28 23:23:03.268092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.268199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.268224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.991 qpair failed and we were unable to recover it. 00:30:59.991 [2024-11-28 23:23:03.268311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.268386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.268418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.991 qpair failed and we were unable to recover it. 00:30:59.991 [2024-11-28 23:23:03.268503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.268622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.268646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.991 qpair failed and we were unable to recover it. 00:30:59.991 [2024-11-28 23:23:03.268771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.268852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.268878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.991 qpair failed and we were unable to recover it. 00:30:59.991 [2024-11-28 23:23:03.268993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.269102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.269127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.991 qpair failed and we were unable to recover it. 00:30:59.991 [2024-11-28 23:23:03.269209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.269292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.269316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.991 qpair failed and we were unable to recover it. 00:30:59.991 [2024-11-28 23:23:03.269407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.269494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.269519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.991 qpair failed and we were unable to recover it. 00:30:59.991 [2024-11-28 23:23:03.269608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.269725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.269750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.991 qpair failed and we were unable to recover it. 00:30:59.991 [2024-11-28 23:23:03.269852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.269939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.269964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.991 qpair failed and we were unable to recover it. 00:30:59.991 [2024-11-28 23:23:03.270101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.270187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.270212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.991 qpair failed and we were unable to recover it. 00:30:59.991 [2024-11-28 23:23:03.270294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.270387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.270432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.991 qpair failed and we were unable to recover it. 00:30:59.991 [2024-11-28 23:23:03.270526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.270622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.270647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.991 qpair failed and we were unable to recover it. 00:30:59.991 [2024-11-28 23:23:03.270773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.270865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.270890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.991 qpair failed and we were unable to recover it. 00:30:59.991 [2024-11-28 23:23:03.270979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.271072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.271098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.991 qpair failed and we were unable to recover it. 00:30:59.991 [2024-11-28 23:23:03.271182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.271277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.271302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.991 qpair failed and we were unable to recover it. 00:30:59.991 [2024-11-28 23:23:03.271421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.271507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.271534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.991 qpair failed and we were unable to recover it. 00:30:59.991 [2024-11-28 23:23:03.271613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.991 [2024-11-28 23:23:03.271692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.271717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.992 qpair failed and we were unable to recover it. 00:30:59.992 [2024-11-28 23:23:03.271824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.271914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.271939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.992 qpair failed and we were unable to recover it. 00:30:59.992 [2024-11-28 23:23:03.272028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.272107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.272131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.992 qpair failed and we were unable to recover it. 00:30:59.992 [2024-11-28 23:23:03.272224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.272315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.272343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.992 qpair failed and we were unable to recover it. 00:30:59.992 [2024-11-28 23:23:03.272467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.272580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.272605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.992 qpair failed and we were unable to recover it. 00:30:59.992 [2024-11-28 23:23:03.272710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.272821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.272847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.992 qpair failed and we were unable to recover it. 00:30:59.992 [2024-11-28 23:23:03.272968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.273047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.273073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.992 qpair failed and we were unable to recover it. 00:30:59.992 [2024-11-28 23:23:03.273165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.273258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.273287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.992 qpair failed and we were unable to recover it. 00:30:59.992 [2024-11-28 23:23:03.273372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.273469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.273495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.992 qpair failed and we were unable to recover it. 00:30:59.992 [2024-11-28 23:23:03.273619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.273709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.273734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.992 qpair failed and we were unable to recover it. 00:30:59.992 [2024-11-28 23:23:03.273821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.273910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.273935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.992 qpair failed and we were unable to recover it. 00:30:59.992 [2024-11-28 23:23:03.274052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.274150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.274175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.992 qpair failed and we were unable to recover it. 00:30:59.992 [2024-11-28 23:23:03.274273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.274359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.274384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.992 qpair failed and we were unable to recover it. 00:30:59.992 [2024-11-28 23:23:03.274487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.274604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.274629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.992 qpair failed and we were unable to recover it. 00:30:59.992 [2024-11-28 23:23:03.274726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.274816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.274843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.992 qpair failed and we were unable to recover it. 00:30:59.992 [2024-11-28 23:23:03.274943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.275023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.275049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.992 qpair failed and we were unable to recover it. 00:30:59.992 [2024-11-28 23:23:03.275146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.275230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.275257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.992 qpair failed and we were unable to recover it. 00:30:59.992 [2024-11-28 23:23:03.275341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.275487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.275513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.992 qpair failed and we were unable to recover it. 00:30:59.992 [2024-11-28 23:23:03.275605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.275703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.275728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.992 qpair failed and we were unable to recover it. 00:30:59.992 [2024-11-28 23:23:03.275833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.275943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.275967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.992 qpair failed and we were unable to recover it. 00:30:59.992 [2024-11-28 23:23:03.276111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.276200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.276225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.992 qpair failed and we were unable to recover it. 00:30:59.992 [2024-11-28 23:23:03.276312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.276429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.276456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.992 qpair failed and we were unable to recover it. 00:30:59.992 [2024-11-28 23:23:03.276540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.276646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.276671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.992 qpair failed and we were unable to recover it. 00:30:59.992 [2024-11-28 23:23:03.276757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.276870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.276895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.992 qpair failed and we were unable to recover it. 00:30:59.992 [2024-11-28 23:23:03.276985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.277067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.277093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.992 qpair failed and we were unable to recover it. 00:30:59.992 [2024-11-28 23:23:03.277171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.277247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.277271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.992 qpair failed and we were unable to recover it. 00:30:59.992 [2024-11-28 23:23:03.277364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.277486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.277511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.992 qpair failed and we were unable to recover it. 00:30:59.992 [2024-11-28 23:23:03.277608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.277692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.277717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.992 qpair failed and we were unable to recover it. 00:30:59.992 [2024-11-28 23:23:03.277842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.277927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.277953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.992 qpair failed and we were unable to recover it. 00:30:59.992 [2024-11-28 23:23:03.278045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.278159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.992 [2024-11-28 23:23:03.278184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.992 qpair failed and we were unable to recover it. 00:30:59.993 [2024-11-28 23:23:03.278274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.278366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.278424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.993 qpair failed and we were unable to recover it. 00:30:59.993 [2024-11-28 23:23:03.278509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.278602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.278627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.993 qpair failed and we were unable to recover it. 00:30:59.993 [2024-11-28 23:23:03.278761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.278873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.278898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.993 qpair failed and we were unable to recover it. 00:30:59.993 [2024-11-28 23:23:03.278992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.279108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.279133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.993 qpair failed and we were unable to recover it. 00:30:59.993 [2024-11-28 23:23:03.279221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.279310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.279335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.993 qpair failed and we were unable to recover it. 00:30:59.993 [2024-11-28 23:23:03.279431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.279517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.279542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.993 qpair failed and we were unable to recover it. 00:30:59.993 [2024-11-28 23:23:03.279632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.279722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.279747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.993 qpair failed and we were unable to recover it. 00:30:59.993 [2024-11-28 23:23:03.279860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.279949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.279974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.993 qpair failed and we were unable to recover it. 00:30:59.993 [2024-11-28 23:23:03.280069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.280150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.280175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.993 qpair failed and we were unable to recover it. 00:30:59.993 [2024-11-28 23:23:03.280267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.280378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.280414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.993 qpair failed and we were unable to recover it. 00:30:59.993 [2024-11-28 23:23:03.280534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.280620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.280644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.993 qpair failed and we were unable to recover it. 00:30:59.993 [2024-11-28 23:23:03.280734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.280846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.280872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.993 qpair failed and we were unable to recover it. 00:30:59.993 [2024-11-28 23:23:03.280955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.281049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.281074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.993 qpair failed and we were unable to recover it. 00:30:59.993 [2024-11-28 23:23:03.281198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.281279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.281310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.993 qpair failed and we were unable to recover it. 00:30:59.993 [2024-11-28 23:23:03.281412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.281489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.281514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.993 qpair failed and we were unable to recover it. 00:30:59.993 [2024-11-28 23:23:03.281612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.281704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.281730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.993 qpair failed and we were unable to recover it. 00:30:59.993 [2024-11-28 23:23:03.281850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.281943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.281968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.993 qpair failed and we were unable to recover it. 00:30:59.993 [2024-11-28 23:23:03.282057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.282198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.282222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.993 qpair failed and we were unable to recover it. 00:30:59.993 [2024-11-28 23:23:03.282348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.282535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.282561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.993 qpair failed and we were unable to recover it. 00:30:59.993 [2024-11-28 23:23:03.282644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.282753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.282778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.993 qpair failed and we were unable to recover it. 00:30:59.993 [2024-11-28 23:23:03.282896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.282983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.283008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.993 qpair failed and we were unable to recover it. 00:30:59.993 [2024-11-28 23:23:03.283094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.283186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.283212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.993 qpair failed and we were unable to recover it. 00:30:59.993 [2024-11-28 23:23:03.283303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.283430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.283457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.993 qpair failed and we were unable to recover it. 00:30:59.993 [2024-11-28 23:23:03.283541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.283630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.283655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.993 qpair failed and we were unable to recover it. 00:30:59.993 [2024-11-28 23:23:03.283758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.283874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.283899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.993 qpair failed and we were unable to recover it. 00:30:59.993 [2024-11-28 23:23:03.283993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.284078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.284103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.993 qpair failed and we were unable to recover it. 00:30:59.993 [2024-11-28 23:23:03.284182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.284274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.284299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.993 qpair failed and we were unable to recover it. 00:30:59.993 [2024-11-28 23:23:03.284404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.284488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.284513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.993 qpair failed and we were unable to recover it. 00:30:59.993 [2024-11-28 23:23:03.284617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.284722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.993 [2024-11-28 23:23:03.284751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.993 qpair failed and we were unable to recover it. 00:30:59.994 [2024-11-28 23:23:03.284877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.284993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.285018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.994 qpair failed and we were unable to recover it. 00:30:59.994 [2024-11-28 23:23:03.285106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.285218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.285243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.994 qpair failed and we were unable to recover it. 00:30:59.994 [2024-11-28 23:23:03.285334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.285485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.285511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.994 qpair failed and we were unable to recover it. 00:30:59.994 [2024-11-28 23:23:03.285601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.285685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.285710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.994 qpair failed and we were unable to recover it. 00:30:59.994 [2024-11-28 23:23:03.285835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.285911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.285936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.994 qpair failed and we were unable to recover it. 00:30:59.994 [2024-11-28 23:23:03.286045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.286135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.286161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.994 qpair failed and we were unable to recover it. 00:30:59.994 [2024-11-28 23:23:03.286275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.286361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.286388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.994 qpair failed and we were unable to recover it. 00:30:59.994 [2024-11-28 23:23:03.286477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.286568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.286592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.994 qpair failed and we were unable to recover it. 00:30:59.994 [2024-11-28 23:23:03.286710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.286797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.286822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.994 qpair failed and we were unable to recover it. 00:30:59.994 [2024-11-28 23:23:03.286903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.286991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.287017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.994 qpair failed and we were unable to recover it. 00:30:59.994 [2024-11-28 23:23:03.287133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.287231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.287255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.994 qpair failed and we were unable to recover it. 00:30:59.994 [2024-11-28 23:23:03.287370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.287472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.287498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.994 qpair failed and we were unable to recover it. 00:30:59.994 [2024-11-28 23:23:03.287589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.287686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.287712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.994 qpair failed and we were unable to recover it. 00:30:59.994 [2024-11-28 23:23:03.287857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.287968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.287993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.994 qpair failed and we were unable to recover it. 00:30:59.994 [2024-11-28 23:23:03.288118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.288196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.288221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.994 qpair failed and we were unable to recover it. 00:30:59.994 [2024-11-28 23:23:03.288354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.288442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.288469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.994 qpair failed and we were unable to recover it. 00:30:59.994 [2024-11-28 23:23:03.288565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.288648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.288672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.994 qpair failed and we were unable to recover it. 00:30:59.994 [2024-11-28 23:23:03.288793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.288886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.288912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.994 qpair failed and we were unable to recover it. 00:30:59.994 [2024-11-28 23:23:03.289008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.289088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.289114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.994 qpair failed and we were unable to recover it. 00:30:59.994 [2024-11-28 23:23:03.289225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.289353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.289378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.994 qpair failed and we were unable to recover it. 00:30:59.994 [2024-11-28 23:23:03.289493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.289572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.289597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.994 qpair failed and we were unable to recover it. 00:30:59.994 [2024-11-28 23:23:03.289685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.289777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.289802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.994 qpair failed and we were unable to recover it. 00:30:59.994 [2024-11-28 23:23:03.289886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.289990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.290015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.994 qpair failed and we were unable to recover it. 00:30:59.994 [2024-11-28 23:23:03.290125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.290217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.290242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.994 qpair failed and we were unable to recover it. 00:30:59.994 [2024-11-28 23:23:03.290386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.290515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.290540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.994 qpair failed and we were unable to recover it. 00:30:59.994 [2024-11-28 23:23:03.290671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.290764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.290790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.994 qpair failed and we were unable to recover it. 00:30:59.994 [2024-11-28 23:23:03.290881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.290972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.994 [2024-11-28 23:23:03.290996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.994 qpair failed and we were unable to recover it. 00:30:59.994 [2024-11-28 23:23:03.291077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.291167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.291192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.995 qpair failed and we were unable to recover it. 00:30:59.995 [2024-11-28 23:23:03.291279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.291421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.291447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.995 qpair failed and we were unable to recover it. 00:30:59.995 [2024-11-28 23:23:03.291542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.291629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.291654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.995 qpair failed and we were unable to recover it. 00:30:59.995 [2024-11-28 23:23:03.291763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.291853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.291878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.995 qpair failed and we were unable to recover it. 00:30:59.995 [2024-11-28 23:23:03.291963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.292062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.292088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.995 qpair failed and we were unable to recover it. 00:30:59.995 [2024-11-28 23:23:03.292186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.292301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.292327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.995 qpair failed and we were unable to recover it. 00:30:59.995 [2024-11-28 23:23:03.292452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.292534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.292559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.995 qpair failed and we were unable to recover it. 00:30:59.995 [2024-11-28 23:23:03.292648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.292744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.292769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.995 qpair failed and we were unable to recover it. 00:30:59.995 [2024-11-28 23:23:03.292856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.292940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.292964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.995 qpair failed and we were unable to recover it. 00:30:59.995 [2024-11-28 23:23:03.293061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.293179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.293205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.995 qpair failed and we were unable to recover it. 00:30:59.995 [2024-11-28 23:23:03.293329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.293466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.293492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.995 qpair failed and we were unable to recover it. 00:30:59.995 [2024-11-28 23:23:03.293576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.293666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.293693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.995 qpair failed and we were unable to recover it. 00:30:59.995 [2024-11-28 23:23:03.293793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.293884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.293909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.995 qpair failed and we were unable to recover it. 00:30:59.995 [2024-11-28 23:23:03.294001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.294088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.294113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.995 qpair failed and we were unable to recover it. 00:30:59.995 [2024-11-28 23:23:03.294202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.294316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.294342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.995 qpair failed and we were unable to recover it. 00:30:59.995 [2024-11-28 23:23:03.294455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.294549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.294573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.995 qpair failed and we were unable to recover it. 00:30:59.995 [2024-11-28 23:23:03.294672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.294770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.294797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.995 qpair failed and we were unable to recover it. 00:30:59.995 [2024-11-28 23:23:03.294883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.294973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.294998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.995 qpair failed and we were unable to recover it. 00:30:59.995 [2024-11-28 23:23:03.295110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.295196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.295220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.995 qpair failed and we were unable to recover it. 00:30:59.995 [2024-11-28 23:23:03.295319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.295429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.295456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.995 qpair failed and we were unable to recover it. 00:30:59.995 [2024-11-28 23:23:03.295537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.295627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.295652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.995 qpair failed and we were unable to recover it. 00:30:59.995 [2024-11-28 23:23:03.295752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.295845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.295869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.995 qpair failed and we were unable to recover it. 00:30:59.995 [2024-11-28 23:23:03.295990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.296076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.296101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.995 qpair failed and we were unable to recover it. 00:30:59.995 [2024-11-28 23:23:03.296213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.296296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.296325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.995 qpair failed and we were unable to recover it. 00:30:59.995 [2024-11-28 23:23:03.296431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.296521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.296547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.995 qpair failed and we were unable to recover it. 00:30:59.995 [2024-11-28 23:23:03.296645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.296737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.296763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.995 qpair failed and we were unable to recover it. 00:30:59.995 [2024-11-28 23:23:03.296881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.296964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.296991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.995 qpair failed and we were unable to recover it. 00:30:59.995 [2024-11-28 23:23:03.297088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.995 [2024-11-28 23:23:03.297212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.297237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.996 qpair failed and we were unable to recover it. 00:30:59.996 [2024-11-28 23:23:03.297337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.297463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.297489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.996 qpair failed and we were unable to recover it. 00:30:59.996 [2024-11-28 23:23:03.297572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.297674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.297698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.996 qpair failed and we were unable to recover it. 00:30:59.996 [2024-11-28 23:23:03.297827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.297917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.297942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.996 qpair failed and we were unable to recover it. 00:30:59.996 [2024-11-28 23:23:03.298043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.298128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.298153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.996 qpair failed and we were unable to recover it. 00:30:59.996 [2024-11-28 23:23:03.298246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.298338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.298362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.996 qpair failed and we were unable to recover it. 00:30:59.996 [2024-11-28 23:23:03.298459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.298558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.298583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.996 qpair failed and we were unable to recover it. 00:30:59.996 [2024-11-28 23:23:03.298679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.298795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.298820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.996 qpair failed and we were unable to recover it. 00:30:59.996 [2024-11-28 23:23:03.298942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.299040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.299066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.996 qpair failed and we were unable to recover it. 00:30:59.996 [2024-11-28 23:23:03.299153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.299247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.299271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.996 qpair failed and we were unable to recover it. 00:30:59.996 [2024-11-28 23:23:03.299363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.299471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.299497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.996 qpair failed and we were unable to recover it. 00:30:59.996 [2024-11-28 23:23:03.299585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.299694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.299720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.996 qpair failed and we were unable to recover it. 00:30:59.996 [2024-11-28 23:23:03.299811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.299955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.299980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.996 qpair failed and we were unable to recover it. 00:30:59.996 [2024-11-28 23:23:03.300080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.300197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.300223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.996 qpair failed and we were unable to recover it. 00:30:59.996 [2024-11-28 23:23:03.300308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.300405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.300435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.996 qpair failed and we were unable to recover it. 00:30:59.996 [2024-11-28 23:23:03.300547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.300631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.300655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.996 qpair failed and we were unable to recover it. 00:30:59.996 [2024-11-28 23:23:03.300781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.300889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.300915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.996 qpair failed and we were unable to recover it. 00:30:59.996 [2024-11-28 23:23:03.301002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.301098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.301124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.996 qpair failed and we were unable to recover it. 00:30:59.996 [2024-11-28 23:23:03.301210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.301298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.301323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.996 qpair failed and we were unable to recover it. 00:30:59.996 [2024-11-28 23:23:03.301418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.301500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.301526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.996 qpair failed and we were unable to recover it. 00:30:59.996 [2024-11-28 23:23:03.301623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.301712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.301737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.996 qpair failed and we were unable to recover it. 00:30:59.996 [2024-11-28 23:23:03.301858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.301969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.301994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.996 qpair failed and we were unable to recover it. 00:30:59.996 [2024-11-28 23:23:03.302085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.302199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.302224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.996 qpair failed and we were unable to recover it. 00:30:59.996 [2024-11-28 23:23:03.302315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.302406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.302431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.996 qpair failed and we were unable to recover it. 00:30:59.996 [2024-11-28 23:23:03.302524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.302613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.302638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.996 qpair failed and we were unable to recover it. 00:30:59.996 [2024-11-28 23:23:03.302744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.302833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.302858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.996 qpair failed and we were unable to recover it. 00:30:59.996 [2024-11-28 23:23:03.302942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.303031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.303055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.996 qpair failed and we were unable to recover it. 00:30:59.996 [2024-11-28 23:23:03.303141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.303232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.303260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.996 qpair failed and we were unable to recover it. 00:30:59.996 [2024-11-28 23:23:03.303376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.303502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.303528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.996 qpair failed and we were unable to recover it. 00:30:59.996 [2024-11-28 23:23:03.303616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.303709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.996 [2024-11-28 23:23:03.303733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.997 qpair failed and we were unable to recover it. 00:30:59.997 [2024-11-28 23:23:03.303819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.303915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.303941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.997 qpair failed and we were unable to recover it. 00:30:59.997 [2024-11-28 23:23:03.304037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.304155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.304180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.997 qpair failed and we were unable to recover it. 00:30:59.997 [2024-11-28 23:23:03.304278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.304364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.304389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.997 qpair failed and we were unable to recover it. 00:30:59.997 [2024-11-28 23:23:03.304531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.304657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.304683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.997 qpair failed and we were unable to recover it. 00:30:59.997 [2024-11-28 23:23:03.304812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.304904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.304929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.997 qpair failed and we were unable to recover it. 00:30:59.997 [2024-11-28 23:23:03.305019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.305102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.305126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.997 qpair failed and we were unable to recover it. 00:30:59.997 [2024-11-28 23:23:03.305241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.305331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.305357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.997 qpair failed and we were unable to recover it. 00:30:59.997 [2024-11-28 23:23:03.305495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.305586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.305621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.997 qpair failed and we were unable to recover it. 00:30:59.997 [2024-11-28 23:23:03.305743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.305824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.305850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.997 qpair failed and we were unable to recover it. 00:30:59.997 [2024-11-28 23:23:03.305942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.306037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.306061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.997 qpair failed and we were unable to recover it. 00:30:59.997 [2024-11-28 23:23:03.306146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.306265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.306290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.997 qpair failed and we were unable to recover it. 00:30:59.997 [2024-11-28 23:23:03.306380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.306499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.306525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.997 qpair failed and we were unable to recover it. 00:30:59.997 [2024-11-28 23:23:03.306604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.306720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.306746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.997 qpair failed and we were unable to recover it. 00:30:59.997 [2024-11-28 23:23:03.306842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.306939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.306963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.997 qpair failed and we were unable to recover it. 00:30:59.997 [2024-11-28 23:23:03.307052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.307144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.307170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.997 qpair failed and we were unable to recover it. 00:30:59.997 [2024-11-28 23:23:03.307258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.307342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.307367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.997 qpair failed and we were unable to recover it. 00:30:59.997 [2024-11-28 23:23:03.307472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.307588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.307613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.997 qpair failed and we were unable to recover it. 00:30:59.997 [2024-11-28 23:23:03.307727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.307817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.307842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.997 qpair failed and we were unable to recover it. 00:30:59.997 [2024-11-28 23:23:03.307958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.308048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.308074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.997 qpair failed and we were unable to recover it. 00:30:59.997 [2024-11-28 23:23:03.308163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.308252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.308278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.997 qpair failed and we were unable to recover it. 00:30:59.997 [2024-11-28 23:23:03.308402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.308482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.308507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.997 qpair failed and we were unable to recover it. 00:30:59.997 [2024-11-28 23:23:03.308593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.308674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.308700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.997 qpair failed and we were unable to recover it. 00:30:59.997 [2024-11-28 23:23:03.308795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.308907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.308932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.997 qpair failed and we were unable to recover it. 00:30:59.997 [2024-11-28 23:23:03.309049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.309141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.309166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.997 qpair failed and we were unable to recover it. 00:30:59.997 [2024-11-28 23:23:03.309283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.309409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.309435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.997 qpair failed and we were unable to recover it. 00:30:59.997 [2024-11-28 23:23:03.309530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.309656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.309682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.997 qpair failed and we were unable to recover it. 00:30:59.997 [2024-11-28 23:23:03.309791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.309881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.309907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.997 qpair failed and we were unable to recover it. 00:30:59.997 [2024-11-28 23:23:03.309993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.310074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.310099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.997 qpair failed and we were unable to recover it. 00:30:59.997 [2024-11-28 23:23:03.310199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.310323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.997 [2024-11-28 23:23:03.310348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.997 qpair failed and we were unable to recover it. 00:30:59.998 [2024-11-28 23:23:03.310437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.310560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.310585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.998 qpair failed and we were unable to recover it. 00:30:59.998 [2024-11-28 23:23:03.310676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.310769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.310794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.998 qpair failed and we were unable to recover it. 00:30:59.998 [2024-11-28 23:23:03.310912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.311021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.311047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.998 qpair failed and we were unable to recover it. 00:30:59.998 [2024-11-28 23:23:03.311141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.311236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.311262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.998 qpair failed and we were unable to recover it. 00:30:59.998 [2024-11-28 23:23:03.311353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.311503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.311529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.998 qpair failed and we were unable to recover it. 00:30:59.998 [2024-11-28 23:23:03.311646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.311741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.311767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.998 qpair failed and we were unable to recover it. 00:30:59.998 [2024-11-28 23:23:03.311863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.312006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.312031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.998 qpair failed and we were unable to recover it. 00:30:59.998 [2024-11-28 23:23:03.312120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.312229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.312254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.998 qpair failed and we were unable to recover it. 00:30:59.998 [2024-11-28 23:23:03.312342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.312435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.312461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.998 qpair failed and we were unable to recover it. 00:30:59.998 [2024-11-28 23:23:03.312554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.312674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.312700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.998 qpair failed and we were unable to recover it. 00:30:59.998 [2024-11-28 23:23:03.312792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.312878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.312904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.998 qpair failed and we were unable to recover it. 00:30:59.998 [2024-11-28 23:23:03.312994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.313139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.313165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.998 qpair failed and we were unable to recover it. 00:30:59.998 [2024-11-28 23:23:03.313258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.313406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.313432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.998 qpair failed and we were unable to recover it. 00:30:59.998 [2024-11-28 23:23:03.313520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.313598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.313623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.998 qpair failed and we were unable to recover it. 00:30:59.998 [2024-11-28 23:23:03.313775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.313891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.313918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.998 qpair failed and we were unable to recover it. 00:30:59.998 [2024-11-28 23:23:03.314004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.314105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.314132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.998 qpair failed and we were unable to recover it. 00:30:59.998 [2024-11-28 23:23:03.314246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.314362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.314388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.998 qpair failed and we were unable to recover it. 00:30:59.998 [2024-11-28 23:23:03.314496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.314578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.314603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.998 qpair failed and we were unable to recover it. 00:30:59.998 [2024-11-28 23:23:03.314683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.314768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.314793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.998 qpair failed and we were unable to recover it. 00:30:59.998 [2024-11-28 23:23:03.314875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.314992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.315018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.998 qpair failed and we were unable to recover it. 00:30:59.998 [2024-11-28 23:23:03.315113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.315234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.315260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.998 qpair failed and we were unable to recover it. 00:30:59.998 [2024-11-28 23:23:03.315345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.315425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.315452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.998 qpair failed and we were unable to recover it. 00:30:59.998 [2024-11-28 23:23:03.315533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.315650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.315675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.998 qpair failed and we were unable to recover it. 00:30:59.998 [2024-11-28 23:23:03.315793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.315904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.315930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.998 qpair failed and we were unable to recover it. 00:30:59.998 [2024-11-28 23:23:03.316050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.316130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.316155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.998 qpair failed and we were unable to recover it. 00:30:59.998 [2024-11-28 23:23:03.316246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.316356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.316381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.998 qpair failed and we were unable to recover it. 00:30:59.998 [2024-11-28 23:23:03.316483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.316599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.316624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.998 qpair failed and we were unable to recover it. 00:30:59.998 [2024-11-28 23:23:03.316712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.316823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.316848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.998 qpair failed and we were unable to recover it. 00:30:59.998 [2024-11-28 23:23:03.316932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.317022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.998 [2024-11-28 23:23:03.317048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.998 qpair failed and we were unable to recover it. 00:30:59.998 [2024-11-28 23:23:03.317173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.317286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.317315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.999 qpair failed and we were unable to recover it. 00:30:59.999 [2024-11-28 23:23:03.317407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.317495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.317522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.999 qpair failed and we were unable to recover it. 00:30:59.999 [2024-11-28 23:23:03.317611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.317697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.317722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.999 qpair failed and we were unable to recover it. 00:30:59.999 [2024-11-28 23:23:03.317845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.317928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.317953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.999 qpair failed and we were unable to recover it. 00:30:59.999 [2024-11-28 23:23:03.318033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.318119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.318143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.999 qpair failed and we were unable to recover it. 00:30:59.999 [2024-11-28 23:23:03.318235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.318349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.318375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.999 qpair failed and we were unable to recover it. 00:30:59.999 [2024-11-28 23:23:03.318475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.318567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.318592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.999 qpair failed and we were unable to recover it. 00:30:59.999 [2024-11-28 23:23:03.318707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.318805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.318830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.999 qpair failed and we were unable to recover it. 00:30:59.999 [2024-11-28 23:23:03.318925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.319009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.319033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.999 qpair failed and we were unable to recover it. 00:30:59.999 [2024-11-28 23:23:03.319123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.319212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.319237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.999 qpair failed and we were unable to recover it. 00:30:59.999 [2024-11-28 23:23:03.319353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.319447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.319473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.999 qpair failed and we were unable to recover it. 00:30:59.999 [2024-11-28 23:23:03.319595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.319685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.319709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.999 qpair failed and we were unable to recover it. 00:30:59.999 [2024-11-28 23:23:03.319792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.319901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.319927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.999 qpair failed and we were unable to recover it. 00:30:59.999 [2024-11-28 23:23:03.320044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.320171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.320197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.999 qpair failed and we were unable to recover it. 00:30:59.999 [2024-11-28 23:23:03.320282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.320390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.320422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.999 qpair failed and we were unable to recover it. 00:30:59.999 [2024-11-28 23:23:03.320507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.320589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.320614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.999 qpair failed and we were unable to recover it. 00:30:59.999 [2024-11-28 23:23:03.320706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.320799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.320826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.999 qpair failed and we were unable to recover it. 00:30:59.999 [2024-11-28 23:23:03.320905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.320989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.321014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.999 qpair failed and we were unable to recover it. 00:30:59.999 [2024-11-28 23:23:03.321131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.321222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.321248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.999 qpair failed and we were unable to recover it. 00:30:59.999 [2024-11-28 23:23:03.321326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.321427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.321453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.999 qpair failed and we were unable to recover it. 00:30:59.999 [2024-11-28 23:23:03.321567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.321653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.321678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.999 qpair failed and we were unable to recover it. 00:30:59.999 [2024-11-28 23:23:03.321775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.321851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.321877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.999 qpair failed and we were unable to recover it. 00:30:59.999 [2024-11-28 23:23:03.321968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.322055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.322079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.999 qpair failed and we were unable to recover it. 00:30:59.999 [2024-11-28 23:23:03.322172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.322252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.322277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.999 qpair failed and we were unable to recover it. 00:30:59.999 [2024-11-28 23:23:03.322405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.322493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.322518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:30:59.999 qpair failed and we were unable to recover it. 00:30:59.999 [2024-11-28 23:23:03.322609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.322719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.999 [2024-11-28 23:23:03.322745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.000 qpair failed and we were unable to recover it. 00:31:00.000 [2024-11-28 23:23:03.322829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.322912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.322936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.000 qpair failed and we were unable to recover it. 00:31:00.000 [2024-11-28 23:23:03.323057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.323146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.323173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.000 qpair failed and we were unable to recover it. 00:31:00.000 [2024-11-28 23:23:03.323294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.323387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.323419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.000 qpair failed and we were unable to recover it. 00:31:00.000 [2024-11-28 23:23:03.323503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.323594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.323619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.000 qpair failed and we were unable to recover it. 00:31:00.000 [2024-11-28 23:23:03.323750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.323833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.323857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.000 qpair failed and we were unable to recover it. 00:31:00.000 [2024-11-28 23:23:03.323975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.324067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.324093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.000 qpair failed and we were unable to recover it. 00:31:00.000 [2024-11-28 23:23:03.324183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.324297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.324325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.000 qpair failed and we were unable to recover it. 00:31:00.000 [2024-11-28 23:23:03.324422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.324513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.324539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.000 qpair failed and we were unable to recover it. 00:31:00.000 [2024-11-28 23:23:03.324625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.324710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.324736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.000 qpair failed and we were unable to recover it. 00:31:00.000 [2024-11-28 23:23:03.324833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.325031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.325068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.000 qpair failed and we were unable to recover it. 00:31:00.000 [2024-11-28 23:23:03.325155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.325247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.325273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.000 qpair failed and we were unable to recover it. 00:31:00.000 [2024-11-28 23:23:03.325367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.325462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.325488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.000 qpair failed and we were unable to recover it. 00:31:00.000 [2024-11-28 23:23:03.325580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.325667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.325691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.000 qpair failed and we were unable to recover it. 00:31:00.000 [2024-11-28 23:23:03.325787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.325910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.325935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.000 qpair failed and we were unable to recover it. 00:31:00.000 [2024-11-28 23:23:03.326024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.326115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.326140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.000 qpair failed and we were unable to recover it. 00:31:00.000 [2024-11-28 23:23:03.326236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.326359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.326384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.000 qpair failed and we were unable to recover it. 00:31:00.000 [2024-11-28 23:23:03.326485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.326573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.326599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.000 qpair failed and we were unable to recover it. 00:31:00.000 [2024-11-28 23:23:03.326724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.326808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.326834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.000 qpair failed and we were unable to recover it. 00:31:00.000 [2024-11-28 23:23:03.326915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.326992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.327016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.000 qpair failed and we were unable to recover it. 00:31:00.000 [2024-11-28 23:23:03.327117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.327199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.327224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.000 qpair failed and we were unable to recover it. 00:31:00.000 [2024-11-28 23:23:03.327309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.327402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.327428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.000 qpair failed and we were unable to recover it. 00:31:00.000 [2024-11-28 23:23:03.327542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.327658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.327683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.000 qpair failed and we were unable to recover it. 00:31:00.000 [2024-11-28 23:23:03.327831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.327915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.327939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.000 qpair failed and we were unable to recover it. 00:31:00.000 [2024-11-28 23:23:03.328058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.328145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.328171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.000 qpair failed and we were unable to recover it. 00:31:00.000 [2024-11-28 23:23:03.328260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.328351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.328376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.000 qpair failed and we were unable to recover it. 00:31:00.000 [2024-11-28 23:23:03.328472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.328568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.328597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.000 qpair failed and we were unable to recover it. 00:31:00.000 [2024-11-28 23:23:03.328692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.328795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.328819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.000 qpair failed and we were unable to recover it. 00:31:00.000 [2024-11-28 23:23:03.328915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.329001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.329026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.000 qpair failed and we were unable to recover it. 00:31:00.000 [2024-11-28 23:23:03.329148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.329239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.000 [2024-11-28 23:23:03.329263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.000 qpair failed and we were unable to recover it. 00:31:00.001 [2024-11-28 23:23:03.329355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.329456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.329482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.001 qpair failed and we were unable to recover it. 00:31:00.001 [2024-11-28 23:23:03.329569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.329662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.329687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.001 qpair failed and we were unable to recover it. 00:31:00.001 [2024-11-28 23:23:03.329809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.329902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.329927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.001 qpair failed and we were unable to recover it. 00:31:00.001 [2024-11-28 23:23:03.330013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.330096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.330121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.001 qpair failed and we were unable to recover it. 00:31:00.001 [2024-11-28 23:23:03.330215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.330306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.330307] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:31:00.001 [2024-11-28 23:23:03.330332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.001 qpair failed and we were unable to recover it. 00:31:00.001 [2024-11-28 23:23:03.330436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.330451] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:31:00.001 [2024-11-28 23:23:03.330471] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:31:00.001 [2024-11-28 23:23:03.330485] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:31:00.001 [2024-11-28 23:23:03.330530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.330559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.001 qpair failed and we were unable to recover it. 00:31:00.001 [2024-11-28 23:23:03.330652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.330781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.330807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.001 qpair failed and we were unable to recover it. 00:31:00.001 [2024-11-28 23:23:03.330778] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:31:00.001 [2024-11-28 23:23:03.330840] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:31:00.001 [2024-11-28 23:23:03.330904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.330837] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:31:00.001 [2024-11-28 23:23:03.330813] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:31:00.001 [2024-11-28 23:23:03.330993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.331017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.001 qpair failed and we were unable to recover it. 00:31:00.001 [2024-11-28 23:23:03.331115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.331212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.331237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.001 qpair failed and we were unable to recover it. 00:31:00.001 [2024-11-28 23:23:03.331346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.331456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.331482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.001 qpair failed and we were unable to recover it. 00:31:00.001 [2024-11-28 23:23:03.331597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.331683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.331719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.001 qpair failed and we were unable to recover it. 00:31:00.001 [2024-11-28 23:23:03.331816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.331942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.331968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.001 qpair failed and we were unable to recover it. 00:31:00.001 [2024-11-28 23:23:03.332050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.332135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.332167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.001 qpair failed and we were unable to recover it. 00:31:00.001 [2024-11-28 23:23:03.332282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.332390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.332424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.001 qpair failed and we were unable to recover it. 00:31:00.001 [2024-11-28 23:23:03.332520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.332613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.332637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.001 qpair failed and we were unable to recover it. 00:31:00.001 [2024-11-28 23:23:03.332767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.332844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.332875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.001 qpair failed and we were unable to recover it. 00:31:00.001 [2024-11-28 23:23:03.332963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.333052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.333078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.001 qpair failed and we were unable to recover it. 00:31:00.001 [2024-11-28 23:23:03.333173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.333264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.333289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.001 qpair failed and we were unable to recover it. 00:31:00.001 [2024-11-28 23:23:03.333399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.333528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.333553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.001 qpair failed and we were unable to recover it. 00:31:00.001 [2024-11-28 23:23:03.333647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.333747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.333772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.001 qpair failed and we were unable to recover it. 00:31:00.001 [2024-11-28 23:23:03.333869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.333950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.333976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.001 qpair failed and we were unable to recover it. 00:31:00.001 [2024-11-28 23:23:03.334062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.334154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.334184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.001 qpair failed and we were unable to recover it. 00:31:00.001 [2024-11-28 23:23:03.334266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.334350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.334374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.001 qpair failed and we were unable to recover it. 00:31:00.001 [2024-11-28 23:23:03.334489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.334571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.334595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.001 qpair failed and we were unable to recover it. 00:31:00.001 [2024-11-28 23:23:03.334686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.334786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.334811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.001 qpair failed and we were unable to recover it. 00:31:00.001 [2024-11-28 23:23:03.334897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.334980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.335005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.001 qpair failed and we were unable to recover it. 00:31:00.001 [2024-11-28 23:23:03.335093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.335172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.001 [2024-11-28 23:23:03.335197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.001 qpair failed and we were unable to recover it. 00:31:00.001 [2024-11-28 23:23:03.335279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.335371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.335416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.002 qpair failed and we were unable to recover it. 00:31:00.002 [2024-11-28 23:23:03.335508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.335624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.335649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.002 qpair failed and we were unable to recover it. 00:31:00.002 [2024-11-28 23:23:03.335743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.335838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.335864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.002 qpair failed and we were unable to recover it. 00:31:00.002 [2024-11-28 23:23:03.335960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.336039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.336065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.002 qpair failed and we were unable to recover it. 00:31:00.002 [2024-11-28 23:23:03.336155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.336229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.336255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.002 qpair failed and we were unable to recover it. 00:31:00.002 [2024-11-28 23:23:03.336357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.336451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.336476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.002 qpair failed and we were unable to recover it. 00:31:00.002 [2024-11-28 23:23:03.336554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.336644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.336669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.002 qpair failed and we were unable to recover it. 00:31:00.002 [2024-11-28 23:23:03.336772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.336857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.336882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.002 qpair failed and we were unable to recover it. 00:31:00.002 [2024-11-28 23:23:03.337001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.337093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.337119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.002 qpair failed and we were unable to recover it. 00:31:00.002 [2024-11-28 23:23:03.337201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.337287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.337313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.002 qpair failed and we were unable to recover it. 00:31:00.002 [2024-11-28 23:23:03.337437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.337527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.337552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.002 qpair failed and we were unable to recover it. 00:31:00.002 [2024-11-28 23:23:03.337652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.337744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.337770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.002 qpair failed and we were unable to recover it. 00:31:00.002 [2024-11-28 23:23:03.337889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.337971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.337995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.002 qpair failed and we were unable to recover it. 00:31:00.002 [2024-11-28 23:23:03.338082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.338194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.338218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.002 qpair failed and we were unable to recover it. 00:31:00.002 [2024-11-28 23:23:03.338316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.338411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.338437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.002 qpair failed and we were unable to recover it. 00:31:00.002 [2024-11-28 23:23:03.338521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.338598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.338623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.002 qpair failed and we were unable to recover it. 00:31:00.002 [2024-11-28 23:23:03.338722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.338800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.338824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.002 qpair failed and we were unable to recover it. 00:31:00.002 [2024-11-28 23:23:03.338907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.338987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.339012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.002 qpair failed and we were unable to recover it. 00:31:00.002 [2024-11-28 23:23:03.339095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.339175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.339222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.002 qpair failed and we were unable to recover it. 00:31:00.002 [2024-11-28 23:23:03.339308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.339417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.339443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.002 qpair failed and we were unable to recover it. 00:31:00.002 [2024-11-28 23:23:03.339533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.339647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.339672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.002 qpair failed and we were unable to recover it. 00:31:00.002 [2024-11-28 23:23:03.339766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.339852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.339877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.002 qpair failed and we were unable to recover it. 00:31:00.002 [2024-11-28 23:23:03.339974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.340065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.340089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.002 qpair failed and we were unable to recover it. 00:31:00.002 [2024-11-28 23:23:03.340214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.340329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.340354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.002 qpair failed and we were unable to recover it. 00:31:00.002 [2024-11-28 23:23:03.340451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.340560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.340586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.002 qpair failed and we were unable to recover it. 00:31:00.002 [2024-11-28 23:23:03.340671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.340764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.340789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.002 qpair failed and we were unable to recover it. 00:31:00.002 [2024-11-28 23:23:03.340882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.340966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.340991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.002 qpair failed and we were unable to recover it. 00:31:00.002 [2024-11-28 23:23:03.341080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.341161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.341186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.002 qpair failed and we were unable to recover it. 00:31:00.002 [2024-11-28 23:23:03.341268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.341380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.002 [2024-11-28 23:23:03.341414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.002 qpair failed and we were unable to recover it. 00:31:00.002 [2024-11-28 23:23:03.341503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.341591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.341616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.003 qpair failed and we were unable to recover it. 00:31:00.003 [2024-11-28 23:23:03.341720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.341805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.341829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.003 qpair failed and we were unable to recover it. 00:31:00.003 [2024-11-28 23:23:03.341942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.342033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.342057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.003 qpair failed and we were unable to recover it. 00:31:00.003 [2024-11-28 23:23:03.342177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.342262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.342287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.003 qpair failed and we were unable to recover it. 00:31:00.003 [2024-11-28 23:23:03.342414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.342495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.342520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.003 qpair failed and we were unable to recover it. 00:31:00.003 [2024-11-28 23:23:03.342610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.342705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.342731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.003 qpair failed and we were unable to recover it. 00:31:00.003 [2024-11-28 23:23:03.342816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.342904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.342928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.003 qpair failed and we were unable to recover it. 00:31:00.003 [2024-11-28 23:23:03.343016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.343098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.343124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.003 qpair failed and we were unable to recover it. 00:31:00.003 [2024-11-28 23:23:03.343205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.343291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.343316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.003 qpair failed and we were unable to recover it. 00:31:00.003 [2024-11-28 23:23:03.343451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.343568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.343593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.003 qpair failed and we were unable to recover it. 00:31:00.003 [2024-11-28 23:23:03.343682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.343791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.343815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.003 qpair failed and we were unable to recover it. 00:31:00.003 [2024-11-28 23:23:03.343904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.343994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.344021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.003 qpair failed and we were unable to recover it. 00:31:00.003 [2024-11-28 23:23:03.344113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.344198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.344223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.003 qpair failed and we were unable to recover it. 00:31:00.003 [2024-11-28 23:23:03.344312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.344411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.344436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.003 qpair failed and we were unable to recover it. 00:31:00.003 [2024-11-28 23:23:03.344519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.344599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.344623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.003 qpair failed and we were unable to recover it. 00:31:00.003 [2024-11-28 23:23:03.344722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.344807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.344832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.003 qpair failed and we were unable to recover it. 00:31:00.003 [2024-11-28 23:23:03.344921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.345039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.345065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.003 qpair failed and we were unable to recover it. 00:31:00.003 [2024-11-28 23:23:03.345151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.345237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.345262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.003 qpair failed and we were unable to recover it. 00:31:00.003 [2024-11-28 23:23:03.345349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.345458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.345483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.003 qpair failed and we were unable to recover it. 00:31:00.003 [2024-11-28 23:23:03.345564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.345656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.345680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.003 qpair failed and we were unable to recover it. 00:31:00.003 [2024-11-28 23:23:03.345847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.345972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.346002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.003 qpair failed and we were unable to recover it. 00:31:00.003 [2024-11-28 23:23:03.346109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.346229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.346256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.003 qpair failed and we were unable to recover it. 00:31:00.003 [2024-11-28 23:23:03.346349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.346453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.346481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.003 qpair failed and we were unable to recover it. 00:31:00.003 [2024-11-28 23:23:03.346571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.346668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.346703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.003 qpair failed and we were unable to recover it. 00:31:00.003 [2024-11-28 23:23:03.346792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.346877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.346903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.003 qpair failed and we were unable to recover it. 00:31:00.003 [2024-11-28 23:23:03.347001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.347080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.347105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.003 qpair failed and we were unable to recover it. 00:31:00.003 [2024-11-28 23:23:03.347181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.347300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.347328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.003 qpair failed and we were unable to recover it. 00:31:00.003 [2024-11-28 23:23:03.347429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.347520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.347548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.003 qpair failed and we were unable to recover it. 00:31:00.003 [2024-11-28 23:23:03.347636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.347727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.003 [2024-11-28 23:23:03.347754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.003 qpair failed and we were unable to recover it. 00:31:00.003 [2024-11-28 23:23:03.347896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.348015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.348041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.004 qpair failed and we were unable to recover it. 00:31:00.004 [2024-11-28 23:23:03.348136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.348228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.348254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.004 qpair failed and we were unable to recover it. 00:31:00.004 [2024-11-28 23:23:03.348341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.348475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.348502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.004 qpair failed and we were unable to recover it. 00:31:00.004 [2024-11-28 23:23:03.348583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.348669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.348703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.004 qpair failed and we were unable to recover it. 00:31:00.004 [2024-11-28 23:23:03.348834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.348979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.349005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.004 qpair failed and we were unable to recover it. 00:31:00.004 [2024-11-28 23:23:03.349088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.349205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.349230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.004 qpair failed and we were unable to recover it. 00:31:00.004 [2024-11-28 23:23:03.349346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.349448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.349474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.004 qpair failed and we were unable to recover it. 00:31:00.004 [2024-11-28 23:23:03.349592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.349673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.349700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.004 qpair failed and we were unable to recover it. 00:31:00.004 [2024-11-28 23:23:03.349809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.349903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.349928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.004 qpair failed and we were unable to recover it. 00:31:00.004 [2024-11-28 23:23:03.350012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.350102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.350127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.004 qpair failed and we were unable to recover it. 00:31:00.004 [2024-11-28 23:23:03.350222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.350311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.350336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.004 qpair failed and we were unable to recover it. 00:31:00.004 [2024-11-28 23:23:03.350437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.350546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.350572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.004 qpair failed and we were unable to recover it. 00:31:00.004 [2024-11-28 23:23:03.350699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.350781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.350808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.004 qpair failed and we were unable to recover it. 00:31:00.004 [2024-11-28 23:23:03.350943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.351022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.351049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.004 qpair failed and we were unable to recover it. 00:31:00.004 [2024-11-28 23:23:03.351130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.351220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.351247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.004 qpair failed and we were unable to recover it. 00:31:00.004 [2024-11-28 23:23:03.351333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.351436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.351464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.004 qpair failed and we were unable to recover it. 00:31:00.004 [2024-11-28 23:23:03.351611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.351727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.351754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.004 qpair failed and we were unable to recover it. 00:31:00.004 [2024-11-28 23:23:03.351830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.351916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.351944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.004 qpair failed and we were unable to recover it. 00:31:00.004 [2024-11-28 23:23:03.352063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.352149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.352176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.004 qpair failed and we were unable to recover it. 00:31:00.004 [2024-11-28 23:23:03.352287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.352380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.352415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.004 qpair failed and we were unable to recover it. 00:31:00.004 [2024-11-28 23:23:03.352499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.352612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.352637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.004 qpair failed and we were unable to recover it. 00:31:00.004 [2024-11-28 23:23:03.352740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.352863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.352890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.004 qpair failed and we were unable to recover it. 00:31:00.004 [2024-11-28 23:23:03.352991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.353109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.353135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.004 qpair failed and we were unable to recover it. 00:31:00.004 [2024-11-28 23:23:03.353251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.353372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.353413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.004 qpair failed and we were unable to recover it. 00:31:00.004 [2024-11-28 23:23:03.353506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.353600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.353626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.004 qpair failed and we were unable to recover it. 00:31:00.004 [2024-11-28 23:23:03.353756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.353876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.004 [2024-11-28 23:23:03.353902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.004 qpair failed and we were unable to recover it. 00:31:00.005 [2024-11-28 23:23:03.354003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.354085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.354111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.005 qpair failed and we were unable to recover it. 00:31:00.005 [2024-11-28 23:23:03.354236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.354323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.354348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.005 qpair failed and we were unable to recover it. 00:31:00.005 [2024-11-28 23:23:03.354456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.354543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.354570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.005 qpair failed and we were unable to recover it. 00:31:00.005 [2024-11-28 23:23:03.354661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.354758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.354783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.005 qpair failed and we were unable to recover it. 00:31:00.005 [2024-11-28 23:23:03.354871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.354958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.354984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.005 qpair failed and we were unable to recover it. 00:31:00.005 [2024-11-28 23:23:03.355068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.355181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.355212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.005 qpair failed and we were unable to recover it. 00:31:00.005 [2024-11-28 23:23:03.355299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.355390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.355423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.005 qpair failed and we were unable to recover it. 00:31:00.005 [2024-11-28 23:23:03.355504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.355587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.355611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.005 qpair failed and we were unable to recover it. 00:31:00.005 [2024-11-28 23:23:03.355774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.355895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.355921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.005 qpair failed and we were unable to recover it. 00:31:00.005 [2024-11-28 23:23:03.356020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.356115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.356140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.005 qpair failed and we were unable to recover it. 00:31:00.005 [2024-11-28 23:23:03.356224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.356318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.356344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.005 qpair failed and we were unable to recover it. 00:31:00.005 [2024-11-28 23:23:03.356464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.356543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.356569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.005 qpair failed and we were unable to recover it. 00:31:00.005 [2024-11-28 23:23:03.356682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.356773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.356799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.005 qpair failed and we were unable to recover it. 00:31:00.005 [2024-11-28 23:23:03.356886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.356973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.356998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.005 qpair failed and we were unable to recover it. 00:31:00.005 [2024-11-28 23:23:03.357100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.357210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.357234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.005 qpair failed and we were unable to recover it. 00:31:00.005 [2024-11-28 23:23:03.357333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.357433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.357458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.005 qpair failed and we were unable to recover it. 00:31:00.005 [2024-11-28 23:23:03.357558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.357674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.357706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.005 qpair failed and we were unable to recover it. 00:31:00.005 [2024-11-28 23:23:03.357801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.357883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.357908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.005 qpair failed and we were unable to recover it. 00:31:00.005 [2024-11-28 23:23:03.358024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.358106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.358131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.005 qpair failed and we were unable to recover it. 00:31:00.005 [2024-11-28 23:23:03.358248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.358357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.358386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.005 qpair failed and we were unable to recover it. 00:31:00.005 [2024-11-28 23:23:03.358481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.358561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.358586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.005 qpair failed and we were unable to recover it. 00:31:00.005 [2024-11-28 23:23:03.358678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.358762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.358787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.005 qpair failed and we were unable to recover it. 00:31:00.005 [2024-11-28 23:23:03.358881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.358992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.359017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.005 qpair failed and we were unable to recover it. 00:31:00.005 [2024-11-28 23:23:03.359136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.359227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.359253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.005 qpair failed and we were unable to recover it. 00:31:00.005 [2024-11-28 23:23:03.359346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.359446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.359471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.005 qpair failed and we were unable to recover it. 00:31:00.005 [2024-11-28 23:23:03.359558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.359674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.359699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.005 qpair failed and we were unable to recover it. 00:31:00.005 [2024-11-28 23:23:03.359824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.359912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.359939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.005 qpair failed and we were unable to recover it. 00:31:00.005 [2024-11-28 23:23:03.360081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.360160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.360184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.005 qpair failed and we were unable to recover it. 00:31:00.005 [2024-11-28 23:23:03.360287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.360461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.005 [2024-11-28 23:23:03.360488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.005 qpair failed and we were unable to recover it. 00:31:00.005 [2024-11-28 23:23:03.360576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.360662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.360687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.006 qpair failed and we were unable to recover it. 00:31:00.006 [2024-11-28 23:23:03.360805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.360883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.360908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.006 qpair failed and we were unable to recover it. 00:31:00.006 [2024-11-28 23:23:03.361000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.361107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.361132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.006 qpair failed and we were unable to recover it. 00:31:00.006 [2024-11-28 23:23:03.361228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.361344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.361369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.006 qpair failed and we were unable to recover it. 00:31:00.006 [2024-11-28 23:23:03.361466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.361558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.361584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.006 qpair failed and we were unable to recover it. 00:31:00.006 [2024-11-28 23:23:03.361711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.361804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.361829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.006 qpair failed and we were unable to recover it. 00:31:00.006 [2024-11-28 23:23:03.361918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.362004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.362030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.006 qpair failed and we were unable to recover it. 00:31:00.006 [2024-11-28 23:23:03.362149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.362245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.362270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.006 qpair failed and we were unable to recover it. 00:31:00.006 [2024-11-28 23:23:03.362355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.362490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.362516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.006 qpair failed and we were unable to recover it. 00:31:00.006 [2024-11-28 23:23:03.362603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.362698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.362723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.006 qpair failed and we were unable to recover it. 00:31:00.006 [2024-11-28 23:23:03.362814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.362926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.362951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.006 qpair failed and we were unable to recover it. 00:31:00.006 [2024-11-28 23:23:03.363036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.363176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.363202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.006 qpair failed and we were unable to recover it. 00:31:00.006 [2024-11-28 23:23:03.363299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.363381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.363416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.006 qpair failed and we were unable to recover it. 00:31:00.006 [2024-11-28 23:23:03.363502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.363600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.363625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.006 qpair failed and we were unable to recover it. 00:31:00.006 [2024-11-28 23:23:03.363750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.363836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.363861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.006 qpair failed and we were unable to recover it. 00:31:00.006 [2024-11-28 23:23:03.363974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.364089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.364114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.006 qpair failed and we were unable to recover it. 00:31:00.006 [2024-11-28 23:23:03.364211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.364291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.364316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.006 qpair failed and we were unable to recover it. 00:31:00.006 [2024-11-28 23:23:03.364421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.364510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.364536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.006 qpair failed and we were unable to recover it. 00:31:00.006 [2024-11-28 23:23:03.364622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.364735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.364760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.006 qpair failed and we were unable to recover it. 00:31:00.006 [2024-11-28 23:23:03.364871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.364959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.364985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.006 qpair failed and we were unable to recover it. 00:31:00.006 [2024-11-28 23:23:03.365071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.365216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.365242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.006 qpair failed and we were unable to recover it. 00:31:00.006 [2024-11-28 23:23:03.365327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.365430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.365456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.006 qpair failed and we were unable to recover it. 00:31:00.006 [2024-11-28 23:23:03.365542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.365664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.365689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.006 qpair failed and we were unable to recover it. 00:31:00.006 [2024-11-28 23:23:03.365780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.365882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.365907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.006 qpair failed and we were unable to recover it. 00:31:00.006 [2024-11-28 23:23:03.366026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.366110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.366137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.006 qpair failed and we were unable to recover it. 00:31:00.006 [2024-11-28 23:23:03.366219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.366303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.366328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.006 qpair failed and we were unable to recover it. 00:31:00.006 [2024-11-28 23:23:03.366432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.366514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.366539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.006 qpair failed and we were unable to recover it. 00:31:00.006 [2024-11-28 23:23:03.366628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.366752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.366782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.006 qpair failed and we were unable to recover it. 00:31:00.006 [2024-11-28 23:23:03.366893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.366980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.367006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.006 qpair failed and we were unable to recover it. 00:31:00.006 [2024-11-28 23:23:03.367082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.006 [2024-11-28 23:23:03.367164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.367188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.007 qpair failed and we were unable to recover it. 00:31:00.007 [2024-11-28 23:23:03.367301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.367413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.367439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.007 qpair failed and we were unable to recover it. 00:31:00.007 [2024-11-28 23:23:03.367522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.367603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.367629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.007 qpair failed and we were unable to recover it. 00:31:00.007 [2024-11-28 23:23:03.367756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.367896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.367921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.007 qpair failed and we were unable to recover it. 00:31:00.007 [2024-11-28 23:23:03.368006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.368120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.368146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.007 qpair failed and we were unable to recover it. 00:31:00.007 [2024-11-28 23:23:03.368259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.368348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.368374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.007 qpair failed and we were unable to recover it. 00:31:00.007 [2024-11-28 23:23:03.368482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.368569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.368594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.007 qpair failed and we were unable to recover it. 00:31:00.007 [2024-11-28 23:23:03.368714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.368831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.368856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.007 qpair failed and we were unable to recover it. 00:31:00.007 [2024-11-28 23:23:03.368940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.369051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.369076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.007 qpair failed and we were unable to recover it. 00:31:00.007 [2024-11-28 23:23:03.369170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.369256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.369280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.007 qpair failed and we were unable to recover it. 00:31:00.007 [2024-11-28 23:23:03.369435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.369527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.369553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.007 qpair failed and we were unable to recover it. 00:31:00.007 [2024-11-28 23:23:03.369649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.369763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.369788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.007 qpair failed and we were unable to recover it. 00:31:00.007 [2024-11-28 23:23:03.369876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.369969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.369994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.007 qpair failed and we were unable to recover it. 00:31:00.007 [2024-11-28 23:23:03.370117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.370205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.370230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.007 qpair failed and we were unable to recover it. 00:31:00.007 [2024-11-28 23:23:03.370311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.370407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.370433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.007 qpair failed and we were unable to recover it. 00:31:00.007 [2024-11-28 23:23:03.370533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.370648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.370673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.007 qpair failed and we were unable to recover it. 00:31:00.007 [2024-11-28 23:23:03.370762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.370850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.370875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.007 qpair failed and we were unable to recover it. 00:31:00.007 [2024-11-28 23:23:03.370985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.371084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.371109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.007 qpair failed and we were unable to recover it. 00:31:00.007 [2024-11-28 23:23:03.371221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.371301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.371326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.007 qpair failed and we were unable to recover it. 00:31:00.007 [2024-11-28 23:23:03.371449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.371533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.371559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.007 qpair failed and we were unable to recover it. 00:31:00.007 [2024-11-28 23:23:03.371683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.371823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.371848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.007 qpair failed and we were unable to recover it. 00:31:00.007 [2024-11-28 23:23:03.371931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.372027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.372052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.007 qpair failed and we were unable to recover it. 00:31:00.007 [2024-11-28 23:23:03.372170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.372280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.372306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.007 qpair failed and we were unable to recover it. 00:31:00.007 [2024-11-28 23:23:03.372411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.372500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.372525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.007 qpair failed and we were unable to recover it. 00:31:00.007 [2024-11-28 23:23:03.372631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.372756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.372781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.007 qpair failed and we were unable to recover it. 00:31:00.007 [2024-11-28 23:23:03.372865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.372985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.373010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.007 qpair failed and we were unable to recover it. 00:31:00.007 [2024-11-28 23:23:03.373128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.373216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.373241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.007 qpair failed and we were unable to recover it. 00:31:00.007 [2024-11-28 23:23:03.373328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.373422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.373448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.007 qpair failed and we were unable to recover it. 00:31:00.007 [2024-11-28 23:23:03.373536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.373619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.007 [2024-11-28 23:23:03.373645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.007 qpair failed and we were unable to recover it. 00:31:00.007 [2024-11-28 23:23:03.373732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.373878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.373904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.008 qpair failed and we were unable to recover it. 00:31:00.008 [2024-11-28 23:23:03.374019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.374101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.374126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.008 qpair failed and we were unable to recover it. 00:31:00.008 [2024-11-28 23:23:03.374210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.374325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.374350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.008 qpair failed and we were unable to recover it. 00:31:00.008 [2024-11-28 23:23:03.374452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.374544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.374571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.008 qpair failed and we were unable to recover it. 00:31:00.008 [2024-11-28 23:23:03.374662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.374742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.374768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.008 qpair failed and we were unable to recover it. 00:31:00.008 [2024-11-28 23:23:03.374856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.374967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.374992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.008 qpair failed and we were unable to recover it. 00:31:00.008 [2024-11-28 23:23:03.375079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.375163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.375188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.008 qpair failed and we were unable to recover it. 00:31:00.008 [2024-11-28 23:23:03.375281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.375361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.375387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.008 qpair failed and we were unable to recover it. 00:31:00.008 [2024-11-28 23:23:03.375501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.375592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.375617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.008 qpair failed and we were unable to recover it. 00:31:00.008 [2024-11-28 23:23:03.375715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.375808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.375840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.008 qpair failed and we were unable to recover it. 00:31:00.008 [2024-11-28 23:23:03.375934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.376018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.376043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.008 qpair failed and we were unable to recover it. 00:31:00.008 [2024-11-28 23:23:03.376166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.376253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.376278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.008 qpair failed and we were unable to recover it. 00:31:00.008 [2024-11-28 23:23:03.376356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.376450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.376477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.008 qpair failed and we were unable to recover it. 00:31:00.008 [2024-11-28 23:23:03.376569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.376659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.376691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.008 qpair failed and we were unable to recover it. 00:31:00.008 [2024-11-28 23:23:03.376824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.376908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.376934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.008 qpair failed and we were unable to recover it. 00:31:00.008 [2024-11-28 23:23:03.377048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.377128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.377153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.008 qpair failed and we were unable to recover it. 00:31:00.008 [2024-11-28 23:23:03.377234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.377375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.377408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.008 qpair failed and we were unable to recover it. 00:31:00.008 [2024-11-28 23:23:03.377503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.377590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.377615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.008 qpair failed and we were unable to recover it. 00:31:00.008 [2024-11-28 23:23:03.377708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.377796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.377822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.008 qpair failed and we were unable to recover it. 00:31:00.008 [2024-11-28 23:23:03.377931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.378010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.378034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.008 qpair failed and we were unable to recover it. 00:31:00.008 [2024-11-28 23:23:03.378124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.378210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.378239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.008 qpair failed and we were unable to recover it. 00:31:00.008 [2024-11-28 23:23:03.378336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.378456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.378482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.008 qpair failed and we were unable to recover it. 00:31:00.008 [2024-11-28 23:23:03.378567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.378674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.378699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.008 qpair failed and we were unable to recover it. 00:31:00.008 [2024-11-28 23:23:03.378793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.378873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.378898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.008 qpair failed and we were unable to recover it. 00:31:00.008 [2024-11-28 23:23:03.378979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.379099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.379125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.008 qpair failed and we were unable to recover it. 00:31:00.008 [2024-11-28 23:23:03.379223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.379338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.008 [2024-11-28 23:23:03.379363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.009 qpair failed and we were unable to recover it. 00:31:00.009 [2024-11-28 23:23:03.379510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.379624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.379649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.009 qpair failed and we were unable to recover it. 00:31:00.009 [2024-11-28 23:23:03.379728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.379823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.379847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.009 qpair failed and we were unable to recover it. 00:31:00.009 [2024-11-28 23:23:03.379925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.380043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.380068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.009 qpair failed and we were unable to recover it. 00:31:00.009 [2024-11-28 23:23:03.380162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.380308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.380333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.009 qpair failed and we were unable to recover it. 00:31:00.009 [2024-11-28 23:23:03.380459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.380540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.380565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.009 qpair failed and we were unable to recover it. 00:31:00.009 [2024-11-28 23:23:03.380650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.380740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.380765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.009 qpair failed and we were unable to recover it. 00:31:00.009 [2024-11-28 23:23:03.380860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.380946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.380976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.009 qpair failed and we were unable to recover it. 00:31:00.009 [2024-11-28 23:23:03.381118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.381203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.381228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.009 qpair failed and we were unable to recover it. 00:31:00.009 [2024-11-28 23:23:03.381304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.381406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.381432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.009 qpair failed and we were unable to recover it. 00:31:00.009 [2024-11-28 23:23:03.381551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.381626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.381651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.009 qpair failed and we were unable to recover it. 00:31:00.009 [2024-11-28 23:23:03.381758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.381884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.381910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.009 qpair failed and we were unable to recover it. 00:31:00.009 [2024-11-28 23:23:03.382019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.382153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.382178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.009 qpair failed and we were unable to recover it. 00:31:00.009 [2024-11-28 23:23:03.382296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.382448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.382473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.009 qpair failed and we were unable to recover it. 00:31:00.009 [2024-11-28 23:23:03.382583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.382698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.382723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.009 qpair failed and we were unable to recover it. 00:31:00.009 [2024-11-28 23:23:03.382812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.382927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.382952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.009 qpair failed and we were unable to recover it. 00:31:00.009 [2024-11-28 23:23:03.383044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.383124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.383148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.009 qpair failed and we were unable to recover it. 00:31:00.009 [2024-11-28 23:23:03.383232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.383311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.383336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.009 qpair failed and we were unable to recover it. 00:31:00.009 [2024-11-28 23:23:03.383430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.383512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.383537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.009 qpair failed and we were unable to recover it. 00:31:00.009 [2024-11-28 23:23:03.383635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.383724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.383749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.009 qpair failed and we were unable to recover it. 00:31:00.009 [2024-11-28 23:23:03.383848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.383927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.383951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.009 qpair failed and we were unable to recover it. 00:31:00.009 [2024-11-28 23:23:03.384069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.384153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.384178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.009 qpair failed and we were unable to recover it. 00:31:00.009 [2024-11-28 23:23:03.384268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.384356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.384385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.009 qpair failed and we were unable to recover it. 00:31:00.009 [2024-11-28 23:23:03.384474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.384589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.384614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.009 qpair failed and we were unable to recover it. 00:31:00.009 [2024-11-28 23:23:03.384702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.384791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.384815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.009 qpair failed and we were unable to recover it. 00:31:00.009 [2024-11-28 23:23:03.384900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.384988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.385015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.009 qpair failed and we were unable to recover it. 00:31:00.009 [2024-11-28 23:23:03.385099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.385214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.385238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.009 qpair failed and we were unable to recover it. 00:31:00.009 [2024-11-28 23:23:03.385316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.385409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.385436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.009 qpair failed and we were unable to recover it. 00:31:00.009 [2024-11-28 23:23:03.385530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.385645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.385670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.009 qpair failed and we were unable to recover it. 00:31:00.009 [2024-11-28 23:23:03.385748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.385858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.009 [2024-11-28 23:23:03.385882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.009 qpair failed and we were unable to recover it. 00:31:00.010 [2024-11-28 23:23:03.386005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.386089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.386113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.010 qpair failed and we were unable to recover it. 00:31:00.010 [2024-11-28 23:23:03.386195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.386279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.386304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.010 qpair failed and we were unable to recover it. 00:31:00.010 [2024-11-28 23:23:03.386383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.386469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.386493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.010 qpair failed and we were unable to recover it. 00:31:00.010 [2024-11-28 23:23:03.386611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.386715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.386739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.010 qpair failed and we were unable to recover it. 00:31:00.010 [2024-11-28 23:23:03.386862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.386951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.386975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.010 qpair failed and we were unable to recover it. 00:31:00.010 [2024-11-28 23:23:03.387087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.387162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.387187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.010 qpair failed and we were unable to recover it. 00:31:00.010 [2024-11-28 23:23:03.387271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.387415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.387445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.010 qpair failed and we were unable to recover it. 00:31:00.010 [2024-11-28 23:23:03.387546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.387638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.387663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.010 qpair failed and we were unable to recover it. 00:31:00.010 [2024-11-28 23:23:03.387782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.387867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.387892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.010 qpair failed and we were unable to recover it. 00:31:00.010 [2024-11-28 23:23:03.387977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.388087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.388112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.010 qpair failed and we were unable to recover it. 00:31:00.010 [2024-11-28 23:23:03.388197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.388291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.388316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.010 qpair failed and we were unable to recover it. 00:31:00.010 [2024-11-28 23:23:03.388411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.388527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.388552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.010 qpair failed and we were unable to recover it. 00:31:00.010 [2024-11-28 23:23:03.388644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.388724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.388749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.010 qpair failed and we were unable to recover it. 00:31:00.010 [2024-11-28 23:23:03.388832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.388914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.388938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.010 qpair failed and we were unable to recover it. 00:31:00.010 [2024-11-28 23:23:03.389050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.389125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.389151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.010 qpair failed and we were unable to recover it. 00:31:00.010 [2024-11-28 23:23:03.389233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.389345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.389371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.010 qpair failed and we were unable to recover it. 00:31:00.010 [2024-11-28 23:23:03.389464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.389546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.389571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.010 qpair failed and we were unable to recover it. 00:31:00.010 [2024-11-28 23:23:03.389685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.389795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.389820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.010 qpair failed and we were unable to recover it. 00:31:00.010 [2024-11-28 23:23:03.389963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.390071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.390096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.010 qpair failed and we were unable to recover it. 00:31:00.010 [2024-11-28 23:23:03.390218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.390329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.390354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.010 qpair failed and we were unable to recover it. 00:31:00.010 [2024-11-28 23:23:03.390452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.390575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.390601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.010 qpair failed and we were unable to recover it. 00:31:00.010 [2024-11-28 23:23:03.390679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.390762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.390786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.010 qpair failed and we were unable to recover it. 00:31:00.010 [2024-11-28 23:23:03.390873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.390980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.391005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.010 qpair failed and we were unable to recover it. 00:31:00.010 [2024-11-28 23:23:03.391092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.391175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.391200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.010 qpair failed and we were unable to recover it. 00:31:00.010 [2024-11-28 23:23:03.391298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.391415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.391441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.010 qpair failed and we were unable to recover it. 00:31:00.010 [2024-11-28 23:23:03.391554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.391675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.391699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.010 qpair failed and we were unable to recover it. 00:31:00.010 [2024-11-28 23:23:03.391783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.391861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.391886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.010 qpair failed and we were unable to recover it. 00:31:00.010 [2024-11-28 23:23:03.391977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.392060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.392085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.010 qpair failed and we were unable to recover it. 00:31:00.010 [2024-11-28 23:23:03.392171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.392248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.010 [2024-11-28 23:23:03.392273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.010 qpair failed and we were unable to recover it. 00:31:00.010 [2024-11-28 23:23:03.392364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.392488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.392513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.011 qpair failed and we were unable to recover it. 00:31:00.011 [2024-11-28 23:23:03.392595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.392678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.392701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.011 qpair failed and we were unable to recover it. 00:31:00.011 [2024-11-28 23:23:03.392850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.392925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.392949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.011 qpair failed and we were unable to recover it. 00:31:00.011 [2024-11-28 23:23:03.393036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.393122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.393147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.011 qpair failed and we were unable to recover it. 00:31:00.011 [2024-11-28 23:23:03.393267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.393344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.393369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.011 qpair failed and we were unable to recover it. 00:31:00.011 [2024-11-28 23:23:03.393493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.393584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.393609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.011 qpair failed and we were unable to recover it. 00:31:00.011 [2024-11-28 23:23:03.393705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.393785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.393810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.011 qpair failed and we were unable to recover it. 00:31:00.011 [2024-11-28 23:23:03.393903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.394000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.394024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.011 qpair failed and we were unable to recover it. 00:31:00.011 [2024-11-28 23:23:03.394127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.394238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.394263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.011 qpair failed and we were unable to recover it. 00:31:00.011 [2024-11-28 23:23:03.394348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.394466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.394492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.011 qpair failed and we were unable to recover it. 00:31:00.011 [2024-11-28 23:23:03.394609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.394725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.394751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.011 qpair failed and we were unable to recover it. 00:31:00.011 [2024-11-28 23:23:03.394836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.394927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.394954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.011 qpair failed and we were unable to recover it. 00:31:00.011 [2024-11-28 23:23:03.395076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.395156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.395181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.011 qpair failed and we were unable to recover it. 00:31:00.011 [2024-11-28 23:23:03.395268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.395355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.395386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.011 qpair failed and we were unable to recover it. 00:31:00.011 [2024-11-28 23:23:03.395528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.395605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.395631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.011 qpair failed and we were unable to recover it. 00:31:00.011 [2024-11-28 23:23:03.395754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.395834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.395860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.011 qpair failed and we were unable to recover it. 00:31:00.011 [2024-11-28 23:23:03.395974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.396076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.396101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.011 qpair failed and we were unable to recover it. 00:31:00.011 [2024-11-28 23:23:03.396195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.396273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.396298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.011 qpair failed and we were unable to recover it. 00:31:00.011 [2024-11-28 23:23:03.396377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.396471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.396497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.011 qpair failed and we were unable to recover it. 00:31:00.011 [2024-11-28 23:23:03.396603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.396716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.396741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.011 qpair failed and we were unable to recover it. 00:31:00.011 [2024-11-28 23:23:03.396866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.396944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.396973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.011 qpair failed and we were unable to recover it. 00:31:00.011 [2024-11-28 23:23:03.397058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.397140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.397166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.011 qpair failed and we were unable to recover it. 00:31:00.011 [2024-11-28 23:23:03.397285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.397377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.397412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.011 qpair failed and we were unable to recover it. 00:31:00.011 [2024-11-28 23:23:03.397499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.397638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.397663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.011 qpair failed and we were unable to recover it. 00:31:00.011 [2024-11-28 23:23:03.397808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.397890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.397915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.011 qpair failed and we were unable to recover it. 00:31:00.011 [2024-11-28 23:23:03.397999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.398089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.398115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.011 qpair failed and we were unable to recover it. 00:31:00.011 [2024-11-28 23:23:03.398208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.398295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.398320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.011 qpair failed and we were unable to recover it. 00:31:00.011 [2024-11-28 23:23:03.398415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.398504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.398531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.011 qpair failed and we were unable to recover it. 00:31:00.011 [2024-11-28 23:23:03.398614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.398720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.398750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.011 qpair failed and we were unable to recover it. 00:31:00.011 [2024-11-28 23:23:03.398833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.011 [2024-11-28 23:23:03.398911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.398936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.012 qpair failed and we were unable to recover it. 00:31:00.012 [2024-11-28 23:23:03.399021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.399099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.399124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.012 qpair failed and we were unable to recover it. 00:31:00.012 [2024-11-28 23:23:03.399208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.399374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.399405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.012 qpair failed and we were unable to recover it. 00:31:00.012 [2024-11-28 23:23:03.399494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.399571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.399596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.012 qpair failed and we were unable to recover it. 00:31:00.012 [2024-11-28 23:23:03.399751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.399831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.399856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.012 qpair failed and we were unable to recover it. 00:31:00.012 [2024-11-28 23:23:03.399946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.400064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.400089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.012 qpair failed and we were unable to recover it. 00:31:00.012 [2024-11-28 23:23:03.400180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.400257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.400282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.012 qpair failed and we were unable to recover it. 00:31:00.012 [2024-11-28 23:23:03.400366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.400453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.400479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.012 qpair failed and we were unable to recover it. 00:31:00.012 [2024-11-28 23:23:03.400592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.400676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.400702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.012 qpair failed and we were unable to recover it. 00:31:00.012 [2024-11-28 23:23:03.400809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.400890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.400915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.012 qpair failed and we were unable to recover it. 00:31:00.012 [2024-11-28 23:23:03.401033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.401122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.401147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.012 qpair failed and we were unable to recover it. 00:31:00.012 [2024-11-28 23:23:03.401230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.401341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.401366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.012 qpair failed and we were unable to recover it. 00:31:00.012 [2024-11-28 23:23:03.401463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.401540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.401565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.012 qpair failed and we were unable to recover it. 00:31:00.012 [2024-11-28 23:23:03.401654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.401779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.401804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.012 qpair failed and we were unable to recover it. 00:31:00.012 [2024-11-28 23:23:03.401913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.402025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.402049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.012 qpair failed and we were unable to recover it. 00:31:00.012 [2024-11-28 23:23:03.402134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.402241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.402266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.012 qpair failed and we were unable to recover it. 00:31:00.012 [2024-11-28 23:23:03.402350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.402453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.402479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.012 qpair failed and we were unable to recover it. 00:31:00.012 [2024-11-28 23:23:03.402572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.402716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.402742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.012 qpair failed and we were unable to recover it. 00:31:00.012 [2024-11-28 23:23:03.402869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.402955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.402981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.012 qpair failed and we were unable to recover it. 00:31:00.012 [2024-11-28 23:23:03.403072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.403149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.403173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.012 qpair failed and we were unable to recover it. 00:31:00.012 [2024-11-28 23:23:03.403284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.403444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.403470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.012 qpair failed and we were unable to recover it. 00:31:00.012 [2024-11-28 23:23:03.403570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.403664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.403690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.012 qpair failed and we were unable to recover it. 00:31:00.012 [2024-11-28 23:23:03.403780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.403896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.403921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.012 qpair failed and we were unable to recover it. 00:31:00.012 [2024-11-28 23:23:03.404006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.404087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.404111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.012 qpair failed and we were unable to recover it. 00:31:00.012 [2024-11-28 23:23:03.404200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.404306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.404333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.012 qpair failed and we were unable to recover it. 00:31:00.012 [2024-11-28 23:23:03.404421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.404510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.404534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.012 qpair failed and we were unable to recover it. 00:31:00.012 [2024-11-28 23:23:03.404622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.404759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.404784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.012 qpair failed and we were unable to recover it. 00:31:00.012 [2024-11-28 23:23:03.404865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.404945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.404969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.012 qpair failed and we were unable to recover it. 00:31:00.012 [2024-11-28 23:23:03.405081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.405173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.405197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.012 qpair failed and we were unable to recover it. 00:31:00.012 [2024-11-28 23:23:03.405275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.405355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.012 [2024-11-28 23:23:03.405386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.013 qpair failed and we were unable to recover it. 00:31:00.013 [2024-11-28 23:23:03.405489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.405571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.405596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.013 qpair failed and we were unable to recover it. 00:31:00.013 [2024-11-28 23:23:03.405676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.405832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.405858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.013 qpair failed and we were unable to recover it. 00:31:00.013 [2024-11-28 23:23:03.405979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.406087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.406112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.013 qpair failed and we were unable to recover it. 00:31:00.013 [2024-11-28 23:23:03.406202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.406319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.406344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.013 qpair failed and we were unable to recover it. 00:31:00.013 [2024-11-28 23:23:03.406440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.406527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.406552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.013 qpair failed and we were unable to recover it. 00:31:00.013 [2024-11-28 23:23:03.406645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.406733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.406758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.013 qpair failed and we were unable to recover it. 00:31:00.013 [2024-11-28 23:23:03.406869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.406988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.407013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.013 qpair failed and we were unable to recover it. 00:31:00.013 [2024-11-28 23:23:03.407099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.407183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.407209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.013 qpair failed and we were unable to recover it. 00:31:00.013 [2024-11-28 23:23:03.407290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.407372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.407403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.013 qpair failed and we were unable to recover it. 00:31:00.013 [2024-11-28 23:23:03.407537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.407629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.407654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.013 qpair failed and we were unable to recover it. 00:31:00.013 [2024-11-28 23:23:03.407754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.407856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.407882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.013 qpair failed and we were unable to recover it. 00:31:00.013 [2024-11-28 23:23:03.407974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.408063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.408087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.013 qpair failed and we were unable to recover it. 00:31:00.013 [2024-11-28 23:23:03.408202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.408281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.408305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.013 qpair failed and we were unable to recover it. 00:31:00.013 [2024-11-28 23:23:03.408406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.408549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.408575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.013 qpair failed and we were unable to recover it. 00:31:00.013 [2024-11-28 23:23:03.408659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.408739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.408764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.013 qpair failed and we were unable to recover it. 00:31:00.013 [2024-11-28 23:23:03.408855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.408980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.409006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.013 qpair failed and we were unable to recover it. 00:31:00.013 [2024-11-28 23:23:03.409118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.409229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.409253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.013 qpair failed and we were unable to recover it. 00:31:00.013 [2024-11-28 23:23:03.409347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.409448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.409473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.013 qpair failed and we were unable to recover it. 00:31:00.013 [2024-11-28 23:23:03.409599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.409678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.409704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.013 qpair failed and we were unable to recover it. 00:31:00.013 [2024-11-28 23:23:03.409812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.409909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.409934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.013 qpair failed and we were unable to recover it. 00:31:00.013 [2024-11-28 23:23:03.410042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.410129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.410160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.013 qpair failed and we were unable to recover it. 00:31:00.013 [2024-11-28 23:23:03.410247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.410355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.410379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.013 qpair failed and we were unable to recover it. 00:31:00.013 [2024-11-28 23:23:03.410501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.410580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.410604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.013 qpair failed and we were unable to recover it. 00:31:00.013 [2024-11-28 23:23:03.410691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.410778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.410802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.013 qpair failed and we were unable to recover it. 00:31:00.013 [2024-11-28 23:23:03.410893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.411012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.411036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.013 qpair failed and we were unable to recover it. 00:31:00.013 [2024-11-28 23:23:03.411151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.013 [2024-11-28 23:23:03.411236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.411261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.014 qpair failed and we were unable to recover it. 00:31:00.014 [2024-11-28 23:23:03.411354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.411483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.411509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.014 qpair failed and we were unable to recover it. 00:31:00.014 [2024-11-28 23:23:03.411629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.411746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.411770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.014 qpair failed and we were unable to recover it. 00:31:00.014 [2024-11-28 23:23:03.411885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.411965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.411989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.014 qpair failed and we were unable to recover it. 00:31:00.014 [2024-11-28 23:23:03.412079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.412159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.412184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.014 qpair failed and we were unable to recover it. 00:31:00.014 [2024-11-28 23:23:03.412301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.412385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.412418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.014 qpair failed and we were unable to recover it. 00:31:00.014 [2024-11-28 23:23:03.412510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.412626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.412650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.014 qpair failed and we were unable to recover it. 00:31:00.014 [2024-11-28 23:23:03.412749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.412834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.412858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.014 qpair failed and we were unable to recover it. 00:31:00.014 [2024-11-28 23:23:03.412941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.413025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.413050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.014 qpair failed and we were unable to recover it. 00:31:00.014 [2024-11-28 23:23:03.413160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.413246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.413271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.014 qpair failed and we were unable to recover it. 00:31:00.014 [2024-11-28 23:23:03.413383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.413474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.413499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.014 qpair failed and we were unable to recover it. 00:31:00.014 [2024-11-28 23:23:03.413587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.413675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.413699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.014 qpair failed and we were unable to recover it. 00:31:00.014 [2024-11-28 23:23:03.413776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.413892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.413917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.014 qpair failed and we were unable to recover it. 00:31:00.014 [2024-11-28 23:23:03.414006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.414084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.414108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.014 qpair failed and we were unable to recover it. 00:31:00.014 [2024-11-28 23:23:03.414224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.414334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.414359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.014 qpair failed and we were unable to recover it. 00:31:00.014 [2024-11-28 23:23:03.414462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.414544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.414569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.014 qpair failed and we were unable to recover it. 00:31:00.014 [2024-11-28 23:23:03.414699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.414821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.414846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.014 qpair failed and we were unable to recover it. 00:31:00.014 [2024-11-28 23:23:03.414935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.415053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.415077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.014 qpair failed and we were unable to recover it. 00:31:00.014 [2024-11-28 23:23:03.415166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.415246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.415271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.014 qpair failed and we were unable to recover it. 00:31:00.014 [2024-11-28 23:23:03.415352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.415477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.415502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.014 qpair failed and we were unable to recover it. 00:31:00.014 [2024-11-28 23:23:03.415592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.415714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.415739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.014 qpair failed and we were unable to recover it. 00:31:00.014 [2024-11-28 23:23:03.415853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.415967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.415991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.014 qpair failed and we were unable to recover it. 00:31:00.014 [2024-11-28 23:23:03.416087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.416198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.416224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.014 qpair failed and we were unable to recover it. 00:31:00.014 [2024-11-28 23:23:03.416311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.416407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.416433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.014 qpair failed and we were unable to recover it. 00:31:00.014 [2024-11-28 23:23:03.416525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.416610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.416634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.014 qpair failed and we were unable to recover it. 00:31:00.014 [2024-11-28 23:23:03.416717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.416804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.416828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.014 qpair failed and we were unable to recover it. 00:31:00.014 [2024-11-28 23:23:03.416949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.417065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.417089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.014 qpair failed and we were unable to recover it. 00:31:00.014 [2024-11-28 23:23:03.417199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.417279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.417304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.014 qpair failed and we were unable to recover it. 00:31:00.014 [2024-11-28 23:23:03.417436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.417554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.417578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.014 qpair failed and we were unable to recover it. 00:31:00.014 [2024-11-28 23:23:03.417668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.417752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-11-28 23:23:03.417778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.014 qpair failed and we were unable to recover it. 00:31:00.015 [2024-11-28 23:23:03.417858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.417936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.417961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.015 qpair failed and we were unable to recover it. 00:31:00.015 [2024-11-28 23:23:03.418082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.418166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.418191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.015 qpair failed and we were unable to recover it. 00:31:00.015 [2024-11-28 23:23:03.418284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.418364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.418388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.015 qpair failed and we were unable to recover it. 00:31:00.015 [2024-11-28 23:23:03.418478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.418588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.418614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.015 qpair failed and we were unable to recover it. 00:31:00.015 [2024-11-28 23:23:03.418719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.418801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.418827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.015 qpair failed and we were unable to recover it. 00:31:00.015 [2024-11-28 23:23:03.418947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.419029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.419054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.015 qpair failed and we were unable to recover it. 00:31:00.015 [2024-11-28 23:23:03.419138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.419248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.419278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.015 qpair failed and we were unable to recover it. 00:31:00.015 [2024-11-28 23:23:03.419368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.419492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.419517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.015 qpair failed and we were unable to recover it. 00:31:00.015 [2024-11-28 23:23:03.419636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.419750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.419775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.015 qpair failed and we were unable to recover it. 00:31:00.015 [2024-11-28 23:23:03.419862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.419943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.419968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.015 qpair failed and we were unable to recover it. 00:31:00.015 [2024-11-28 23:23:03.420084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.420170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.420195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.015 qpair failed and we were unable to recover it. 00:31:00.015 [2024-11-28 23:23:03.420287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.420376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.420459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.015 qpair failed and we were unable to recover it. 00:31:00.015 [2024-11-28 23:23:03.420607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.420694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.420721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.015 qpair failed and we were unable to recover it. 00:31:00.015 [2024-11-28 23:23:03.420812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.420892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.420917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.015 qpair failed and we were unable to recover it. 00:31:00.015 [2024-11-28 23:23:03.421015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.421127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.421152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.015 qpair failed and we were unable to recover it. 00:31:00.015 [2024-11-28 23:23:03.421252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.421330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.421354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.015 qpair failed and we were unable to recover it. 00:31:00.015 [2024-11-28 23:23:03.421448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.421542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.421567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.015 qpair failed and we were unable to recover it. 00:31:00.015 [2024-11-28 23:23:03.421704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.421824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.421848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.015 qpair failed and we were unable to recover it. 00:31:00.015 [2024-11-28 23:23:03.421977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.422117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.422141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.015 qpair failed and we were unable to recover it. 00:31:00.015 [2024-11-28 23:23:03.422241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.422332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.422357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.015 qpair failed and we were unable to recover it. 00:31:00.015 [2024-11-28 23:23:03.422494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.422611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.422636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.015 qpair failed and we were unable to recover it. 00:31:00.015 [2024-11-28 23:23:03.422729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.422811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.422836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.015 qpair failed and we were unable to recover it. 00:31:00.015 [2024-11-28 23:23:03.422912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.423032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.423057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.015 qpair failed and we were unable to recover it. 00:31:00.015 [2024-11-28 23:23:03.423170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.423253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.423277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.015 qpair failed and we were unable to recover it. 00:31:00.015 [2024-11-28 23:23:03.423360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.423450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.423474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.015 qpair failed and we were unable to recover it. 00:31:00.015 [2024-11-28 23:23:03.423569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.423685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.423710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.015 qpair failed and we were unable to recover it. 00:31:00.015 [2024-11-28 23:23:03.423820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.423937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.423962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.015 qpair failed and we were unable to recover it. 00:31:00.015 [2024-11-28 23:23:03.424057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.424134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.424159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.015 qpair failed and we were unable to recover it. 00:31:00.015 [2024-11-28 23:23:03.424251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.424337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-11-28 23:23:03.424362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.015 qpair failed and we were unable to recover it. 00:31:00.015 [2024-11-28 23:23:03.424455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.424537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.424563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.016 qpair failed and we were unable to recover it. 00:31:00.016 [2024-11-28 23:23:03.424710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.424798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.424824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.016 qpair failed and we were unable to recover it. 00:31:00.016 [2024-11-28 23:23:03.424941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.425057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.425081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.016 qpair failed and we were unable to recover it. 00:31:00.016 [2024-11-28 23:23:03.425171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.425261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.425286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.016 qpair failed and we were unable to recover it. 00:31:00.016 [2024-11-28 23:23:03.425372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.425490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.425516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.016 qpair failed and we were unable to recover it. 00:31:00.016 [2024-11-28 23:23:03.425629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.425750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.425776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.016 qpair failed and we were unable to recover it. 00:31:00.016 [2024-11-28 23:23:03.425897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.425977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.426004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.016 qpair failed and we were unable to recover it. 00:31:00.016 [2024-11-28 23:23:03.426087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.426168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.426192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.016 qpair failed and we were unable to recover it. 00:31:00.016 [2024-11-28 23:23:03.426273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.426350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.426375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.016 qpair failed and we were unable to recover it. 00:31:00.016 [2024-11-28 23:23:03.426508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.426623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.426648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.016 qpair failed and we were unable to recover it. 00:31:00.016 [2024-11-28 23:23:03.426731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.426826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.426850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.016 qpair failed and we were unable to recover it. 00:31:00.016 [2024-11-28 23:23:03.426930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.427016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.427042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.016 qpair failed and we were unable to recover it. 00:31:00.016 [2024-11-28 23:23:03.427159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.427247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.427272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.016 qpair failed and we were unable to recover it. 00:31:00.016 [2024-11-28 23:23:03.427364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.427491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.427517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.016 qpair failed and we were unable to recover it. 00:31:00.016 [2024-11-28 23:23:03.427609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.427689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.427714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.016 qpair failed and we were unable to recover it. 00:31:00.016 [2024-11-28 23:23:03.427830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.427969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.427994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.016 qpair failed and we were unable to recover it. 00:31:00.016 [2024-11-28 23:23:03.428081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.428193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.428217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.016 qpair failed and we were unable to recover it. 00:31:00.016 [2024-11-28 23:23:03.428302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.428424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.428449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.016 qpair failed and we were unable to recover it. 00:31:00.016 [2024-11-28 23:23:03.428533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.428680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.428711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.016 qpair failed and we were unable to recover it. 00:31:00.016 [2024-11-28 23:23:03.428802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.428877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.428901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.016 qpair failed and we were unable to recover it. 00:31:00.016 [2024-11-28 23:23:03.429014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.429097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.429121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.016 qpair failed and we were unable to recover it. 00:31:00.016 [2024-11-28 23:23:03.429241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.429331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.429356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.016 qpair failed and we were unable to recover it. 00:31:00.016 [2024-11-28 23:23:03.429446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.429561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.429586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.016 qpair failed and we were unable to recover it. 00:31:00.016 [2024-11-28 23:23:03.429667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.429750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.429774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.016 qpair failed and we were unable to recover it. 00:31:00.016 [2024-11-28 23:23:03.429864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.429949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.429975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.016 qpair failed and we were unable to recover it. 00:31:00.016 [2024-11-28 23:23:03.430086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.430203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.430228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.016 qpair failed and we were unable to recover it. 00:31:00.016 [2024-11-28 23:23:03.430307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.430420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.430446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.016 qpair failed and we were unable to recover it. 00:31:00.016 [2024-11-28 23:23:03.430531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.430609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.430635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.016 qpair failed and we were unable to recover it. 00:31:00.016 [2024-11-28 23:23:03.430781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.430867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-11-28 23:23:03.430896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.016 qpair failed and we were unable to recover it. 00:31:00.016 [2024-11-28 23:23:03.430983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.431095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.431119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.017 qpair failed and we were unable to recover it. 00:31:00.017 [2024-11-28 23:23:03.431206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.431321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.431345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.017 qpair failed and we were unable to recover it. 00:31:00.017 [2024-11-28 23:23:03.431483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.431569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.431593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.017 qpair failed and we were unable to recover it. 00:31:00.017 [2024-11-28 23:23:03.431682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.431796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.431820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.017 qpair failed and we were unable to recover it. 00:31:00.017 [2024-11-28 23:23:03.431919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.432003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.432028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.017 qpair failed and we were unable to recover it. 00:31:00.017 [2024-11-28 23:23:03.432176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.432261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.432285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.017 qpair failed and we were unable to recover it. 00:31:00.017 [2024-11-28 23:23:03.432373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.432525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.432551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.017 qpair failed and we were unable to recover it. 00:31:00.017 [2024-11-28 23:23:03.432634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.432761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.432786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.017 qpair failed and we were unable to recover it. 00:31:00.017 [2024-11-28 23:23:03.432873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.432968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.432993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.017 qpair failed and we were unable to recover it. 00:31:00.017 [2024-11-28 23:23:03.433136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.433228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.433253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.017 qpair failed and we were unable to recover it. 00:31:00.017 [2024-11-28 23:23:03.433341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.433439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.433464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.017 qpair failed and we were unable to recover it. 00:31:00.017 [2024-11-28 23:23:03.433562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.433677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.433702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.017 qpair failed and we were unable to recover it. 00:31:00.017 [2024-11-28 23:23:03.433786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.433897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.433922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.017 qpair failed and we were unable to recover it. 00:31:00.017 [2024-11-28 23:23:03.434013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.434104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.434128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.017 qpair failed and we were unable to recover it. 00:31:00.017 [2024-11-28 23:23:03.434237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.434319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.434344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.017 qpair failed and we were unable to recover it. 00:31:00.017 [2024-11-28 23:23:03.434430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.434545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.434572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.017 qpair failed and we were unable to recover it. 00:31:00.017 [2024-11-28 23:23:03.434688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.434803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.434828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.017 qpair failed and we were unable to recover it. 00:31:00.017 [2024-11-28 23:23:03.434916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.434996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.435021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.017 qpair failed and we were unable to recover it. 00:31:00.017 [2024-11-28 23:23:03.435109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.435196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.435221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.017 qpair failed and we were unable to recover it. 00:31:00.017 [2024-11-28 23:23:03.435312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.435404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.435429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.017 qpair failed and we were unable to recover it. 00:31:00.017 [2024-11-28 23:23:03.435552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.435643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.435668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.017 qpair failed and we were unable to recover it. 00:31:00.017 [2024-11-28 23:23:03.435752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.435838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.435863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.017 qpair failed and we were unable to recover it. 00:31:00.017 [2024-11-28 23:23:03.435948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.436061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.436086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.017 qpair failed and we were unable to recover it. 00:31:00.017 [2024-11-28 23:23:03.436172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.436278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.436303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.017 qpair failed and we were unable to recover it. 00:31:00.017 [2024-11-28 23:23:03.436389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.436472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.436496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.017 qpair failed and we were unable to recover it. 00:31:00.017 [2024-11-28 23:23:03.436615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.436711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.017 [2024-11-28 23:23:03.436735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.017 qpair failed and we were unable to recover it. 00:31:00.017 [2024-11-28 23:23:03.436826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.436937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.436961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.018 qpair failed and we were unable to recover it. 00:31:00.018 [2024-11-28 23:23:03.437038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.437125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.437152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.018 qpair failed and we were unable to recover it. 00:31:00.018 [2024-11-28 23:23:03.437248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.437338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.437363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.018 qpair failed and we were unable to recover it. 00:31:00.018 [2024-11-28 23:23:03.437462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.437549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.437574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.018 qpair failed and we were unable to recover it. 00:31:00.018 [2024-11-28 23:23:03.437704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.437793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.437818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.018 qpair failed and we were unable to recover it. 00:31:00.018 [2024-11-28 23:23:03.437906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.438022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.438046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.018 qpair failed and we were unable to recover it. 00:31:00.018 [2024-11-28 23:23:03.438134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.438224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.438249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.018 qpair failed and we were unable to recover it. 00:31:00.018 [2024-11-28 23:23:03.438329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.438428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.438453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.018 qpair failed and we were unable to recover it. 00:31:00.018 [2024-11-28 23:23:03.438539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.438623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.438649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.018 qpair failed and we were unable to recover it. 00:31:00.018 [2024-11-28 23:23:03.438732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.438812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.438836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.018 qpair failed and we were unable to recover it. 00:31:00.018 [2024-11-28 23:23:03.438929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.439044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.439068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.018 qpair failed and we were unable to recover it. 00:31:00.018 [2024-11-28 23:23:03.439164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.439273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.439297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.018 qpair failed and we were unable to recover it. 00:31:00.018 [2024-11-28 23:23:03.439389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.439513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.439537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.018 qpair failed and we were unable to recover it. 00:31:00.018 [2024-11-28 23:23:03.439623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.439717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.439742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.018 qpair failed and we were unable to recover it. 00:31:00.018 [2024-11-28 23:23:03.439829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.439942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.439967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.018 qpair failed and we were unable to recover it. 00:31:00.018 [2024-11-28 23:23:03.440052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.440138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.440163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.018 qpair failed and we were unable to recover it. 00:31:00.018 [2024-11-28 23:23:03.440247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.440337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.440361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.018 qpair failed and we were unable to recover it. 00:31:00.018 [2024-11-28 23:23:03.440462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.440550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.440575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.018 qpair failed and we were unable to recover it. 00:31:00.018 [2024-11-28 23:23:03.440670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.440748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.440774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.018 qpair failed and we were unable to recover it. 00:31:00.018 [2024-11-28 23:23:03.440866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.440958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.440983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.018 qpair failed and we were unable to recover it. 00:31:00.018 [2024-11-28 23:23:03.441064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.441142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.441166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.018 qpair failed and we were unable to recover it. 00:31:00.018 [2024-11-28 23:23:03.441248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.441333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.441358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.018 qpair failed and we were unable to recover it. 00:31:00.018 [2024-11-28 23:23:03.441451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.441565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.441589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.018 qpair failed and we were unable to recover it. 00:31:00.018 [2024-11-28 23:23:03.441697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.441787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.441811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.018 qpair failed and we were unable to recover it. 00:31:00.018 [2024-11-28 23:23:03.441897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.441984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.442013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.018 qpair failed and we were unable to recover it. 00:31:00.018 [2024-11-28 23:23:03.442121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.442237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.442263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.018 qpair failed and we were unable to recover it. 00:31:00.018 [2024-11-28 23:23:03.442349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.442441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.442466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.018 qpair failed and we were unable to recover it. 00:31:00.018 [2024-11-28 23:23:03.442580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.442706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.442731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.018 qpair failed and we were unable to recover it. 00:31:00.018 [2024-11-28 23:23:03.442821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.442911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.442936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.018 qpair failed and we were unable to recover it. 00:31:00.018 [2024-11-28 23:23:03.443052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.018 [2024-11-28 23:23:03.443134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.443158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.019 qpair failed and we were unable to recover it. 00:31:00.019 [2024-11-28 23:23:03.443251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.443361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.443386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.019 qpair failed and we were unable to recover it. 00:31:00.019 [2024-11-28 23:23:03.443477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.443561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.443586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.019 qpair failed and we were unable to recover it. 00:31:00.019 [2024-11-28 23:23:03.443671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.443811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.443836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.019 qpair failed and we were unable to recover it. 00:31:00.019 [2024-11-28 23:23:03.443945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.444031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.444056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.019 qpair failed and we were unable to recover it. 00:31:00.019 [2024-11-28 23:23:03.444163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.444249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.444274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.019 qpair failed and we were unable to recover it. 00:31:00.019 [2024-11-28 23:23:03.444363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.444474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.444500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.019 qpair failed and we were unable to recover it. 00:31:00.019 [2024-11-28 23:23:03.444586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.444710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.444735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.019 qpair failed and we were unable to recover it. 00:31:00.019 [2024-11-28 23:23:03.444822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.444901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.444926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.019 qpair failed and we were unable to recover it. 00:31:00.019 [2024-11-28 23:23:03.445043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.445120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.445146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.019 qpair failed and we were unable to recover it. 00:31:00.019 [2024-11-28 23:23:03.445259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.445340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.445365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.019 qpair failed and we were unable to recover it. 00:31:00.019 [2024-11-28 23:23:03.445464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.445555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.445580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.019 qpair failed and we were unable to recover it. 00:31:00.019 [2024-11-28 23:23:03.445661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.445770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.445795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.019 qpair failed and we were unable to recover it. 00:31:00.019 [2024-11-28 23:23:03.445885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.445962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.445988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.019 qpair failed and we were unable to recover it. 00:31:00.019 [2024-11-28 23:23:03.446101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.446178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.446204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.019 qpair failed and we were unable to recover it. 00:31:00.019 [2024-11-28 23:23:03.446294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.446375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.446407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.019 qpair failed and we were unable to recover it. 00:31:00.019 [2024-11-28 23:23:03.446500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.446585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.446610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.019 qpair failed and we were unable to recover it. 00:31:00.019 [2024-11-28 23:23:03.446714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.446829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.446854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.019 qpair failed and we were unable to recover it. 00:31:00.019 [2024-11-28 23:23:03.446940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.447048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.447074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.019 qpair failed and we were unable to recover it. 00:31:00.019 [2024-11-28 23:23:03.447158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.447251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.447275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.019 qpair failed and we were unable to recover it. 00:31:00.019 [2024-11-28 23:23:03.447360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.447459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.447486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.019 qpair failed and we were unable to recover it. 00:31:00.019 [2024-11-28 23:23:03.447577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.447659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.447683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.019 qpair failed and we were unable to recover it. 00:31:00.019 [2024-11-28 23:23:03.447770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.447881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.447906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.019 qpair failed and we were unable to recover it. 00:31:00.019 [2024-11-28 23:23:03.448024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.448111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.448137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.019 qpair failed and we were unable to recover it. 00:31:00.019 [2024-11-28 23:23:03.448222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.448298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.448323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.019 qpair failed and we were unable to recover it. 00:31:00.019 [2024-11-28 23:23:03.448419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.448502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.448527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.019 qpair failed and we were unable to recover it. 00:31:00.019 [2024-11-28 23:23:03.448636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.448754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.448779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.019 qpair failed and we were unable to recover it. 00:31:00.019 [2024-11-28 23:23:03.448866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.448952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.448976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.019 qpair failed and we were unable to recover it. 00:31:00.019 [2024-11-28 23:23:03.449116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.449224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.449249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.019 qpair failed and we were unable to recover it. 00:31:00.019 [2024-11-28 23:23:03.449332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.019 [2024-11-28 23:23:03.449420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.449446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.020 qpair failed and we were unable to recover it. 00:31:00.020 [2024-11-28 23:23:03.449562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.449646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.449671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.020 qpair failed and we were unable to recover it. 00:31:00.020 [2024-11-28 23:23:03.449753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.449829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.449853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.020 qpair failed and we were unable to recover it. 00:31:00.020 [2024-11-28 23:23:03.449938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.450032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.450057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.020 qpair failed and we were unable to recover it. 00:31:00.020 [2024-11-28 23:23:03.450144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.450223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.450247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.020 qpair failed and we were unable to recover it. 00:31:00.020 [2024-11-28 23:23:03.450342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.450435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.450461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.020 qpair failed and we were unable to recover it. 00:31:00.020 [2024-11-28 23:23:03.450552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.450626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.450652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.020 qpair failed and we were unable to recover it. 00:31:00.020 [2024-11-28 23:23:03.450774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.450860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.450889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.020 qpair failed and we were unable to recover it. 00:31:00.020 [2024-11-28 23:23:03.450972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.451058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.451082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.020 qpair failed and we were unable to recover it. 00:31:00.020 [2024-11-28 23:23:03.451163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.451246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.451270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.020 qpair failed and we were unable to recover it. 00:31:00.020 [2024-11-28 23:23:03.451385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.451477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.451502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.020 qpair failed and we were unable to recover it. 00:31:00.020 [2024-11-28 23:23:03.451613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.451758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.451783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.020 qpair failed and we were unable to recover it. 00:31:00.020 [2024-11-28 23:23:03.451869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.451982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.452008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.020 qpair failed and we were unable to recover it. 00:31:00.020 [2024-11-28 23:23:03.452153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.452268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.452294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.020 qpair failed and we were unable to recover it. 00:31:00.020 [2024-11-28 23:23:03.452380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.452465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.452491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.020 qpair failed and we were unable to recover it. 00:31:00.020 [2024-11-28 23:23:03.452608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.452687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.452711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.020 qpair failed and we were unable to recover it. 00:31:00.020 [2024-11-28 23:23:03.452860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.452950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.452975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.020 qpair failed and we were unable to recover it. 00:31:00.020 [2024-11-28 23:23:03.453119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.453200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.453226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.020 qpair failed and we were unable to recover it. 00:31:00.020 [2024-11-28 23:23:03.453312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.453408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.453433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.020 qpair failed and we were unable to recover it. 00:31:00.020 [2024-11-28 23:23:03.453518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.453659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.453683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.020 qpair failed and we were unable to recover it. 00:31:00.020 [2024-11-28 23:23:03.453774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.453891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.453915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.020 qpair failed and we were unable to recover it. 00:31:00.020 [2024-11-28 23:23:03.454014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.454093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.454118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.020 qpair failed and we were unable to recover it. 00:31:00.020 [2024-11-28 23:23:03.454234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.454376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.454405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.020 qpair failed and we were unable to recover it. 00:31:00.020 [2024-11-28 23:23:03.454492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.454583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.454609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.020 qpair failed and we were unable to recover it. 00:31:00.020 [2024-11-28 23:23:03.454724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.454806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.454831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.020 qpair failed and we were unable to recover it. 00:31:00.020 [2024-11-28 23:23:03.454911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.454985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.455010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.020 qpair failed and we were unable to recover it. 00:31:00.020 [2024-11-28 23:23:03.455094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.455190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.455214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.020 qpair failed and we were unable to recover it. 00:31:00.020 [2024-11-28 23:23:03.455355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.455441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.455466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.020 qpair failed and we were unable to recover it. 00:31:00.020 [2024-11-28 23:23:03.455564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.455646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.455671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.020 qpair failed and we were unable to recover it. 00:31:00.020 [2024-11-28 23:23:03.455752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.455863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.020 [2024-11-28 23:23:03.455888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.021 qpair failed and we were unable to recover it. 00:31:00.021 [2024-11-28 23:23:03.455976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.456054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.456078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.021 qpair failed and we were unable to recover it. 00:31:00.021 [2024-11-28 23:23:03.456170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.456264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.456288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.021 qpair failed and we were unable to recover it. 00:31:00.021 [2024-11-28 23:23:03.456368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.456487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.456513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.021 qpair failed and we were unable to recover it. 00:31:00.021 [2024-11-28 23:23:03.456604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.456701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.456726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.021 qpair failed and we were unable to recover it. 00:31:00.021 [2024-11-28 23:23:03.456811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.456892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.456917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.021 qpair failed and we were unable to recover it. 00:31:00.021 [2024-11-28 23:23:03.457032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.457143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.457167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.021 qpair failed and we were unable to recover it. 00:31:00.021 [2024-11-28 23:23:03.457258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.457349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.457373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.021 qpair failed and we were unable to recover it. 00:31:00.021 [2024-11-28 23:23:03.457475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.457567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.457592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.021 qpair failed and we were unable to recover it. 00:31:00.021 [2024-11-28 23:23:03.457762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.457906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.457935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.021 qpair failed and we were unable to recover it. 00:31:00.021 [2024-11-28 23:23:03.458029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.458124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.458150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.021 qpair failed and we were unable to recover it. 00:31:00.021 [2024-11-28 23:23:03.458235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.458362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.458388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.021 qpair failed and we were unable to recover it. 00:31:00.021 [2024-11-28 23:23:03.458490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.458575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.458600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.021 qpair failed and we were unable to recover it. 00:31:00.021 [2024-11-28 23:23:03.458687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.458770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.458796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.021 qpair failed and we were unable to recover it. 00:31:00.021 [2024-11-28 23:23:03.458880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.458967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.458992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.021 qpair failed and we were unable to recover it. 00:31:00.021 [2024-11-28 23:23:03.459108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.459192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.459217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.021 qpair failed and we were unable to recover it. 00:31:00.021 [2024-11-28 23:23:03.459297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.459398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.459424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.021 qpair failed and we were unable to recover it. 00:31:00.021 [2024-11-28 23:23:03.459505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.459589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.459614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.021 qpair failed and we were unable to recover it. 00:31:00.021 [2024-11-28 23:23:03.459726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.459839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.459864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.021 qpair failed and we were unable to recover it. 00:31:00.021 [2024-11-28 23:23:03.459958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.460040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.460064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.021 qpair failed and we were unable to recover it. 00:31:00.021 [2024-11-28 23:23:03.460146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.460228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.460252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.021 qpair failed and we were unable to recover it. 00:31:00.021 [2024-11-28 23:23:03.460374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.460466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.460490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.021 qpair failed and we were unable to recover it. 00:31:00.021 [2024-11-28 23:23:03.460572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.460681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.460705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.021 qpair failed and we were unable to recover it. 00:31:00.021 [2024-11-28 23:23:03.460790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.460870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.460895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.021 qpair failed and we were unable to recover it. 00:31:00.021 [2024-11-28 23:23:03.460980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.461121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.461146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.021 qpair failed and we were unable to recover it. 00:31:00.021 [2024-11-28 23:23:03.461234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.461351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.461376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.021 qpair failed and we were unable to recover it. 00:31:00.021 [2024-11-28 23:23:03.461523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.461613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.461638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.021 qpair failed and we were unable to recover it. 00:31:00.021 [2024-11-28 23:23:03.461729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.461840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.461865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.021 qpair failed and we were unable to recover it. 00:31:00.021 [2024-11-28 23:23:03.461950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.462096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.462120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.021 qpair failed and we were unable to recover it. 00:31:00.021 [2024-11-28 23:23:03.462242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.462330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.021 [2024-11-28 23:23:03.462359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.021 qpair failed and we were unable to recover it. 00:31:00.021 [2024-11-28 23:23:03.462444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.462558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.462583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.022 qpair failed and we were unable to recover it. 00:31:00.022 [2024-11-28 23:23:03.462700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.462789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.462815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.022 qpair failed and we were unable to recover it. 00:31:00.022 [2024-11-28 23:23:03.462902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.463013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.463039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.022 qpair failed and we were unable to recover it. 00:31:00.022 [2024-11-28 23:23:03.463122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.463236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.463261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.022 qpair failed and we were unable to recover it. 00:31:00.022 [2024-11-28 23:23:03.463377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.463474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.463500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.022 qpair failed and we were unable to recover it. 00:31:00.022 [2024-11-28 23:23:03.463622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.463742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.463767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.022 qpair failed and we were unable to recover it. 00:31:00.022 [2024-11-28 23:23:03.463849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.463932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.463957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.022 qpair failed and we were unable to recover it. 00:31:00.022 [2024-11-28 23:23:03.464077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.464157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.464182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.022 qpair failed and we were unable to recover it. 00:31:00.022 [2024-11-28 23:23:03.464290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.464405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.464430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.022 qpair failed and we were unable to recover it. 00:31:00.022 [2024-11-28 23:23:03.464516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.464602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.464631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.022 qpair failed and we were unable to recover it. 00:31:00.022 [2024-11-28 23:23:03.464714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.464792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.464816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.022 qpair failed and we were unable to recover it. 00:31:00.022 [2024-11-28 23:23:03.464903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.464990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.465014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.022 qpair failed and we were unable to recover it. 00:31:00.022 [2024-11-28 23:23:03.465105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.465186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.465210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.022 qpair failed and we were unable to recover it. 00:31:00.022 [2024-11-28 23:23:03.465327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.465438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.465463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.022 qpair failed and we were unable to recover it. 00:31:00.022 [2024-11-28 23:23:03.465546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.465624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.465648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.022 qpair failed and we were unable to recover it. 00:31:00.022 [2024-11-28 23:23:03.465729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.465815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.465841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.022 qpair failed and we were unable to recover it. 00:31:00.022 [2024-11-28 23:23:03.465938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.466016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.466040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.022 qpair failed and we were unable to recover it. 00:31:00.022 [2024-11-28 23:23:03.466121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.466200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.466224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.022 qpair failed and we were unable to recover it. 00:31:00.022 [2024-11-28 23:23:03.466314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.466404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.466429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.022 qpair failed and we were unable to recover it. 00:31:00.022 [2024-11-28 23:23:03.466547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.466657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.466681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.022 qpair failed and we were unable to recover it. 00:31:00.022 [2024-11-28 23:23:03.466768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.466877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.466902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.022 qpair failed and we were unable to recover it. 00:31:00.022 [2024-11-28 23:23:03.466999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.467108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.467133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.022 qpair failed and we were unable to recover it. 00:31:00.022 [2024-11-28 23:23:03.467225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.467314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.467339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.022 qpair failed and we were unable to recover it. 00:31:00.022 [2024-11-28 23:23:03.467459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.467535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.467560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.022 qpair failed and we were unable to recover it. 00:31:00.022 [2024-11-28 23:23:03.467677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.467788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.467813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.022 qpair failed and we were unable to recover it. 00:31:00.022 [2024-11-28 23:23:03.467899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.467981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.022 [2024-11-28 23:23:03.468005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.022 qpair failed and we were unable to recover it. 00:31:00.023 [2024-11-28 23:23:03.468091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.468175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.468199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.023 qpair failed and we were unable to recover it. 00:31:00.023 [2024-11-28 23:23:03.468294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.468381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.468412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.023 qpair failed and we were unable to recover it. 00:31:00.023 [2024-11-28 23:23:03.468507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.468614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.468639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.023 qpair failed and we were unable to recover it. 00:31:00.023 [2024-11-28 23:23:03.468723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.468839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.468864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.023 qpair failed and we were unable to recover it. 00:31:00.023 [2024-11-28 23:23:03.468994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.469079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.469103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.023 qpair failed and we were unable to recover it. 00:31:00.023 [2024-11-28 23:23:03.469186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.469266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.469291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.023 qpair failed and we were unable to recover it. 00:31:00.023 [2024-11-28 23:23:03.469399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.469512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.469537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.023 qpair failed and we were unable to recover it. 00:31:00.023 [2024-11-28 23:23:03.469617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.469703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.469727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.023 qpair failed and we were unable to recover it. 00:31:00.023 [2024-11-28 23:23:03.469821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.469907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.469933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.023 qpair failed and we were unable to recover it. 00:31:00.023 [2024-11-28 23:23:03.470024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.470108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.470133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.023 qpair failed and we were unable to recover it. 00:31:00.023 [2024-11-28 23:23:03.470212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.470322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.470347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.023 qpair failed and we were unable to recover it. 00:31:00.023 [2024-11-28 23:23:03.470466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.470548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.470574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.023 qpair failed and we were unable to recover it. 00:31:00.023 [2024-11-28 23:23:03.470668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.470780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.470804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.023 qpair failed and we were unable to recover it. 00:31:00.023 [2024-11-28 23:23:03.470879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.470963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.470988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.023 qpair failed and we were unable to recover it. 00:31:00.023 [2024-11-28 23:23:03.471113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.471201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.471226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.023 qpair failed and we were unable to recover it. 00:31:00.023 [2024-11-28 23:23:03.471344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.471449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.471474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.023 qpair failed and we were unable to recover it. 00:31:00.023 [2024-11-28 23:23:03.471551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.471666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.471691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.023 qpair failed and we were unable to recover it. 00:31:00.023 [2024-11-28 23:23:03.471782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.471867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.471894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.023 qpair failed and we were unable to recover it. 00:31:00.023 [2024-11-28 23:23:03.471981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.472095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.472119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.023 qpair failed and we were unable to recover it. 00:31:00.023 [2024-11-28 23:23:03.472206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.472282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.472307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.023 qpair failed and we were unable to recover it. 00:31:00.023 [2024-11-28 23:23:03.472410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.472507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.472532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.023 qpair failed and we were unable to recover it. 00:31:00.023 [2024-11-28 23:23:03.472612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.472696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.472720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.023 qpair failed and we were unable to recover it. 00:31:00.023 [2024-11-28 23:23:03.472816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.472894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.472919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.023 qpair failed and we were unable to recover it. 00:31:00.023 [2024-11-28 23:23:03.472997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.473106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.473132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.023 qpair failed and we were unable to recover it. 00:31:00.023 [2024-11-28 23:23:03.473219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.473326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.473355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.023 qpair failed and we were unable to recover it. 00:31:00.023 [2024-11-28 23:23:03.473442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.473519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.473543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.023 qpair failed and we were unable to recover it. 00:31:00.023 [2024-11-28 23:23:03.473627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.473708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.473732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.023 qpair failed and we were unable to recover it. 00:31:00.023 [2024-11-28 23:23:03.473813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.473933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.473957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.023 qpair failed and we were unable to recover it. 00:31:00.023 [2024-11-28 23:23:03.474043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.474121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.023 [2024-11-28 23:23:03.474147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.023 qpair failed and we were unable to recover it. 00:31:00.023 [2024-11-28 23:23:03.474256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.474370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.474410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.024 qpair failed and we were unable to recover it. 00:31:00.024 [2024-11-28 23:23:03.474504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.474620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.474645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.024 qpair failed and we were unable to recover it. 00:31:00.024 [2024-11-28 23:23:03.474730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.474816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.474840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.024 qpair failed and we were unable to recover it. 00:31:00.024 [2024-11-28 23:23:03.474961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.475075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.475099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.024 qpair failed and we were unable to recover it. 00:31:00.024 [2024-11-28 23:23:03.475215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.475308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.475332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.024 qpair failed and we were unable to recover it. 00:31:00.024 [2024-11-28 23:23:03.475415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.475541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.475565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.024 qpair failed and we were unable to recover it. 00:31:00.024 [2024-11-28 23:23:03.475654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.475736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.475761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.024 qpair failed and we were unable to recover it. 00:31:00.024 [2024-11-28 23:23:03.475851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.475942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.475966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.024 qpair failed and we were unable to recover it. 00:31:00.024 [2024-11-28 23:23:03.476045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.476125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.476149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.024 qpair failed and we were unable to recover it. 00:31:00.024 [2024-11-28 23:23:03.476242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.476354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.476378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.024 qpair failed and we were unable to recover it. 00:31:00.024 [2024-11-28 23:23:03.476475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.476560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.476585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.024 qpair failed and we were unable to recover it. 00:31:00.024 [2024-11-28 23:23:03.476667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.476780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.476804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.024 qpair failed and we were unable to recover it. 00:31:00.024 [2024-11-28 23:23:03.476885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.476967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.476993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.024 qpair failed and we were unable to recover it. 00:31:00.024 [2024-11-28 23:23:03.477092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.477209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.477234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.024 qpair failed and we were unable to recover it. 00:31:00.024 [2024-11-28 23:23:03.477321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.477440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.477467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.024 qpair failed and we were unable to recover it. 00:31:00.024 [2024-11-28 23:23:03.477552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.477637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.477661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.024 qpair failed and we were unable to recover it. 00:31:00.024 [2024-11-28 23:23:03.477751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.477889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.477914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.024 qpair failed and we were unable to recover it. 00:31:00.024 [2024-11-28 23:23:03.477999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.478087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.478112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.024 qpair failed and we were unable to recover it. 00:31:00.024 [2024-11-28 23:23:03.478201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.478283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.478308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.024 qpair failed and we were unable to recover it. 00:31:00.024 [2024-11-28 23:23:03.478454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.478534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.478559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.024 qpair failed and we were unable to recover it. 00:31:00.024 [2024-11-28 23:23:03.478641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.478718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.478743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.024 qpair failed and we were unable to recover it. 00:31:00.024 [2024-11-28 23:23:03.478855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.478931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.478955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.024 qpair failed and we were unable to recover it. 00:31:00.024 [2024-11-28 23:23:03.479045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.479129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.479154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.024 qpair failed and we were unable to recover it. 00:31:00.024 [2024-11-28 23:23:03.479240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.479321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.479345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.024 qpair failed and we were unable to recover it. 00:31:00.024 [2024-11-28 23:23:03.479443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.479536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.479560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.024 qpair failed and we were unable to recover it. 00:31:00.024 [2024-11-28 23:23:03.479650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.479758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.479783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.024 qpair failed and we were unable to recover it. 00:31:00.024 [2024-11-28 23:23:03.479869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.479951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.479977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.024 qpair failed and we were unable to recover it. 00:31:00.024 [2024-11-28 23:23:03.480060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.480173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.480198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.024 qpair failed and we were unable to recover it. 00:31:00.024 [2024-11-28 23:23:03.480281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.480362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.480387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.024 qpair failed and we were unable to recover it. 00:31:00.024 [2024-11-28 23:23:03.480528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.024 [2024-11-28 23:23:03.480613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.480639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.025 qpair failed and we were unable to recover it. 00:31:00.025 [2024-11-28 23:23:03.480759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.480857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.480881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.025 qpair failed and we were unable to recover it. 00:31:00.025 [2024-11-28 23:23:03.480976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.481056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.481081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.025 qpair failed and we were unable to recover it. 00:31:00.025 [2024-11-28 23:23:03.481198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.481314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.481339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.025 qpair failed and we were unable to recover it. 00:31:00.025 [2024-11-28 23:23:03.481420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.481507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.481538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.025 qpair failed and we were unable to recover it. 00:31:00.025 [2024-11-28 23:23:03.481626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.481739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.481764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.025 qpair failed and we were unable to recover it. 00:31:00.025 [2024-11-28 23:23:03.481864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.481950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.481975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.025 qpair failed and we were unable to recover it. 00:31:00.025 [2024-11-28 23:23:03.482058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.482156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.482183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.025 qpair failed and we were unable to recover it. 00:31:00.025 [2024-11-28 23:23:03.482279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.482362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.482387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.025 qpair failed and we were unable to recover it. 00:31:00.025 [2024-11-28 23:23:03.482484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.482577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.482601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.025 qpair failed and we were unable to recover it. 00:31:00.025 [2024-11-28 23:23:03.482715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.482796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.482821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.025 qpair failed and we were unable to recover it. 00:31:00.025 [2024-11-28 23:23:03.482916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.483024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.483049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.025 qpair failed and we were unable to recover it. 00:31:00.025 [2024-11-28 23:23:03.483161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.483270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.483296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.025 qpair failed and we were unable to recover it. 00:31:00.025 [2024-11-28 23:23:03.483382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.483497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.483522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.025 qpair failed and we were unable to recover it. 00:31:00.025 [2024-11-28 23:23:03.483621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.483734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.483759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.025 qpair failed and we were unable to recover it. 00:31:00.025 [2024-11-28 23:23:03.483844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.483924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.483949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.025 qpair failed and we were unable to recover it. 00:31:00.025 [2024-11-28 23:23:03.484033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.484116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.484140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.025 qpair failed and we were unable to recover it. 00:31:00.025 [2024-11-28 23:23:03.484255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.484337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.484366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.025 qpair failed and we were unable to recover it. 00:31:00.025 [2024-11-28 23:23:03.484488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.484569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.484594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.025 qpair failed and we were unable to recover it. 00:31:00.025 [2024-11-28 23:23:03.484707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.484819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.484844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.025 qpair failed and we were unable to recover it. 00:31:00.025 [2024-11-28 23:23:03.484923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.485034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.485058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.025 qpair failed and we were unable to recover it. 00:31:00.025 [2024-11-28 23:23:03.485146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.485253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.485278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.025 qpair failed and we were unable to recover it. 00:31:00.025 [2024-11-28 23:23:03.485356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.485478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.485503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.025 qpair failed and we were unable to recover it. 00:31:00.025 [2024-11-28 23:23:03.485593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.485709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.485734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.025 qpair failed and we were unable to recover it. 00:31:00.025 [2024-11-28 23:23:03.485818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.485899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.485924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.025 qpair failed and we were unable to recover it. 00:31:00.025 [2024-11-28 23:23:03.486032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.486150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.486175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.025 qpair failed and we were unable to recover it. 00:31:00.025 [2024-11-28 23:23:03.486269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.486409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.486435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.025 qpair failed and we were unable to recover it. 00:31:00.025 [2024-11-28 23:23:03.486525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.486600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.486624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.025 qpair failed and we were unable to recover it. 00:31:00.025 [2024-11-28 23:23:03.486705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.486793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.486819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.025 qpair failed and we were unable to recover it. 00:31:00.025 [2024-11-28 23:23:03.486935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.487024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.025 [2024-11-28 23:23:03.487050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.026 qpair failed and we were unable to recover it. 00:31:00.026 [2024-11-28 23:23:03.487157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.487274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.487299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.026 qpair failed and we were unable to recover it. 00:31:00.026 [2024-11-28 23:23:03.487384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.487484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.487509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.026 qpair failed and we were unable to recover it. 00:31:00.026 [2024-11-28 23:23:03.487599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.487713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.487738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.026 qpair failed and we were unable to recover it. 00:31:00.026 [2024-11-28 23:23:03.487820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.487903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.487929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.026 qpair failed and we were unable to recover it. 00:31:00.026 [2024-11-28 23:23:03.488045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.488126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.488151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.026 qpair failed and we were unable to recover it. 00:31:00.026 [2024-11-28 23:23:03.488271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.488355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.488379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.026 qpair failed and we were unable to recover it. 00:31:00.026 [2024-11-28 23:23:03.488474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.488555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.488580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.026 qpair failed and we were unable to recover it. 00:31:00.026 [2024-11-28 23:23:03.488682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.488772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.488797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.026 qpair failed and we were unable to recover it. 00:31:00.026 [2024-11-28 23:23:03.488890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.488971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.488995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.026 qpair failed and we were unable to recover it. 00:31:00.026 [2024-11-28 23:23:03.489076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.489167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.489192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.026 qpair failed and we were unable to recover it. 00:31:00.026 [2024-11-28 23:23:03.489275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.489358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.489383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.026 qpair failed and we were unable to recover it. 00:31:00.026 [2024-11-28 23:23:03.489476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.489554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.489579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.026 qpair failed and we were unable to recover it. 00:31:00.026 [2024-11-28 23:23:03.489666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.489752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.489778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.026 qpair failed and we were unable to recover it. 00:31:00.026 [2024-11-28 23:23:03.489863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.489947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.489972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.026 qpair failed and we were unable to recover it. 00:31:00.026 [2024-11-28 23:23:03.490082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.490159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.490185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.026 qpair failed and we were unable to recover it. 00:31:00.026 [2024-11-28 23:23:03.490270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.490354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.490380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.026 qpair failed and we were unable to recover it. 00:31:00.026 [2024-11-28 23:23:03.490473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.490563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.490588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.026 qpair failed and we were unable to recover it. 00:31:00.026 [2024-11-28 23:23:03.490681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.490762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.490787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.026 qpair failed and we were unable to recover it. 00:31:00.026 [2024-11-28 23:23:03.490879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.490961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.490985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.026 qpair failed and we were unable to recover it. 00:31:00.026 [2024-11-28 23:23:03.491064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.491150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.491174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.026 qpair failed and we were unable to recover it. 00:31:00.026 [2024-11-28 23:23:03.491265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.491385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.491419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.026 qpair failed and we were unable to recover it. 00:31:00.026 [2024-11-28 23:23:03.491506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.491613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.491639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.026 qpair failed and we were unable to recover it. 00:31:00.026 [2024-11-28 23:23:03.491728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.491812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.491837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.026 qpair failed and we were unable to recover it. 00:31:00.026 [2024-11-28 23:23:03.491920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.492032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.492057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.026 qpair failed and we were unable to recover it. 00:31:00.026 [2024-11-28 23:23:03.492140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.492228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.026 [2024-11-28 23:23:03.492253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.026 qpair failed and we were unable to recover it. 00:31:00.026 [2024-11-28 23:23:03.492334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.492419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.492445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.027 qpair failed and we were unable to recover it. 00:31:00.027 [2024-11-28 23:23:03.492536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.492617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.492641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.027 qpair failed and we were unable to recover it. 00:31:00.027 [2024-11-28 23:23:03.492726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.492812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.492837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.027 qpair failed and we were unable to recover it. 00:31:00.027 [2024-11-28 23:23:03.492917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.493009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.493037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.027 qpair failed and we were unable to recover it. 00:31:00.027 [2024-11-28 23:23:03.493131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.493231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.493255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.027 qpair failed and we were unable to recover it. 00:31:00.027 [2024-11-28 23:23:03.493346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.493436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.493462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.027 qpair failed and we were unable to recover it. 00:31:00.027 [2024-11-28 23:23:03.493542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.493623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.493647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.027 qpair failed and we were unable to recover it. 00:31:00.027 [2024-11-28 23:23:03.493738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.493818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.493844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.027 qpair failed and we were unable to recover it. 00:31:00.027 [2024-11-28 23:23:03.493932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.494017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.494042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.027 qpair failed and we were unable to recover it. 00:31:00.027 [2024-11-28 23:23:03.494136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.494222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.494248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.027 qpair failed and we were unable to recover it. 00:31:00.027 [2024-11-28 23:23:03.494334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.494418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.494444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.027 qpair failed and we were unable to recover it. 00:31:00.027 [2024-11-28 23:23:03.494530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.494624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.494650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.027 qpair failed and we were unable to recover it. 00:31:00.027 [2024-11-28 23:23:03.494731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.494806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.494832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.027 qpair failed and we were unable to recover it. 00:31:00.027 [2024-11-28 23:23:03.494915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.495005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.495030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.027 qpair failed and we were unable to recover it. 00:31:00.027 [2024-11-28 23:23:03.495128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.495205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.495231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.027 qpair failed and we were unable to recover it. 00:31:00.027 [2024-11-28 23:23:03.495315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.495429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.495455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.027 qpair failed and we were unable to recover it. 00:31:00.027 [2024-11-28 23:23:03.495542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.495653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.495678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.027 qpair failed and we were unable to recover it. 00:31:00.027 [2024-11-28 23:23:03.495759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.495847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.495873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.027 qpair failed and we were unable to recover it. 00:31:00.027 [2024-11-28 23:23:03.495965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.496048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.496073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.027 qpair failed and we were unable to recover it. 00:31:00.027 [2024-11-28 23:23:03.496156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.496267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.496291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.027 qpair failed and we were unable to recover it. 00:31:00.027 [2024-11-28 23:23:03.496373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.496461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.496486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.027 qpair failed and we were unable to recover it. 00:31:00.027 [2024-11-28 23:23:03.496569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.496652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.496677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.027 qpair failed and we were unable to recover it. 00:31:00.027 [2024-11-28 23:23:03.496780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.496865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.496890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.027 qpair failed and we were unable to recover it. 00:31:00.027 [2024-11-28 23:23:03.497009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.497090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.497114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.027 qpair failed and we were unable to recover it. 00:31:00.027 [2024-11-28 23:23:03.497205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.497295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.497319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.027 qpair failed and we were unable to recover it. 00:31:00.027 [2024-11-28 23:23:03.497415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.497504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.497529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.027 qpair failed and we were unable to recover it. 00:31:00.027 [2024-11-28 23:23:03.497611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.497696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.497723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.027 qpair failed and we were unable to recover it. 00:31:00.027 [2024-11-28 23:23:03.497803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.497883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.497908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.027 qpair failed and we were unable to recover it. 00:31:00.027 [2024-11-28 23:23:03.498001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.498089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.498114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.027 qpair failed and we were unable to recover it. 00:31:00.027 [2024-11-28 23:23:03.498210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.027 [2024-11-28 23:23:03.498296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.498321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.028 qpair failed and we were unable to recover it. 00:31:00.028 [2024-11-28 23:23:03.498403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.498494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.498519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.028 qpair failed and we were unable to recover it. 00:31:00.028 [2024-11-28 23:23:03.498608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.498688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.498713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.028 qpair failed and we were unable to recover it. 00:31:00.028 [2024-11-28 23:23:03.498795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.498876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.498900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.028 qpair failed and we were unable to recover it. 00:31:00.028 [2024-11-28 23:23:03.498981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.499063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.499088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.028 qpair failed and we were unable to recover it. 00:31:00.028 [2024-11-28 23:23:03.499192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.499286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.499312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.028 qpair failed and we were unable to recover it. 00:31:00.028 [2024-11-28 23:23:03.499389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.499480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.499505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.028 qpair failed and we were unable to recover it. 00:31:00.028 [2024-11-28 23:23:03.499592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.499677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.499703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.028 qpair failed and we were unable to recover it. 00:31:00.028 [2024-11-28 23:23:03.499796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.499909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.499935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.028 qpair failed and we were unable to recover it. 00:31:00.028 [2024-11-28 23:23:03.500017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.500101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.500125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.028 qpair failed and we were unable to recover it. 00:31:00.028 [2024-11-28 23:23:03.500207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.500315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.500339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.028 qpair failed and we were unable to recover it. 00:31:00.028 [2024-11-28 23:23:03.500430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.500512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.500537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.028 qpair failed and we were unable to recover it. 00:31:00.028 [2024-11-28 23:23:03.500628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.500709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.500734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.028 qpair failed and we were unable to recover it. 00:31:00.028 [2024-11-28 23:23:03.500823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.500946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.500971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.028 qpair failed and we were unable to recover it. 00:31:00.028 [2024-11-28 23:23:03.501053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.501136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.501162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.028 qpair failed and we were unable to recover it. 00:31:00.028 [2024-11-28 23:23:03.501251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.501342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.501369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.028 qpair failed and we were unable to recover it. 00:31:00.028 [2024-11-28 23:23:03.501468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.501547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.501573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.028 qpair failed and we were unable to recover it. 00:31:00.028 [2024-11-28 23:23:03.501669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.501750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.501775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.028 qpair failed and we were unable to recover it. 00:31:00.028 [2024-11-28 23:23:03.501898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.501982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.502007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.028 qpair failed and we were unable to recover it. 00:31:00.028 [2024-11-28 23:23:03.502099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.502186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.502210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.028 qpair failed and we were unable to recover it. 00:31:00.028 [2024-11-28 23:23:03.502295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.502379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.502424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.028 qpair failed and we were unable to recover it. 00:31:00.028 [2024-11-28 23:23:03.502536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.502620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.502645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.028 qpair failed and we were unable to recover it. 00:31:00.028 [2024-11-28 23:23:03.502735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.502817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.502842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.028 qpair failed and we were unable to recover it. 00:31:00.028 [2024-11-28 23:23:03.502934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.503015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.503039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.028 qpair failed and we were unable to recover it. 00:31:00.028 [2024-11-28 23:23:03.503120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.503212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.503238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.028 qpair failed and we were unable to recover it. 00:31:00.028 [2024-11-28 23:23:03.503323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.503406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.503436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.028 qpair failed and we were unable to recover it. 00:31:00.028 [2024-11-28 23:23:03.503521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.503618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.503642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.028 qpair failed and we were unable to recover it. 00:31:00.028 [2024-11-28 23:23:03.503723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.503808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.503833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.028 qpair failed and we were unable to recover it. 00:31:00.028 [2024-11-28 23:23:03.503918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.504040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.504065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.028 qpair failed and we were unable to recover it. 00:31:00.028 [2024-11-28 23:23:03.504162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.028 [2024-11-28 23:23:03.504280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.504305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.029 qpair failed and we were unable to recover it. 00:31:00.029 [2024-11-28 23:23:03.504403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.504485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.504511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.029 qpair failed and we were unable to recover it. 00:31:00.029 [2024-11-28 23:23:03.504594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.504682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.504706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.029 qpair failed and we were unable to recover it. 00:31:00.029 [2024-11-28 23:23:03.504791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.504873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.504897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.029 qpair failed and we were unable to recover it. 00:31:00.029 [2024-11-28 23:23:03.504980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.505098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.505124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.029 qpair failed and we were unable to recover it. 00:31:00.029 [2024-11-28 23:23:03.505212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.505291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.505317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.029 qpair failed and we were unable to recover it. 00:31:00.029 [2024-11-28 23:23:03.505405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.505488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.505513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.029 qpair failed and we were unable to recover it. 00:31:00.029 [2024-11-28 23:23:03.505603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.505692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.505716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.029 qpair failed and we were unable to recover it. 00:31:00.029 [2024-11-28 23:23:03.505799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.505886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.505911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.029 qpair failed and we were unable to recover it. 00:31:00.029 [2024-11-28 23:23:03.505994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.506113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.506138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.029 qpair failed and we were unable to recover it. 00:31:00.029 [2024-11-28 23:23:03.506230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.506319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.506344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.029 qpair failed and we were unable to recover it. 00:31:00.029 [2024-11-28 23:23:03.506469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.506552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.506578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.029 qpair failed and we were unable to recover it. 00:31:00.029 [2024-11-28 23:23:03.506668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.506744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.506768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.029 qpair failed and we were unable to recover it. 00:31:00.029 [2024-11-28 23:23:03.506864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.506952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.506976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.029 qpair failed and we were unable to recover it. 00:31:00.029 [2024-11-28 23:23:03.507067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.507151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.507175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.029 qpair failed and we were unable to recover it. 00:31:00.029 [2024-11-28 23:23:03.507261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.507343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.507369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.029 qpair failed and we were unable to recover it. 00:31:00.029 [2024-11-28 23:23:03.507479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.507562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.507587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.029 qpair failed and we were unable to recover it. 00:31:00.029 [2024-11-28 23:23:03.507677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.507790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.507814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.029 qpair failed and we were unable to recover it. 00:31:00.029 [2024-11-28 23:23:03.507912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.508005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.508030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.029 qpair failed and we were unable to recover it. 00:31:00.029 [2024-11-28 23:23:03.508111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.508256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.508280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.029 qpair failed and we were unable to recover it. 00:31:00.029 [2024-11-28 23:23:03.508370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.508457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.508482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.029 qpair failed and we were unable to recover it. 00:31:00.029 [2024-11-28 23:23:03.508578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.508670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.508694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.029 qpair failed and we were unable to recover it. 00:31:00.029 [2024-11-28 23:23:03.508779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.508863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.508888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.029 qpair failed and we were unable to recover it. 00:31:00.029 [2024-11-28 23:23:03.508972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.509050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.509074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.029 qpair failed and we were unable to recover it. 00:31:00.029 [2024-11-28 23:23:03.509157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.509249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.509274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.029 qpair failed and we were unable to recover it. 00:31:00.029 [2024-11-28 23:23:03.509368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.509456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.509481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.029 qpair failed and we were unable to recover it. 00:31:00.029 [2024-11-28 23:23:03.509576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.509663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.509688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.029 qpair failed and we were unable to recover it. 00:31:00.029 [2024-11-28 23:23:03.509771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.509885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.509909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.029 qpair failed and we were unable to recover it. 00:31:00.029 [2024-11-28 23:23:03.509999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.510087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.510111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.029 qpair failed and we were unable to recover it. 00:31:00.029 [2024-11-28 23:23:03.510224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.510308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.510332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.029 qpair failed and we were unable to recover it. 00:31:00.029 [2024-11-28 23:23:03.510425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.510513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.510537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.029 qpair failed and we were unable to recover it. 00:31:00.029 [2024-11-28 23:23:03.510632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.510721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.029 [2024-11-28 23:23:03.510746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.029 qpair failed and we were unable to recover it. 00:31:00.029 [2024-11-28 23:23:03.510833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.510916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.510941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.030 qpair failed and we were unable to recover it. 00:31:00.030 [2024-11-28 23:23:03.511061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.511143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.511167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.030 qpair failed and we were unable to recover it. 00:31:00.030 [2024-11-28 23:23:03.511261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.511338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.511363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.030 qpair failed and we were unable to recover it. 00:31:00.030 [2024-11-28 23:23:03.511481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.511566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.511590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.030 qpair failed and we were unable to recover it. 00:31:00.030 [2024-11-28 23:23:03.511683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.511768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.511793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.030 qpair failed and we were unable to recover it. 00:31:00.030 [2024-11-28 23:23:03.511887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.512010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.512035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.030 qpair failed and we were unable to recover it. 00:31:00.030 [2024-11-28 23:23:03.512224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.512310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.512335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.030 qpair failed and we were unable to recover it. 00:31:00.030 [2024-11-28 23:23:03.512425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.512505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.512531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.030 qpair failed and we were unable to recover it. 00:31:00.030 [2024-11-28 23:23:03.512615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.512697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.512722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.030 qpair failed and we were unable to recover it. 00:31:00.030 [2024-11-28 23:23:03.512802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.512892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.512916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.030 qpair failed and we were unable to recover it. 00:31:00.030 [2024-11-28 23:23:03.513002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.513086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.513111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.030 qpair failed and we were unable to recover it. 00:31:00.030 [2024-11-28 23:23:03.513221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.513331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.513356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.030 qpair failed and we were unable to recover it. 00:31:00.030 [2024-11-28 23:23:03.513447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.513527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.513553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.030 qpair failed and we were unable to recover it. 00:31:00.030 [2024-11-28 23:23:03.513637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.513720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.513744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.030 qpair failed and we were unable to recover it. 00:31:00.030 [2024-11-28 23:23:03.513837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.513925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.513950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.030 qpair failed and we were unable to recover it. 00:31:00.030 [2024-11-28 23:23:03.514034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.514123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.514154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.030 qpair failed and we were unable to recover it. 00:31:00.030 [2024-11-28 23:23:03.514241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.514329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.514353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.030 qpair failed and we were unable to recover it. 00:31:00.030 [2024-11-28 23:23:03.514455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.514539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.514566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.030 qpair failed and we were unable to recover it. 00:31:00.030 [2024-11-28 23:23:03.514680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.514765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.514790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.030 qpair failed and we were unable to recover it. 00:31:00.030 [2024-11-28 23:23:03.514876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.514968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.514994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.030 qpair failed and we were unable to recover it. 00:31:00.030 [2024-11-28 23:23:03.515070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.515149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.515174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.030 qpair failed and we were unable to recover it. 00:31:00.030 [2024-11-28 23:23:03.515261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.515374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.515406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.030 qpair failed and we were unable to recover it. 00:31:00.030 [2024-11-28 23:23:03.515502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.515585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.515610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.030 qpair failed and we were unable to recover it. 00:31:00.030 [2024-11-28 23:23:03.515690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.515780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.515804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.030 qpair failed and we were unable to recover it. 00:31:00.030 [2024-11-28 23:23:03.515895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.515983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.516007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.030 qpair failed and we were unable to recover it. 00:31:00.030 [2024-11-28 23:23:03.516092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.516180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.516204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.030 qpair failed and we were unable to recover it. 00:31:00.030 [2024-11-28 23:23:03.516293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.516423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.516449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.030 qpair failed and we were unable to recover it. 00:31:00.030 [2024-11-28 23:23:03.516539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.516629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.516654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.030 qpair failed and we were unable to recover it. 00:31:00.030 [2024-11-28 23:23:03.516737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.516822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.516846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.030 qpair failed and we were unable to recover it. 00:31:00.030 [2024-11-28 23:23:03.516927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.517053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.517077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.030 qpair failed and we were unable to recover it. 00:31:00.030 [2024-11-28 23:23:03.517168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.030 [2024-11-28 23:23:03.517289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.031 [2024-11-28 23:23:03.517313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.031 qpair failed and we were unable to recover it. 00:31:00.031 [2024-11-28 23:23:03.517408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.031 [2024-11-28 23:23:03.517497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.031 [2024-11-28 23:23:03.517521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.031 qpair failed and we were unable to recover it. 00:31:00.031 [2024-11-28 23:23:03.517605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.031 [2024-11-28 23:23:03.517684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.031 [2024-11-28 23:23:03.517709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.031 qpair failed and we were unable to recover it. 00:31:00.031 [2024-11-28 23:23:03.517797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.031 [2024-11-28 23:23:03.517886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.031 [2024-11-28 23:23:03.517911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.031 qpair failed and we were unable to recover it. 00:31:00.031 [2024-11-28 23:23:03.517993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.031 [2024-11-28 23:23:03.518087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.031 [2024-11-28 23:23:03.518111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.031 qpair failed and we were unable to recover it. 00:31:00.031 [2024-11-28 23:23:03.518206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.031 [2024-11-28 23:23:03.518285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.031 [2024-11-28 23:23:03.518309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.031 qpair failed and we were unable to recover it. 00:31:00.031 [2024-11-28 23:23:03.518397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.031 [2024-11-28 23:23:03.518481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.031 [2024-11-28 23:23:03.518507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.031 qpair failed and we were unable to recover it. 00:31:00.031 [2024-11-28 23:23:03.518598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.031 [2024-11-28 23:23:03.518681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.031 [2024-11-28 23:23:03.518707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.031 qpair failed and we were unable to recover it. 00:31:00.031 [2024-11-28 23:23:03.518792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.031 [2024-11-28 23:23:03.518877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.031 [2024-11-28 23:23:03.518901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.031 qpair failed and we were unable to recover it. 00:31:00.031 [2024-11-28 23:23:03.518993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.031 [2024-11-28 23:23:03.519084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.031 [2024-11-28 23:23:03.519110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.031 qpair failed and we were unable to recover it. 00:31:00.031 [2024-11-28 23:23:03.519195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.031 [2024-11-28 23:23:03.519277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.031 [2024-11-28 23:23:03.519302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.031 qpair failed and we were unable to recover it. 00:31:00.031 [2024-11-28 23:23:03.519413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.031 [2024-11-28 23:23:03.519496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.031 [2024-11-28 23:23:03.519521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.031 qpair failed and we were unable to recover it. 00:31:00.031 [2024-11-28 23:23:03.519613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.031 [2024-11-28 23:23:03.519696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.031 [2024-11-28 23:23:03.519720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.031 qpair failed and we were unable to recover it. 00:31:00.031 [2024-11-28 23:23:03.519808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.031 [2024-11-28 23:23:03.519889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.031 [2024-11-28 23:23:03.519914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.031 qpair failed and we were unable to recover it. 00:31:00.031 [2024-11-28 23:23:03.519993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.031 [2024-11-28 23:23:03.520073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.031 [2024-11-28 23:23:03.520098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.031 qpair failed and we were unable to recover it. 00:31:00.031 [2024-11-28 23:23:03.520184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.031 [2024-11-28 23:23:03.520272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.031 [2024-11-28 23:23:03.520297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.031 qpair failed and we were unable to recover it. 00:31:00.031 [2024-11-28 23:23:03.520420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.031 [2024-11-28 23:23:03.520513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.031 [2024-11-28 23:23:03.520538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.031 qpair failed and we were unable to recover it. 00:31:00.031 [2024-11-28 23:23:03.520629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.031 [2024-11-28 23:23:03.520716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.031 [2024-11-28 23:23:03.520740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.031 qpair failed and we were unable to recover it. 00:31:00.031 [2024-11-28 23:23:03.520824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.031 [2024-11-28 23:23:03.520905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.031 [2024-11-28 23:23:03.520930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.031 qpair failed and we were unable to recover it. 00:31:00.031 [2024-11-28 23:23:03.521014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.031 [2024-11-28 23:23:03.521128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.031 [2024-11-28 23:23:03.521153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.031 qpair failed and we were unable to recover it. 00:31:00.031 [2024-11-28 23:23:03.521243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.031 [2024-11-28 23:23:03.521353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.031 [2024-11-28 23:23:03.521378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.031 qpair failed and we were unable to recover it. 00:31:00.031 [2024-11-28 23:23:03.521476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.031 [2024-11-28 23:23:03.521559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.521584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.032 qpair failed and we were unable to recover it. 00:31:00.032 [2024-11-28 23:23:03.521669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.521785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.521809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.032 qpair failed and we were unable to recover it. 00:31:00.032 [2024-11-28 23:23:03.521900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.521987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.522013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.032 qpair failed and we were unable to recover it. 00:31:00.032 [2024-11-28 23:23:03.522096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.522179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.522203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.032 qpair failed and we were unable to recover it. 00:31:00.032 [2024-11-28 23:23:03.522298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.522376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.522406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.032 qpair failed and we were unable to recover it. 00:31:00.032 [2024-11-28 23:23:03.522494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.522583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.522613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.032 qpair failed and we were unable to recover it. 00:31:00.032 [2024-11-28 23:23:03.522700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.522791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.522815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.032 qpair failed and we were unable to recover it. 00:31:00.032 [2024-11-28 23:23:03.522899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.523008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.523033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.032 qpair failed and we were unable to recover it. 00:31:00.032 [2024-11-28 23:23:03.523124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.523214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.523238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.032 qpair failed and we were unable to recover it. 00:31:00.032 [2024-11-28 23:23:03.523325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.523409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.523434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.032 qpair failed and we were unable to recover it. 00:31:00.032 [2024-11-28 23:23:03.523550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.523641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.523666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.032 qpair failed and we were unable to recover it. 00:31:00.032 [2024-11-28 23:23:03.523758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.523845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.523870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.032 qpair failed and we were unable to recover it. 00:31:00.032 [2024-11-28 23:23:03.523963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.524044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.524070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.032 qpair failed and we were unable to recover it. 00:31:00.032 [2024-11-28 23:23:03.524161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.524269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.524295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.032 qpair failed and we were unable to recover it. 00:31:00.032 [2024-11-28 23:23:03.524389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.524480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.524505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.032 qpair failed and we were unable to recover it. 00:31:00.032 [2024-11-28 23:23:03.524586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.524662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.524687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.032 qpair failed and we were unable to recover it. 00:31:00.032 [2024-11-28 23:23:03.524786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.524861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.524885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.032 qpair failed and we were unable to recover it. 00:31:00.032 [2024-11-28 23:23:03.524965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.525058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.525084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.032 qpair failed and we were unable to recover it. 00:31:00.032 [2024-11-28 23:23:03.525168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.525249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.525273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.032 qpair failed and we were unable to recover it. 00:31:00.032 [2024-11-28 23:23:03.525390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.525492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.525516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.032 qpair failed and we were unable to recover it. 00:31:00.032 [2024-11-28 23:23:03.525634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.525724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.525750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.032 qpair failed and we were unable to recover it. 00:31:00.032 [2024-11-28 23:23:03.525851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.525942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.525969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.032 qpair failed and we were unable to recover it. 00:31:00.032 [2024-11-28 23:23:03.526064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.526145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.526170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.032 qpair failed and we were unable to recover it. 00:31:00.032 [2024-11-28 23:23:03.526281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.526372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.526406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.032 qpair failed and we were unable to recover it. 00:31:00.032 [2024-11-28 23:23:03.526491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.526573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.526597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.032 qpair failed and we were unable to recover it. 00:31:00.032 [2024-11-28 23:23:03.526685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.526768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.526793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.032 qpair failed and we were unable to recover it. 00:31:00.032 [2024-11-28 23:23:03.526881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.526963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.526988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.032 qpair failed and we were unable to recover it. 00:31:00.032 [2024-11-28 23:23:03.527079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.527172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.527197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.032 qpair failed and we were unable to recover it. 00:31:00.032 [2024-11-28 23:23:03.527279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.527365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.527390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.032 qpair failed and we were unable to recover it. 00:31:00.032 [2024-11-28 23:23:03.527482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.032 [2024-11-28 23:23:03.527564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.527588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.033 qpair failed and we were unable to recover it. 00:31:00.033 [2024-11-28 23:23:03.527667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.527766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.527792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.033 qpair failed and we were unable to recover it. 00:31:00.033 [2024-11-28 23:23:03.527879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.527959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.527984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.033 qpair failed and we were unable to recover it. 00:31:00.033 [2024-11-28 23:23:03.528069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.528148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.528173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.033 qpair failed and we were unable to recover it. 00:31:00.033 [2024-11-28 23:23:03.528256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.528332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.528357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.033 qpair failed and we were unable to recover it. 00:31:00.033 [2024-11-28 23:23:03.528463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.528550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.528576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.033 qpair failed and we were unable to recover it. 00:31:00.033 [2024-11-28 23:23:03.528661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.528775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.528800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.033 qpair failed and we were unable to recover it. 00:31:00.033 [2024-11-28 23:23:03.528892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.528986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.529010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.033 qpair failed and we were unable to recover it. 00:31:00.033 [2024-11-28 23:23:03.529093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.529171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.529196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.033 qpair failed and we were unable to recover it. 00:31:00.033 [2024-11-28 23:23:03.529274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.529355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.529380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.033 qpair failed and we were unable to recover it. 00:31:00.033 [2024-11-28 23:23:03.529480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.529565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.529589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.033 qpair failed and we were unable to recover it. 00:31:00.033 [2024-11-28 23:23:03.529684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.529765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.529789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.033 qpair failed and we were unable to recover it. 00:31:00.033 [2024-11-28 23:23:03.529884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.529973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.529998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.033 qpair failed and we were unable to recover it. 00:31:00.033 [2024-11-28 23:23:03.530081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.530186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.530211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.033 qpair failed and we were unable to recover it. 00:31:00.033 [2024-11-28 23:23:03.530301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.530417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.530443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.033 qpair failed and we were unable to recover it. 00:31:00.033 [2024-11-28 23:23:03.530532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.530623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.530648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.033 qpair failed and we were unable to recover it. 00:31:00.033 [2024-11-28 23:23:03.530729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.530810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.530835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.033 qpair failed and we were unable to recover it. 00:31:00.033 [2024-11-28 23:23:03.530920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.531007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.531033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.033 qpair failed and we were unable to recover it. 00:31:00.033 [2024-11-28 23:23:03.531124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.531213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.531238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.033 qpair failed and we were unable to recover it. 00:31:00.033 [2024-11-28 23:23:03.531321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.531408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.531433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.033 qpair failed and we were unable to recover it. 00:31:00.033 [2024-11-28 23:23:03.531517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.531598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.531622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.033 qpair failed and we were unable to recover it. 00:31:00.033 [2024-11-28 23:23:03.531708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.531789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.531814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.033 qpair failed and we were unable to recover it. 00:31:00.033 [2024-11-28 23:23:03.531900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.531979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.532003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.033 qpair failed and we were unable to recover it. 00:31:00.033 [2024-11-28 23:23:03.532119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.532206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.532230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.033 qpair failed and we were unable to recover it. 00:31:00.033 [2024-11-28 23:23:03.532323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.532408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.532433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.033 qpair failed and we were unable to recover it. 00:31:00.033 [2024-11-28 23:23:03.532512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.532598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.532622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.033 qpair failed and we were unable to recover it. 00:31:00.033 [2024-11-28 23:23:03.532714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.532819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.532845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.033 qpair failed and we were unable to recover it. 00:31:00.033 [2024-11-28 23:23:03.532935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.533025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.533053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.033 qpair failed and we were unable to recover it. 00:31:00.033 [2024-11-28 23:23:03.533149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.533236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.533261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.033 qpair failed and we were unable to recover it. 00:31:00.033 [2024-11-28 23:23:03.533352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.533443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.533468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.033 qpair failed and we were unable to recover it. 00:31:00.033 [2024-11-28 23:23:03.533554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.533637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.533661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.033 qpair failed and we were unable to recover it. 00:31:00.033 [2024-11-28 23:23:03.533750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.533832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.033 [2024-11-28 23:23:03.533856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.033 qpair failed and we were unable to recover it. 00:31:00.033 [2024-11-28 23:23:03.533950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.534026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.534051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.034 qpair failed and we were unable to recover it. 00:31:00.034 [2024-11-28 23:23:03.534136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.534233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.534258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.034 qpair failed and we were unable to recover it. 00:31:00.034 [2024-11-28 23:23:03.534347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.534439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.534465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.034 qpair failed and we were unable to recover it. 00:31:00.034 [2024-11-28 23:23:03.534557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.534644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.534668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.034 qpair failed and we were unable to recover it. 00:31:00.034 [2024-11-28 23:23:03.534758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.534845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.534871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.034 qpair failed and we were unable to recover it. 00:31:00.034 [2024-11-28 23:23:03.534962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.535086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.535110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.034 qpair failed and we were unable to recover it. 00:31:00.034 [2024-11-28 23:23:03.535203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.535300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.535325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.034 qpair failed and we were unable to recover it. 00:31:00.034 [2024-11-28 23:23:03.535410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.535506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.535532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.034 qpair failed and we were unable to recover it. 00:31:00.034 [2024-11-28 23:23:03.535626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.535742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.535767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.034 qpair failed and we were unable to recover it. 00:31:00.034 [2024-11-28 23:23:03.535852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.535934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.535959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.034 qpair failed and we were unable to recover it. 00:31:00.034 [2024-11-28 23:23:03.536050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.536134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.536160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.034 qpair failed and we were unable to recover it. 00:31:00.034 [2024-11-28 23:23:03.536239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.536320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.536344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.034 qpair failed and we were unable to recover it. 00:31:00.034 [2024-11-28 23:23:03.536433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.536514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.536540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.034 qpair failed and we were unable to recover it. 00:31:00.034 [2024-11-28 23:23:03.536625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.536706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.536730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.034 qpair failed and we were unable to recover it. 00:31:00.034 [2024-11-28 23:23:03.536815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.536929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.536953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.034 qpair failed and we were unable to recover it. 00:31:00.034 [2024-11-28 23:23:03.537042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.537139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.537163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.034 qpair failed and we were unable to recover it. 00:31:00.034 [2024-11-28 23:23:03.537260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.537351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.537376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.034 qpair failed and we were unable to recover it. 00:31:00.034 [2024-11-28 23:23:03.537473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.537556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.537580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.034 qpair failed and we were unable to recover it. 00:31:00.034 [2024-11-28 23:23:03.537670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.537752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.537776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.034 qpair failed and we were unable to recover it. 00:31:00.034 [2024-11-28 23:23:03.537860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.537945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.537970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.034 qpair failed and we were unable to recover it. 00:31:00.034 [2024-11-28 23:23:03.538059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.538170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.538194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.034 qpair failed and we were unable to recover it. 00:31:00.034 [2024-11-28 23:23:03.538290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.538373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.538404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.034 qpair failed and we were unable to recover it. 00:31:00.034 [2024-11-28 23:23:03.538490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.538579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.538603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.034 qpair failed and we were unable to recover it. 00:31:00.034 [2024-11-28 23:23:03.538683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.538768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.538793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.034 qpair failed and we were unable to recover it. 00:31:00.034 [2024-11-28 23:23:03.538885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.538966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.538991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.034 qpair failed and we were unable to recover it. 00:31:00.034 [2024-11-28 23:23:03.539071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.539157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.539182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.034 qpair failed and we were unable to recover it. 00:31:00.034 [2024-11-28 23:23:03.539277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.539361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.539386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.034 qpair failed and we were unable to recover it. 00:31:00.034 [2024-11-28 23:23:03.539478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.539564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.539589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.034 qpair failed and we were unable to recover it. 00:31:00.034 [2024-11-28 23:23:03.539680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.539756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.539781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.034 qpair failed and we were unable to recover it. 00:31:00.034 [2024-11-28 23:23:03.539876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.539956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.539981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.034 qpair failed and we were unable to recover it. 00:31:00.034 [2024-11-28 23:23:03.540070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.540159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.540183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.034 qpair failed and we were unable to recover it. 00:31:00.034 [2024-11-28 23:23:03.540269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.540356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.034 [2024-11-28 23:23:03.540382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.035 qpair failed and we were unable to recover it. 00:31:00.035 [2024-11-28 23:23:03.540471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.540557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.540582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.035 qpair failed and we were unable to recover it. 00:31:00.035 [2024-11-28 23:23:03.540666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.540747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.540771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.035 qpair failed and we were unable to recover it. 00:31:00.035 [2024-11-28 23:23:03.540858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.540946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.540970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.035 qpair failed and we were unable to recover it. 00:31:00.035 [2024-11-28 23:23:03.541056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.541144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.541170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.035 qpair failed and we were unable to recover it. 00:31:00.035 [2024-11-28 23:23:03.541253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.541342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.541367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.035 qpair failed and we were unable to recover it. 00:31:00.035 [2024-11-28 23:23:03.541466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.541552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.541576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.035 qpair failed and we were unable to recover it. 00:31:00.035 [2024-11-28 23:23:03.541654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.541737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.541761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.035 qpair failed and we were unable to recover it. 00:31:00.035 [2024-11-28 23:23:03.541853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.541932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.541956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.035 qpair failed and we were unable to recover it. 00:31:00.035 [2024-11-28 23:23:03.542046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.542175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.542201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.035 qpair failed and we were unable to recover it. 00:31:00.035 [2024-11-28 23:23:03.542281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.542362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.542386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.035 qpair failed and we were unable to recover it. 00:31:00.035 [2024-11-28 23:23:03.542490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.542574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.542598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.035 qpair failed and we were unable to recover it. 00:31:00.035 [2024-11-28 23:23:03.542691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.542777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.542803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.035 qpair failed and we were unable to recover it. 00:31:00.035 [2024-11-28 23:23:03.542881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.542959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.542985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.035 qpair failed and we were unable to recover it. 00:31:00.035 [2024-11-28 23:23:03.543082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.543193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.543218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.035 qpair failed and we were unable to recover it. 00:31:00.035 [2024-11-28 23:23:03.543309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.543426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.543456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.035 qpair failed and we were unable to recover it. 00:31:00.035 [2024-11-28 23:23:03.543545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.543633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.543658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.035 qpair failed and we were unable to recover it. 00:31:00.035 [2024-11-28 23:23:03.543756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.543839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.543864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.035 qpair failed and we were unable to recover it. 00:31:00.035 [2024-11-28 23:23:03.543948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.544029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.544053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.035 qpair failed and we were unable to recover it. 00:31:00.035 [2024-11-28 23:23:03.544139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.544219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.544244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.035 qpair failed and we were unable to recover it. 00:31:00.035 [2024-11-28 23:23:03.544332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.544427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.544452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.035 qpair failed and we were unable to recover it. 00:31:00.035 [2024-11-28 23:23:03.544539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.544622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.544647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.035 qpair failed and we were unable to recover it. 00:31:00.035 [2024-11-28 23:23:03.544730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.544814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.544838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.035 qpair failed and we were unable to recover it. 00:31:00.035 [2024-11-28 23:23:03.544930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.545010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.545035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.035 qpair failed and we were unable to recover it. 00:31:00.035 [2024-11-28 23:23:03.545117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.545200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.545225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.035 qpair failed and we were unable to recover it. 00:31:00.035 [2024-11-28 23:23:03.545315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.545408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.545434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.035 qpair failed and we were unable to recover it. 00:31:00.035 [2024-11-28 23:23:03.545524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.035 [2024-11-28 23:23:03.545609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.545634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.036 qpair failed and we were unable to recover it. 00:31:00.036 [2024-11-28 23:23:03.545714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.545789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.545815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.036 qpair failed and we were unable to recover it. 00:31:00.036 [2024-11-28 23:23:03.545909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.545995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.546019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.036 qpair failed and we were unable to recover it. 00:31:00.036 [2024-11-28 23:23:03.546114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.546194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.546219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.036 qpair failed and we were unable to recover it. 00:31:00.036 [2024-11-28 23:23:03.546314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.546403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.546428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.036 qpair failed and we were unable to recover it. 00:31:00.036 [2024-11-28 23:23:03.546521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.546601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.546625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.036 qpair failed and we were unable to recover it. 00:31:00.036 [2024-11-28 23:23:03.546718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.546800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.546825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.036 qpair failed and we were unable to recover it. 00:31:00.036 [2024-11-28 23:23:03.546914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.547025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.547050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.036 qpair failed and we were unable to recover it. 00:31:00.036 [2024-11-28 23:23:03.547140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.547222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.547247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.036 qpair failed and we were unable to recover it. 00:31:00.036 [2024-11-28 23:23:03.547334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.547448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.547473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.036 qpair failed and we were unable to recover it. 00:31:00.036 [2024-11-28 23:23:03.547560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.547647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.547671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.036 qpair failed and we were unable to recover it. 00:31:00.036 [2024-11-28 23:23:03.547765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.547846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.547871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.036 qpair failed and we were unable to recover it. 00:31:00.036 [2024-11-28 23:23:03.547962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.548044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.548069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.036 qpair failed and we were unable to recover it. 00:31:00.036 [2024-11-28 23:23:03.548158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.548241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.548265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.036 qpair failed and we were unable to recover it. 00:31:00.036 [2024-11-28 23:23:03.548348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.548430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.548455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.036 qpair failed and we were unable to recover it. 00:31:00.036 [2024-11-28 23:23:03.548552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.548643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.548667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.036 qpair failed and we were unable to recover it. 00:31:00.036 [2024-11-28 23:23:03.548832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.548923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.548947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.036 qpair failed and we were unable to recover it. 00:31:00.036 [2024-11-28 23:23:03.549033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.549117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.549142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.036 qpair failed and we were unable to recover it. 00:31:00.036 [2024-11-28 23:23:03.549234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.549318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.549342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.036 qpair failed and we were unable to recover it. 00:31:00.036 [2024-11-28 23:23:03.549438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.549531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.549555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.036 qpair failed and we were unable to recover it. 00:31:00.036 [2024-11-28 23:23:03.549678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.549793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.549818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.036 qpair failed and we were unable to recover it. 00:31:00.036 [2024-11-28 23:23:03.549901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.549980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.550004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.036 qpair failed and we were unable to recover it. 00:31:00.036 [2024-11-28 23:23:03.550088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.550172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.550198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.036 qpair failed and we were unable to recover it. 00:31:00.036 [2024-11-28 23:23:03.550291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.550368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.550398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.036 qpair failed and we were unable to recover it. 00:31:00.036 [2024-11-28 23:23:03.550489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.550573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.550597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.036 qpair failed and we were unable to recover it. 00:31:00.036 [2024-11-28 23:23:03.550684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.550775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.550799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.036 qpair failed and we were unable to recover it. 00:31:00.036 [2024-11-28 23:23:03.550890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.550974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.550999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.036 qpair failed and we were unable to recover it. 00:31:00.036 [2024-11-28 23:23:03.551089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.551178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.551203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.036 qpair failed and we were unable to recover it. 00:31:00.036 [2024-11-28 23:23:03.551286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.551369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.551428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.036 qpair failed and we were unable to recover it. 00:31:00.036 [2024-11-28 23:23:03.551549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.551630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.551654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.036 qpair failed and we were unable to recover it. 00:31:00.036 [2024-11-28 23:23:03.551746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.551824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.551853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.036 qpair failed and we were unable to recover it. 00:31:00.036 [2024-11-28 23:23:03.551940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.552025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.552049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.036 qpair failed and we were unable to recover it. 00:31:00.036 [2024-11-28 23:23:03.552131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.552219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.036 [2024-11-28 23:23:03.552245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.037 qpair failed and we were unable to recover it. 00:31:00.037 [2024-11-28 23:23:03.552333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.552443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.552469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.037 qpair failed and we were unable to recover it. 00:31:00.037 [2024-11-28 23:23:03.552571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.552668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.552692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.037 qpair failed and we were unable to recover it. 00:31:00.037 [2024-11-28 23:23:03.552777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.552861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.552885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.037 qpair failed and we were unable to recover it. 00:31:00.037 [2024-11-28 23:23:03.552974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.553055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.553080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.037 qpair failed and we were unable to recover it. 00:31:00.037 [2024-11-28 23:23:03.553171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.553253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.553277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.037 qpair failed and we were unable to recover it. 00:31:00.037 [2024-11-28 23:23:03.553366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.553454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.553479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.037 qpair failed and we were unable to recover it. 00:31:00.037 [2024-11-28 23:23:03.553573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.553657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.553681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.037 qpair failed and we were unable to recover it. 00:31:00.037 [2024-11-28 23:23:03.553795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.553878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.553903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.037 qpair failed and we were unable to recover it. 00:31:00.037 [2024-11-28 23:23:03.554001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.554092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.554117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.037 qpair failed and we were unable to recover it. 00:31:00.037 [2024-11-28 23:23:03.554237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.554317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.554342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.037 qpair failed and we were unable to recover it. 00:31:00.037 [2024-11-28 23:23:03.554425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.554502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.554527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.037 qpair failed and we were unable to recover it. 00:31:00.037 [2024-11-28 23:23:03.554618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.554705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.554729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.037 qpair failed and we were unable to recover it. 00:31:00.037 [2024-11-28 23:23:03.554822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.554908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.554932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.037 qpair failed and we were unable to recover it. 00:31:00.037 [2024-11-28 23:23:03.555012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.555094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.555119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.037 qpair failed and we were unable to recover it. 00:31:00.037 [2024-11-28 23:23:03.555221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.555306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.555331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.037 qpair failed and we were unable to recover it. 00:31:00.037 [2024-11-28 23:23:03.555432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.555513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.555538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.037 qpair failed and we were unable to recover it. 00:31:00.037 [2024-11-28 23:23:03.555619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.555699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.555724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.037 qpair failed and we were unable to recover it. 00:31:00.037 [2024-11-28 23:23:03.555806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.555898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.555923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.037 qpair failed and we were unable to recover it. 00:31:00.037 [2024-11-28 23:23:03.556024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.556114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.556138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.037 qpair failed and we were unable to recover it. 00:31:00.037 [2024-11-28 23:23:03.556218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.556296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.556320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.037 qpair failed and we were unable to recover it. 00:31:00.037 [2024-11-28 23:23:03.556429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.556511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.556536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.037 qpair failed and we were unable to recover it. 00:31:00.037 [2024-11-28 23:23:03.556626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.556701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.556726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.037 qpair failed and we were unable to recover it. 00:31:00.037 [2024-11-28 23:23:03.556816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.556907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.556931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.037 qpair failed and we were unable to recover it. 00:31:00.037 [2024-11-28 23:23:03.557027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.557106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.557131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.037 qpair failed and we were unable to recover it. 00:31:00.037 [2024-11-28 23:23:03.557244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.557330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.557354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.037 qpair failed and we were unable to recover it. 00:31:00.037 [2024-11-28 23:23:03.557477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.557567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.557591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.037 qpair failed and we were unable to recover it. 00:31:00.037 [2024-11-28 23:23:03.557680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.557762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.557787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.037 qpair failed and we were unable to recover it. 00:31:00.037 [2024-11-28 23:23:03.557875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.557957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.557981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.037 qpair failed and we were unable to recover it. 00:31:00.037 [2024-11-28 23:23:03.558084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.558201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.558243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.037 qpair failed and we were unable to recover it. 00:31:00.037 [2024-11-28 23:23:03.558373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.558489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.558519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.037 qpair failed and we were unable to recover it. 00:31:00.037 [2024-11-28 23:23:03.558623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.558714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.558740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.037 qpair failed and we were unable to recover it. 00:31:00.037 [2024-11-28 23:23:03.558855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.037 [2024-11-28 23:23:03.558967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.038 [2024-11-28 23:23:03.558996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.038 qpair failed and we were unable to recover it. 00:31:00.038 [2024-11-28 23:23:03.559088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.038 [2024-11-28 23:23:03.559182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.038 [2024-11-28 23:23:03.559213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.038 qpair failed and we were unable to recover it. 00:31:00.038 [2024-11-28 23:23:03.559316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.038 [2024-11-28 23:23:03.559455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.038 [2024-11-28 23:23:03.559483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.038 qpair failed and we were unable to recover it. 00:31:00.038 [2024-11-28 23:23:03.559574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.038 [2024-11-28 23:23:03.559661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.038 [2024-11-28 23:23:03.559687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.038 qpair failed and we were unable to recover it. 00:31:00.038 [2024-11-28 23:23:03.559771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.038 [2024-11-28 23:23:03.559864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.038 [2024-11-28 23:23:03.559890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.038 qpair failed and we were unable to recover it. 00:31:00.038 [2024-11-28 23:23:03.559980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.320 [2024-11-28 23:23:03.560066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.320 [2024-11-28 23:23:03.560092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.321 qpair failed and we were unable to recover it. 00:31:00.321 [2024-11-28 23:23:03.560191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.560283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.560308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.321 qpair failed and we were unable to recover it. 00:31:00.321 [2024-11-28 23:23:03.560494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.560585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.560610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.321 qpair failed and we were unable to recover it. 00:31:00.321 [2024-11-28 23:23:03.560713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.560825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.560849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.321 qpair failed and we were unable to recover it. 00:31:00.321 [2024-11-28 23:23:03.560933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.561018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.561044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.321 qpair failed and we were unable to recover it. 00:31:00.321 [2024-11-28 23:23:03.561138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.561222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.561247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.321 qpair failed and we were unable to recover it. 00:31:00.321 [2024-11-28 23:23:03.561341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.561425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.561450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.321 qpair failed and we were unable to recover it. 00:31:00.321 [2024-11-28 23:23:03.561539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.561648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.561672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.321 qpair failed and we were unable to recover it. 00:31:00.321 [2024-11-28 23:23:03.561757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.561842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.561866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.321 qpair failed and we were unable to recover it. 00:31:00.321 [2024-11-28 23:23:03.561967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.562049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.562074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.321 qpair failed and we were unable to recover it. 00:31:00.321 [2024-11-28 23:23:03.562164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.562310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.562335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.321 qpair failed and we were unable to recover it. 00:31:00.321 [2024-11-28 23:23:03.562425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.562516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.562541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.321 qpair failed and we were unable to recover it. 00:31:00.321 [2024-11-28 23:23:03.562628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.562722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.562746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.321 qpair failed and we were unable to recover it. 00:31:00.321 [2024-11-28 23:23:03.562833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.562919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.562945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.321 qpair failed and we were unable to recover it. 00:31:00.321 [2024-11-28 23:23:03.563030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.563154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.563178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.321 qpair failed and we were unable to recover it. 00:31:00.321 [2024-11-28 23:23:03.563264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.563347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.563372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.321 qpair failed and we were unable to recover it. 00:31:00.321 [2024-11-28 23:23:03.563470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.563558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.563584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.321 qpair failed and we were unable to recover it. 00:31:00.321 [2024-11-28 23:23:03.563674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.563754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.563779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.321 qpair failed and we were unable to recover it. 00:31:00.321 [2024-11-28 23:23:03.563899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.563986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.564012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.321 qpair failed and we were unable to recover it. 00:31:00.321 [2024-11-28 23:23:03.564125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.564212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.564239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.321 qpair failed and we were unable to recover it. 00:31:00.321 [2024-11-28 23:23:03.564319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.564415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.564441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.321 qpair failed and we were unable to recover it. 00:31:00.321 [2024-11-28 23:23:03.564542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.564635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.564665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.321 qpair failed and we were unable to recover it. 00:31:00.321 [2024-11-28 23:23:03.564759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.564852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.564882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.321 qpair failed and we were unable to recover it. 00:31:00.321 [2024-11-28 23:23:03.564971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.565061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.565086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.321 qpair failed and we were unable to recover it. 00:31:00.321 [2024-11-28 23:23:03.565183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.565267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.565292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.321 qpair failed and we were unable to recover it. 00:31:00.321 [2024-11-28 23:23:03.565375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.565472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.565497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.321 qpair failed and we were unable to recover it. 00:31:00.321 [2024-11-28 23:23:03.565587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.565672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.565696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.321 qpair failed and we were unable to recover it. 00:31:00.321 [2024-11-28 23:23:03.565777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.565867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.321 [2024-11-28 23:23:03.565892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.321 qpair failed and we were unable to recover it. 00:31:00.321 [2024-11-28 23:23:03.565975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.566102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.566126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.322 qpair failed and we were unable to recover it. 00:31:00.322 [2024-11-28 23:23:03.566208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.566292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.566318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.322 qpair failed and we were unable to recover it. 00:31:00.322 [2024-11-28 23:23:03.566410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.566490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.566515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.322 qpair failed and we were unable to recover it. 00:31:00.322 [2024-11-28 23:23:03.566607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.566693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.566718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.322 qpair failed and we were unable to recover it. 00:31:00.322 [2024-11-28 23:23:03.566800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.566880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.566905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.322 qpair failed and we were unable to recover it. 00:31:00.322 [2024-11-28 23:23:03.567027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.567110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.567136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.322 qpair failed and we were unable to recover it. 00:31:00.322 [2024-11-28 23:23:03.567214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.567305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.567331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.322 qpair failed and we were unable to recover it. 00:31:00.322 [2024-11-28 23:23:03.567421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.567511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.567536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.322 qpair failed and we were unable to recover it. 00:31:00.322 [2024-11-28 23:23:03.567622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.567700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.567724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.322 qpair failed and we were unable to recover it. 00:31:00.322 [2024-11-28 23:23:03.567863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.567949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.567975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.322 qpair failed and we were unable to recover it. 00:31:00.322 [2024-11-28 23:23:03.568066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.568148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.568173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.322 qpair failed and we were unable to recover it. 00:31:00.322 [2024-11-28 23:23:03.568257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.568341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.568365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.322 qpair failed and we were unable to recover it. 00:31:00.322 [2024-11-28 23:23:03.568474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.568558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.568584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.322 qpair failed and we were unable to recover it. 00:31:00.322 [2024-11-28 23:23:03.568671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.568760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.568786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.322 qpair failed and we were unable to recover it. 00:31:00.322 [2024-11-28 23:23:03.568903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.568996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.569021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.322 qpair failed and we were unable to recover it. 00:31:00.322 [2024-11-28 23:23:03.569113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.569193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.569218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.322 qpair failed and we were unable to recover it. 00:31:00.322 [2024-11-28 23:23:03.569335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.569427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.569453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.322 qpair failed and we were unable to recover it. 00:31:00.322 [2024-11-28 23:23:03.569539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.569631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.569656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.322 qpair failed and we were unable to recover it. 00:31:00.322 [2024-11-28 23:23:03.569747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.569829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.569854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.322 qpair failed and we were unable to recover it. 00:31:00.322 [2024-11-28 23:23:03.569939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.570018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.570042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.322 qpair failed and we were unable to recover it. 00:31:00.322 [2024-11-28 23:23:03.570133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.570227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.570252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.322 qpair failed and we were unable to recover it. 00:31:00.322 [2024-11-28 23:23:03.570370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.570466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.570494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.322 qpair failed and we were unable to recover it. 00:31:00.322 [2024-11-28 23:23:03.570588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.570664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.570690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.322 qpair failed and we were unable to recover it. 00:31:00.322 [2024-11-28 23:23:03.570787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.570871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.570896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.322 qpair failed and we were unable to recover it. 00:31:00.322 [2024-11-28 23:23:03.570984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.571096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.571122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.322 qpair failed and we were unable to recover it. 00:31:00.322 [2024-11-28 23:23:03.571219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.571308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.571337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.322 qpair failed and we were unable to recover it. 00:31:00.322 [2024-11-28 23:23:03.571427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.571508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.571534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.322 qpair failed and we were unable to recover it. 00:31:00.322 [2024-11-28 23:23:03.571625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.571705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.571730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.322 qpair failed and we were unable to recover it. 00:31:00.322 [2024-11-28 23:23:03.571809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.571891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.322 [2024-11-28 23:23:03.571917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.322 qpair failed and we were unable to recover it. 00:31:00.322 [2024-11-28 23:23:03.572001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.572086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.572112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.323 qpair failed and we were unable to recover it. 00:31:00.323 [2024-11-28 23:23:03.572198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.572286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.572312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.323 qpair failed and we were unable to recover it. 00:31:00.323 [2024-11-28 23:23:03.572399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.572485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.572509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.323 qpair failed and we were unable to recover it. 00:31:00.323 [2024-11-28 23:23:03.572609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.572695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.572720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.323 qpair failed and we were unable to recover it. 00:31:00.323 [2024-11-28 23:23:03.572835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.572917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.572943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.323 qpair failed and we were unable to recover it. 00:31:00.323 [2024-11-28 23:23:03.573027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.573109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.573134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.323 qpair failed and we were unable to recover it. 00:31:00.323 [2024-11-28 23:23:03.573256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.573342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.573367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.323 qpair failed and we were unable to recover it. 00:31:00.323 [2024-11-28 23:23:03.573461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.573543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.573567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.323 qpair failed and we were unable to recover it. 00:31:00.323 [2024-11-28 23:23:03.573650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.573735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.573760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.323 qpair failed and we were unable to recover it. 00:31:00.323 [2024-11-28 23:23:03.573860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.573944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.573970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.323 qpair failed and we were unable to recover it. 00:31:00.323 [2024-11-28 23:23:03.574050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.574132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.574156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.323 qpair failed and we were unable to recover it. 00:31:00.323 [2024-11-28 23:23:03.574234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.574313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.574338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.323 qpair failed and we were unable to recover it. 00:31:00.323 [2024-11-28 23:23:03.574433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.574515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.574540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.323 qpair failed and we were unable to recover it. 00:31:00.323 [2024-11-28 23:23:03.574626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.574718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.574742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.323 qpair failed and we were unable to recover it. 00:31:00.323 [2024-11-28 23:23:03.574824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.574909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.574935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.323 qpair failed and we were unable to recover it. 00:31:00.323 [2024-11-28 23:23:03.575079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.575171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.575196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.323 qpair failed and we were unable to recover it. 00:31:00.323 [2024-11-28 23:23:03.575281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.575360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.575390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.323 qpair failed and we were unable to recover it. 00:31:00.323 [2024-11-28 23:23:03.575481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.575567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.575593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.323 qpair failed and we were unable to recover it. 00:31:00.323 [2024-11-28 23:23:03.575676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.575758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.575782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.323 qpair failed and we were unable to recover it. 00:31:00.323 [2024-11-28 23:23:03.575868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.575959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.575985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.323 qpair failed and we were unable to recover it. 00:31:00.323 [2024-11-28 23:23:03.576068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.576145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.576169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.323 qpair failed and we were unable to recover it. 00:31:00.323 [2024-11-28 23:23:03.576250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.576332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.576356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.323 qpair failed and we were unable to recover it. 00:31:00.323 [2024-11-28 23:23:03.576453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.576544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.576568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.323 qpair failed and we were unable to recover it. 00:31:00.323 [2024-11-28 23:23:03.576676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.576753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.576777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.323 qpair failed and we were unable to recover it. 00:31:00.323 [2024-11-28 23:23:03.576861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.576946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.576970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.323 qpair failed and we were unable to recover it. 00:31:00.323 [2024-11-28 23:23:03.577055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.577139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.577163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.323 qpair failed and we were unable to recover it. 00:31:00.323 [2024-11-28 23:23:03.577278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.577373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.577405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.323 qpair failed and we were unable to recover it. 00:31:00.323 [2024-11-28 23:23:03.577507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.577593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.577617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.323 qpair failed and we were unable to recover it. 00:31:00.323 [2024-11-28 23:23:03.577694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.577837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.577862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.323 qpair failed and we were unable to recover it. 00:31:00.323 [2024-11-28 23:23:03.577948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.323 [2024-11-28 23:23:03.578031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.578056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.324 qpair failed and we were unable to recover it. 00:31:00.324 [2024-11-28 23:23:03.578146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.578232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.578256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.324 qpair failed and we were unable to recover it. 00:31:00.324 [2024-11-28 23:23:03.578339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.578419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.578445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.324 qpair failed and we were unable to recover it. 00:31:00.324 [2024-11-28 23:23:03.578530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.578654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.578678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.324 qpair failed and we were unable to recover it. 00:31:00.324 [2024-11-28 23:23:03.578758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.578843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.578868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.324 qpair failed and we were unable to recover it. 00:31:00.324 [2024-11-28 23:23:03.578988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.579071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.579097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.324 qpair failed and we were unable to recover it. 00:31:00.324 [2024-11-28 23:23:03.579182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.579258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.579283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.324 qpair failed and we were unable to recover it. 00:31:00.324 [2024-11-28 23:23:03.579377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.579467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.579492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.324 qpair failed and we were unable to recover it. 00:31:00.324 [2024-11-28 23:23:03.579590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.579668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.579693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.324 qpair failed and we were unable to recover it. 00:31:00.324 [2024-11-28 23:23:03.579784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.579867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.579891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.324 qpair failed and we were unable to recover it. 00:31:00.324 [2024-11-28 23:23:03.579983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.580064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.580090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.324 qpair failed and we were unable to recover it. 00:31:00.324 [2024-11-28 23:23:03.580173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.580252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.580276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.324 qpair failed and we were unable to recover it. 00:31:00.324 [2024-11-28 23:23:03.580371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.580477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.580503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.324 qpair failed and we were unable to recover it. 00:31:00.324 [2024-11-28 23:23:03.580598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.580691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.580716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.324 qpair failed and we were unable to recover it. 00:31:00.324 [2024-11-28 23:23:03.580801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.580884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.580909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.324 qpair failed and we were unable to recover it. 00:31:00.324 [2024-11-28 23:23:03.580996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.581087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.581112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.324 qpair failed and we were unable to recover it. 00:31:00.324 [2024-11-28 23:23:03.581197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.581303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.581328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.324 qpair failed and we were unable to recover it. 00:31:00.324 [2024-11-28 23:23:03.581417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.581501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.581525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.324 qpair failed and we were unable to recover it. 00:31:00.324 [2024-11-28 23:23:03.581618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.581717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.581742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.324 qpair failed and we were unable to recover it. 00:31:00.324 [2024-11-28 23:23:03.581823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.581906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.581931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.324 qpair failed and we were unable to recover it. 00:31:00.324 [2024-11-28 23:23:03.582022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.582106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.582130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.324 qpair failed and we were unable to recover it. 00:31:00.324 [2024-11-28 23:23:03.582217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.582326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.582350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.324 qpair failed and we were unable to recover it. 00:31:00.324 [2024-11-28 23:23:03.582446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.582539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.582563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.324 qpair failed and we were unable to recover it. 00:31:00.324 [2024-11-28 23:23:03.582658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.582776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.582801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.324 qpair failed and we were unable to recover it. 00:31:00.324 [2024-11-28 23:23:03.582884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.582995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.583019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.324 qpair failed and we were unable to recover it. 00:31:00.324 [2024-11-28 23:23:03.583103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.583191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.583216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.324 qpair failed and we were unable to recover it. 00:31:00.324 [2024-11-28 23:23:03.583298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.583382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.583414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.324 qpair failed and we were unable to recover it. 00:31:00.324 [2024-11-28 23:23:03.583511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.583588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.583612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.324 qpair failed and we were unable to recover it. 00:31:00.324 [2024-11-28 23:23:03.583703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.583797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.583823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.324 qpair failed and we were unable to recover it. 00:31:00.324 [2024-11-28 23:23:03.583939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.584050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.324 [2024-11-28 23:23:03.584076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.324 qpair failed and we were unable to recover it. 00:31:00.325 [2024-11-28 23:23:03.584157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.325 [2024-11-28 23:23:03.584269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.325 [2024-11-28 23:23:03.584293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.325 qpair failed and we were unable to recover it. 00:31:00.325 [2024-11-28 23:23:03.584382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.325 [2024-11-28 23:23:03.584487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.325 [2024-11-28 23:23:03.584512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.325 qpair failed and we were unable to recover it. 00:31:00.325 [2024-11-28 23:23:03.584595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.325 [2024-11-28 23:23:03.584676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.325 [2024-11-28 23:23:03.584701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.325 qpair failed and we were unable to recover it. 00:31:00.325 [2024-11-28 23:23:03.584840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.325 [2024-11-28 23:23:03.584932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.325 [2024-11-28 23:23:03.584957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.325 qpair failed and we were unable to recover it. 00:31:00.325 [2024-11-28 23:23:03.585048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.325 [2024-11-28 23:23:03.585126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.325 [2024-11-28 23:23:03.585150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.325 qpair failed and we were unable to recover it. 00:31:00.325 [2024-11-28 23:23:03.585246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.325 [2024-11-28 23:23:03.585367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.325 [2024-11-28 23:23:03.585413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.325 qpair failed and we were unable to recover it. 00:31:00.325 [2024-11-28 23:23:03.585537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.325 [2024-11-28 23:23:03.585619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.325 [2024-11-28 23:23:03.585643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.325 qpair failed and we were unable to recover it. 00:31:00.325 [2024-11-28 23:23:03.585741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.325 [2024-11-28 23:23:03.585862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.325 [2024-11-28 23:23:03.585887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.325 qpair failed and we were unable to recover it. 00:31:00.325 [2024-11-28 23:23:03.585981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.325 [2024-11-28 23:23:03.586069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.325 [2024-11-28 23:23:03.586098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.325 qpair failed and we were unable to recover it. 00:31:00.325 [2024-11-28 23:23:03.586182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.325 [2024-11-28 23:23:03.586268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.325 [2024-11-28 23:23:03.586292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.325 qpair failed and we were unable to recover it. 00:31:00.325 [2024-11-28 23:23:03.586388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.325 [2024-11-28 23:23:03.586518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.325 [2024-11-28 23:23:03.586542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.325 qpair failed and we were unable to recover it. 00:31:00.325 [2024-11-28 23:23:03.586655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.325 [2024-11-28 23:23:03.586744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.325 [2024-11-28 23:23:03.586769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.325 qpair failed and we were unable to recover it. 00:31:00.325 [2024-11-28 23:23:03.586860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.325 [2024-11-28 23:23:03.586950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.325 [2024-11-28 23:23:03.586975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.325 qpair failed and we were unable to recover it. 00:31:00.325 [2024-11-28 23:23:03.587066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.325 [2024-11-28 23:23:03.587144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.325 [2024-11-28 23:23:03.587168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.325 qpair failed and we were unable to recover it. 00:31:00.325 [2024-11-28 23:23:03.587257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.325 [2024-11-28 23:23:03.587340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.325 [2024-11-28 23:23:03.587365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.325 qpair failed and we were unable to recover it. 00:31:00.325 [2024-11-28 23:23:03.587455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.325 [2024-11-28 23:23:03.587564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.325 [2024-11-28 23:23:03.587588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.325 qpair failed and we were unable to recover it. 00:31:00.325 [2024-11-28 23:23:03.587681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.325 [2024-11-28 23:23:03.587811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.325 [2024-11-28 23:23:03.587837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.325 qpair failed and we were unable to recover it. 00:31:00.325 [2024-11-28 23:23:03.587926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.325 [2024-11-28 23:23:03.588013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.325 [2024-11-28 23:23:03.588040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.325 qpair failed and we were unable to recover it. 00:31:00.325 [2024-11-28 23:23:03.588117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.325 [2024-11-28 23:23:03.588200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.325 [2024-11-28 23:23:03.588224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.325 qpair failed and we were unable to recover it. 00:31:00.325 [2024-11-28 23:23:03.588318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.325 [2024-11-28 23:23:03.588427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.325 [2024-11-28 23:23:03.588452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.325 qpair failed and we were unable to recover it. 00:31:00.325 [2024-11-28 23:23:03.588550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.325 [2024-11-28 23:23:03.588630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.325 [2024-11-28 23:23:03.588654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.325 qpair failed and we were unable to recover it. 00:31:00.325 [2024-11-28 23:23:03.588739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.325 [2024-11-28 23:23:03.588820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.325 [2024-11-28 23:23:03.588845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.325 qpair failed and we were unable to recover it. 00:31:00.325 [2024-11-28 23:23:03.588933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.325 [2024-11-28 23:23:03.589012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.325 [2024-11-28 23:23:03.589036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.325 qpair failed and we were unable to recover it. 00:31:00.325 [2024-11-28 23:23:03.589146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.589240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.589264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.326 qpair failed and we were unable to recover it. 00:31:00.326 [2024-11-28 23:23:03.589351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.589451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.589477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.326 qpair failed and we were unable to recover it. 00:31:00.326 [2024-11-28 23:23:03.589561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.589645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.589669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.326 qpair failed and we were unable to recover it. 00:31:00.326 [2024-11-28 23:23:03.589750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.589858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.589882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.326 qpair failed and we were unable to recover it. 00:31:00.326 [2024-11-28 23:23:03.589970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.590049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.590073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.326 qpair failed and we were unable to recover it. 00:31:00.326 [2024-11-28 23:23:03.590160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.590291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.590316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.326 qpair failed and we were unable to recover it. 00:31:00.326 [2024-11-28 23:23:03.590407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.590493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.590518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.326 qpair failed and we were unable to recover it. 00:31:00.326 [2024-11-28 23:23:03.590608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.590691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.590716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.326 qpair failed and we were unable to recover it. 00:31:00.326 [2024-11-28 23:23:03.590802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.590888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.590913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.326 qpair failed and we were unable to recover it. 00:31:00.326 [2024-11-28 23:23:03.590990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.591078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.591101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.326 qpair failed and we were unable to recover it. 00:31:00.326 [2024-11-28 23:23:03.591189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.591278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.591302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.326 qpair failed and we were unable to recover it. 00:31:00.326 [2024-11-28 23:23:03.591391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.591503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.591528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.326 qpair failed and we were unable to recover it. 00:31:00.326 [2024-11-28 23:23:03.591622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.591711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.591735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.326 qpair failed and we were unable to recover it. 00:31:00.326 [2024-11-28 23:23:03.591823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.591943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.591968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.326 qpair failed and we were unable to recover it. 00:31:00.326 [2024-11-28 23:23:03.592052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.592139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.592164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.326 qpair failed and we were unable to recover it. 00:31:00.326 [2024-11-28 23:23:03.592278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.592391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.592425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.326 qpair failed and we were unable to recover it. 00:31:00.326 [2024-11-28 23:23:03.592514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.592604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.592629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.326 qpair failed and we were unable to recover it. 00:31:00.326 [2024-11-28 23:23:03.592719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.592803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.592828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.326 qpair failed and we were unable to recover it. 00:31:00.326 [2024-11-28 23:23:03.592921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.593060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.593084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.326 qpair failed and we were unable to recover it. 00:31:00.326 [2024-11-28 23:23:03.593172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.593265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.593289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.326 qpair failed and we were unable to recover it. 00:31:00.326 [2024-11-28 23:23:03.593379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.593504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.593528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.326 qpair failed and we were unable to recover it. 00:31:00.326 [2024-11-28 23:23:03.593613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.593694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.593718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.326 qpair failed and we were unable to recover it. 00:31:00.326 [2024-11-28 23:23:03.593800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.593887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.593911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.326 qpair failed and we were unable to recover it. 00:31:00.326 [2024-11-28 23:23:03.593995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.594106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.594130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.326 qpair failed and we were unable to recover it. 00:31:00.326 [2024-11-28 23:23:03.594215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.594309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.594333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.326 qpair failed and we were unable to recover it. 00:31:00.326 [2024-11-28 23:23:03.594422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.594509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.594534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.326 qpair failed and we were unable to recover it. 00:31:00.326 [2024-11-28 23:23:03.594618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.594706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.594731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.326 qpair failed and we were unable to recover it. 00:31:00.326 [2024-11-28 23:23:03.594816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.594926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.594951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.326 qpair failed and we were unable to recover it. 00:31:00.326 [2024-11-28 23:23:03.595038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.595121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.595145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.326 qpair failed and we were unable to recover it. 00:31:00.326 [2024-11-28 23:23:03.595241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.326 [2024-11-28 23:23:03.595327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.595352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.327 qpair failed and we were unable to recover it. 00:31:00.327 [2024-11-28 23:23:03.595471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.595567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.595591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.327 qpair failed and we were unable to recover it. 00:31:00.327 [2024-11-28 23:23:03.595677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.595761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.595786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.327 qpair failed and we were unable to recover it. 00:31:00.327 [2024-11-28 23:23:03.595884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.595997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.596022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.327 qpair failed and we were unable to recover it. 00:31:00.327 [2024-11-28 23:23:03.596109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.596186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.596211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.327 qpair failed and we were unable to recover it. 00:31:00.327 [2024-11-28 23:23:03.596290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.596372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.596424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.327 qpair failed and we were unable to recover it. 00:31:00.327 [2024-11-28 23:23:03.596527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.596609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.596634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.327 qpair failed and we were unable to recover it. 00:31:00.327 [2024-11-28 23:23:03.596721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.596817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.596845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.327 qpair failed and we were unable to recover it. 00:31:00.327 [2024-11-28 23:23:03.596960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.597052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.597076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.327 qpair failed and we were unable to recover it. 00:31:00.327 [2024-11-28 23:23:03.597168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.597256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.597281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.327 qpair failed and we were unable to recover it. 00:31:00.327 [2024-11-28 23:23:03.597362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.597451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.597477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.327 qpair failed and we were unable to recover it. 00:31:00.327 [2024-11-28 23:23:03.597564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.597646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.597671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.327 qpair failed and we were unable to recover it. 00:31:00.327 [2024-11-28 23:23:03.597755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.597840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.597866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.327 qpair failed and we were unable to recover it. 00:31:00.327 [2024-11-28 23:23:03.597953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.598151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.598176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.327 qpair failed and we were unable to recover it. 00:31:00.327 [2024-11-28 23:23:03.598270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.598381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.598415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.327 qpair failed and we were unable to recover it. 00:31:00.327 [2024-11-28 23:23:03.598503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.598592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.598617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.327 qpair failed and we were unable to recover it. 00:31:00.327 [2024-11-28 23:23:03.598702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.598786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.598811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.327 qpair failed and we were unable to recover it. 00:31:00.327 [2024-11-28 23:23:03.598923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.599012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.599038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.327 qpair failed and we were unable to recover it. 00:31:00.327 [2024-11-28 23:23:03.599132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.599217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.599242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.327 qpair failed and we were unable to recover it. 00:31:00.327 [2024-11-28 23:23:03.599355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.599447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.599473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.327 qpair failed and we were unable to recover it. 00:31:00.327 [2024-11-28 23:23:03.599557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.599635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.599660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.327 qpair failed and we were unable to recover it. 00:31:00.327 [2024-11-28 23:23:03.599782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.599874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.599899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.327 qpair failed and we were unable to recover it. 00:31:00.327 [2024-11-28 23:23:03.599978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.600084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.600108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.327 qpair failed and we were unable to recover it. 00:31:00.327 [2024-11-28 23:23:03.600191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.600274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.600298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.327 qpair failed and we were unable to recover it. 00:31:00.327 [2024-11-28 23:23:03.600384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.600478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.600504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.327 qpair failed and we were unable to recover it. 00:31:00.327 [2024-11-28 23:23:03.600587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.600699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.600724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.327 qpair failed and we were unable to recover it. 00:31:00.327 [2024-11-28 23:23:03.600839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.600930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.600954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.327 qpair failed and we were unable to recover it. 00:31:00.327 [2024-11-28 23:23:03.601045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.601129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.601153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.327 qpair failed and we were unable to recover it. 00:31:00.327 [2024-11-28 23:23:03.601238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.601322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.601347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.327 qpair failed and we were unable to recover it. 00:31:00.327 [2024-11-28 23:23:03.601434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.327 [2024-11-28 23:23:03.601547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.601573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.328 qpair failed and we were unable to recover it. 00:31:00.328 [2024-11-28 23:23:03.601717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.601799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.601824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.328 qpair failed and we were unable to recover it. 00:31:00.328 [2024-11-28 23:23:03.601901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.601986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.602011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.328 qpair failed and we were unable to recover it. 00:31:00.328 [2024-11-28 23:23:03.602099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.602212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.602236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.328 qpair failed and we were unable to recover it. 00:31:00.328 [2024-11-28 23:23:03.602331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.602445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.602470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.328 qpair failed and we were unable to recover it. 00:31:00.328 [2024-11-28 23:23:03.602586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.602676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.602701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.328 qpair failed and we were unable to recover it. 00:31:00.328 [2024-11-28 23:23:03.602781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.602865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.602891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.328 qpair failed and we were unable to recover it. 00:31:00.328 [2024-11-28 23:23:03.602987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.603099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.603126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.328 qpair failed and we were unable to recover it. 00:31:00.328 [2024-11-28 23:23:03.603216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.603300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.603325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.328 qpair failed and we were unable to recover it. 00:31:00.328 [2024-11-28 23:23:03.603433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.603517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.603542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.328 qpair failed and we were unable to recover it. 00:31:00.328 [2024-11-28 23:23:03.603641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.603726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.603750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.328 qpair failed and we were unable to recover it. 00:31:00.328 [2024-11-28 23:23:03.603865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.603979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.604003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.328 qpair failed and we were unable to recover it. 00:31:00.328 [2024-11-28 23:23:03.604093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.604206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.604231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.328 qpair failed and we were unable to recover it. 00:31:00.328 [2024-11-28 23:23:03.604313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.604403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.604428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.328 qpair failed and we were unable to recover it. 00:31:00.328 [2024-11-28 23:23:03.604513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.604597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.604622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.328 qpair failed and we were unable to recover it. 00:31:00.328 [2024-11-28 23:23:03.604703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.604785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.604809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.328 qpair failed and we were unable to recover it. 00:31:00.328 [2024-11-28 23:23:03.604924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.605002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.605026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.328 qpair failed and we were unable to recover it. 00:31:00.328 [2024-11-28 23:23:03.605114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.605207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.605231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.328 qpair failed and we were unable to recover it. 00:31:00.328 [2024-11-28 23:23:03.605318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.605416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.605442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.328 qpair failed and we were unable to recover it. 00:31:00.328 [2024-11-28 23:23:03.605532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.605607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.605637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.328 qpair failed and we were unable to recover it. 00:31:00.328 [2024-11-28 23:23:03.605752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.605864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.605890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.328 qpair failed and we were unable to recover it. 00:31:00.328 [2024-11-28 23:23:03.605983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.606100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.606124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.328 qpair failed and we were unable to recover it. 00:31:00.328 [2024-11-28 23:23:03.606210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.606322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.606346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.328 qpair failed and we were unable to recover it. 00:31:00.328 [2024-11-28 23:23:03.606471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.606557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.606582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.328 qpair failed and we were unable to recover it. 00:31:00.328 [2024-11-28 23:23:03.606674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.606758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.606782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.328 qpair failed and we were unable to recover it. 00:31:00.328 [2024-11-28 23:23:03.606894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.606975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.606999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.328 qpair failed and we were unable to recover it. 00:31:00.328 [2024-11-28 23:23:03.607089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.607207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.607232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.328 qpair failed and we were unable to recover it. 00:31:00.328 [2024-11-28 23:23:03.607317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.607434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.607460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.328 qpair failed and we were unable to recover it. 00:31:00.328 [2024-11-28 23:23:03.607551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.607636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.607661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.328 qpair failed and we were unable to recover it. 00:31:00.328 [2024-11-28 23:23:03.607763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.607879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.328 [2024-11-28 23:23:03.607903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.329 qpair failed and we were unable to recover it. 00:31:00.329 [2024-11-28 23:23:03.608022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.608105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.608129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.329 qpair failed and we were unable to recover it. 00:31:00.329 [2024-11-28 23:23:03.608211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.608329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.608355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.329 qpair failed and we were unable to recover it. 00:31:00.329 [2024-11-28 23:23:03.608447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.608530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.608555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.329 qpair failed and we were unable to recover it. 00:31:00.329 [2024-11-28 23:23:03.608672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.608752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.608776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.329 qpair failed and we were unable to recover it. 00:31:00.329 [2024-11-28 23:23:03.608863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.608953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.608979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.329 qpair failed and we were unable to recover it. 00:31:00.329 [2024-11-28 23:23:03.609067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.609161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.609186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.329 qpair failed and we were unable to recover it. 00:31:00.329 [2024-11-28 23:23:03.609270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.609384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.609416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.329 qpair failed and we were unable to recover it. 00:31:00.329 [2024-11-28 23:23:03.609509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.609606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.609632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.329 qpair failed and we were unable to recover it. 00:31:00.329 [2024-11-28 23:23:03.609716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.609832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.609858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.329 qpair failed and we were unable to recover it. 00:31:00.329 [2024-11-28 23:23:03.609971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.610062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.610086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.329 qpair failed and we were unable to recover it. 00:31:00.329 [2024-11-28 23:23:03.610182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.610265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.610301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.329 qpair failed and we were unable to recover it. 00:31:00.329 [2024-11-28 23:23:03.610386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.610477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.610503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.329 qpair failed and we were unable to recover it. 00:31:00.329 [2024-11-28 23:23:03.610584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.610693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.610717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.329 qpair failed and we were unable to recover it. 00:31:00.329 [2024-11-28 23:23:03.610799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.610885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.610910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.329 qpair failed and we were unable to recover it. 00:31:00.329 [2024-11-28 23:23:03.610997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.611089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.611114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.329 qpair failed and we were unable to recover it. 00:31:00.329 [2024-11-28 23:23:03.611199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.611311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.611336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.329 qpair failed and we were unable to recover it. 00:31:00.329 [2024-11-28 23:23:03.611430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.611520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.611545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.329 qpair failed and we were unable to recover it. 00:31:00.329 [2024-11-28 23:23:03.611636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.611724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.611748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.329 qpair failed and we were unable to recover it. 00:31:00.329 [2024-11-28 23:23:03.611831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.611928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.611952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.329 qpair failed and we were unable to recover it. 00:31:00.329 [2024-11-28 23:23:03.612066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.612141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.612167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.329 qpair failed and we were unable to recover it. 00:31:00.329 [2024-11-28 23:23:03.612298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.612409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.612440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.329 qpair failed and we were unable to recover it. 00:31:00.329 [2024-11-28 23:23:03.612532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.612617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.612643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.329 qpair failed and we were unable to recover it. 00:31:00.329 [2024-11-28 23:23:03.612743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.612845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.612872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.329 qpair failed and we were unable to recover it. 00:31:00.329 [2024-11-28 23:23:03.612951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.613039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.613067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.329 qpair failed and we were unable to recover it. 00:31:00.329 [2024-11-28 23:23:03.613162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.613245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.613270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.329 qpair failed and we were unable to recover it. 00:31:00.329 [2024-11-28 23:23:03.613387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.613496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.613525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.329 qpair failed and we were unable to recover it. 00:31:00.329 [2024-11-28 23:23:03.613609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.613698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.613724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.329 qpair failed and we were unable to recover it. 00:31:00.329 [2024-11-28 23:23:03.613841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.613932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.613958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.329 qpair failed and we were unable to recover it. 00:31:00.329 [2024-11-28 23:23:03.614045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.614134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.329 [2024-11-28 23:23:03.614160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.329 qpair failed and we were unable to recover it. 00:31:00.330 [2024-11-28 23:23:03.614246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.614325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.614352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.330 qpair failed and we were unable to recover it. 00:31:00.330 [2024-11-28 23:23:03.614471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.614586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.614612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.330 qpair failed and we were unable to recover it. 00:31:00.330 [2024-11-28 23:23:03.614715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.614806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.614831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.330 qpair failed and we were unable to recover it. 00:31:00.330 [2024-11-28 23:23:03.614919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.615024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.615048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.330 qpair failed and we were unable to recover it. 00:31:00.330 [2024-11-28 23:23:03.615139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.615224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.615249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.330 qpair failed and we were unable to recover it. 00:31:00.330 [2024-11-28 23:23:03.615333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.615441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.615467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.330 qpair failed and we were unable to recover it. 00:31:00.330 [2024-11-28 23:23:03.615549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.615628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.615653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.330 qpair failed and we were unable to recover it. 00:31:00.330 [2024-11-28 23:23:03.615739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.615828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.615852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.330 qpair failed and we were unable to recover it. 00:31:00.330 [2024-11-28 23:23:03.615942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.616023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.616048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.330 qpair failed and we were unable to recover it. 00:31:00.330 [2024-11-28 23:23:03.616126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.616266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.616291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.330 qpair failed and we were unable to recover it. 00:31:00.330 [2024-11-28 23:23:03.616380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.616472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.616497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.330 qpair failed and we were unable to recover it. 00:31:00.330 [2024-11-28 23:23:03.616612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.616728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.616753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.330 qpair failed and we were unable to recover it. 00:31:00.330 [2024-11-28 23:23:03.616840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.616922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.616947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.330 qpair failed and we were unable to recover it. 00:31:00.330 [2024-11-28 23:23:03.617063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.617145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.617169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.330 qpair failed and we were unable to recover it. 00:31:00.330 [2024-11-28 23:23:03.617257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.617333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.617358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.330 qpair failed and we were unable to recover it. 00:31:00.330 [2024-11-28 23:23:03.617473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.617553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.617578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.330 qpair failed and we were unable to recover it. 00:31:00.330 [2024-11-28 23:23:03.617664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.617779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.617804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.330 qpair failed and we were unable to recover it. 00:31:00.330 [2024-11-28 23:23:03.617918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.618004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.618028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.330 qpair failed and we were unable to recover it. 00:31:00.330 [2024-11-28 23:23:03.618107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.618197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.618223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.330 qpair failed and we were unable to recover it. 00:31:00.330 [2024-11-28 23:23:03.618314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.618423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.618449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.330 qpair failed and we were unable to recover it. 00:31:00.330 [2024-11-28 23:23:03.618536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.618623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.618648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.330 qpair failed and we were unable to recover it. 00:31:00.330 [2024-11-28 23:23:03.618758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.618845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.618873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.330 qpair failed and we were unable to recover it. 00:31:00.330 [2024-11-28 23:23:03.618959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.619077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.619102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.330 qpair failed and we were unable to recover it. 00:31:00.330 [2024-11-28 23:23:03.619191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.619273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.619297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.330 qpair failed and we were unable to recover it. 00:31:00.330 [2024-11-28 23:23:03.619414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.619505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.619529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.330 qpair failed and we were unable to recover it. 00:31:00.330 [2024-11-28 23:23:03.619611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.619732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.330 [2024-11-28 23:23:03.619756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.331 qpair failed and we were unable to recover it. 00:31:00.331 [2024-11-28 23:23:03.619840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.619921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.619945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.331 qpair failed and we were unable to recover it. 00:31:00.331 [2024-11-28 23:23:03.620031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.620117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.620141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.331 qpair failed and we were unable to recover it. 00:31:00.331 [2024-11-28 23:23:03.620223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.620317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.620343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.331 qpair failed and we were unable to recover it. 00:31:00.331 [2024-11-28 23:23:03.620440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.620554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.620579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.331 qpair failed and we were unable to recover it. 00:31:00.331 [2024-11-28 23:23:03.620666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.620755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.620780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.331 qpair failed and we were unable to recover it. 00:31:00.331 [2024-11-28 23:23:03.620878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.620964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.620988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.331 qpair failed and we were unable to recover it. 00:31:00.331 [2024-11-28 23:23:03.621083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.621175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.621199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.331 qpair failed and we were unable to recover it. 00:31:00.331 [2024-11-28 23:23:03.621312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.621412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.621444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.331 qpair failed and we were unable to recover it. 00:31:00.331 [2024-11-28 23:23:03.621532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.621613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.621638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.331 qpair failed and we were unable to recover it. 00:31:00.331 [2024-11-28 23:23:03.621752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.621837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.621863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.331 qpair failed and we were unable to recover it. 00:31:00.331 [2024-11-28 23:23:03.621944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.622029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.622055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.331 qpair failed and we were unable to recover it. 00:31:00.331 [2024-11-28 23:23:03.622169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.622256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.622280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.331 qpair failed and we were unable to recover it. 00:31:00.331 [2024-11-28 23:23:03.622365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.622458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.622483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.331 qpair failed and we were unable to recover it. 00:31:00.331 [2024-11-28 23:23:03.622566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.622644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.622669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.331 qpair failed and we were unable to recover it. 00:31:00.331 [2024-11-28 23:23:03.622760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.622836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.622860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.331 qpair failed and we were unable to recover it. 00:31:00.331 [2024-11-28 23:23:03.622949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.623062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.623086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.331 qpair failed and we were unable to recover it. 00:31:00.331 [2024-11-28 23:23:03.623175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.623252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.623277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.331 qpair failed and we were unable to recover it. 00:31:00.331 [2024-11-28 23:23:03.623391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.623486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.623511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.331 qpair failed and we were unable to recover it. 00:31:00.331 [2024-11-28 23:23:03.623627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.623710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.623734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.331 qpair failed and we were unable to recover it. 00:31:00.331 [2024-11-28 23:23:03.623816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.623932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.623957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.331 qpair failed and we were unable to recover it. 00:31:00.331 [2024-11-28 23:23:03.624043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.624154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.624178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.331 qpair failed and we were unable to recover it. 00:31:00.331 [2024-11-28 23:23:03.624275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.624388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.624420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.331 qpair failed and we were unable to recover it. 00:31:00.331 [2024-11-28 23:23:03.624503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.624582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.624608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.331 qpair failed and we were unable to recover it. 00:31:00.331 [2024-11-28 23:23:03.624694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.624799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.624824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.331 qpair failed and we were unable to recover it. 00:31:00.331 [2024-11-28 23:23:03.624912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.624991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.625015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.331 qpair failed and we were unable to recover it. 00:31:00.331 [2024-11-28 23:23:03.625126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.625209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.625234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.331 qpair failed and we were unable to recover it. 00:31:00.331 [2024-11-28 23:23:03.625320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.625440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.625465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.331 qpair failed and we were unable to recover it. 00:31:00.331 [2024-11-28 23:23:03.625560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.625646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.625671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.331 qpair failed and we were unable to recover it. 00:31:00.331 [2024-11-28 23:23:03.625784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.625869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.331 [2024-11-28 23:23:03.625894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.331 qpair failed and we were unable to recover it. 00:31:00.332 [2024-11-28 23:23:03.626008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.626092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.626117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.332 qpair failed and we were unable to recover it. 00:31:00.332 [2024-11-28 23:23:03.626212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.626299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.626324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.332 qpair failed and we were unable to recover it. 00:31:00.332 [2024-11-28 23:23:03.626408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.626494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.626519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.332 qpair failed and we were unable to recover it. 00:31:00.332 [2024-11-28 23:23:03.626628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.626710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.626734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.332 qpair failed and we were unable to recover it. 00:31:00.332 [2024-11-28 23:23:03.626816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.626901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.626927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.332 qpair failed and we were unable to recover it. 00:31:00.332 [2024-11-28 23:23:03.627014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.627152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.627177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.332 qpair failed and we were unable to recover it. 00:31:00.332 [2024-11-28 23:23:03.627261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.627354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.627379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.332 qpair failed and we were unable to recover it. 00:31:00.332 [2024-11-28 23:23:03.627483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.627572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.627600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.332 qpair failed and we were unable to recover it. 00:31:00.332 [2024-11-28 23:23:03.627691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.627776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.627801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.332 qpair failed and we were unable to recover it. 00:31:00.332 [2024-11-28 23:23:03.627886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.627970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.627994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.332 qpair failed and we were unable to recover it. 00:31:00.332 [2024-11-28 23:23:03.628142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.628234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.628259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.332 qpair failed and we were unable to recover it. 00:31:00.332 [2024-11-28 23:23:03.628344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.628455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.628480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.332 qpair failed and we were unable to recover it. 00:31:00.332 [2024-11-28 23:23:03.628565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.628639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.628664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.332 qpair failed and we were unable to recover it. 00:31:00.332 [2024-11-28 23:23:03.628750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.628865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.628889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.332 qpair failed and we were unable to recover it. 00:31:00.332 [2024-11-28 23:23:03.628999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.629077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.629102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.332 qpair failed and we were unable to recover it. 00:31:00.332 [2024-11-28 23:23:03.629189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.629273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.629296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.332 qpair failed and we were unable to recover it. 00:31:00.332 [2024-11-28 23:23:03.629387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.629552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.629577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.332 qpair failed and we were unable to recover it. 00:31:00.332 [2024-11-28 23:23:03.629686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.629775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.629799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.332 qpair failed and we were unable to recover it. 00:31:00.332 [2024-11-28 23:23:03.629894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.630007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.630032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.332 qpair failed and we were unable to recover it. 00:31:00.332 [2024-11-28 23:23:03.630114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.630205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.630230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.332 qpair failed and we were unable to recover it. 00:31:00.332 [2024-11-28 23:23:03.630342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.630443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.630469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.332 qpair failed and we were unable to recover it. 00:31:00.332 [2024-11-28 23:23:03.630590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.630668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.630692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.332 qpair failed and we were unable to recover it. 00:31:00.332 [2024-11-28 23:23:03.630771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.630917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.630941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.332 qpair failed and we were unable to recover it. 00:31:00.332 [2024-11-28 23:23:03.631027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.631102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.631128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.332 qpair failed and we were unable to recover it. 00:31:00.332 [2024-11-28 23:23:03.631247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.631356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.631381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.332 qpair failed and we were unable to recover it. 00:31:00.332 [2024-11-28 23:23:03.631480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.631561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.631587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.332 qpair failed and we were unable to recover it. 00:31:00.332 [2024-11-28 23:23:03.631675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.631766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.631790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.332 qpair failed and we were unable to recover it. 00:31:00.332 [2024-11-28 23:23:03.631901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.631983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.632008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.332 qpair failed and we were unable to recover it. 00:31:00.332 [2024-11-28 23:23:03.632127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.632214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.332 [2024-11-28 23:23:03.632238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.332 qpair failed and we were unable to recover it. 00:31:00.332 [2024-11-28 23:23:03.632324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.632421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.632445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.333 qpair failed and we were unable to recover it. 00:31:00.333 [2024-11-28 23:23:03.632527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.632640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.632665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.333 qpair failed and we were unable to recover it. 00:31:00.333 [2024-11-28 23:23:03.632761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.632845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.632870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.333 qpair failed and we were unable to recover it. 00:31:00.333 [2024-11-28 23:23:03.632953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.633068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.633095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.333 qpair failed and we were unable to recover it. 00:31:00.333 [2024-11-28 23:23:03.633182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.633266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.633291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.333 qpair failed and we were unable to recover it. 00:31:00.333 [2024-11-28 23:23:03.633424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.633544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.633569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.333 qpair failed and we were unable to recover it. 00:31:00.333 [2024-11-28 23:23:03.633664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.633751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.633775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.333 qpair failed and we were unable to recover it. 00:31:00.333 [2024-11-28 23:23:03.633890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.633998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.634023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.333 qpair failed and we were unable to recover it. 00:31:00.333 [2024-11-28 23:23:03.634135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.634210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.634235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.333 qpair failed and we were unable to recover it. 00:31:00.333 [2024-11-28 23:23:03.634325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.634415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.634442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.333 qpair failed and we were unable to recover it. 00:31:00.333 [2024-11-28 23:23:03.634525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.634613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.634638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.333 qpair failed and we were unable to recover it. 00:31:00.333 [2024-11-28 23:23:03.634726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.634868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.634893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.333 qpair failed and we were unable to recover it. 00:31:00.333 [2024-11-28 23:23:03.634975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.635087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.635112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.333 qpair failed and we were unable to recover it. 00:31:00.333 [2024-11-28 23:23:03.635200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.635282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.635306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.333 qpair failed and we were unable to recover it. 00:31:00.333 [2024-11-28 23:23:03.635397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.635512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.635537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.333 qpair failed and we were unable to recover it. 00:31:00.333 [2024-11-28 23:23:03.635624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.635707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.635733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.333 qpair failed and we were unable to recover it. 00:31:00.333 [2024-11-28 23:23:03.635821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.635905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.635931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.333 qpair failed and we were unable to recover it. 00:31:00.333 [2024-11-28 23:23:03.636028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.636138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.636163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.333 qpair failed and we were unable to recover it. 00:31:00.333 [2024-11-28 23:23:03.636245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.636320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.636345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.333 qpair failed and we were unable to recover it. 00:31:00.333 [2024-11-28 23:23:03.636433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.636529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.636554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.333 qpair failed and we were unable to recover it. 00:31:00.333 [2024-11-28 23:23:03.636650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.636734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.636760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.333 qpair failed and we were unable to recover it. 00:31:00.333 [2024-11-28 23:23:03.636869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.636951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.636975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.333 qpair failed and we were unable to recover it. 00:31:00.333 [2024-11-28 23:23:03.637064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.637158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.637182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.333 qpair failed and we were unable to recover it. 00:31:00.333 [2024-11-28 23:23:03.637267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.637352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.637377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.333 qpair failed and we were unable to recover it. 00:31:00.333 [2024-11-28 23:23:03.637467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.637580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.637604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.333 qpair failed and we were unable to recover it. 00:31:00.333 [2024-11-28 23:23:03.637684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.637770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.637795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.333 qpair failed and we were unable to recover it. 00:31:00.333 [2024-11-28 23:23:03.637880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.637999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.638024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.333 qpair failed and we were unable to recover it. 00:31:00.333 [2024-11-28 23:23:03.638110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.638196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.638221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.333 qpair failed and we were unable to recover it. 00:31:00.333 [2024-11-28 23:23:03.638298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.638377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.638410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.333 qpair failed and we were unable to recover it. 00:31:00.333 [2024-11-28 23:23:03.638533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.333 [2024-11-28 23:23:03.638647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.638676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.334 qpair failed and we were unable to recover it. 00:31:00.334 [2024-11-28 23:23:03.638768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.638883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.638907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.334 qpair failed and we were unable to recover it. 00:31:00.334 [2024-11-28 23:23:03.639001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.639081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.639106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.334 qpair failed and we were unable to recover it. 00:31:00.334 [2024-11-28 23:23:03.639189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.639297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.639322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.334 qpair failed and we were unable to recover it. 00:31:00.334 [2024-11-28 23:23:03.639408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.639524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.639549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.334 qpair failed and we were unable to recover it. 00:31:00.334 [2024-11-28 23:23:03.639671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.639766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.639790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.334 qpair failed and we were unable to recover it. 00:31:00.334 [2024-11-28 23:23:03.639874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.639989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.640015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.334 qpair failed and we were unable to recover it. 00:31:00.334 [2024-11-28 23:23:03.640107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.640198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.640223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.334 qpair failed and we were unable to recover it. 00:31:00.334 [2024-11-28 23:23:03.640303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.640412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.640436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.334 qpair failed and we were unable to recover it. 00:31:00.334 [2024-11-28 23:23:03.640548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.640657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.640682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.334 qpair failed and we were unable to recover it. 00:31:00.334 [2024-11-28 23:23:03.640784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.640867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.640892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.334 qpair failed and we were unable to recover it. 00:31:00.334 [2024-11-28 23:23:03.640983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.641093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.641118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.334 qpair failed and we were unable to recover it. 00:31:00.334 [2024-11-28 23:23:03.641207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.641292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.641316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.334 qpair failed and we were unable to recover it. 00:31:00.334 [2024-11-28 23:23:03.641406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.641488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.641513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.334 qpair failed and we were unable to recover it. 00:31:00.334 [2024-11-28 23:23:03.641599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.641677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.641702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.334 qpair failed and we were unable to recover it. 00:31:00.334 [2024-11-28 23:23:03.641789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.641904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.641929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.334 qpair failed and we were unable to recover it. 00:31:00.334 [2024-11-28 23:23:03.642013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.642090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.642114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.334 qpair failed and we were unable to recover it. 00:31:00.334 [2024-11-28 23:23:03.642198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.642285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.642310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.334 qpair failed and we were unable to recover it. 00:31:00.334 [2024-11-28 23:23:03.642419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.642535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.642560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.334 qpair failed and we were unable to recover it. 00:31:00.334 [2024-11-28 23:23:03.642641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.642722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.642747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.334 qpair failed and we were unable to recover it. 00:31:00.334 [2024-11-28 23:23:03.642838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.642915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.642940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.334 qpair failed and we were unable to recover it. 00:31:00.334 [2024-11-28 23:23:03.643031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.643113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.643137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.334 qpair failed and we were unable to recover it. 00:31:00.334 [2024-11-28 23:23:03.643253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.643363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.643388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.334 qpair failed and we were unable to recover it. 00:31:00.334 [2024-11-28 23:23:03.643486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.643568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.643594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.334 qpair failed and we were unable to recover it. 00:31:00.334 [2024-11-28 23:23:03.643714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.643797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.643822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.334 qpair failed and we were unable to recover it. 00:31:00.334 [2024-11-28 23:23:03.643903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.643984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.644008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.334 qpair failed and we were unable to recover it. 00:31:00.334 [2024-11-28 23:23:03.644101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.334 [2024-11-28 23:23:03.644185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.644209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.335 qpair failed and we were unable to recover it. 00:31:00.335 [2024-11-28 23:23:03.644298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.644413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.644439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.335 qpair failed and we were unable to recover it. 00:31:00.335 [2024-11-28 23:23:03.644527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.644641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.644666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.335 qpair failed and we were unable to recover it. 00:31:00.335 [2024-11-28 23:23:03.644758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.644854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.644878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.335 qpair failed and we were unable to recover it. 00:31:00.335 [2024-11-28 23:23:03.644976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.645056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.645081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.335 qpair failed and we were unable to recover it. 00:31:00.335 [2024-11-28 23:23:03.645196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.645293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.645319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.335 qpair failed and we were unable to recover it. 00:31:00.335 [2024-11-28 23:23:03.645420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.645561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.645586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.335 qpair failed and we were unable to recover it. 00:31:00.335 [2024-11-28 23:23:03.645684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.645780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.645804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.335 qpair failed and we were unable to recover it. 00:31:00.335 [2024-11-28 23:23:03.645883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.645969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.645995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.335 qpair failed and we were unable to recover it. 00:31:00.335 [2024-11-28 23:23:03.646076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.646160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.646184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.335 qpair failed and we were unable to recover it. 00:31:00.335 [2024-11-28 23:23:03.646302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.646388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.646420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.335 qpair failed and we were unable to recover it. 00:31:00.335 [2024-11-28 23:23:03.646505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.646587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.646612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.335 qpair failed and we were unable to recover it. 00:31:00.335 [2024-11-28 23:23:03.646731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.646810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.646836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.335 qpair failed and we were unable to recover it. 00:31:00.335 [2024-11-28 23:23:03.646925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.647009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.647034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.335 qpair failed and we were unable to recover it. 00:31:00.335 [2024-11-28 23:23:03.647149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.647230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.647254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.335 qpair failed and we were unable to recover it. 00:31:00.335 [2024-11-28 23:23:03.647343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.647425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.647451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.335 qpair failed and we were unable to recover it. 00:31:00.335 [2024-11-28 23:23:03.647540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.647630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.647656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.335 qpair failed and we were unable to recover it. 00:31:00.335 [2024-11-28 23:23:03.647745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.647856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.647882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.335 qpair failed and we were unable to recover it. 00:31:00.335 [2024-11-28 23:23:03.647964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.648072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.648097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.335 qpair failed and we were unable to recover it. 00:31:00.335 [2024-11-28 23:23:03.648219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.648327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.648352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.335 qpair failed and we were unable to recover it. 00:31:00.335 [2024-11-28 23:23:03.648451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.648534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.648559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.335 qpair failed and we were unable to recover it. 00:31:00.335 [2024-11-28 23:23:03.648640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.648721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.648745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.335 qpair failed and we were unable to recover it. 00:31:00.335 [2024-11-28 23:23:03.648859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.648951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.648975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.335 qpair failed and we were unable to recover it. 00:31:00.335 [2024-11-28 23:23:03.649066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.649147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.649172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.335 qpair failed and we were unable to recover it. 00:31:00.335 [2024-11-28 23:23:03.649284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.649359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.649383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.335 qpair failed and we were unable to recover it. 00:31:00.335 [2024-11-28 23:23:03.649488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.649572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.649601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.335 qpair failed and we were unable to recover it. 00:31:00.335 [2024-11-28 23:23:03.649690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.649802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.649827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.335 qpair failed and we were unable to recover it. 00:31:00.335 [2024-11-28 23:23:03.649916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.650009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.650034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.335 qpair failed and we were unable to recover it. 00:31:00.335 [2024-11-28 23:23:03.650118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.650199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.650225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.335 qpair failed and we were unable to recover it. 00:31:00.335 [2024-11-28 23:23:03.650315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.650391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.335 [2024-11-28 23:23:03.650444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.336 qpair failed and we were unable to recover it. 00:31:00.336 [2024-11-28 23:23:03.650539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.650627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.650652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.336 qpair failed and we were unable to recover it. 00:31:00.336 [2024-11-28 23:23:03.650765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.650862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.650888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.336 qpair failed and we were unable to recover it. 00:31:00.336 [2024-11-28 23:23:03.651002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.651084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.651109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.336 qpair failed and we were unable to recover it. 00:31:00.336 [2024-11-28 23:23:03.651225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.651309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.651334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.336 qpair failed and we were unable to recover it. 00:31:00.336 [2024-11-28 23:23:03.651425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.651540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.651565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.336 qpair failed and we were unable to recover it. 00:31:00.336 [2024-11-28 23:23:03.651648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.651740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.651765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.336 qpair failed and we were unable to recover it. 00:31:00.336 [2024-11-28 23:23:03.651863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.651952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.651977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.336 qpair failed and we were unable to recover it. 00:31:00.336 [2024-11-28 23:23:03.652071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.652161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.652187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.336 qpair failed and we were unable to recover it. 00:31:00.336 [2024-11-28 23:23:03.652266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.652360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.652384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.336 qpair failed and we were unable to recover it. 00:31:00.336 [2024-11-28 23:23:03.652480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.652569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.652594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.336 qpair failed and we were unable to recover it. 00:31:00.336 [2024-11-28 23:23:03.652695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.652783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.652808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.336 qpair failed and we were unable to recover it. 00:31:00.336 [2024-11-28 23:23:03.652892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.652976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.653001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.336 qpair failed and we were unable to recover it. 00:31:00.336 [2024-11-28 23:23:03.653114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.653231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.653257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.336 qpair failed and we were unable to recover it. 00:31:00.336 [2024-11-28 23:23:03.653347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.653461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.653487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.336 qpair failed and we were unable to recover it. 00:31:00.336 [2024-11-28 23:23:03.653576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.653656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.653681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.336 qpair failed and we were unable to recover it. 00:31:00.336 [2024-11-28 23:23:03.653764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.653885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.653910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.336 qpair failed and we were unable to recover it. 00:31:00.336 [2024-11-28 23:23:03.654012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.654104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.654129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.336 qpair failed and we were unable to recover it. 00:31:00.336 [2024-11-28 23:23:03.654209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.654292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.654316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.336 qpair failed and we were unable to recover it. 00:31:00.336 [2024-11-28 23:23:03.654431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.654519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.654546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.336 qpair failed and we were unable to recover it. 00:31:00.336 [2024-11-28 23:23:03.654638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.654757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.654782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.336 qpair failed and we were unable to recover it. 00:31:00.336 [2024-11-28 23:23:03.654872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.654957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.654982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.336 qpair failed and we were unable to recover it. 00:31:00.336 [2024-11-28 23:23:03.655099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.655181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.655206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.336 qpair failed and we were unable to recover it. 00:31:00.336 [2024-11-28 23:23:03.655405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.655528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.655553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.336 qpair failed and we were unable to recover it. 00:31:00.336 [2024-11-28 23:23:03.655648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.655732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.655758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.336 qpair failed and we were unable to recover it. 00:31:00.336 [2024-11-28 23:23:03.655838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.655918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.655943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.336 qpair failed and we were unable to recover it. 00:31:00.336 [2024-11-28 23:23:03.656039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.656118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.656143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.336 qpair failed and we were unable to recover it. 00:31:00.336 [2024-11-28 23:23:03.656230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.656312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.656337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.336 qpair failed and we were unable to recover it. 00:31:00.336 [2024-11-28 23:23:03.656429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.656545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.656571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.336 qpair failed and we were unable to recover it. 00:31:00.336 [2024-11-28 23:23:03.656657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.656770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.336 [2024-11-28 23:23:03.656794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.336 qpair failed and we were unable to recover it. 00:31:00.337 [2024-11-28 23:23:03.656888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.656967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.656991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.337 qpair failed and we were unable to recover it. 00:31:00.337 [2024-11-28 23:23:03.657080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.657164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.657189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.337 qpair failed and we were unable to recover it. 00:31:00.337 [2024-11-28 23:23:03.657302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.657383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.657414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.337 qpair failed and we were unable to recover it. 00:31:00.337 [2024-11-28 23:23:03.657501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.657593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.657617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.337 qpair failed and we were unable to recover it. 00:31:00.337 [2024-11-28 23:23:03.657707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.657794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.657819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.337 qpair failed and we were unable to recover it. 00:31:00.337 [2024-11-28 23:23:03.657910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.657991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.658015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.337 qpair failed and we were unable to recover it. 00:31:00.337 [2024-11-28 23:23:03.658094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.658175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.658200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.337 qpair failed and we were unable to recover it. 00:31:00.337 [2024-11-28 23:23:03.658322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.658442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.658474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.337 qpair failed and we were unable to recover it. 00:31:00.337 [2024-11-28 23:23:03.658579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.658666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.658691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.337 qpair failed and we were unable to recover it. 00:31:00.337 [2024-11-28 23:23:03.658775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.658861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.658886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.337 qpair failed and we were unable to recover it. 00:31:00.337 [2024-11-28 23:23:03.658971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.659052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.659077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.337 qpair failed and we were unable to recover it. 00:31:00.337 [2024-11-28 23:23:03.659198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.659283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.659308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.337 qpair failed and we were unable to recover it. 00:31:00.337 [2024-11-28 23:23:03.659389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.659489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.659513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.337 qpair failed and we were unable to recover it. 00:31:00.337 [2024-11-28 23:23:03.659593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.659680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.659705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.337 qpair failed and we were unable to recover it. 00:31:00.337 [2024-11-28 23:23:03.659798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.659941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.659966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.337 qpair failed and we were unable to recover it. 00:31:00.337 [2024-11-28 23:23:03.660055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.660143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.660168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.337 qpair failed and we were unable to recover it. 00:31:00.337 [2024-11-28 23:23:03.660250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.660329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.660353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.337 qpair failed and we were unable to recover it. 00:31:00.337 [2024-11-28 23:23:03.660457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.660548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.660572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.337 qpair failed and we were unable to recover it. 00:31:00.337 [2024-11-28 23:23:03.660663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.660740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.660765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.337 qpair failed and we were unable to recover it. 00:31:00.337 [2024-11-28 23:23:03.660880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.660959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.660984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.337 qpair failed and we were unable to recover it. 00:31:00.337 [2024-11-28 23:23:03.661107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.661196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.661221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.337 qpair failed and we were unable to recover it. 00:31:00.337 [2024-11-28 23:23:03.661304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.661387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.661419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.337 qpair failed and we were unable to recover it. 00:31:00.337 [2024-11-28 23:23:03.661520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.661602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.661627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.337 qpair failed and we were unable to recover it. 00:31:00.337 [2024-11-28 23:23:03.661716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.661797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.661821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.337 qpair failed and we were unable to recover it. 00:31:00.337 [2024-11-28 23:23:03.661907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.661992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.662016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.337 qpair failed and we were unable to recover it. 00:31:00.337 [2024-11-28 23:23:03.662106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.662191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.662218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.337 qpair failed and we were unable to recover it. 00:31:00.337 [2024-11-28 23:23:03.662323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.662412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.662437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.337 qpair failed and we were unable to recover it. 00:31:00.337 [2024-11-28 23:23:03.662524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.662600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.662624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.337 qpair failed and we were unable to recover it. 00:31:00.337 [2024-11-28 23:23:03.662709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.662789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.337 [2024-11-28 23:23:03.662813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.337 qpair failed and we were unable to recover it. 00:31:00.337 [2024-11-28 23:23:03.662892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.662979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.663006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.338 qpair failed and we were unable to recover it. 00:31:00.338 [2024-11-28 23:23:03.663121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.663210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.663235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.338 qpair failed and we were unable to recover it. 00:31:00.338 [2024-11-28 23:23:03.663329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.663421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.663447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.338 qpair failed and we were unable to recover it. 00:31:00.338 [2024-11-28 23:23:03.663542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.663623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.663647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.338 qpair failed and we were unable to recover it. 00:31:00.338 [2024-11-28 23:23:03.663734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.663818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.663842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.338 qpair failed and we were unable to recover it. 00:31:00.338 [2024-11-28 23:23:03.663951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.664035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.664060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.338 qpair failed and we were unable to recover it. 00:31:00.338 [2024-11-28 23:23:03.664164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.664274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.664298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.338 qpair failed and we were unable to recover it. 00:31:00.338 [2024-11-28 23:23:03.664386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.664476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.664501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.338 qpair failed and we were unable to recover it. 00:31:00.338 [2024-11-28 23:23:03.664585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.664673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.664698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.338 qpair failed and we were unable to recover it. 00:31:00.338 [2024-11-28 23:23:03.664790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.664929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.664955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.338 qpair failed and we were unable to recover it. 00:31:00.338 [2024-11-28 23:23:03.665043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.665153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.665178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.338 qpair failed and we were unable to recover it. 00:31:00.338 [2024-11-28 23:23:03.665265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.665345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.665370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.338 qpair failed and we were unable to recover it. 00:31:00.338 [2024-11-28 23:23:03.665454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.665567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.665592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.338 qpair failed and we were unable to recover it. 00:31:00.338 [2024-11-28 23:23:03.665675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.665782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.665807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.338 qpair failed and we were unable to recover it. 00:31:00.338 [2024-11-28 23:23:03.665900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.666012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.666037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.338 qpair failed and we were unable to recover it. 00:31:00.338 [2024-11-28 23:23:03.666117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.666195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.666220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.338 qpair failed and we were unable to recover it. 00:31:00.338 [2024-11-28 23:23:03.666306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.666388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.666421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.338 qpair failed and we were unable to recover it. 00:31:00.338 [2024-11-28 23:23:03.666508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.666595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.666621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.338 qpair failed and we were unable to recover it. 00:31:00.338 [2024-11-28 23:23:03.666702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.666782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.666807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.338 qpair failed and we were unable to recover it. 00:31:00.338 [2024-11-28 23:23:03.666891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.666980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.667005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.338 qpair failed and we were unable to recover it. 00:31:00.338 [2024-11-28 23:23:03.667090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.667199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.667224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.338 qpair failed and we were unable to recover it. 00:31:00.338 [2024-11-28 23:23:03.667312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.667426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.667451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.338 qpair failed and we were unable to recover it. 00:31:00.338 [2024-11-28 23:23:03.667539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.667634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.667659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.338 qpair failed and we were unable to recover it. 00:31:00.338 [2024-11-28 23:23:03.667747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.667829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.667854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.338 qpair failed and we were unable to recover it. 00:31:00.338 [2024-11-28 23:23:03.667942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.668025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.668050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.338 qpair failed and we were unable to recover it. 00:31:00.338 [2024-11-28 23:23:03.668151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.668231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.668255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.338 qpair failed and we were unable to recover it. 00:31:00.338 [2024-11-28 23:23:03.668369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.668456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.668481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.338 qpair failed and we were unable to recover it. 00:31:00.338 [2024-11-28 23:23:03.668582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.668658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.668684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.338 qpair failed and we were unable to recover it. 00:31:00.338 [2024-11-28 23:23:03.668769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.668875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.668899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.338 qpair failed and we were unable to recover it. 00:31:00.338 [2024-11-28 23:23:03.668993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.338 [2024-11-28 23:23:03.669071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.669100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.339 qpair failed and we were unable to recover it. 00:31:00.339 [2024-11-28 23:23:03.669190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.669320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.669345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.339 qpair failed and we were unable to recover it. 00:31:00.339 [2024-11-28 23:23:03.669438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.669529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.669555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.339 qpair failed and we were unable to recover it. 00:31:00.339 [2024-11-28 23:23:03.669671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.669754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.669778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.339 qpair failed and we were unable to recover it. 00:31:00.339 [2024-11-28 23:23:03.669866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.669990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.670016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.339 qpair failed and we were unable to recover it. 00:31:00.339 [2024-11-28 23:23:03.670098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.670188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.670213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.339 qpair failed and we were unable to recover it. 00:31:00.339 [2024-11-28 23:23:03.670294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.670412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.670437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.339 qpair failed and we were unable to recover it. 00:31:00.339 [2024-11-28 23:23:03.670520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.670609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.670633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.339 qpair failed and we were unable to recover it. 00:31:00.339 [2024-11-28 23:23:03.670728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.670813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.670839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.339 qpair failed and we were unable to recover it. 00:31:00.339 [2024-11-28 23:23:03.670926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.671012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.671036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.339 qpair failed and we were unable to recover it. 00:31:00.339 [2024-11-28 23:23:03.671125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.671212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.671238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.339 qpair failed and we were unable to recover it. 00:31:00.339 [2024-11-28 23:23:03.671329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.671441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.671467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.339 qpair failed and we were unable to recover it. 00:31:00.339 [2024-11-28 23:23:03.671555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.671631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.671655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.339 qpair failed and we were unable to recover it. 00:31:00.339 [2024-11-28 23:23:03.671798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.671877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.671902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.339 qpair failed and we were unable to recover it. 00:31:00.339 [2024-11-28 23:23:03.671996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.672081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.672106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.339 qpair failed and we were unable to recover it. 00:31:00.339 [2024-11-28 23:23:03.672207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.672286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.672311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.339 qpair failed and we were unable to recover it. 00:31:00.339 [2024-11-28 23:23:03.672402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.672499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.672524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.339 qpair failed and we were unable to recover it. 00:31:00.339 [2024-11-28 23:23:03.672620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.672697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.672722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.339 qpair failed and we were unable to recover it. 00:31:00.339 [2024-11-28 23:23:03.672808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.672889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.672915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.339 qpair failed and we were unable to recover it. 00:31:00.339 [2024-11-28 23:23:03.672995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.673082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.673108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.339 qpair failed and we were unable to recover it. 00:31:00.339 [2024-11-28 23:23:03.673201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.673287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.673312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.339 qpair failed and we were unable to recover it. 00:31:00.339 [2024-11-28 23:23:03.673431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.673522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.673547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.339 qpair failed and we were unable to recover it. 00:31:00.339 [2024-11-28 23:23:03.673630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.673715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.673740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.339 qpair failed and we were unable to recover it. 00:31:00.339 [2024-11-28 23:23:03.673829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.673937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.673962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.339 qpair failed and we were unable to recover it. 00:31:00.339 [2024-11-28 23:23:03.674037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.674118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.674142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.339 qpair failed and we were unable to recover it. 00:31:00.339 [2024-11-28 23:23:03.674263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.674349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.339 [2024-11-28 23:23:03.674374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.339 qpair failed and we were unable to recover it. 00:31:00.340 [2024-11-28 23:23:03.674475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.674562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.674587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.340 qpair failed and we were unable to recover it. 00:31:00.340 [2024-11-28 23:23:03.674672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.674755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.674780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.340 qpair failed and we were unable to recover it. 00:31:00.340 [2024-11-28 23:23:03.674872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.674953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.674977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.340 qpair failed and we were unable to recover it. 00:31:00.340 [2024-11-28 23:23:03.675077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.675162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.675187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.340 qpair failed and we were unable to recover it. 00:31:00.340 [2024-11-28 23:23:03.675305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.675391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.675425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.340 qpair failed and we were unable to recover it. 00:31:00.340 [2024-11-28 23:23:03.675520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.675601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.675626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.340 qpair failed and we were unable to recover it. 00:31:00.340 [2024-11-28 23:23:03.675709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.675794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.675818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.340 qpair failed and we were unable to recover it. 00:31:00.340 [2024-11-28 23:23:03.675905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.675988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.676013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.340 qpair failed and we were unable to recover it. 00:31:00.340 [2024-11-28 23:23:03.676099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.676290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.676314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.340 qpair failed and we were unable to recover it. 00:31:00.340 [2024-11-28 23:23:03.676420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.676532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.676558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.340 qpair failed and we were unable to recover it. 00:31:00.340 [2024-11-28 23:23:03.676645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.676753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.676777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.340 qpair failed and we were unable to recover it. 00:31:00.340 [2024-11-28 23:23:03.676870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.676954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.676979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.340 qpair failed and we were unable to recover it. 00:31:00.340 [2024-11-28 23:23:03.677072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.677154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.677179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.340 qpair failed and we were unable to recover it. 00:31:00.340 [2024-11-28 23:23:03.677257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.677338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.677363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.340 qpair failed and we were unable to recover it. 00:31:00.340 [2024-11-28 23:23:03.677452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.677539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.677564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.340 qpair failed and we were unable to recover it. 00:31:00.340 [2024-11-28 23:23:03.677654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.677747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.677773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.340 qpair failed and we were unable to recover it. 00:31:00.340 [2024-11-28 23:23:03.677892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.677968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.677992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.340 qpair failed and we were unable to recover it. 00:31:00.340 [2024-11-28 23:23:03.678084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.678197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.678222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.340 qpair failed and we were unable to recover it. 00:31:00.340 [2024-11-28 23:23:03.678300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.678415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.678441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.340 qpair failed and we were unable to recover it. 00:31:00.340 [2024-11-28 23:23:03.678555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.678638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.678662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.340 qpair failed and we were unable to recover it. 00:31:00.340 [2024-11-28 23:23:03.678774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.678857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.678882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.340 qpair failed and we were unable to recover it. 00:31:00.340 [2024-11-28 23:23:03.678972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.679055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.679079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.340 qpair failed and we were unable to recover it. 00:31:00.340 [2024-11-28 23:23:03.679187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.679270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.679295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.340 qpair failed and we were unable to recover it. 00:31:00.340 [2024-11-28 23:23:03.679408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.679495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.679520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.340 qpair failed and we were unable to recover it. 00:31:00.340 [2024-11-28 23:23:03.679605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.679692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.679716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.340 qpair failed and we were unable to recover it. 00:31:00.340 [2024-11-28 23:23:03.679807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.679889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.679918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.340 qpair failed and we were unable to recover it. 00:31:00.340 [2024-11-28 23:23:03.680010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.680134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.680158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.340 qpair failed and we were unable to recover it. 00:31:00.340 [2024-11-28 23:23:03.680247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.680366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.680390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.340 qpair failed and we were unable to recover it. 00:31:00.340 [2024-11-28 23:23:03.680485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.680565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.340 [2024-11-28 23:23:03.680591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.340 qpair failed and we were unable to recover it. 00:31:00.340 [2024-11-28 23:23:03.680683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.680764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.680789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.341 qpair failed and we were unable to recover it. 00:31:00.341 [2024-11-28 23:23:03.680876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.680962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.680987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.341 qpair failed and we were unable to recover it. 00:31:00.341 [2024-11-28 23:23:03.681075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.681190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.681215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.341 qpair failed and we were unable to recover it. 00:31:00.341 [2024-11-28 23:23:03.681302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.681387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.681417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.341 qpair failed and we were unable to recover it. 00:31:00.341 [2024-11-28 23:23:03.681509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.681627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.681652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.341 qpair failed and we were unable to recover it. 00:31:00.341 [2024-11-28 23:23:03.681765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.681894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.681919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.341 qpair failed and we were unable to recover it. 00:31:00.341 [2024-11-28 23:23:03.682013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.682123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.682148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.341 qpair failed and we were unable to recover it. 00:31:00.341 [2024-11-28 23:23:03.682244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.682329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.682353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.341 qpair failed and we were unable to recover it. 00:31:00.341 [2024-11-28 23:23:03.682447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.682531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.682555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.341 qpair failed and we were unable to recover it. 00:31:00.341 [2024-11-28 23:23:03.682643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.682719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.682743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.341 qpair failed and we were unable to recover it. 00:31:00.341 [2024-11-28 23:23:03.682860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.682947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.682973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.341 qpair failed and we were unable to recover it. 00:31:00.341 [2024-11-28 23:23:03.683055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.683136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.683161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.341 qpair failed and we were unable to recover it. 00:31:00.341 [2024-11-28 23:23:03.683276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.683418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.683445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.341 qpair failed and we were unable to recover it. 00:31:00.341 [2024-11-28 23:23:03.683532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.683615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.683641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.341 qpair failed and we were unable to recover it. 00:31:00.341 [2024-11-28 23:23:03.683730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.683813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.683838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.341 qpair failed and we were unable to recover it. 00:31:00.341 [2024-11-28 23:23:03.683921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.684014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.684038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.341 qpair failed and we were unable to recover it. 00:31:00.341 [2024-11-28 23:23:03.684131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.684249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.684274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.341 qpair failed and we were unable to recover it. 00:31:00.341 [2024-11-28 23:23:03.684363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.684459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.684485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.341 qpair failed and we were unable to recover it. 00:31:00.341 [2024-11-28 23:23:03.684569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.684685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.684709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.341 qpair failed and we were unable to recover it. 00:31:00.341 [2024-11-28 23:23:03.684795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.684886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.684911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.341 qpair failed and we were unable to recover it. 00:31:00.341 [2024-11-28 23:23:03.684999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.685078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.685103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.341 qpair failed and we were unable to recover it. 00:31:00.341 [2024-11-28 23:23:03.685189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.685269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.685294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.341 qpair failed and we were unable to recover it. 00:31:00.341 [2024-11-28 23:23:03.685401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.685479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.685504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.341 qpair failed and we were unable to recover it. 00:31:00.341 [2024-11-28 23:23:03.685588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.685671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.685695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.341 qpair failed and we were unable to recover it. 00:31:00.341 [2024-11-28 23:23:03.685775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.685862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.685888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.341 qpair failed and we were unable to recover it. 00:31:00.341 [2024-11-28 23:23:03.685985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.686076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.686101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.341 qpair failed and we were unable to recover it. 00:31:00.341 [2024-11-28 23:23:03.686197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.686278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.686302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.341 qpair failed and we were unable to recover it. 00:31:00.341 [2024-11-28 23:23:03.686400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.686496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.686521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.341 qpair failed and we were unable to recover it. 00:31:00.341 [2024-11-28 23:23:03.686607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.686695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.686720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.341 qpair failed and we were unable to recover it. 00:31:00.341 [2024-11-28 23:23:03.686803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.341 [2024-11-28 23:23:03.686941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.686966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.342 qpair failed and we were unable to recover it. 00:31:00.342 [2024-11-28 23:23:03.687062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.687206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.687231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.342 qpair failed and we were unable to recover it. 00:31:00.342 [2024-11-28 23:23:03.687319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.687405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.687431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.342 qpair failed and we were unable to recover it. 00:31:00.342 [2024-11-28 23:23:03.687515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.687598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.687624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.342 qpair failed and we were unable to recover it. 00:31:00.342 [2024-11-28 23:23:03.687710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.687802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.687827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.342 qpair failed and we were unable to recover it. 00:31:00.342 [2024-11-28 23:23:03.687914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.687994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.688019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.342 qpair failed and we were unable to recover it. 00:31:00.342 [2024-11-28 23:23:03.688133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.688219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.688244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.342 qpair failed and we were unable to recover it. 00:31:00.342 [2024-11-28 23:23:03.688327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.688413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.688447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.342 qpair failed and we were unable to recover it. 00:31:00.342 [2024-11-28 23:23:03.688538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.688627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.688656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.342 qpair failed and we were unable to recover it. 00:31:00.342 [2024-11-28 23:23:03.688749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.688837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.688863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.342 qpair failed and we were unable to recover it. 00:31:00.342 [2024-11-28 23:23:03.688978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.689065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.689089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.342 qpair failed and we were unable to recover it. 00:31:00.342 [2024-11-28 23:23:03.689175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.689289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.689314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.342 qpair failed and we were unable to recover it. 00:31:00.342 [2024-11-28 23:23:03.689406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.689490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.689514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.342 qpair failed and we were unable to recover it. 00:31:00.342 [2024-11-28 23:23:03.689639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.689726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.689750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.342 qpair failed and we were unable to recover it. 00:31:00.342 [2024-11-28 23:23:03.689854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.689940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.689965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.342 qpair failed and we were unable to recover it. 00:31:00.342 [2024-11-28 23:23:03.690053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.690136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.690160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.342 qpair failed and we were unable to recover it. 00:31:00.342 [2024-11-28 23:23:03.690273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.690360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.690386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.342 qpair failed and we were unable to recover it. 00:31:00.342 [2024-11-28 23:23:03.690483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.690564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.690590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.342 qpair failed and we were unable to recover it. 00:31:00.342 [2024-11-28 23:23:03.690674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.690753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.690777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.342 qpair failed and we were unable to recover it. 00:31:00.342 [2024-11-28 23:23:03.690871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.690978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.691004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.342 qpair failed and we were unable to recover it. 00:31:00.342 [2024-11-28 23:23:03.691121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.691202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.691227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.342 qpair failed and we were unable to recover it. 00:31:00.342 [2024-11-28 23:23:03.691321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.691428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.691454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.342 qpair failed and we were unable to recover it. 00:31:00.342 [2024-11-28 23:23:03.691542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.691624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.691650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.342 qpair failed and we were unable to recover it. 00:31:00.342 [2024-11-28 23:23:03.691762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.691847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.691872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.342 qpair failed and we were unable to recover it. 00:31:00.342 [2024-11-28 23:23:03.691950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.692040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.692064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.342 qpair failed and we were unable to recover it. 00:31:00.342 [2024-11-28 23:23:03.692148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.692238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.692263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.342 qpair failed and we were unable to recover it. 00:31:00.342 [2024-11-28 23:23:03.692345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.692432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.692456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.342 qpair failed and we were unable to recover it. 00:31:00.342 [2024-11-28 23:23:03.692579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.692659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.692683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.342 qpair failed and we were unable to recover it. 00:31:00.342 [2024-11-28 23:23:03.692762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.692845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.692870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.342 qpair failed and we were unable to recover it. 00:31:00.342 [2024-11-28 23:23:03.692993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.342 [2024-11-28 23:23:03.693077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.693103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.343 qpair failed and we were unable to recover it. 00:31:00.343 [2024-11-28 23:23:03.693194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.693275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.693299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.343 qpair failed and we were unable to recover it. 00:31:00.343 [2024-11-28 23:23:03.693380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.693495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.693520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.343 qpair failed and we were unable to recover it. 00:31:00.343 [2024-11-28 23:23:03.693617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.693700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.693724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.343 qpair failed and we were unable to recover it. 00:31:00.343 [2024-11-28 23:23:03.693813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.693891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.693915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.343 qpair failed and we were unable to recover it. 00:31:00.343 [2024-11-28 23:23:03.693989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.694068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.694091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.343 qpair failed and we were unable to recover it. 00:31:00.343 [2024-11-28 23:23:03.694181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.694264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.694290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.343 qpair failed and we were unable to recover it. 00:31:00.343 [2024-11-28 23:23:03.694375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.694470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.694494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.343 qpair failed and we were unable to recover it. 00:31:00.343 [2024-11-28 23:23:03.694582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.694664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.694688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.343 qpair failed and we were unable to recover it. 00:31:00.343 [2024-11-28 23:23:03.694776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.694855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.694880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.343 qpair failed and we were unable to recover it. 00:31:00.343 [2024-11-28 23:23:03.694979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.695072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.695102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.343 qpair failed and we were unable to recover it. 00:31:00.343 [2024-11-28 23:23:03.695203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.695296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.695325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.343 qpair failed and we were unable to recover it. 00:31:00.343 [2024-11-28 23:23:03.695419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.695505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.695530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.343 qpair failed and we were unable to recover it. 00:31:00.343 [2024-11-28 23:23:03.695618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.695738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.695764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.343 qpair failed and we were unable to recover it. 00:31:00.343 [2024-11-28 23:23:03.695845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.695930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.695960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.343 qpair failed and we were unable to recover it. 00:31:00.343 [2024-11-28 23:23:03.696046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.696134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.696161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.343 qpair failed and we were unable to recover it. 00:31:00.343 [2024-11-28 23:23:03.696259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.696348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.696374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.343 qpair failed and we were unable to recover it. 00:31:00.343 [2024-11-28 23:23:03.696480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.696572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.696597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.343 qpair failed and we were unable to recover it. 00:31:00.343 [2024-11-28 23:23:03.696682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.696767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.696796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.343 qpair failed and we were unable to recover it. 00:31:00.343 [2024-11-28 23:23:03.696878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.696971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.696998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.343 qpair failed and we were unable to recover it. 00:31:00.343 [2024-11-28 23:23:03.697092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.697188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.697215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.343 qpair failed and we were unable to recover it. 00:31:00.343 [2024-11-28 23:23:03.697326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.697418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.697445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.343 qpair failed and we were unable to recover it. 00:31:00.343 [2024-11-28 23:23:03.697558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.697646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.697673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.343 qpair failed and we were unable to recover it. 00:31:00.343 [2024-11-28 23:23:03.697760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.697846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.697872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.343 qpair failed and we were unable to recover it. 00:31:00.343 [2024-11-28 23:23:03.697960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.698053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.698080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.343 qpair failed and we were unable to recover it. 00:31:00.343 [2024-11-28 23:23:03.698169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.698257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.343 [2024-11-28 23:23:03.698283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.343 qpair failed and we were unable to recover it. 00:31:00.344 [2024-11-28 23:23:03.698380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.698472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.698498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.344 qpair failed and we were unable to recover it. 00:31:00.344 [2024-11-28 23:23:03.698581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.698677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.698701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.344 qpair failed and we were unable to recover it. 00:31:00.344 [2024-11-28 23:23:03.698786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.698867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.698892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.344 qpair failed and we were unable to recover it. 00:31:00.344 [2024-11-28 23:23:03.698979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.699089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.699113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.344 qpair failed and we were unable to recover it. 00:31:00.344 [2024-11-28 23:23:03.699200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.699291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.699317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.344 qpair failed and we were unable to recover it. 00:31:00.344 [2024-11-28 23:23:03.699425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.699517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.699542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.344 qpair failed and we were unable to recover it. 00:31:00.344 [2024-11-28 23:23:03.699636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.699719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.699743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.344 qpair failed and we were unable to recover it. 00:31:00.344 [2024-11-28 23:23:03.699830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.699913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.699937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.344 qpair failed and we were unable to recover it. 00:31:00.344 [2024-11-28 23:23:03.700043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.700125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.700151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.344 qpair failed and we were unable to recover it. 00:31:00.344 [2024-11-28 23:23:03.700234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.700323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.700349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.344 qpair failed and we were unable to recover it. 00:31:00.344 [2024-11-28 23:23:03.700435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.700553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.700577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.344 qpair failed and we were unable to recover it. 00:31:00.344 [2024-11-28 23:23:03.700659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.700743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.700767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.344 qpair failed and we were unable to recover it. 00:31:00.344 [2024-11-28 23:23:03.700854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.700934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.700959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.344 qpair failed and we were unable to recover it. 00:31:00.344 [2024-11-28 23:23:03.701071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.701151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.701176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.344 qpair failed and we were unable to recover it. 00:31:00.344 [2024-11-28 23:23:03.701264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.701344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.701374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.344 qpair failed and we were unable to recover it. 00:31:00.344 [2024-11-28 23:23:03.701466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.701544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.701569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.344 qpair failed and we were unable to recover it. 00:31:00.344 [2024-11-28 23:23:03.701653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.701734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.701759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.344 qpair failed and we were unable to recover it. 00:31:00.344 [2024-11-28 23:23:03.701853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.701967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.701993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.344 qpair failed and we were unable to recover it. 00:31:00.344 [2024-11-28 23:23:03.702086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.702175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.702201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.344 qpair failed and we were unable to recover it. 00:31:00.344 [2024-11-28 23:23:03.702281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.702363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.702388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.344 qpair failed and we were unable to recover it. 00:31:00.344 [2024-11-28 23:23:03.702477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.702565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.702590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.344 qpair failed and we were unable to recover it. 00:31:00.344 [2024-11-28 23:23:03.702705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.702784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.702808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.344 qpair failed and we were unable to recover it. 00:31:00.344 [2024-11-28 23:23:03.702892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.702981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.703007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.344 qpair failed and we were unable to recover it. 00:31:00.344 [2024-11-28 23:23:03.703091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.703171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.703196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.344 qpair failed and we were unable to recover it. 00:31:00.344 [2024-11-28 23:23:03.703283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.703362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.703387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.344 qpair failed and we were unable to recover it. 00:31:00.344 [2024-11-28 23:23:03.703484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.703596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.703621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.344 qpair failed and we were unable to recover it. 00:31:00.344 [2024-11-28 23:23:03.703715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.703795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.703820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.344 qpair failed and we were unable to recover it. 00:31:00.344 [2024-11-28 23:23:03.703906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.703987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.704011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.344 qpair failed and we were unable to recover it. 00:31:00.344 [2024-11-28 23:23:03.704096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.704183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.704208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.344 qpair failed and we were unable to recover it. 00:31:00.344 [2024-11-28 23:23:03.704309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.344 [2024-11-28 23:23:03.704390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.704422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.345 qpair failed and we were unable to recover it. 00:31:00.345 [2024-11-28 23:23:03.704509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.704594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.704619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.345 qpair failed and we were unable to recover it. 00:31:00.345 [2024-11-28 23:23:03.704705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.704788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.704813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.345 qpair failed and we were unable to recover it. 00:31:00.345 [2024-11-28 23:23:03.704899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.705013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.705037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.345 qpair failed and we were unable to recover it. 00:31:00.345 [2024-11-28 23:23:03.705120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.705205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.705231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.345 qpair failed and we were unable to recover it. 00:31:00.345 [2024-11-28 23:23:03.705316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.705400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.705425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.345 qpair failed and we were unable to recover it. 00:31:00.345 [2024-11-28 23:23:03.705511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.705589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.705614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.345 qpair failed and we were unable to recover it. 00:31:00.345 [2024-11-28 23:23:03.705695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.705779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.705803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.345 qpair failed and we were unable to recover it. 00:31:00.345 [2024-11-28 23:23:03.705918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.705997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.706021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.345 qpair failed and we were unable to recover it. 00:31:00.345 [2024-11-28 23:23:03.706101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.706188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.706213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.345 qpair failed and we were unable to recover it. 00:31:00.345 [2024-11-28 23:23:03.706341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.706423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.706449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.345 qpair failed and we were unable to recover it. 00:31:00.345 [2024-11-28 23:23:03.706531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.706639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.706664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.345 qpair failed and we were unable to recover it. 00:31:00.345 [2024-11-28 23:23:03.706746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.706830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.706854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.345 qpair failed and we were unable to recover it. 00:31:00.345 [2024-11-28 23:23:03.706948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.707041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.707066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.345 qpair failed and we were unable to recover it. 00:31:00.345 [2024-11-28 23:23:03.707152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.707230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.707254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.345 qpair failed and we were unable to recover it. 00:31:00.345 [2024-11-28 23:23:03.707331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.707413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.707439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.345 qpair failed and we were unable to recover it. 00:31:00.345 [2024-11-28 23:23:03.707540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.707646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.707675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.345 qpair failed and we were unable to recover it. 00:31:00.345 [2024-11-28 23:23:03.707777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.707872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.707900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.345 qpair failed and we were unable to recover it. 00:31:00.345 [2024-11-28 23:23:03.707988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.708070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.708095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.345 qpair failed and we were unable to recover it. 00:31:00.345 [2024-11-28 23:23:03.708183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.708266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.708292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.345 qpair failed and we were unable to recover it. 00:31:00.345 [2024-11-28 23:23:03.708373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.708475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.708501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.345 qpair failed and we were unable to recover it. 00:31:00.345 [2024-11-28 23:23:03.708599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.708683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.708709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.345 qpair failed and we were unable to recover it. 00:31:00.345 [2024-11-28 23:23:03.708803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.708885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.708910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.345 qpair failed and we were unable to recover it. 00:31:00.345 [2024-11-28 23:23:03.709001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.709087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.709112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.345 qpair failed and we were unable to recover it. 00:31:00.345 [2024-11-28 23:23:03.709195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.709279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.709304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.345 qpair failed and we were unable to recover it. 00:31:00.345 [2024-11-28 23:23:03.709402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.709486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.709511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.345 qpair failed and we were unable to recover it. 00:31:00.345 [2024-11-28 23:23:03.709600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.709687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.709712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.345 qpair failed and we were unable to recover it. 00:31:00.345 [2024-11-28 23:23:03.709804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.709899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.709923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.345 qpair failed and we were unable to recover it. 00:31:00.345 [2024-11-28 23:23:03.710014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.710104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.345 [2024-11-28 23:23:03.710130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.345 qpair failed and we were unable to recover it. 00:31:00.345 [2024-11-28 23:23:03.710223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.710308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.710332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.346 qpair failed and we were unable to recover it. 00:31:00.346 [2024-11-28 23:23:03.710429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.710525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.710550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.346 qpair failed and we were unable to recover it. 00:31:00.346 [2024-11-28 23:23:03.710639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.710722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.710748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.346 qpair failed and we were unable to recover it. 00:31:00.346 [2024-11-28 23:23:03.710826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.710911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.710936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.346 qpair failed and we were unable to recover it. 00:31:00.346 [2024-11-28 23:23:03.711024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.711105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.711130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.346 qpair failed and we were unable to recover it. 00:31:00.346 [2024-11-28 23:23:03.711224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.711308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.711334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.346 qpair failed and we were unable to recover it. 00:31:00.346 [2024-11-28 23:23:03.711420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.711509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.711535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.346 qpair failed and we were unable to recover it. 00:31:00.346 [2024-11-28 23:23:03.711618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.711707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.711732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.346 qpair failed and we were unable to recover it. 00:31:00.346 [2024-11-28 23:23:03.711826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.711904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.711930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.346 qpair failed and we were unable to recover it. 00:31:00.346 [2024-11-28 23:23:03.712017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.712100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.712124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.346 qpair failed and we were unable to recover it. 00:31:00.346 [2024-11-28 23:23:03.712208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.712296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.712323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.346 qpair failed and we were unable to recover it. 00:31:00.346 [2024-11-28 23:23:03.712438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.712520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.712545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.346 qpair failed and we were unable to recover it. 00:31:00.346 [2024-11-28 23:23:03.712638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.712750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.712776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.346 qpair failed and we were unable to recover it. 00:31:00.346 [2024-11-28 23:23:03.712852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.712936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.712961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.346 qpair failed and we were unable to recover it. 00:31:00.346 [2024-11-28 23:23:03.713083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.713167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.713192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.346 qpair failed and we were unable to recover it. 00:31:00.346 [2024-11-28 23:23:03.713282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.713362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.713389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.346 qpair failed and we were unable to recover it. 00:31:00.346 [2024-11-28 23:23:03.713482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.713609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.713634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.346 qpair failed and we were unable to recover it. 00:31:00.346 [2024-11-28 23:23:03.713751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.713848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.713874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.346 qpair failed and we were unable to recover it. 00:31:00.346 [2024-11-28 23:23:03.713956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.714081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.714107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.346 qpair failed and we were unable to recover it. 00:31:00.346 [2024-11-28 23:23:03.714209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.714320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.714346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.346 qpair failed and we were unable to recover it. 00:31:00.346 [2024-11-28 23:23:03.714447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.714531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.714557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.346 qpair failed and we were unable to recover it. 00:31:00.346 [2024-11-28 23:23:03.714640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.714751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.714777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.346 qpair failed and we were unable to recover it. 00:31:00.346 [2024-11-28 23:23:03.714870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.714984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.715010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.346 qpair failed and we were unable to recover it. 00:31:00.346 [2024-11-28 23:23:03.715096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.715183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.715209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.346 qpair failed and we were unable to recover it. 00:31:00.346 [2024-11-28 23:23:03.715307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.715405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.715432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.346 qpair failed and we were unable to recover it. 00:31:00.346 [2024-11-28 23:23:03.715517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.715602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.715628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.346 qpair failed and we were unable to recover it. 00:31:00.346 [2024-11-28 23:23:03.715716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.715800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.715825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.346 qpair failed and we were unable to recover it. 00:31:00.346 [2024-11-28 23:23:03.715910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.716031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.716061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.346 qpair failed and we were unable to recover it. 00:31:00.346 [2024-11-28 23:23:03.716150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.716232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.346 [2024-11-28 23:23:03.716257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.346 qpair failed and we were unable to recover it. 00:31:00.346 [2024-11-28 23:23:03.716342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.716427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.716454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.347 qpair failed and we were unable to recover it. 00:31:00.347 [2024-11-28 23:23:03.716532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.716619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.716644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.347 qpair failed and we were unable to recover it. 00:31:00.347 [2024-11-28 23:23:03.716735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.716815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.716840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.347 qpair failed and we were unable to recover it. 00:31:00.347 [2024-11-28 23:23:03.716922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.717059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.717084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.347 qpair failed and we were unable to recover it. 00:31:00.347 [2024-11-28 23:23:03.717197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.717278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.717305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.347 qpair failed and we were unable to recover it. 00:31:00.347 [2024-11-28 23:23:03.717388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.717510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.717536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.347 qpair failed and we were unable to recover it. 00:31:00.347 [2024-11-28 23:23:03.717622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.717734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.717760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.347 qpair failed and we were unable to recover it. 00:31:00.347 [2024-11-28 23:23:03.717879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.717966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.717991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.347 qpair failed and we were unable to recover it. 00:31:00.347 [2024-11-28 23:23:03.718070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.718179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.718209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.347 qpair failed and we were unable to recover it. 00:31:00.347 [2024-11-28 23:23:03.718291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.718379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.718410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.347 qpair failed and we were unable to recover it. 00:31:00.347 [2024-11-28 23:23:03.718500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.718585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.718611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.347 qpair failed and we were unable to recover it. 00:31:00.347 [2024-11-28 23:23:03.718733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.718816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.718841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.347 qpair failed and we were unable to recover it. 00:31:00.347 [2024-11-28 23:23:03.718953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.719036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.719062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.347 qpair failed and we were unable to recover it. 00:31:00.347 [2024-11-28 23:23:03.719207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.719287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.719313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.347 qpair failed and we were unable to recover it. 00:31:00.347 [2024-11-28 23:23:03.719423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.719505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.719530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.347 qpair failed and we were unable to recover it. 00:31:00.347 [2024-11-28 23:23:03.719613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.719699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.719724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.347 qpair failed and we were unable to recover it. 00:31:00.347 [2024-11-28 23:23:03.719842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.719921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.719946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.347 qpair failed and we were unable to recover it. 00:31:00.347 [2024-11-28 23:23:03.720036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.720117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.720143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.347 qpair failed and we were unable to recover it. 00:31:00.347 [2024-11-28 23:23:03.720232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.720343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.720374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.347 qpair failed and we were unable to recover it. 00:31:00.347 [2024-11-28 23:23:03.720480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.720624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.720650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.347 qpair failed and we were unable to recover it. 00:31:00.347 [2024-11-28 23:23:03.720731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.720815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.720840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.347 qpair failed and we were unable to recover it. 00:31:00.347 [2024-11-28 23:23:03.720932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.721041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.721066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.347 qpair failed and we were unable to recover it. 00:31:00.347 [2024-11-28 23:23:03.721148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.721225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.721251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.347 qpair failed and we were unable to recover it. 00:31:00.347 [2024-11-28 23:23:03.721363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.721457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.721483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.347 qpair failed and we were unable to recover it. 00:31:00.347 [2024-11-28 23:23:03.721571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.721645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.721670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.347 qpair failed and we were unable to recover it. 00:31:00.347 [2024-11-28 23:23:03.721756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.721869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.721894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.347 qpair failed and we were unable to recover it. 00:31:00.347 [2024-11-28 23:23:03.721977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.722065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.722090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.347 qpair failed and we were unable to recover it. 00:31:00.347 [2024-11-28 23:23:03.722178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.722259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.722285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.347 qpair failed and we were unable to recover it. 00:31:00.347 [2024-11-28 23:23:03.722381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.722475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.347 [2024-11-28 23:23:03.722506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.347 qpair failed and we were unable to recover it. 00:31:00.347 [2024-11-28 23:23:03.722586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.722663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.722689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.348 qpair failed and we were unable to recover it. 00:31:00.348 [2024-11-28 23:23:03.722774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.722857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.722883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.348 qpair failed and we were unable to recover it. 00:31:00.348 [2024-11-28 23:23:03.722980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.723064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.723090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.348 qpair failed and we were unable to recover it. 00:31:00.348 [2024-11-28 23:23:03.723176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.723256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.723282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.348 qpair failed and we were unable to recover it. 00:31:00.348 [2024-11-28 23:23:03.723364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.723494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.723521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.348 qpair failed and we were unable to recover it. 00:31:00.348 [2024-11-28 23:23:03.723607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.723692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.723718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.348 qpair failed and we were unable to recover it. 00:31:00.348 [2024-11-28 23:23:03.723836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.723927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.723953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.348 qpair failed and we were unable to recover it. 00:31:00.348 [2024-11-28 23:23:03.724068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.724151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.724177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.348 qpair failed and we were unable to recover it. 00:31:00.348 [2024-11-28 23:23:03.724264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.724374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.724407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.348 qpair failed and we were unable to recover it. 00:31:00.348 [2024-11-28 23:23:03.724488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.724573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.724600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.348 qpair failed and we were unable to recover it. 00:31:00.348 [2024-11-28 23:23:03.724721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.724809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.724834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.348 qpair failed and we were unable to recover it. 00:31:00.348 [2024-11-28 23:23:03.724928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.725065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.725091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.348 qpair failed and we were unable to recover it. 00:31:00.348 [2024-11-28 23:23:03.725234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.725320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.725346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.348 qpair failed and we were unable to recover it. 00:31:00.348 [2024-11-28 23:23:03.725427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.725516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.725541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.348 qpair failed and we were unable to recover it. 00:31:00.348 [2024-11-28 23:23:03.725658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.725742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.725768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.348 qpair failed and we were unable to recover it. 00:31:00.348 [2024-11-28 23:23:03.725851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.725932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.725957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.348 qpair failed and we were unable to recover it. 00:31:00.348 [2024-11-28 23:23:03.726043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.726128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.726153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.348 qpair failed and we were unable to recover it. 00:31:00.348 [2024-11-28 23:23:03.726231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.726347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.726372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.348 qpair failed and we were unable to recover it. 00:31:00.348 [2024-11-28 23:23:03.726469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.726560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.726587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.348 qpair failed and we were unable to recover it. 00:31:00.348 [2024-11-28 23:23:03.726671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.726781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.726806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.348 qpair failed and we were unable to recover it. 00:31:00.348 [2024-11-28 23:23:03.726907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.727014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.727040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.348 qpair failed and we were unable to recover it. 00:31:00.348 [2024-11-28 23:23:03.727124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.727206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.727233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.348 qpair failed and we were unable to recover it. 00:31:00.348 [2024-11-28 23:23:03.727322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.727419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.727445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.348 qpair failed and we were unable to recover it. 00:31:00.348 [2024-11-28 23:23:03.727529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.727614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.727641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.348 qpair failed and we were unable to recover it. 00:31:00.348 [2024-11-28 23:23:03.727768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.727881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.727906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.348 qpair failed and we were unable to recover it. 00:31:00.348 [2024-11-28 23:23:03.727990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.728105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.348 [2024-11-28 23:23:03.728131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.348 qpair failed and we were unable to recover it. 00:31:00.349 [2024-11-28 23:23:03.728221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.728333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.728358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.349 qpair failed and we were unable to recover it. 00:31:00.349 [2024-11-28 23:23:03.728470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.728582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.728608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.349 qpair failed and we were unable to recover it. 00:31:00.349 [2024-11-28 23:23:03.728696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.728802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.728827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.349 qpair failed and we were unable to recover it. 00:31:00.349 [2024-11-28 23:23:03.728909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.728993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.729019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.349 qpair failed and we were unable to recover it. 00:31:00.349 [2024-11-28 23:23:03.729110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.729191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.729218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.349 qpair failed and we were unable to recover it. 00:31:00.349 [2024-11-28 23:23:03.729303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.729383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.729418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.349 qpair failed and we were unable to recover it. 00:31:00.349 [2024-11-28 23:23:03.729523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.729638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.729665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.349 qpair failed and we were unable to recover it. 00:31:00.349 [2024-11-28 23:23:03.729782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.729871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.729896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.349 qpair failed and we were unable to recover it. 00:31:00.349 [2024-11-28 23:23:03.730017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.730101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.730126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.349 qpair failed and we were unable to recover it. 00:31:00.349 [2024-11-28 23:23:03.730239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.730324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.730349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.349 qpair failed and we were unable to recover it. 00:31:00.349 [2024-11-28 23:23:03.730446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.730534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.730560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.349 qpair failed and we were unable to recover it. 00:31:00.349 [2024-11-28 23:23:03.730653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.730736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.730762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.349 qpair failed and we were unable to recover it. 00:31:00.349 [2024-11-28 23:23:03.730853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.730963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.730989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.349 qpair failed and we were unable to recover it. 00:31:00.349 [2024-11-28 23:23:03.731075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.731191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.731217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.349 qpair failed and we were unable to recover it. 00:31:00.349 [2024-11-28 23:23:03.731334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.731419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.731446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.349 qpair failed and we were unable to recover it. 00:31:00.349 [2024-11-28 23:23:03.731531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.731613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.731639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.349 qpair failed and we were unable to recover it. 00:31:00.349 [2024-11-28 23:23:03.731725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.731836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.731861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.349 qpair failed and we were unable to recover it. 00:31:00.349 [2024-11-28 23:23:03.731979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.732061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.732086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.349 qpair failed and we were unable to recover it. 00:31:00.349 [2024-11-28 23:23:03.732205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.732287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.732313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.349 qpair failed and we were unable to recover it. 00:31:00.349 [2024-11-28 23:23:03.732458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.732573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.732599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.349 qpair failed and we were unable to recover it. 00:31:00.349 [2024-11-28 23:23:03.732685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.732770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.732796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.349 qpair failed and we were unable to recover it. 00:31:00.349 [2024-11-28 23:23:03.732910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.732993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.733018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.349 qpair failed and we were unable to recover it. 00:31:00.349 [2024-11-28 23:23:03.733105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.733195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.733220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.349 qpair failed and we were unable to recover it. 00:31:00.349 [2024-11-28 23:23:03.733308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.733402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.733428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.349 qpair failed and we were unable to recover it. 00:31:00.349 [2024-11-28 23:23:03.733516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.733593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.733619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.349 qpair failed and we were unable to recover it. 00:31:00.349 [2024-11-28 23:23:03.733727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.733814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.733839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.349 qpair failed and we were unable to recover it. 00:31:00.349 [2024-11-28 23:23:03.733922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.734010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.734035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.349 qpair failed and we were unable to recover it. 00:31:00.349 [2024-11-28 23:23:03.734129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.734214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.734239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.349 qpair failed and we were unable to recover it. 00:31:00.349 [2024-11-28 23:23:03.734325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.734404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.349 [2024-11-28 23:23:03.734431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.349 qpair failed and we were unable to recover it. 00:31:00.350 [2024-11-28 23:23:03.734517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.734607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.734633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.350 qpair failed and we were unable to recover it. 00:31:00.350 [2024-11-28 23:23:03.734716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.734803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.734829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.350 qpair failed and we were unable to recover it. 00:31:00.350 [2024-11-28 23:23:03.734925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.735068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.735094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.350 qpair failed and we were unable to recover it. 00:31:00.350 [2024-11-28 23:23:03.735183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.735274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.735300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.350 qpair failed and we were unable to recover it. 00:31:00.350 [2024-11-28 23:23:03.735399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.735486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.735512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.350 qpair failed and we were unable to recover it. 00:31:00.350 [2024-11-28 23:23:03.735607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.735686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.735711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.350 qpair failed and we were unable to recover it. 00:31:00.350 [2024-11-28 23:23:03.735792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.735881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.735906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.350 qpair failed and we were unable to recover it. 00:31:00.350 [2024-11-28 23:23:03.736021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.736111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.736137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.350 qpair failed and we were unable to recover it. 00:31:00.350 [2024-11-28 23:23:03.736230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.736313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.736340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.350 qpair failed and we were unable to recover it. 00:31:00.350 [2024-11-28 23:23:03.736427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.736512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.736538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.350 qpair failed and we were unable to recover it. 00:31:00.350 [2024-11-28 23:23:03.736630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.736706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.736731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.350 qpair failed and we were unable to recover it. 00:31:00.350 [2024-11-28 23:23:03.736813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.736898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.736923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.350 qpair failed and we were unable to recover it. 00:31:00.350 [2024-11-28 23:23:03.737008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.737101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.737127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.350 qpair failed and we were unable to recover it. 00:31:00.350 [2024-11-28 23:23:03.737213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.737325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.737351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.350 qpair failed and we were unable to recover it. 00:31:00.350 [2024-11-28 23:23:03.737443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.737526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.737551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.350 qpair failed and we were unable to recover it. 00:31:00.350 [2024-11-28 23:23:03.737645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.737784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.737809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.350 qpair failed and we were unable to recover it. 00:31:00.350 [2024-11-28 23:23:03.737892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.737977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.738004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.350 qpair failed and we were unable to recover it. 00:31:00.350 [2024-11-28 23:23:03.738092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.738185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.738211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.350 qpair failed and we were unable to recover it. 00:31:00.350 [2024-11-28 23:23:03.738301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.738417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.738443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.350 qpair failed and we were unable to recover it. 00:31:00.350 [2024-11-28 23:23:03.738565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.738660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.738685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.350 qpair failed and we were unable to recover it. 00:31:00.350 [2024-11-28 23:23:03.738769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.738856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.738882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.350 qpair failed and we were unable to recover it. 00:31:00.350 [2024-11-28 23:23:03.738971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.739082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.739108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.350 qpair failed and we were unable to recover it. 00:31:00.350 [2024-11-28 23:23:03.739203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.739303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.739338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.350 qpair failed and we were unable to recover it. 00:31:00.350 [2024-11-28 23:23:03.739491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.739598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.739633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.350 qpair failed and we were unable to recover it. 00:31:00.350 [2024-11-28 23:23:03.739749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.739854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.739891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.350 qpair failed and we were unable to recover it. 00:31:00.350 [2024-11-28 23:23:03.740012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.740116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.740145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.350 qpair failed and we were unable to recover it. 00:31:00.350 [2024-11-28 23:23:03.740236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.740324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.740350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.350 qpair failed and we were unable to recover it. 00:31:00.350 [2024-11-28 23:23:03.740449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.740539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.740565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.350 qpair failed and we were unable to recover it. 00:31:00.350 [2024-11-28 23:23:03.740689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.740782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.350 [2024-11-28 23:23:03.740808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.350 qpair failed and we were unable to recover it. 00:31:00.351 [2024-11-28 23:23:03.740908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.741002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.741029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.351 qpair failed and we were unable to recover it. 00:31:00.351 [2024-11-28 23:23:03.741114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.741205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.741230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.351 qpair failed and we were unable to recover it. 00:31:00.351 [2024-11-28 23:23:03.741314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.741405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.741431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.351 qpair failed and we were unable to recover it. 00:31:00.351 [2024-11-28 23:23:03.741532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.741622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.741652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.351 qpair failed and we were unable to recover it. 00:31:00.351 [2024-11-28 23:23:03.741751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.741840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.741866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.351 qpair failed and we were unable to recover it. 00:31:00.351 [2024-11-28 23:23:03.741953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.742038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.742064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.351 qpair failed and we were unable to recover it. 00:31:00.351 [2024-11-28 23:23:03.742180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.742267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.742293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.351 qpair failed and we were unable to recover it. 00:31:00.351 [2024-11-28 23:23:03.742374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.742463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.742489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.351 qpair failed and we were unable to recover it. 00:31:00.351 [2024-11-28 23:23:03.742604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.742689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.742718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.351 qpair failed and we were unable to recover it. 00:31:00.351 [2024-11-28 23:23:03.742841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.742921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.742947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.351 qpair failed and we were unable to recover it. 00:31:00.351 [2024-11-28 23:23:03.743035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.743151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.743177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.351 qpair failed and we were unable to recover it. 00:31:00.351 [2024-11-28 23:23:03.743261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.743342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.743368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.351 qpair failed and we were unable to recover it. 00:31:00.351 [2024-11-28 23:23:03.743465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.743556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.743582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.351 qpair failed and we were unable to recover it. 00:31:00.351 [2024-11-28 23:23:03.743669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.743753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.743780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.351 qpair failed and we were unable to recover it. 00:31:00.351 [2024-11-28 23:23:03.743872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.743956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.743983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.351 qpair failed and we were unable to recover it. 00:31:00.351 [2024-11-28 23:23:03.744087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.744169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.744195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.351 qpair failed and we were unable to recover it. 00:31:00.351 [2024-11-28 23:23:03.744289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.744373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.744407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.351 qpair failed and we were unable to recover it. 00:31:00.351 [2024-11-28 23:23:03.744502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.744588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.744613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.351 qpair failed and we were unable to recover it. 00:31:00.351 [2024-11-28 23:23:03.744702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.744814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.744840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.351 qpair failed and we were unable to recover it. 00:31:00.351 [2024-11-28 23:23:03.744931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.745035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.745060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.351 qpair failed and we were unable to recover it. 00:31:00.351 [2024-11-28 23:23:03.745144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.745237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.745263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.351 qpair failed and we were unable to recover it. 00:31:00.351 [2024-11-28 23:23:03.745345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.745440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.745471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.351 qpair failed and we were unable to recover it. 00:31:00.351 [2024-11-28 23:23:03.745561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.745650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.745677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.351 qpair failed and we were unable to recover it. 00:31:00.351 [2024-11-28 23:23:03.745763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.745846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.745872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.351 qpair failed and we were unable to recover it. 00:31:00.351 [2024-11-28 23:23:03.745985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.746095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.746121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.351 qpair failed and we were unable to recover it. 00:31:00.351 [2024-11-28 23:23:03.746201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.746289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.746315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.351 qpair failed and we were unable to recover it. 00:31:00.351 [2024-11-28 23:23:03.746433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.746530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.746557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.351 qpair failed and we were unable to recover it. 00:31:00.351 [2024-11-28 23:23:03.746636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.746724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.746750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.351 qpair failed and we were unable to recover it. 00:31:00.351 [2024-11-28 23:23:03.746842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.746932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.351 [2024-11-28 23:23:03.746957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.351 qpair failed and we were unable to recover it. 00:31:00.352 [2024-11-28 23:23:03.747049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.747161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.747189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.352 qpair failed and we were unable to recover it. 00:31:00.352 [2024-11-28 23:23:03.747287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.747378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.747410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.352 qpair failed and we were unable to recover it. 00:31:00.352 [2024-11-28 23:23:03.747495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.747577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.747603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.352 qpair failed and we were unable to recover it. 00:31:00.352 [2024-11-28 23:23:03.747696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.747809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.747834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.352 qpair failed and we were unable to recover it. 00:31:00.352 [2024-11-28 23:23:03.747917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.748031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.748056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.352 qpair failed and we were unable to recover it. 00:31:00.352 [2024-11-28 23:23:03.748180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.748261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.748291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.352 qpair failed and we were unable to recover it. 00:31:00.352 [2024-11-28 23:23:03.748375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.748465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.748491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.352 qpair failed and we were unable to recover it. 00:31:00.352 [2024-11-28 23:23:03.748572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.748668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.748694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.352 qpair failed and we were unable to recover it. 00:31:00.352 [2024-11-28 23:23:03.748780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.748867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.748893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.352 qpair failed and we were unable to recover it. 00:31:00.352 [2024-11-28 23:23:03.748978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.749099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.749125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.352 qpair failed and we were unable to recover it. 00:31:00.352 [2024-11-28 23:23:03.749212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.749301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.749326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.352 qpair failed and we were unable to recover it. 00:31:00.352 [2024-11-28 23:23:03.749427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.749545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.749572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.352 qpair failed and we were unable to recover it. 00:31:00.352 [2024-11-28 23:23:03.749661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.749776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.749802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.352 qpair failed and we were unable to recover it. 00:31:00.352 [2024-11-28 23:23:03.749921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.750000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.750026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.352 qpair failed and we were unable to recover it. 00:31:00.352 [2024-11-28 23:23:03.750117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.750226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.750251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.352 qpair failed and we were unable to recover it. 00:31:00.352 [2024-11-28 23:23:03.750344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.750433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.750459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.352 qpair failed and we were unable to recover it. 00:31:00.352 [2024-11-28 23:23:03.750547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.750651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.750677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.352 qpair failed and we were unable to recover it. 00:31:00.352 [2024-11-28 23:23:03.750793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.750882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.750920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.352 qpair failed and we were unable to recover it. 00:31:00.352 [2024-11-28 23:23:03.751060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.751147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.751174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.352 qpair failed and we were unable to recover it. 00:31:00.352 [2024-11-28 23:23:03.751258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.751339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.751365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.352 qpair failed and we were unable to recover it. 00:31:00.352 [2024-11-28 23:23:03.751460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.751546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.751572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.352 qpair failed and we were unable to recover it. 00:31:00.352 [2024-11-28 23:23:03.751662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.751749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.751775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.352 qpair failed and we were unable to recover it. 00:31:00.352 [2024-11-28 23:23:03.751861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.751942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.751968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.352 qpair failed and we were unable to recover it. 00:31:00.352 [2024-11-28 23:23:03.752055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.752174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.752200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.352 qpair failed and we were unable to recover it. 00:31:00.352 [2024-11-28 23:23:03.752317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.752407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.752434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.352 qpair failed and we were unable to recover it. 00:31:00.352 [2024-11-28 23:23:03.752525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.352 [2024-11-28 23:23:03.752611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.752637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.353 qpair failed and we were unable to recover it. 00:31:00.353 [2024-11-28 23:23:03.752769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.752858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.752883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.353 qpair failed and we were unable to recover it. 00:31:00.353 [2024-11-28 23:23:03.752960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.753074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.753104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.353 qpair failed and we were unable to recover it. 00:31:00.353 [2024-11-28 23:23:03.753203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.753293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.753319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.353 qpair failed and we were unable to recover it. 00:31:00.353 [2024-11-28 23:23:03.753407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.753534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.753561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.353 qpair failed and we were unable to recover it. 00:31:00.353 [2024-11-28 23:23:03.753681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.753766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.753791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.353 qpair failed and we were unable to recover it. 00:31:00.353 [2024-11-28 23:23:03.753875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.753961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.753987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.353 qpair failed and we were unable to recover it. 00:31:00.353 [2024-11-28 23:23:03.754068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.754179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.754205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.353 qpair failed and we were unable to recover it. 00:31:00.353 [2024-11-28 23:23:03.754292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.754387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.754418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.353 qpair failed and we were unable to recover it. 00:31:00.353 [2024-11-28 23:23:03.754518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.754605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.754631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.353 qpair failed and we were unable to recover it. 00:31:00.353 [2024-11-28 23:23:03.754712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.754802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.754827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.353 qpair failed and we were unable to recover it. 00:31:00.353 [2024-11-28 23:23:03.754917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.755034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.755060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.353 qpair failed and we were unable to recover it. 00:31:00.353 [2024-11-28 23:23:03.755144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.755231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.755264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.353 qpair failed and we were unable to recover it. 00:31:00.353 [2024-11-28 23:23:03.755352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.755457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.755483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.353 qpair failed and we were unable to recover it. 00:31:00.353 [2024-11-28 23:23:03.755574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.755655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.755681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.353 qpair failed and we were unable to recover it. 00:31:00.353 [2024-11-28 23:23:03.755776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.755885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.755914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.353 qpair failed and we were unable to recover it. 00:31:00.353 [2024-11-28 23:23:03.756007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.756102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.756128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.353 qpair failed and we were unable to recover it. 00:31:00.353 [2024-11-28 23:23:03.756217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.756297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.756323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.353 qpair failed and we were unable to recover it. 00:31:00.353 [2024-11-28 23:23:03.756414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.756502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.756528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.353 qpair failed and we were unable to recover it. 00:31:00.353 [2024-11-28 23:23:03.756619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.756703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.756729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.353 qpair failed and we were unable to recover it. 00:31:00.353 [2024-11-28 23:23:03.756851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.756936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.756962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.353 qpair failed and we were unable to recover it. 00:31:00.353 [2024-11-28 23:23:03.757050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.757161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.757187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.353 qpair failed and we were unable to recover it. 00:31:00.353 [2024-11-28 23:23:03.757275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.757365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.757401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.353 qpair failed and we were unable to recover it. 00:31:00.353 [2024-11-28 23:23:03.757491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.757578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.757603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.353 qpair failed and we were unable to recover it. 00:31:00.353 [2024-11-28 23:23:03.757691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.757779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.757805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.353 qpair failed and we were unable to recover it. 00:31:00.353 [2024-11-28 23:23:03.757888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.758006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.758031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.353 qpair failed and we were unable to recover it. 00:31:00.353 [2024-11-28 23:23:03.758129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.758210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.758236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.353 qpair failed and we were unable to recover it. 00:31:00.353 [2024-11-28 23:23:03.758316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.758402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.758429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.353 qpair failed and we were unable to recover it. 00:31:00.353 [2024-11-28 23:23:03.758517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.353 [2024-11-28 23:23:03.758600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.758627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.354 qpair failed and we were unable to recover it. 00:31:00.354 [2024-11-28 23:23:03.758738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.758878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.758904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.354 qpair failed and we were unable to recover it. 00:31:00.354 [2024-11-28 23:23:03.758991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.759110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.759136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.354 qpair failed and we were unable to recover it. 00:31:00.354 [2024-11-28 23:23:03.759224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.759302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.759327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.354 qpair failed and we were unable to recover it. 00:31:00.354 [2024-11-28 23:23:03.759439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.759528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.759553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.354 qpair failed and we were unable to recover it. 00:31:00.354 [2024-11-28 23:23:03.759676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.759755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.759780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.354 qpair failed and we were unable to recover it. 00:31:00.354 [2024-11-28 23:23:03.759878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.759958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.759984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.354 qpair failed and we were unable to recover it. 00:31:00.354 [2024-11-28 23:23:03.760101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.760208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.760235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.354 qpair failed and we were unable to recover it. 00:31:00.354 [2024-11-28 23:23:03.760330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.760448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.760474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.354 qpair failed and we were unable to recover it. 00:31:00.354 [2024-11-28 23:23:03.760557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.760635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.760663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.354 qpair failed and we were unable to recover it. 00:31:00.354 [2024-11-28 23:23:03.760749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.760829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.760859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.354 qpair failed and we were unable to recover it. 00:31:00.354 [2024-11-28 23:23:03.760942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.761053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.761079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.354 qpair failed and we were unable to recover it. 00:31:00.354 [2024-11-28 23:23:03.761175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.761256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.761282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.354 qpair failed and we were unable to recover it. 00:31:00.354 [2024-11-28 23:23:03.761399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.761490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.761515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.354 qpair failed and we were unable to recover it. 00:31:00.354 [2024-11-28 23:23:03.761595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.761720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.761745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.354 qpair failed and we were unable to recover it. 00:31:00.354 [2024-11-28 23:23:03.761848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.761956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.761982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.354 qpair failed and we were unable to recover it. 00:31:00.354 [2024-11-28 23:23:03.762076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.762165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.762192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.354 qpair failed and we were unable to recover it. 00:31:00.354 [2024-11-28 23:23:03.762284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.762361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.762387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.354 qpair failed and we were unable to recover it. 00:31:00.354 [2024-11-28 23:23:03.762483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.762572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.762598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.354 qpair failed and we were unable to recover it. 00:31:00.354 [2024-11-28 23:23:03.762716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.762800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.762826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.354 qpair failed and we were unable to recover it. 00:31:00.354 [2024-11-28 23:23:03.762945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.763031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.763057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.354 qpair failed and we were unable to recover it. 00:31:00.354 [2024-11-28 23:23:03.763172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.763259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.763284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.354 qpair failed and we were unable to recover it. 00:31:00.354 [2024-11-28 23:23:03.763371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.763470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.763497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.354 qpair failed and we were unable to recover it. 00:31:00.354 [2024-11-28 23:23:03.763586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.763715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.763740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.354 qpair failed and we were unable to recover it. 00:31:00.354 [2024-11-28 23:23:03.763831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.763919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.763946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.354 qpair failed and we were unable to recover it. 00:31:00.354 [2024-11-28 23:23:03.764066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.764156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.764181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.354 qpair failed and we were unable to recover it. 00:31:00.354 [2024-11-28 23:23:03.764269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.764355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.764381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.354 qpair failed and we were unable to recover it. 00:31:00.354 [2024-11-28 23:23:03.764472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.764557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.764584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.354 qpair failed and we were unable to recover it. 00:31:00.354 [2024-11-28 23:23:03.764671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.764786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.354 [2024-11-28 23:23:03.764814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.354 qpair failed and we were unable to recover it. 00:31:00.355 [2024-11-28 23:23:03.764908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.764992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.765018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.355 qpair failed and we were unable to recover it. 00:31:00.355 [2024-11-28 23:23:03.765101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.765189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.765214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.355 qpair failed and we were unable to recover it. 00:31:00.355 [2024-11-28 23:23:03.765299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.765391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.765423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.355 qpair failed and we were unable to recover it. 00:31:00.355 [2024-11-28 23:23:03.765507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.765599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.765625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.355 qpair failed and we were unable to recover it. 00:31:00.355 [2024-11-28 23:23:03.765723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.765812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.765838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.355 qpair failed and we were unable to recover it. 00:31:00.355 [2024-11-28 23:23:03.765924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.766004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.766029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.355 qpair failed and we were unable to recover it. 00:31:00.355 [2024-11-28 23:23:03.766125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.766234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.766259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.355 qpair failed and we were unable to recover it. 00:31:00.355 [2024-11-28 23:23:03.766349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.766448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.766476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.355 qpair failed and we were unable to recover it. 00:31:00.355 [2024-11-28 23:23:03.766562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.766658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.766684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.355 qpair failed and we were unable to recover it. 00:31:00.355 [2024-11-28 23:23:03.766814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.766905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.766931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.355 qpair failed and we were unable to recover it. 00:31:00.355 [2024-11-28 23:23:03.767058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.767170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.767195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.355 qpair failed and we were unable to recover it. 00:31:00.355 [2024-11-28 23:23:03.767288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.767365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.767390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.355 qpair failed and we were unable to recover it. 00:31:00.355 [2024-11-28 23:23:03.767489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.767570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.767596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.355 qpair failed and we were unable to recover it. 00:31:00.355 [2024-11-28 23:23:03.767685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.767782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.767807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.355 qpair failed and we were unable to recover it. 00:31:00.355 [2024-11-28 23:23:03.767919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.767998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.768024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.355 qpair failed and we were unable to recover it. 00:31:00.355 [2024-11-28 23:23:03.768144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.768265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.768291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.355 qpair failed and we were unable to recover it. 00:31:00.355 [2024-11-28 23:23:03.768390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.768487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.768516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.355 qpair failed and we were unable to recover it. 00:31:00.355 [2024-11-28 23:23:03.768602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.768683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.768710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.355 qpair failed and we were unable to recover it. 00:31:00.355 [2024-11-28 23:23:03.768799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.768912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.768938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.355 qpair failed and we were unable to recover it. 00:31:00.355 [2024-11-28 23:23:03.769029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.769113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.769143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.355 qpair failed and we were unable to recover it. 00:31:00.355 [2024-11-28 23:23:03.769233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.769349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.769375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.355 qpair failed and we were unable to recover it. 00:31:00.355 [2024-11-28 23:23:03.769528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.769611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.769637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.355 qpair failed and we were unable to recover it. 00:31:00.355 [2024-11-28 23:23:03.769719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.769808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.769835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.355 qpair failed and we were unable to recover it. 00:31:00.355 [2024-11-28 23:23:03.769929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.770010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.770037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.355 qpair failed and we were unable to recover it. 00:31:00.355 [2024-11-28 23:23:03.770127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.770217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.770242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.355 qpair failed and we were unable to recover it. 00:31:00.355 [2024-11-28 23:23:03.770323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.770406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.770432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.355 qpair failed and we were unable to recover it. 00:31:00.355 [2024-11-28 23:23:03.770524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.770638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.770664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.355 qpair failed and we were unable to recover it. 00:31:00.355 [2024-11-28 23:23:03.770752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.770835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.770861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.355 qpair failed and we were unable to recover it. 00:31:00.355 [2024-11-28 23:23:03.770958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.771039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.355 [2024-11-28 23:23:03.771065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.356 qpair failed and we were unable to recover it. 00:31:00.356 [2024-11-28 23:23:03.771154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.771265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.771291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.356 qpair failed and we were unable to recover it. 00:31:00.356 [2024-11-28 23:23:03.771378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.771461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.771487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.356 qpair failed and we were unable to recover it. 00:31:00.356 [2024-11-28 23:23:03.771581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.771670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.771695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.356 qpair failed and we were unable to recover it. 00:31:00.356 [2024-11-28 23:23:03.771784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.771867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.771892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.356 qpair failed and we were unable to recover it. 00:31:00.356 [2024-11-28 23:23:03.771981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.772063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.772088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.356 qpair failed and we were unable to recover it. 00:31:00.356 [2024-11-28 23:23:03.772199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.772314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.772340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.356 qpair failed and we were unable to recover it. 00:31:00.356 [2024-11-28 23:23:03.772430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.772524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.772550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.356 qpair failed and we were unable to recover it. 00:31:00.356 [2024-11-28 23:23:03.772592] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x53c980 (9): Bad file descriptor 00:31:00.356 [2024-11-28 23:23:03.772744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.772838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.772867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.356 qpair failed and we were unable to recover it. 00:31:00.356 [2024-11-28 23:23:03.772968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.773054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.773080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.356 qpair failed and we were unable to recover it. 00:31:00.356 [2024-11-28 23:23:03.773224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.773346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.773371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.356 qpair failed and we were unable to recover it. 00:31:00.356 [2024-11-28 23:23:03.773462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.773554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.773580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.356 qpair failed and we were unable to recover it. 00:31:00.356 [2024-11-28 23:23:03.773668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.773757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.773787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.356 qpair failed and we were unable to recover it. 00:31:00.356 [2024-11-28 23:23:03.773888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.773968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.773997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.356 qpair failed and we were unable to recover it. 00:31:00.356 [2024-11-28 23:23:03.774086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.774179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.774205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.356 qpair failed and we were unable to recover it. 00:31:00.356 [2024-11-28 23:23:03.774299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.774381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.774413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.356 qpair failed and we were unable to recover it. 00:31:00.356 [2024-11-28 23:23:03.774498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.774582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.774613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.356 qpair failed and we were unable to recover it. 00:31:00.356 [2024-11-28 23:23:03.774707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.774810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.774837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.356 qpair failed and we were unable to recover it. 00:31:00.356 [2024-11-28 23:23:03.774936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.775023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.775049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.356 qpair failed and we were unable to recover it. 00:31:00.356 [2024-11-28 23:23:03.775167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.775276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.775301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.356 qpair failed and we were unable to recover it. 00:31:00.356 [2024-11-28 23:23:03.775398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.775490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.775519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.356 qpair failed and we were unable to recover it. 00:31:00.356 [2024-11-28 23:23:03.775642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.775766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.775794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.356 qpair failed and we were unable to recover it. 00:31:00.356 [2024-11-28 23:23:03.775924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.776015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.776041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.356 qpair failed and we were unable to recover it. 00:31:00.356 [2024-11-28 23:23:03.776123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.776206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.776233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.356 qpair failed and we were unable to recover it. 00:31:00.356 [2024-11-28 23:23:03.776316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.776431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.776463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.356 qpair failed and we were unable to recover it. 00:31:00.356 [2024-11-28 23:23:03.776557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.776659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.776688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.356 qpair failed and we were unable to recover it. 00:31:00.356 [2024-11-28 23:23:03.776805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.776889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.776915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.356 qpair failed and we were unable to recover it. 00:31:00.356 [2024-11-28 23:23:03.777028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.777113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.777138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.356 qpair failed and we were unable to recover it. 00:31:00.356 [2024-11-28 23:23:03.777236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.777320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.356 [2024-11-28 23:23:03.777350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.356 qpair failed and we were unable to recover it. 00:31:00.356 [2024-11-28 23:23:03.777469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.777558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.777584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.357 qpair failed and we were unable to recover it. 00:31:00.357 [2024-11-28 23:23:03.777672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.777755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.777781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.357 qpair failed and we were unable to recover it. 00:31:00.357 [2024-11-28 23:23:03.777914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.778001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.778027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.357 qpair failed and we were unable to recover it. 00:31:00.357 [2024-11-28 23:23:03.778111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.778197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.778223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.357 qpair failed and we were unable to recover it. 00:31:00.357 [2024-11-28 23:23:03.778319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.778406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.778432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.357 qpair failed and we were unable to recover it. 00:31:00.357 [2024-11-28 23:23:03.778519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.778612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.778639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.357 qpair failed and we were unable to recover it. 00:31:00.357 [2024-11-28 23:23:03.778743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.778839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.778865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.357 qpair failed and we were unable to recover it. 00:31:00.357 [2024-11-28 23:23:03.778955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.779031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.779057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.357 qpair failed and we were unable to recover it. 00:31:00.357 [2024-11-28 23:23:03.779139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.779224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.779250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.357 qpair failed and we were unable to recover it. 00:31:00.357 [2024-11-28 23:23:03.779374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.779465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.779491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.357 qpair failed and we were unable to recover it. 00:31:00.357 [2024-11-28 23:23:03.779610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.779699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.779725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.357 qpair failed and we were unable to recover it. 00:31:00.357 [2024-11-28 23:23:03.779840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.779957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.779984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.357 qpair failed and we were unable to recover it. 00:31:00.357 [2024-11-28 23:23:03.780075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.780153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.780179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.357 qpair failed and we were unable to recover it. 00:31:00.357 [2024-11-28 23:23:03.780271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.780363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.780388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.357 qpair failed and we were unable to recover it. 00:31:00.357 [2024-11-28 23:23:03.780489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.780571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.780597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.357 qpair failed and we were unable to recover it. 00:31:00.357 [2024-11-28 23:23:03.780697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.780825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.780853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.357 qpair failed and we were unable to recover it. 00:31:00.357 [2024-11-28 23:23:03.780948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.781030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.781056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.357 qpair failed and we were unable to recover it. 00:31:00.357 [2024-11-28 23:23:03.781206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.781295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.781322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.357 qpair failed and we were unable to recover it. 00:31:00.357 [2024-11-28 23:23:03.781415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.781503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.781529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.357 qpair failed and we were unable to recover it. 00:31:00.357 [2024-11-28 23:23:03.781618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.781730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.781756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.357 qpair failed and we were unable to recover it. 00:31:00.357 [2024-11-28 23:23:03.781853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.781932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.781958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.357 qpair failed and we were unable to recover it. 00:31:00.357 [2024-11-28 23:23:03.782038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.782145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.782170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.357 qpair failed and we were unable to recover it. 00:31:00.357 [2024-11-28 23:23:03.782256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.782334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.782359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.357 qpair failed and we were unable to recover it. 00:31:00.357 [2024-11-28 23:23:03.782481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.782562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.782588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.357 qpair failed and we were unable to recover it. 00:31:00.357 [2024-11-28 23:23:03.782709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.782791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.782817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.357 qpair failed and we were unable to recover it. 00:31:00.357 [2024-11-28 23:23:03.782904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.357 [2024-11-28 23:23:03.783019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.783044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.358 qpair failed and we were unable to recover it. 00:31:00.358 [2024-11-28 23:23:03.783128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.783207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.783233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.358 qpair failed and we were unable to recover it. 00:31:00.358 [2024-11-28 23:23:03.783319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.783418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.783445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.358 qpair failed and we were unable to recover it. 00:31:00.358 [2024-11-28 23:23:03.783557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.783635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.783661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.358 qpair failed and we were unable to recover it. 00:31:00.358 [2024-11-28 23:23:03.783749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.783866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.783891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.358 qpair failed and we were unable to recover it. 00:31:00.358 [2024-11-28 23:23:03.784003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.784086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.784111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.358 qpair failed and we were unable to recover it. 00:31:00.358 [2024-11-28 23:23:03.784203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.784280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.784306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.358 qpair failed and we were unable to recover it. 00:31:00.358 [2024-11-28 23:23:03.784413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.784498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.784524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.358 qpair failed and we were unable to recover it. 00:31:00.358 [2024-11-28 23:23:03.784614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.784703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.784729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.358 qpair failed and we were unable to recover it. 00:31:00.358 [2024-11-28 23:23:03.784819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.784903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.784928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.358 qpair failed and we were unable to recover it. 00:31:00.358 [2024-11-28 23:23:03.785019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.785145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.785171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.358 qpair failed and we were unable to recover it. 00:31:00.358 [2024-11-28 23:23:03.785262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.785341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.785367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.358 qpair failed and we were unable to recover it. 00:31:00.358 [2024-11-28 23:23:03.785469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.785547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.785572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.358 qpair failed and we were unable to recover it. 00:31:00.358 [2024-11-28 23:23:03.785662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.785749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.785776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.358 qpair failed and we were unable to recover it. 00:31:00.358 [2024-11-28 23:23:03.785904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.786023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.786049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.358 qpair failed and we were unable to recover it. 00:31:00.358 [2024-11-28 23:23:03.786146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.786231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.786257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.358 qpair failed and we were unable to recover it. 00:31:00.358 [2024-11-28 23:23:03.786351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.786465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.786491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.358 qpair failed and we were unable to recover it. 00:31:00.358 [2024-11-28 23:23:03.786571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.786663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.786688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.358 qpair failed and we were unable to recover it. 00:31:00.358 [2024-11-28 23:23:03.786774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.786863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.786888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.358 qpair failed and we were unable to recover it. 00:31:00.358 [2024-11-28 23:23:03.787006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.787089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.787115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.358 qpair failed and we were unable to recover it. 00:31:00.358 [2024-11-28 23:23:03.787205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.787318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.787344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.358 qpair failed and we were unable to recover it. 00:31:00.358 [2024-11-28 23:23:03.787433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.787521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.787546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.358 qpair failed and we were unable to recover it. 00:31:00.358 [2024-11-28 23:23:03.787680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.787761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.787786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.358 qpair failed and we were unable to recover it. 00:31:00.358 [2024-11-28 23:23:03.787897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.787984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.788009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.358 qpair failed and we were unable to recover it. 00:31:00.358 [2024-11-28 23:23:03.788092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.788189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.788214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.358 qpair failed and we were unable to recover it. 00:31:00.358 [2024-11-28 23:23:03.788310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.788422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.788448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.358 qpair failed and we were unable to recover it. 00:31:00.358 [2024-11-28 23:23:03.788528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.788613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.788639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.358 qpair failed and we were unable to recover it. 00:31:00.358 [2024-11-28 23:23:03.788722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.788810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.788836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.358 qpair failed and we were unable to recover it. 00:31:00.358 [2024-11-28 23:23:03.788923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.789040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.789067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.358 qpair failed and we were unable to recover it. 00:31:00.358 [2024-11-28 23:23:03.789194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.358 [2024-11-28 23:23:03.789278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.789303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.359 qpair failed and we were unable to recover it. 00:31:00.359 [2024-11-28 23:23:03.789403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.789530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.789556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.359 qpair failed and we were unable to recover it. 00:31:00.359 [2024-11-28 23:23:03.789638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.789751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.789777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.359 qpair failed and we were unable to recover it. 00:31:00.359 [2024-11-28 23:23:03.789859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.789938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.789963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.359 qpair failed and we were unable to recover it. 00:31:00.359 [2024-11-28 23:23:03.790046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.790126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.790152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.359 qpair failed and we were unable to recover it. 00:31:00.359 [2024-11-28 23:23:03.790267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.790353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.790379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.359 qpair failed and we were unable to recover it. 00:31:00.359 [2024-11-28 23:23:03.790479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.790594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.790621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.359 qpair failed and we were unable to recover it. 00:31:00.359 [2024-11-28 23:23:03.790708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.790834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.790859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.359 qpair failed and we were unable to recover it. 00:31:00.359 [2024-11-28 23:23:03.790941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.791054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.791079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.359 qpair failed and we were unable to recover it. 00:31:00.359 [2024-11-28 23:23:03.791192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.791283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.791309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.359 qpair failed and we were unable to recover it. 00:31:00.359 [2024-11-28 23:23:03.791404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.791482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.791508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.359 qpair failed and we were unable to recover it. 00:31:00.359 [2024-11-28 23:23:03.791595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.791705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.791730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.359 qpair failed and we were unable to recover it. 00:31:00.359 [2024-11-28 23:23:03.791812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.791922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.791947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.359 qpair failed and we were unable to recover it. 00:31:00.359 [2024-11-28 23:23:03.792069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.792159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.792185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.359 qpair failed and we were unable to recover it. 00:31:00.359 [2024-11-28 23:23:03.792270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.792357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.792382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.359 qpair failed and we were unable to recover it. 00:31:00.359 [2024-11-28 23:23:03.792482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.792564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.792590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.359 qpair failed and we were unable to recover it. 00:31:00.359 [2024-11-28 23:23:03.792679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.792764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.792790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.359 qpair failed and we were unable to recover it. 00:31:00.359 [2024-11-28 23:23:03.792881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.792999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.793025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.359 qpair failed and we were unable to recover it. 00:31:00.359 [2024-11-28 23:23:03.793108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.793188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.793213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.359 qpair failed and we were unable to recover it. 00:31:00.359 [2024-11-28 23:23:03.793300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.793386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.793417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.359 qpair failed and we were unable to recover it. 00:31:00.359 [2024-11-28 23:23:03.793513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.793591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.793616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.359 qpair failed and we were unable to recover it. 00:31:00.359 [2024-11-28 23:23:03.793725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.793811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.793837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.359 qpair failed and we were unable to recover it. 00:31:00.359 [2024-11-28 23:23:03.793916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.794042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.794067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.359 qpair failed and we were unable to recover it. 00:31:00.359 [2024-11-28 23:23:03.794151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.794240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.794265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.359 qpair failed and we were unable to recover it. 00:31:00.359 [2024-11-28 23:23:03.794377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.794466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.794492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.359 qpair failed and we were unable to recover it. 00:31:00.359 [2024-11-28 23:23:03.794613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.794695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.794720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.359 qpair failed and we were unable to recover it. 00:31:00.359 [2024-11-28 23:23:03.794802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.794916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.794942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.359 qpair failed and we were unable to recover it. 00:31:00.359 [2024-11-28 23:23:03.795034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.795122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.795148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.359 qpair failed and we were unable to recover it. 00:31:00.359 [2024-11-28 23:23:03.795242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.795354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.795379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.359 qpair failed and we were unable to recover it. 00:31:00.359 [2024-11-28 23:23:03.795510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.359 [2024-11-28 23:23:03.795603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.795630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.360 qpair failed and we were unable to recover it. 00:31:00.360 [2024-11-28 23:23:03.795723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.795914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.795940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.360 qpair failed and we were unable to recover it. 00:31:00.360 [2024-11-28 23:23:03.796026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.796215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.796240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.360 qpair failed and we were unable to recover it. 00:31:00.360 [2024-11-28 23:23:03.796340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.796427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.796453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.360 qpair failed and we were unable to recover it. 00:31:00.360 [2024-11-28 23:23:03.796545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.796669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.796694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.360 qpair failed and we were unable to recover it. 00:31:00.360 [2024-11-28 23:23:03.796780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.796865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.796891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.360 qpair failed and we were unable to recover it. 00:31:00.360 [2024-11-28 23:23:03.797015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.797098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.797129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.360 qpair failed and we were unable to recover it. 00:31:00.360 [2024-11-28 23:23:03.797212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.797321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.797346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.360 qpair failed and we were unable to recover it. 00:31:00.360 [2024-11-28 23:23:03.797428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.797521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.797546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.360 qpair failed and we were unable to recover it. 00:31:00.360 [2024-11-28 23:23:03.797634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.797718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.797743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.360 qpair failed and we were unable to recover it. 00:31:00.360 [2024-11-28 23:23:03.797827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.797944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.797969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.360 qpair failed and we were unable to recover it. 00:31:00.360 [2024-11-28 23:23:03.798053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.798132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.798157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.360 qpair failed and we were unable to recover it. 00:31:00.360 [2024-11-28 23:23:03.798256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.798333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.798358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.360 qpair failed and we were unable to recover it. 00:31:00.360 [2024-11-28 23:23:03.798452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.798537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.798562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.360 qpair failed and we were unable to recover it. 00:31:00.360 [2024-11-28 23:23:03.798673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.798814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.798839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.360 qpair failed and we were unable to recover it. 00:31:00.360 [2024-11-28 23:23:03.798962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.799079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.799105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.360 qpair failed and we were unable to recover it. 00:31:00.360 [2024-11-28 23:23:03.799195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.799305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.799335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.360 qpair failed and we were unable to recover it. 00:31:00.360 [2024-11-28 23:23:03.799419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.799533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.799559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.360 qpair failed and we were unable to recover it. 00:31:00.360 [2024-11-28 23:23:03.799649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.799733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.799760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.360 qpair failed and we were unable to recover it. 00:31:00.360 [2024-11-28 23:23:03.799870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.799988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.800014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.360 qpair failed and we were unable to recover it. 00:31:00.360 [2024-11-28 23:23:03.800092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.800178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.800203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.360 qpair failed and we were unable to recover it. 00:31:00.360 [2024-11-28 23:23:03.800283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.800406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.800433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.360 qpair failed and we were unable to recover it. 00:31:00.360 [2024-11-28 23:23:03.800547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.800630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.800655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.360 qpair failed and we were unable to recover it. 00:31:00.360 [2024-11-28 23:23:03.800765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.800875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.800900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.360 qpair failed and we were unable to recover it. 00:31:00.360 [2024-11-28 23:23:03.801019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.801134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.801160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.360 qpair failed and we were unable to recover it. 00:31:00.360 [2024-11-28 23:23:03.801240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.801324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.801352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.360 qpair failed and we were unable to recover it. 00:31:00.360 [2024-11-28 23:23:03.801441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.801526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.801557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.360 qpair failed and we were unable to recover it. 00:31:00.360 [2024-11-28 23:23:03.801658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.801774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.801800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.360 qpair failed and we were unable to recover it. 00:31:00.360 [2024-11-28 23:23:03.801885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.801967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.360 [2024-11-28 23:23:03.801993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.360 qpair failed and we were unable to recover it. 00:31:00.360 [2024-11-28 23:23:03.802114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.802195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.802221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.361 qpair failed and we were unable to recover it. 00:31:00.361 [2024-11-28 23:23:03.802315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.802427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.802454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.361 qpair failed and we were unable to recover it. 00:31:00.361 [2024-11-28 23:23:03.802539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.802659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.802684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.361 qpair failed and we were unable to recover it. 00:31:00.361 [2024-11-28 23:23:03.802796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.802879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.802905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.361 qpair failed and we were unable to recover it. 00:31:00.361 [2024-11-28 23:23:03.803028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.803166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.803191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.361 qpair failed and we were unable to recover it. 00:31:00.361 [2024-11-28 23:23:03.803272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.803351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.803376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.361 qpair failed and we were unable to recover it. 00:31:00.361 [2024-11-28 23:23:03.803464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.803584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.803609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.361 qpair failed and we were unable to recover it. 00:31:00.361 [2024-11-28 23:23:03.803726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.803865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.803895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.361 qpair failed and we were unable to recover it. 00:31:00.361 [2024-11-28 23:23:03.803973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.804086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.804112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.361 qpair failed and we were unable to recover it. 00:31:00.361 [2024-11-28 23:23:03.804201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.804288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.804313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.361 qpair failed and we were unable to recover it. 00:31:00.361 [2024-11-28 23:23:03.804403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.804517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.804543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.361 qpair failed and we were unable to recover it. 00:31:00.361 [2024-11-28 23:23:03.804659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.804749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.804775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.361 qpair failed and we were unable to recover it. 00:31:00.361 [2024-11-28 23:23:03.804885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.805003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.805028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.361 qpair failed and we were unable to recover it. 00:31:00.361 [2024-11-28 23:23:03.805154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.805238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.805263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.361 qpair failed and we were unable to recover it. 00:31:00.361 [2024-11-28 23:23:03.805344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.805424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.805449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.361 qpair failed and we were unable to recover it. 00:31:00.361 [2024-11-28 23:23:03.805536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.805649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.805673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.361 qpair failed and we were unable to recover it. 00:31:00.361 [2024-11-28 23:23:03.805756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.805871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.805896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.361 qpair failed and we were unable to recover it. 00:31:00.361 [2024-11-28 23:23:03.806011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.806093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.806118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.361 qpair failed and we were unable to recover it. 00:31:00.361 [2024-11-28 23:23:03.806239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.806433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.806460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.361 qpair failed and we were unable to recover it. 00:31:00.361 [2024-11-28 23:23:03.806581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.806696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.806721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.361 qpair failed and we were unable to recover it. 00:31:00.361 [2024-11-28 23:23:03.806834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.806951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.806977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.361 qpair failed and we were unable to recover it. 00:31:00.361 [2024-11-28 23:23:03.807061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.807173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.807198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.361 qpair failed and we were unable to recover it. 00:31:00.361 [2024-11-28 23:23:03.807285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.807361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.807386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.361 qpair failed and we were unable to recover it. 00:31:00.361 [2024-11-28 23:23:03.807514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.807624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.807650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.361 qpair failed and we were unable to recover it. 00:31:00.361 [2024-11-28 23:23:03.807739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.807817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.361 [2024-11-28 23:23:03.807843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.361 qpair failed and we were unable to recover it. 00:31:00.361 [2024-11-28 23:23:03.807963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.808056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.808081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.362 qpair failed and we were unable to recover it. 00:31:00.362 [2024-11-28 23:23:03.808170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.808247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.808272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.362 qpair failed and we were unable to recover it. 00:31:00.362 [2024-11-28 23:23:03.808421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.808537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.808563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.362 qpair failed and we were unable to recover it. 00:31:00.362 [2024-11-28 23:23:03.808681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.808802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.808828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.362 qpair failed and we were unable to recover it. 00:31:00.362 [2024-11-28 23:23:03.808920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.809010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.809036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.362 qpair failed and we were unable to recover it. 00:31:00.362 [2024-11-28 23:23:03.809135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.809217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.809242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.362 qpair failed and we were unable to recover it. 00:31:00.362 [2024-11-28 23:23:03.809364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.809460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.809487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.362 qpair failed and we were unable to recover it. 00:31:00.362 [2024-11-28 23:23:03.809575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.809666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.809692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.362 qpair failed and we were unable to recover it. 00:31:00.362 [2024-11-28 23:23:03.809770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.809882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.809907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.362 qpair failed and we were unable to recover it. 00:31:00.362 [2024-11-28 23:23:03.810051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.810134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.810160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.362 qpair failed and we were unable to recover it. 00:31:00.362 [2024-11-28 23:23:03.810256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.810331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.810356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.362 qpair failed and we were unable to recover it. 00:31:00.362 [2024-11-28 23:23:03.810486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.810574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.810600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.362 qpair failed and we were unable to recover it. 00:31:00.362 [2024-11-28 23:23:03.810797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.810941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.810966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.362 qpair failed and we were unable to recover it. 00:31:00.362 [2024-11-28 23:23:03.811089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.811202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.811227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.362 qpair failed and we were unable to recover it. 00:31:00.362 [2024-11-28 23:23:03.811372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.811497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.811523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.362 qpair failed and we were unable to recover it. 00:31:00.362 [2024-11-28 23:23:03.811609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.811695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.811720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.362 qpair failed and we were unable to recover it. 00:31:00.362 [2024-11-28 23:23:03.811804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.811888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.811913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.362 qpair failed and we were unable to recover it. 00:31:00.362 [2024-11-28 23:23:03.811991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.812077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.812103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.362 qpair failed and we were unable to recover it. 00:31:00.362 [2024-11-28 23:23:03.812190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.812275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.812301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.362 qpair failed and we were unable to recover it. 00:31:00.362 [2024-11-28 23:23:03.812380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.812476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.812502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.362 qpair failed and we were unable to recover it. 00:31:00.362 [2024-11-28 23:23:03.812594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.812701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.812727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.362 qpair failed and we were unable to recover it. 00:31:00.362 [2024-11-28 23:23:03.812813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.812931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.812956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.362 qpair failed and we were unable to recover it. 00:31:00.362 [2024-11-28 23:23:03.813041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.813123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.813150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.362 qpair failed and we were unable to recover it. 00:31:00.362 [2024-11-28 23:23:03.813347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.813491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.813517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.362 qpair failed and we were unable to recover it. 00:31:00.362 [2024-11-28 23:23:03.813611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.813717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.813743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.362 qpair failed and we were unable to recover it. 00:31:00.362 [2024-11-28 23:23:03.813832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.813922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.813947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.362 qpair failed and we were unable to recover it. 00:31:00.362 [2024-11-28 23:23:03.814038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.814148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.814172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.362 qpair failed and we were unable to recover it. 00:31:00.362 [2024-11-28 23:23:03.814261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.814350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.814377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.362 qpair failed and we were unable to recover it. 00:31:00.362 [2024-11-28 23:23:03.814487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.814605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.362 [2024-11-28 23:23:03.814631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.362 qpair failed and we were unable to recover it. 00:31:00.362 [2024-11-28 23:23:03.814753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.814867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.814892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.363 qpair failed and we were unable to recover it. 00:31:00.363 [2024-11-28 23:23:03.815014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.815207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.815233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.363 qpair failed and we were unable to recover it. 00:31:00.363 [2024-11-28 23:23:03.815346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.815435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.815461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.363 qpair failed and we were unable to recover it. 00:31:00.363 [2024-11-28 23:23:03.815547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.815634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.815661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.363 qpair failed and we were unable to recover it. 00:31:00.363 [2024-11-28 23:23:03.815758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.815840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.815865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.363 qpair failed and we were unable to recover it. 00:31:00.363 [2024-11-28 23:23:03.815944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.816060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.816086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.363 qpair failed and we were unable to recover it. 00:31:00.363 [2024-11-28 23:23:03.816176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.816255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.816280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.363 qpair failed and we were unable to recover it. 00:31:00.363 [2024-11-28 23:23:03.816478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.816565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.816591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.363 qpair failed and we were unable to recover it. 00:31:00.363 [2024-11-28 23:23:03.816701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.816812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.816837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.363 qpair failed and we were unable to recover it. 00:31:00.363 [2024-11-28 23:23:03.816945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.817067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.817094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.363 qpair failed and we were unable to recover it. 00:31:00.363 [2024-11-28 23:23:03.817187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.817268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.817293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.363 qpair failed and we were unable to recover it. 00:31:00.363 [2024-11-28 23:23:03.817408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.817485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.817510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.363 qpair failed and we were unable to recover it. 00:31:00.363 [2024-11-28 23:23:03.817596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.817688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.817714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.363 qpair failed and we were unable to recover it. 00:31:00.363 [2024-11-28 23:23:03.817808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.817896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.817923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.363 qpair failed and we were unable to recover it. 00:31:00.363 [2024-11-28 23:23:03.818006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.818088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.818114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.363 qpair failed and we were unable to recover it. 00:31:00.363 [2024-11-28 23:23:03.818227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.818311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.818336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.363 qpair failed and we were unable to recover it. 00:31:00.363 [2024-11-28 23:23:03.818456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.818570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.818596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.363 qpair failed and we were unable to recover it. 00:31:00.363 [2024-11-28 23:23:03.818682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.818796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.818821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.363 qpair failed and we were unable to recover it. 00:31:00.363 [2024-11-28 23:23:03.818905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.819015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.819042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.363 qpair failed and we were unable to recover it. 00:31:00.363 [2024-11-28 23:23:03.819160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.819237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.819262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.363 qpair failed and we were unable to recover it. 00:31:00.363 [2024-11-28 23:23:03.819341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.819432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.819459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.363 qpair failed and we were unable to recover it. 00:31:00.363 [2024-11-28 23:23:03.819576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.819673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.819698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.363 qpair failed and we were unable to recover it. 00:31:00.363 [2024-11-28 23:23:03.819815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.819900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.819925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.363 qpair failed and we were unable to recover it. 00:31:00.363 [2024-11-28 23:23:03.820005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.820086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.820111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.363 qpair failed and we were unable to recover it. 00:31:00.363 [2024-11-28 23:23:03.820199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.820285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.820310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.363 qpair failed and we were unable to recover it. 00:31:00.363 [2024-11-28 23:23:03.820400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.820479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.820504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.363 qpair failed and we were unable to recover it. 00:31:00.363 [2024-11-28 23:23:03.820624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.820740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.820765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.363 qpair failed and we were unable to recover it. 00:31:00.363 [2024-11-28 23:23:03.820853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.820943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.820969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.363 qpair failed and we were unable to recover it. 00:31:00.363 [2024-11-28 23:23:03.821083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.821196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.363 [2024-11-28 23:23:03.821221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.364 qpair failed and we were unable to recover it. 00:31:00.364 [2024-11-28 23:23:03.821298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.821378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.821408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.364 qpair failed and we were unable to recover it. 00:31:00.364 [2024-11-28 23:23:03.821521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.821598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.821624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.364 qpair failed and we were unable to recover it. 00:31:00.364 [2024-11-28 23:23:03.821707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.821814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.821840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.364 qpair failed and we were unable to recover it. 00:31:00.364 [2024-11-28 23:23:03.821951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.822071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.822097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.364 qpair failed and we were unable to recover it. 00:31:00.364 [2024-11-28 23:23:03.822211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.822294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.822319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.364 qpair failed and we were unable to recover it. 00:31:00.364 [2024-11-28 23:23:03.822463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.822560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.822590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:31:00.364 qpair failed and we were unable to recover it. 00:31:00.364 [2024-11-28 23:23:03.822691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.822781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.822808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:31:00.364 qpair failed and we were unable to recover it. 00:31:00.364 [2024-11-28 23:23:03.822927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.823042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.823070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:31:00.364 qpair failed and we were unable to recover it. 00:31:00.364 [2024-11-28 23:23:03.823154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.823230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.823257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:31:00.364 qpair failed and we were unable to recover it. 00:31:00.364 [2024-11-28 23:23:03.823375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.823471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.823499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:31:00.364 qpair failed and we were unable to recover it. 00:31:00.364 [2024-11-28 23:23:03.823621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.823763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.823790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:31:00.364 qpair failed and we were unable to recover it. 00:31:00.364 [2024-11-28 23:23:03.823875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.823955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.823982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:31:00.364 qpair failed and we were unable to recover it. 00:31:00.364 [2024-11-28 23:23:03.824077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.824189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.824215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:31:00.364 qpair failed and we were unable to recover it. 00:31:00.364 [2024-11-28 23:23:03.824302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.824416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.824443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:31:00.364 qpair failed and we were unable to recover it. 00:31:00.364 [2024-11-28 23:23:03.824561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.824686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.824712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:31:00.364 qpair failed and we were unable to recover it. 00:31:00.364 [2024-11-28 23:23:03.824812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.824910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.824937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:31:00.364 qpair failed and we were unable to recover it. 00:31:00.364 [2024-11-28 23:23:03.825019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.825100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.825127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:31:00.364 qpair failed and we were unable to recover it. 00:31:00.364 [2024-11-28 23:23:03.825216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.825308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.825333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.364 qpair failed and we were unable to recover it. 00:31:00.364 [2024-11-28 23:23:03.825434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.825522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.825548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.364 qpair failed and we were unable to recover it. 00:31:00.364 [2024-11-28 23:23:03.825631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.825749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.825774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.364 qpair failed and we were unable to recover it. 00:31:00.364 [2024-11-28 23:23:03.825856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.825966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.825991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.364 qpair failed and we were unable to recover it. 00:31:00.364 [2024-11-28 23:23:03.826189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.826327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.826354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.364 qpair failed and we were unable to recover it. 00:31:00.364 [2024-11-28 23:23:03.826445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.826526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.826552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.364 qpair failed and we were unable to recover it. 00:31:00.364 [2024-11-28 23:23:03.826638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.826753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.826778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.364 qpair failed and we were unable to recover it. 00:31:00.364 [2024-11-28 23:23:03.826896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.826971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.826996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.364 qpair failed and we were unable to recover it. 00:31:00.364 [2024-11-28 23:23:03.827110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.827193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.827218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.364 qpair failed and we were unable to recover it. 00:31:00.364 [2024-11-28 23:23:03.827303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.827400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.827427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.364 qpair failed and we were unable to recover it. 00:31:00.364 [2024-11-28 23:23:03.827520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.827601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.827626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.364 qpair failed and we were unable to recover it. 00:31:00.364 [2024-11-28 23:23:03.827720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.827794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.827820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.364 qpair failed and we were unable to recover it. 00:31:00.364 [2024-11-28 23:23:03.827907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.827989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.828014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.364 qpair failed and we were unable to recover it. 00:31:00.364 [2024-11-28 23:23:03.828096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.828188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.364 [2024-11-28 23:23:03.828213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.364 qpair failed and we were unable to recover it. 00:31:00.365 [2024-11-28 23:23:03.828338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.828423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.828449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.365 qpair failed and we were unable to recover it. 00:31:00.365 [2024-11-28 23:23:03.828566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.828660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.828685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.365 qpair failed and we were unable to recover it. 00:31:00.365 [2024-11-28 23:23:03.828768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.828852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.828877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.365 qpair failed and we were unable to recover it. 00:31:00.365 [2024-11-28 23:23:03.828963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.829043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.829067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.365 qpair failed and we were unable to recover it. 00:31:00.365 [2024-11-28 23:23:03.829259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.829372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.829405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.365 qpair failed and we were unable to recover it. 00:31:00.365 [2024-11-28 23:23:03.829500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.829583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.829609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.365 qpair failed and we were unable to recover it. 00:31:00.365 [2024-11-28 23:23:03.829699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.829809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.829835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.365 qpair failed and we were unable to recover it. 00:31:00.365 [2024-11-28 23:23:03.829953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.830035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.830061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.365 qpair failed and we were unable to recover it. 00:31:00.365 [2024-11-28 23:23:03.830150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.830258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.830284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.365 qpair failed and we were unable to recover it. 00:31:00.365 [2024-11-28 23:23:03.830369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.830473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.830499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.365 qpair failed and we were unable to recover it. 00:31:00.365 [2024-11-28 23:23:03.830582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.830659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.830685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.365 qpair failed and we were unable to recover it. 00:31:00.365 [2024-11-28 23:23:03.830773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.830860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.830885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.365 qpair failed and we were unable to recover it. 00:31:00.365 [2024-11-28 23:23:03.830967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.831072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.831097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.365 qpair failed and we were unable to recover it. 00:31:00.365 [2024-11-28 23:23:03.831213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.831295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.831319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.365 qpair failed and we were unable to recover it. 00:31:00.365 [2024-11-28 23:23:03.831408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.831500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.831528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.365 qpair failed and we were unable to recover it. 00:31:00.365 [2024-11-28 23:23:03.831624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.831736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.831761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.365 qpair failed and we were unable to recover it. 00:31:00.365 [2024-11-28 23:23:03.831849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.831961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.831986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.365 qpair failed and we were unable to recover it. 00:31:00.365 [2024-11-28 23:23:03.832066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.832154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.832180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.365 qpair failed and we were unable to recover it. 00:31:00.365 [2024-11-28 23:23:03.832274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.832387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.832430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.365 qpair failed and we were unable to recover it. 00:31:00.365 [2024-11-28 23:23:03.832548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.832634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.832659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.365 qpair failed and we were unable to recover it. 00:31:00.365 [2024-11-28 23:23:03.832776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.832862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.832889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.365 qpair failed and we were unable to recover it. 00:31:00.365 [2024-11-28 23:23:03.832976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.833057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.833083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.365 qpair failed and we were unable to recover it. 00:31:00.365 [2024-11-28 23:23:03.833165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.833355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.833381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.365 qpair failed and we were unable to recover it. 00:31:00.365 [2024-11-28 23:23:03.833515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.833601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.833628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.365 qpair failed and we were unable to recover it. 00:31:00.365 [2024-11-28 23:23:03.833723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.833807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.833838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.365 qpair failed and we were unable to recover it. 00:31:00.365 [2024-11-28 23:23:03.833954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.834040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.834068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.365 qpair failed and we were unable to recover it. 00:31:00.365 [2024-11-28 23:23:03.834165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.834248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.834273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.365 qpair failed and we were unable to recover it. 00:31:00.365 [2024-11-28 23:23:03.834373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.834465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.834493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.365 qpair failed and we were unable to recover it. 00:31:00.365 [2024-11-28 23:23:03.834589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.834698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.834724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.365 qpair failed and we were unable to recover it. 00:31:00.365 [2024-11-28 23:23:03.834806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.834896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.834922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.365 qpair failed and we were unable to recover it. 00:31:00.365 [2024-11-28 23:23:03.835033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.835145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.835170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.365 qpair failed and we were unable to recover it. 00:31:00.365 [2024-11-28 23:23:03.835257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.365 [2024-11-28 23:23:03.835345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.366 [2024-11-28 23:23:03.835370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.366 qpair failed and we were unable to recover it. 00:31:00.366 [2024-11-28 23:23:03.835471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.366 [2024-11-28 23:23:03.835554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.366 [2024-11-28 23:23:03.835580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.366 qpair failed and we were unable to recover it. 00:31:00.366 [2024-11-28 23:23:03.835666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.366 [2024-11-28 23:23:03.835818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.366 [2024-11-28 23:23:03.835843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.366 qpair failed and we were unable to recover it. 00:31:00.366 [2024-11-28 23:23:03.835930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.366 [2024-11-28 23:23:03.836039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.366 [2024-11-28 23:23:03.836068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.366 qpair failed and we were unable to recover it. 00:31:00.366 [2024-11-28 23:23:03.836150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.366 [2024-11-28 23:23:03.836237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.366 [2024-11-28 23:23:03.836263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.366 qpair failed and we were unable to recover it. 00:31:00.366 [2024-11-28 23:23:03.836344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.366 [2024-11-28 23:23:03.836428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.366 [2024-11-28 23:23:03.836456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.366 qpair failed and we were unable to recover it. 00:31:00.366 [2024-11-28 23:23:03.836542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.366 [2024-11-28 23:23:03.836624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.366 [2024-11-28 23:23:03.836650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.366 qpair failed and we were unable to recover it. 00:31:00.366 [2024-11-28 23:23:03.836774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.366 [2024-11-28 23:23:03.836858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.366 [2024-11-28 23:23:03.836883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.366 qpair failed and we were unable to recover it. 00:31:00.366 [2024-11-28 23:23:03.836992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.366 [2024-11-28 23:23:03.837079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.366 [2024-11-28 23:23:03.837104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.366 qpair failed and we were unable to recover it. 00:31:00.366 [2024-11-28 23:23:03.837194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.366 [2024-11-28 23:23:03.837305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.366 [2024-11-28 23:23:03.837330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.366 qpair failed and we were unable to recover it. 00:31:00.366 [2024-11-28 23:23:03.837424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.366 [2024-11-28 23:23:03.837507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.366 [2024-11-28 23:23:03.837532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.366 qpair failed and we were unable to recover it. 00:31:00.366 [2024-11-28 23:23:03.837647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.366 [2024-11-28 23:23:03.837730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.366 [2024-11-28 23:23:03.837755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.366 qpair failed and we were unable to recover it. 00:31:00.366 [2024-11-28 23:23:03.837867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.366 [2024-11-28 23:23:03.837974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.366 [2024-11-28 23:23:03.838000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.366 qpair failed and we were unable to recover it. 00:31:00.366 [2024-11-28 23:23:03.838097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.366 [2024-11-28 23:23:03.838175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.366 [2024-11-28 23:23:03.838205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.366 qpair failed and we were unable to recover it. 00:31:00.366 [2024-11-28 23:23:03.838285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.366 [2024-11-28 23:23:03.838479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.366 [2024-11-28 23:23:03.838505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.366 qpair failed and we were unable to recover it. 00:31:00.366 [2024-11-28 23:23:03.838698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.366 [2024-11-28 23:23:03.838780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.366 [2024-11-28 23:23:03.838805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.366 qpair failed and we were unable to recover it. 00:31:00.366 [2024-11-28 23:23:03.838887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.366 [2024-11-28 23:23:03.838970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.366 [2024-11-28 23:23:03.838996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.366 qpair failed and we were unable to recover it. 00:31:00.366 [2024-11-28 23:23:03.839111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.366 [2024-11-28 23:23:03.839227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.366 [2024-11-28 23:23:03.839253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.366 qpair failed and we were unable to recover it. 00:31:00.366 [2024-11-28 23:23:03.839341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.366 [2024-11-28 23:23:03.839435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.366 [2024-11-28 23:23:03.839461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.366 qpair failed and we were unable to recover it. 00:31:00.366 [2024-11-28 23:23:03.839555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.366 [2024-11-28 23:23:03.839643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.366 [2024-11-28 23:23:03.839669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.366 qpair failed and we were unable to recover it. 00:31:00.366 [2024-11-28 23:23:03.839766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.366 [2024-11-28 23:23:03.839851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.366 [2024-11-28 23:23:03.839876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.366 qpair failed and we were unable to recover it. 00:31:00.366 [2024-11-28 23:23:03.839986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.366 [2024-11-28 23:23:03.840068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.840094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.367 qpair failed and we were unable to recover it. 00:31:00.367 [2024-11-28 23:23:03.840182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.840259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.840285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.367 qpair failed and we were unable to recover it. 00:31:00.367 [2024-11-28 23:23:03.840365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.840459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.840489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.367 qpair failed and we were unable to recover it. 00:31:00.367 [2024-11-28 23:23:03.840573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.840686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.840711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.367 qpair failed and we were unable to recover it. 00:31:00.367 [2024-11-28 23:23:03.840829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.840905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.840931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.367 qpair failed and we were unable to recover it. 00:31:00.367 [2024-11-28 23:23:03.841075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.841178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.841204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.367 qpair failed and we were unable to recover it. 00:31:00.367 [2024-11-28 23:23:03.841317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.841409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.841435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.367 qpair failed and we were unable to recover it. 00:31:00.367 [2024-11-28 23:23:03.841524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.841611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.841636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.367 qpair failed and we were unable to recover it. 00:31:00.367 [2024-11-28 23:23:03.841766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.841846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.841870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.367 qpair failed and we were unable to recover it. 00:31:00.367 [2024-11-28 23:23:03.841951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.842034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.842059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.367 qpair failed and we were unable to recover it. 00:31:00.367 [2024-11-28 23:23:03.842170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.842259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.842284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.367 qpair failed and we were unable to recover it. 00:31:00.367 [2024-11-28 23:23:03.842366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.842457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.842483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.367 qpair failed and we were unable to recover it. 00:31:00.367 [2024-11-28 23:23:03.842577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.842655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.842680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.367 qpair failed and we were unable to recover it. 00:31:00.367 [2024-11-28 23:23:03.842773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.842965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.842992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.367 qpair failed and we were unable to recover it. 00:31:00.367 [2024-11-28 23:23:03.843090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.843170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.843195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.367 qpair failed and we were unable to recover it. 00:31:00.367 [2024-11-28 23:23:03.843307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.843390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.843420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.367 qpair failed and we were unable to recover it. 00:31:00.367 [2024-11-28 23:23:03.843511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.843608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.843633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.367 qpair failed and we were unable to recover it. 00:31:00.367 [2024-11-28 23:23:03.843726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.843809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.843834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.367 qpair failed and we were unable to recover it. 00:31:00.367 [2024-11-28 23:23:03.843924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.844001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.844029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.367 qpair failed and we were unable to recover it. 00:31:00.367 [2024-11-28 23:23:03.844114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.844196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.844221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.367 qpair failed and we were unable to recover it. 00:31:00.367 [2024-11-28 23:23:03.844413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.844496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.844522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.367 qpair failed and we were unable to recover it. 00:31:00.367 [2024-11-28 23:23:03.844644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.844734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.844759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.367 qpair failed and we were unable to recover it. 00:31:00.367 [2024-11-28 23:23:03.844846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.844956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.844981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.367 qpair failed and we were unable to recover it. 00:31:00.367 [2024-11-28 23:23:03.845068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.845160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.845185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.367 qpair failed and we were unable to recover it. 00:31:00.367 [2024-11-28 23:23:03.845297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.845391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.845423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.367 qpair failed and we were unable to recover it. 00:31:00.367 [2024-11-28 23:23:03.845504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.845589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.367 [2024-11-28 23:23:03.845615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.367 qpair failed and we were unable to recover it. 00:31:00.367 [2024-11-28 23:23:03.845737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.845825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.845851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.368 qpair failed and we were unable to recover it. 00:31:00.368 [2024-11-28 23:23:03.845937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.846011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.846035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.368 qpair failed and we were unable to recover it. 00:31:00.368 [2024-11-28 23:23:03.846114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.846195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.846220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.368 qpair failed and we were unable to recover it. 00:31:00.368 [2024-11-28 23:23:03.846302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.846381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.846415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.368 qpair failed and we were unable to recover it. 00:31:00.368 [2024-11-28 23:23:03.846507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.846619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.846644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.368 qpair failed and we were unable to recover it. 00:31:00.368 [2024-11-28 23:23:03.846735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.846844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.846869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.368 qpair failed and we were unable to recover it. 00:31:00.368 [2024-11-28 23:23:03.846954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.847038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.847063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.368 qpair failed and we were unable to recover it. 00:31:00.368 [2024-11-28 23:23:03.847193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.847268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.847294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.368 qpair failed and we were unable to recover it. 00:31:00.368 [2024-11-28 23:23:03.847373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.847487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.847513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.368 qpair failed and we were unable to recover it. 00:31:00.368 [2024-11-28 23:23:03.847603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.847685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.847710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.368 qpair failed and we were unable to recover it. 00:31:00.368 [2024-11-28 23:23:03.847823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.848013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.848038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.368 qpair failed and we were unable to recover it. 00:31:00.368 [2024-11-28 23:23:03.848155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.848238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.848263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.368 qpair failed and we were unable to recover it. 00:31:00.368 [2024-11-28 23:23:03.848455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.848570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.848595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.368 qpair failed and we were unable to recover it. 00:31:00.368 [2024-11-28 23:23:03.848720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.848801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.848826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.368 qpair failed and we were unable to recover it. 00:31:00.368 [2024-11-28 23:23:03.848919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.848997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.849022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.368 qpair failed and we were unable to recover it. 00:31:00.368 [2024-11-28 23:23:03.849105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.849194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.849219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.368 qpair failed and we were unable to recover it. 00:31:00.368 [2024-11-28 23:23:03.849301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.849420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.849446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.368 qpair failed and we were unable to recover it. 00:31:00.368 [2024-11-28 23:23:03.849534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.849640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.849665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.368 qpair failed and we were unable to recover it. 00:31:00.368 [2024-11-28 23:23:03.849751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.849835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.849861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.368 qpair failed and we were unable to recover it. 00:31:00.368 [2024-11-28 23:23:03.849944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.850031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.850057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.368 qpair failed and we were unable to recover it. 00:31:00.368 [2024-11-28 23:23:03.850143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.850228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.850255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.368 qpair failed and we were unable to recover it. 00:31:00.368 [2024-11-28 23:23:03.850447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.850560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.850585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.368 qpair failed and we were unable to recover it. 00:31:00.368 [2024-11-28 23:23:03.850727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.850836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.850861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.368 qpair failed and we were unable to recover it. 00:31:00.368 [2024-11-28 23:23:03.850939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.851129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.851154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.368 qpair failed and we were unable to recover it. 00:31:00.368 [2024-11-28 23:23:03.851242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.851353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.851378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.368 qpair failed and we were unable to recover it. 00:31:00.368 [2024-11-28 23:23:03.851465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.851545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.851570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.368 qpair failed and we were unable to recover it. 00:31:00.368 [2024-11-28 23:23:03.851654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.851772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.851798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.368 qpair failed and we were unable to recover it. 00:31:00.368 [2024-11-28 23:23:03.851882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.851991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.852017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.368 qpair failed and we were unable to recover it. 00:31:00.368 [2024-11-28 23:23:03.852132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.852224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.852249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.368 qpair failed and we were unable to recover it. 00:31:00.368 [2024-11-28 23:23:03.852325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.852415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.852441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.368 qpair failed and we were unable to recover it. 00:31:00.368 [2024-11-28 23:23:03.852529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.852611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.852637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.368 qpair failed and we were unable to recover it. 00:31:00.368 [2024-11-28 23:23:03.852714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.852832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.852858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.368 qpair failed and we were unable to recover it. 00:31:00.368 [2024-11-28 23:23:03.852945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.853033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.853058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.368 qpair failed and we were unable to recover it. 00:31:00.368 [2024-11-28 23:23:03.853173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.368 [2024-11-28 23:23:03.853253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.853279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.369 qpair failed and we were unable to recover it. 00:31:00.369 [2024-11-28 23:23:03.853368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.853459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.853486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.369 qpair failed and we were unable to recover it. 00:31:00.369 [2024-11-28 23:23:03.853572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.853694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.853719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.369 qpair failed and we were unable to recover it. 00:31:00.369 [2024-11-28 23:23:03.853807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.853919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.853944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.369 qpair failed and we were unable to recover it. 00:31:00.369 [2024-11-28 23:23:03.854060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.854147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.854173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.369 qpair failed and we were unable to recover it. 00:31:00.369 [2024-11-28 23:23:03.854262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.854350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.854375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.369 qpair failed and we were unable to recover it. 00:31:00.369 [2024-11-28 23:23:03.854465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.854579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.854605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.369 qpair failed and we were unable to recover it. 00:31:00.369 [2024-11-28 23:23:03.854689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.854774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.854800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.369 qpair failed and we were unable to recover it. 00:31:00.369 [2024-11-28 23:23:03.854913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.854991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.855016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.369 qpair failed and we were unable to recover it. 00:31:00.369 [2024-11-28 23:23:03.855105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.855215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.855240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.369 qpair failed and we were unable to recover it. 00:31:00.369 [2024-11-28 23:23:03.855362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.855471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.855497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.369 qpair failed and we were unable to recover it. 00:31:00.369 [2024-11-28 23:23:03.855589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.855674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.855699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.369 qpair failed and we were unable to recover it. 00:31:00.369 [2024-11-28 23:23:03.855809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.855918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.855943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.369 qpair failed and we were unable to recover it. 00:31:00.369 [2024-11-28 23:23:03.856036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.856177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.856202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.369 qpair failed and we were unable to recover it. 00:31:00.369 [2024-11-28 23:23:03.856327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.856446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.856473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.369 qpair failed and we were unable to recover it. 00:31:00.369 [2024-11-28 23:23:03.856565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.856716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.856741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.369 qpair failed and we were unable to recover it. 00:31:00.369 [2024-11-28 23:23:03.856820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.856898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.856924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.369 qpair failed and we were unable to recover it. 00:31:00.369 [2024-11-28 23:23:03.857033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.857108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.857134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.369 qpair failed and we were unable to recover it. 00:31:00.369 [2024-11-28 23:23:03.857218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.857297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.857322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.369 qpair failed and we were unable to recover it. 00:31:00.369 [2024-11-28 23:23:03.857417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.857493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.857519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.369 qpair failed and we were unable to recover it. 00:31:00.369 [2024-11-28 23:23:03.857601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.857689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.857715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.369 qpair failed and we were unable to recover it. 00:31:00.369 [2024-11-28 23:23:03.857858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.857969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.857994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.369 qpair failed and we were unable to recover it. 00:31:00.369 [2024-11-28 23:23:03.858076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.858188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.858213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.369 qpair failed and we were unable to recover it. 00:31:00.369 [2024-11-28 23:23:03.858302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.858431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.858457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.369 qpair failed and we were unable to recover it. 00:31:00.369 [2024-11-28 23:23:03.858543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.858624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.858649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.369 qpair failed and we were unable to recover it. 00:31:00.369 [2024-11-28 23:23:03.858734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.858820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.858846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.369 qpair failed and we were unable to recover it. 00:31:00.369 [2024-11-28 23:23:03.858923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.859033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.859058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.369 qpair failed and we were unable to recover it. 00:31:00.369 [2024-11-28 23:23:03.859139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.859329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.859354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.369 qpair failed and we were unable to recover it. 00:31:00.369 [2024-11-28 23:23:03.859443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.859529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.859554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.369 qpair failed and we were unable to recover it. 00:31:00.369 [2024-11-28 23:23:03.859744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.859932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.859957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.369 qpair failed and we were unable to recover it. 00:31:00.369 [2024-11-28 23:23:03.860070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.860211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.860236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.369 qpair failed and we were unable to recover it. 00:31:00.369 [2024-11-28 23:23:03.860382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.860466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.860492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.369 qpair failed and we were unable to recover it. 00:31:00.369 [2024-11-28 23:23:03.860583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.860663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.860688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.369 qpair failed and we were unable to recover it. 00:31:00.369 [2024-11-28 23:23:03.860811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.860926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.860952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.369 qpair failed and we were unable to recover it. 00:31:00.369 [2024-11-28 23:23:03.861045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.369 [2024-11-28 23:23:03.861130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.861155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.370 qpair failed and we were unable to recover it. 00:31:00.370 [2024-11-28 23:23:03.861241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.861330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.861355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.370 qpair failed and we were unable to recover it. 00:31:00.370 [2024-11-28 23:23:03.861452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.861532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.861558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.370 qpair failed and we were unable to recover it. 00:31:00.370 [2024-11-28 23:23:03.861642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.861757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.861782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.370 qpair failed and we were unable to recover it. 00:31:00.370 [2024-11-28 23:23:03.861878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.861959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.861983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.370 qpair failed and we were unable to recover it. 00:31:00.370 [2024-11-28 23:23:03.862096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.862173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.862200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.370 qpair failed and we were unable to recover it. 00:31:00.370 [2024-11-28 23:23:03.862285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.862376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.862434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.370 qpair failed and we were unable to recover it. 00:31:00.370 [2024-11-28 23:23:03.862540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.862628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.862653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.370 qpair failed and we were unable to recover it. 00:31:00.370 [2024-11-28 23:23:03.862765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.862844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.862869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.370 qpair failed and we were unable to recover it. 00:31:00.370 [2024-11-28 23:23:03.862983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.863074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.863099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.370 qpair failed and we were unable to recover it. 00:31:00.370 [2024-11-28 23:23:03.863186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.863270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.863296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.370 qpair failed and we were unable to recover it. 00:31:00.370 [2024-11-28 23:23:03.863378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.863481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.863506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.370 qpair failed and we were unable to recover it. 00:31:00.370 [2024-11-28 23:23:03.863601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.863693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.863718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.370 qpair failed and we were unable to recover it. 00:31:00.370 [2024-11-28 23:23:03.863801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.863880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.863905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.370 qpair failed and we were unable to recover it. 00:31:00.370 [2024-11-28 23:23:03.863993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.864101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.864126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.370 qpair failed and we were unable to recover it. 00:31:00.370 [2024-11-28 23:23:03.864206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.864284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.864310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.370 qpair failed and we were unable to recover it. 00:31:00.370 [2024-11-28 23:23:03.864389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.864472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.864498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.370 qpair failed and we were unable to recover it. 00:31:00.370 [2024-11-28 23:23:03.864588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.864671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.864696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.370 qpair failed and we were unable to recover it. 00:31:00.370 [2024-11-28 23:23:03.864783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.864865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.864890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.370 qpair failed and we were unable to recover it. 00:31:00.370 [2024-11-28 23:23:03.864973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.865080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.865105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.370 qpair failed and we were unable to recover it. 00:31:00.370 [2024-11-28 23:23:03.865196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.865314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.865340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.370 qpair failed and we were unable to recover it. 00:31:00.370 [2024-11-28 23:23:03.865430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.865550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.865575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.370 qpair failed and we were unable to recover it. 00:31:00.370 [2024-11-28 23:23:03.865692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.865808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.865833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.370 qpair failed and we were unable to recover it. 00:31:00.370 [2024-11-28 23:23:03.865948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.866031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.866058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.370 qpair failed and we were unable to recover it. 00:31:00.370 [2024-11-28 23:23:03.866145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.866335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.866359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.370 qpair failed and we were unable to recover it. 00:31:00.370 [2024-11-28 23:23:03.866449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.866558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.866583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.370 qpair failed and we were unable to recover it. 00:31:00.370 [2024-11-28 23:23:03.866773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.866855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.866880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.370 qpair failed and we were unable to recover it. 00:31:00.370 [2024-11-28 23:23:03.866966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.867073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.867098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.370 qpair failed and we were unable to recover it. 00:31:00.370 [2024-11-28 23:23:03.867210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.867288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.370 [2024-11-28 23:23:03.867313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.370 qpair failed and we were unable to recover it. 00:31:00.371 [2024-11-28 23:23:03.867411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.867489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.867514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.371 qpair failed and we were unable to recover it. 00:31:00.371 [2024-11-28 23:23:03.867595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.867684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.867710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.371 qpair failed and we were unable to recover it. 00:31:00.371 [2024-11-28 23:23:03.867789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.867900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.867926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.371 qpair failed and we were unable to recover it. 00:31:00.371 [2024-11-28 23:23:03.868010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.868121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.868146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.371 qpair failed and we were unable to recover it. 00:31:00.371 [2024-11-28 23:23:03.868229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.868308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.868333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.371 qpair failed and we were unable to recover it. 00:31:00.371 [2024-11-28 23:23:03.868424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.868502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.868527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.371 qpair failed and we were unable to recover it. 00:31:00.371 [2024-11-28 23:23:03.868614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.868704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.868729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.371 qpair failed and we were unable to recover it. 00:31:00.371 [2024-11-28 23:23:03.868815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.868899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.868925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.371 qpair failed and we were unable to recover it. 00:31:00.371 [2024-11-28 23:23:03.869015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.869098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.869123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.371 qpair failed and we were unable to recover it. 00:31:00.371 [2024-11-28 23:23:03.869217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.869296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.869321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.371 qpair failed and we were unable to recover it. 00:31:00.371 [2024-11-28 23:23:03.869409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.869605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.869630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.371 qpair failed and we were unable to recover it. 00:31:00.371 [2024-11-28 23:23:03.869740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.869820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.869850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.371 qpair failed and we were unable to recover it. 00:31:00.371 [2024-11-28 23:23:03.870043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.870148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.870173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.371 qpair failed and we were unable to recover it. 00:31:00.371 [2024-11-28 23:23:03.870252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.870335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.870360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.371 qpair failed and we were unable to recover it. 00:31:00.371 [2024-11-28 23:23:03.870480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.870570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.870596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.371 qpair failed and we were unable to recover it. 00:31:00.371 [2024-11-28 23:23:03.870683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.870768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.870794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.371 qpair failed and we were unable to recover it. 00:31:00.371 [2024-11-28 23:23:03.870901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.870985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.871010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.371 qpair failed and we were unable to recover it. 00:31:00.371 [2024-11-28 23:23:03.871099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.871181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.871207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.371 qpair failed and we were unable to recover it. 00:31:00.371 [2024-11-28 23:23:03.871286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.871438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.871464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.371 qpair failed and we were unable to recover it. 00:31:00.371 [2024-11-28 23:23:03.871546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.871634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.871661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.371 qpair failed and we were unable to recover it. 00:31:00.371 [2024-11-28 23:23:03.871855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.871975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.872001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.371 qpair failed and we were unable to recover it. 00:31:00.371 [2024-11-28 23:23:03.872089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.872173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.872202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.371 qpair failed and we were unable to recover it. 00:31:00.371 [2024-11-28 23:23:03.872323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.872447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.872473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.371 qpair failed and we were unable to recover it. 00:31:00.371 [2024-11-28 23:23:03.872555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.872633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.872659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.371 qpair failed and we were unable to recover it. 00:31:00.371 [2024-11-28 23:23:03.872793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.872906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.872931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.371 qpair failed and we were unable to recover it. 00:31:00.371 [2024-11-28 23:23:03.873013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.873099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.873125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.371 qpair failed and we were unable to recover it. 00:31:00.371 [2024-11-28 23:23:03.873240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.873356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.873381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.371 qpair failed and we were unable to recover it. 00:31:00.371 [2024-11-28 23:23:03.873470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.873558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.873583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.371 qpair failed and we were unable to recover it. 00:31:00.371 [2024-11-28 23:23:03.873699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.873779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.873804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.371 qpair failed and we were unable to recover it. 00:31:00.371 [2024-11-28 23:23:03.873958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.874039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.874064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.371 qpair failed and we were unable to recover it. 00:31:00.371 [2024-11-28 23:23:03.874147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.874261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.874286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.371 qpair failed and we were unable to recover it. 00:31:00.371 [2024-11-28 23:23:03.874364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.874455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.874485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.371 qpair failed and we were unable to recover it. 00:31:00.371 [2024-11-28 23:23:03.874580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.874664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.874690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.371 qpair failed and we were unable to recover it. 00:31:00.371 [2024-11-28 23:23:03.874805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.371 [2024-11-28 23:23:03.874886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.874912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.372 qpair failed and we were unable to recover it. 00:31:00.372 [2024-11-28 23:23:03.875026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.875108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.875134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.372 qpair failed and we were unable to recover it. 00:31:00.372 [2024-11-28 23:23:03.875214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.875293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.875318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.372 qpair failed and we were unable to recover it. 00:31:00.372 [2024-11-28 23:23:03.875450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.875537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.875562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.372 qpair failed and we were unable to recover it. 00:31:00.372 [2024-11-28 23:23:03.875655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.875744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.875771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.372 qpair failed and we were unable to recover it. 00:31:00.372 [2024-11-28 23:23:03.875861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.875974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.875998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.372 qpair failed and we were unable to recover it. 00:31:00.372 [2024-11-28 23:23:03.876082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.876167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.876193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.372 qpair failed and we were unable to recover it. 00:31:00.372 [2024-11-28 23:23:03.876278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.876367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.876398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.372 qpair failed and we were unable to recover it. 00:31:00.372 [2024-11-28 23:23:03.876513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.876600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.876626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.372 qpair failed and we were unable to recover it. 00:31:00.372 [2024-11-28 23:23:03.876727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.876834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.876860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.372 qpair failed and we were unable to recover it. 00:31:00.372 [2024-11-28 23:23:03.876942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.877023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.877048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.372 qpair failed and we were unable to recover it. 00:31:00.372 [2024-11-28 23:23:03.877151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.877260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.877293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.372 qpair failed and we were unable to recover it. 00:31:00.372 [2024-11-28 23:23:03.877383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.877579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.877604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.372 qpair failed and we were unable to recover it. 00:31:00.372 [2024-11-28 23:23:03.877728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.877808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.877833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.372 qpair failed and we were unable to recover it. 00:31:00.372 [2024-11-28 23:23:03.877912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.877997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.878022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.372 qpair failed and we were unable to recover it. 00:31:00.372 [2024-11-28 23:23:03.878114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.878194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.878218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.372 qpair failed and we were unable to recover it. 00:31:00.372 [2024-11-28 23:23:03.878360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.878474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.878501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.372 qpair failed and we were unable to recover it. 00:31:00.372 [2024-11-28 23:23:03.878583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.878692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.878718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.372 qpair failed and we were unable to recover it. 00:31:00.372 [2024-11-28 23:23:03.878805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.878919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.878945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.372 qpair failed and we were unable to recover it. 00:31:00.372 [2024-11-28 23:23:03.879032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.879113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.879139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.372 qpair failed and we were unable to recover it. 00:31:00.372 [2024-11-28 23:23:03.879239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.879354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.879379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.372 qpair failed and we were unable to recover it. 00:31:00.372 [2024-11-28 23:23:03.879474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.879583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.879609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.372 qpair failed and we were unable to recover it. 00:31:00.372 [2024-11-28 23:23:03.879719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.879805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.879830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.372 qpair failed and we were unable to recover it. 00:31:00.372 [2024-11-28 23:23:03.879946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.880024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.880049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.372 qpair failed and we were unable to recover it. 00:31:00.372 [2024-11-28 23:23:03.880139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.880215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.880241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.372 qpair failed and we were unable to recover it. 00:31:00.372 [2024-11-28 23:23:03.880337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.880453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.880479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.372 qpair failed and we were unable to recover it. 00:31:00.372 [2024-11-28 23:23:03.880595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.880715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.880742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.372 qpair failed and we were unable to recover it. 00:31:00.372 [2024-11-28 23:23:03.880830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.880952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.880977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.372 qpair failed and we were unable to recover it. 00:31:00.372 [2024-11-28 23:23:03.881068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.881146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.881170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.372 qpair failed and we were unable to recover it. 00:31:00.372 [2024-11-28 23:23:03.881261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.881342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.881367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.372 qpair failed and we were unable to recover it. 00:31:00.372 [2024-11-28 23:23:03.881490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.881577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.881602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.372 qpair failed and we were unable to recover it. 00:31:00.372 [2024-11-28 23:23:03.881713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.881817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.881843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.372 qpair failed and we were unable to recover it. 00:31:00.372 [2024-11-28 23:23:03.881929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.882014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.882040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.372 qpair failed and we were unable to recover it. 00:31:00.372 [2024-11-28 23:23:03.882129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.882218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.372 [2024-11-28 23:23:03.882244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.372 qpair failed and we were unable to recover it. 00:31:00.372 [2024-11-28 23:23:03.882321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.882433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.882459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.373 qpair failed and we were unable to recover it. 00:31:00.373 [2024-11-28 23:23:03.882552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.882632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.882657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.373 qpair failed and we were unable to recover it. 00:31:00.373 [2024-11-28 23:23:03.882750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.882837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.882862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.373 qpair failed and we were unable to recover it. 00:31:00.373 [2024-11-28 23:23:03.882974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.883117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.883142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.373 qpair failed and we were unable to recover it. 00:31:00.373 [2024-11-28 23:23:03.883230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.883310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.883335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.373 qpair failed and we were unable to recover it. 00:31:00.373 [2024-11-28 23:23:03.883443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.883521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.883547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.373 qpair failed and we were unable to recover it. 00:31:00.373 [2024-11-28 23:23:03.883633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.883745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.883771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.373 qpair failed and we were unable to recover it. 00:31:00.373 [2024-11-28 23:23:03.883853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.883969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.883994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.373 qpair failed and we were unable to recover it. 00:31:00.373 [2024-11-28 23:23:03.884109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.884207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.884232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.373 qpair failed and we were unable to recover it. 00:31:00.373 [2024-11-28 23:23:03.884320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.884409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.884435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.373 qpair failed and we were unable to recover it. 00:31:00.373 [2024-11-28 23:23:03.884512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.884593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.884618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.373 qpair failed and we were unable to recover it. 00:31:00.373 [2024-11-28 23:23:03.884743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.884859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.884884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.373 qpair failed and we were unable to recover it. 00:31:00.373 [2024-11-28 23:23:03.884979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.885057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.885083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.373 qpair failed and we were unable to recover it. 00:31:00.373 [2024-11-28 23:23:03.885174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.885252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.885278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.373 qpair failed and we were unable to recover it. 00:31:00.373 [2024-11-28 23:23:03.885398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.885487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.885513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.373 qpair failed and we were unable to recover it. 00:31:00.373 [2024-11-28 23:23:03.885647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.885786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.885811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.373 qpair failed and we were unable to recover it. 00:31:00.373 [2024-11-28 23:23:03.885925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.886007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.886032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.373 qpair failed and we were unable to recover it. 00:31:00.373 [2024-11-28 23:23:03.886117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.886195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.886221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.373 qpair failed and we were unable to recover it. 00:31:00.373 [2024-11-28 23:23:03.886308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.886423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.886450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.373 qpair failed and we were unable to recover it. 00:31:00.373 [2024-11-28 23:23:03.886562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.886673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.886698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.373 qpair failed and we were unable to recover it. 00:31:00.373 [2024-11-28 23:23:03.886781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.886877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.886903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.373 qpair failed and we were unable to recover it. 00:31:00.373 [2024-11-28 23:23:03.887027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.887118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.887143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.373 qpair failed and we were unable to recover it. 00:31:00.373 [2024-11-28 23:23:03.887229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.887311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.887337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.373 qpair failed and we were unable to recover it. 00:31:00.373 [2024-11-28 23:23:03.887440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.887522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.887548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.373 qpair failed and we were unable to recover it. 00:31:00.373 [2024-11-28 23:23:03.887688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.887796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.887821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.373 qpair failed and we were unable to recover it. 00:31:00.373 [2024-11-28 23:23:03.887917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.888032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.888059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.373 qpair failed and we were unable to recover it. 00:31:00.373 [2024-11-28 23:23:03.888176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.888284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.888310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.373 qpair failed and we were unable to recover it. 00:31:00.373 [2024-11-28 23:23:03.888407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.888499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.888525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.373 qpair failed and we were unable to recover it. 00:31:00.373 [2024-11-28 23:23:03.888642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.888735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.888760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.373 qpair failed and we were unable to recover it. 00:31:00.373 [2024-11-28 23:23:03.888847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.888975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.889001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.373 qpair failed and we were unable to recover it. 00:31:00.373 [2024-11-28 23:23:03.889111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.889193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.889219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.373 qpair failed and we were unable to recover it. 00:31:00.373 [2024-11-28 23:23:03.889300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.889418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.889444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.373 qpair failed and we were unable to recover it. 00:31:00.373 [2024-11-28 23:23:03.889531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.889608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.889633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.373 qpair failed and we were unable to recover it. 00:31:00.373 [2024-11-28 23:23:03.889750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.373 [2024-11-28 23:23:03.889858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.889884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.374 qpair failed and we were unable to recover it. 00:31:00.374 [2024-11-28 23:23:03.889966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.890052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.890077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.374 qpair failed and we were unable to recover it. 00:31:00.374 [2024-11-28 23:23:03.890188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.890300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.890326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.374 qpair failed and we were unable to recover it. 00:31:00.374 [2024-11-28 23:23:03.890468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.890557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.890582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.374 qpair failed and we were unable to recover it. 00:31:00.374 [2024-11-28 23:23:03.890666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.890742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.890767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.374 qpair failed and we were unable to recover it. 00:31:00.374 [2024-11-28 23:23:03.890908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.890983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.891008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.374 qpair failed and we were unable to recover it. 00:31:00.374 [2024-11-28 23:23:03.891100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.891214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.891240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.374 qpair failed and we were unable to recover it. 00:31:00.374 [2024-11-28 23:23:03.891326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.891477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.891503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.374 qpair failed and we were unable to recover it. 00:31:00.374 [2024-11-28 23:23:03.891588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.891705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.891731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.374 qpair failed and we were unable to recover it. 00:31:00.374 [2024-11-28 23:23:03.891859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.891947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.891973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.374 qpair failed and we were unable to recover it. 00:31:00.374 [2024-11-28 23:23:03.892086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.892172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.892197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.374 qpair failed and we were unable to recover it. 00:31:00.374 [2024-11-28 23:23:03.892285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.892375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.892419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.374 qpair failed and we were unable to recover it. 00:31:00.374 [2024-11-28 23:23:03.892515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.892637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.892663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.374 qpair failed and we were unable to recover it. 00:31:00.374 [2024-11-28 23:23:03.892750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.892833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.892860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.374 qpair failed and we were unable to recover it. 00:31:00.374 [2024-11-28 23:23:03.892944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.893026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.893051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.374 qpair failed and we were unable to recover it. 00:31:00.374 [2024-11-28 23:23:03.893139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.893227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.893253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.374 qpair failed and we were unable to recover it. 00:31:00.374 [2024-11-28 23:23:03.893372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.893474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.893500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.374 qpair failed and we were unable to recover it. 00:31:00.374 [2024-11-28 23:23:03.893584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.893701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.893727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.374 qpair failed and we were unable to recover it. 00:31:00.374 [2024-11-28 23:23:03.893808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.893889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.893915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.374 qpair failed and we were unable to recover it. 00:31:00.374 [2024-11-28 23:23:03.893998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.894120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.894146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.374 qpair failed and we were unable to recover it. 00:31:00.374 [2024-11-28 23:23:03.894238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.894317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.894342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.374 qpair failed and we were unable to recover it. 00:31:00.374 [2024-11-28 23:23:03.894426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.894515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.894541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.374 qpair failed and we were unable to recover it. 00:31:00.374 [2024-11-28 23:23:03.894625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.894718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.894743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.374 qpair failed and we were unable to recover it. 00:31:00.374 [2024-11-28 23:23:03.894825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.894940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.894965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.374 qpair failed and we were unable to recover it. 00:31:00.374 [2024-11-28 23:23:03.895076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.895149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.895175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.374 qpair failed and we were unable to recover it. 00:31:00.374 [2024-11-28 23:23:03.895270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.895351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.895376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.374 qpair failed and we were unable to recover it. 00:31:00.374 [2024-11-28 23:23:03.895477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.895557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.895582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.374 qpair failed and we were unable to recover it. 00:31:00.374 [2024-11-28 23:23:03.895665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.895760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.895785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.374 qpair failed and we were unable to recover it. 00:31:00.374 [2024-11-28 23:23:03.895864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.895946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.895972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.374 qpair failed and we were unable to recover it. 00:31:00.374 [2024-11-28 23:23:03.896058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.896169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.896196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.374 qpair failed and we were unable to recover it. 00:31:00.374 [2024-11-28 23:23:03.896321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.374 [2024-11-28 23:23:03.896417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.375 [2024-11-28 23:23:03.896452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.375 qpair failed and we were unable to recover it. 00:31:00.375 [2024-11-28 23:23:03.896545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.375 [2024-11-28 23:23:03.896699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.375 [2024-11-28 23:23:03.896724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.375 qpair failed and we were unable to recover it. 00:31:00.375 [2024-11-28 23:23:03.896803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.375 [2024-11-28 23:23:03.896886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.375 [2024-11-28 23:23:03.896912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.375 qpair failed and we were unable to recover it. 00:31:00.375 [2024-11-28 23:23:03.896995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.375 [2024-11-28 23:23:03.897081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.375 [2024-11-28 23:23:03.897109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.375 qpair failed and we were unable to recover it. 00:31:00.375 [2024-11-28 23:23:03.897203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.375 [2024-11-28 23:23:03.897291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.375 [2024-11-28 23:23:03.897318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.375 qpair failed and we were unable to recover it. 00:31:00.375 [2024-11-28 23:23:03.897465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.375 [2024-11-28 23:23:03.897573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.375 [2024-11-28 23:23:03.897603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.375 qpair failed and we were unable to recover it. 00:31:00.375 [2024-11-28 23:23:03.897723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.375 [2024-11-28 23:23:03.897838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.375 [2024-11-28 23:23:03.897864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.375 qpair failed and we were unable to recover it. 00:31:00.375 [2024-11-28 23:23:03.897948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.375 [2024-11-28 23:23:03.898075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.375 [2024-11-28 23:23:03.898100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.375 qpair failed and we were unable to recover it. 00:31:00.375 [2024-11-28 23:23:03.898194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.375 [2024-11-28 23:23:03.898275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.375 [2024-11-28 23:23:03.898301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.375 qpair failed and we were unable to recover it. 00:31:00.375 [2024-11-28 23:23:03.898414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.375 [2024-11-28 23:23:03.898524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.375 [2024-11-28 23:23:03.898551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.375 qpair failed and we were unable to recover it. 00:31:00.375 [2024-11-28 23:23:03.898645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.375 [2024-11-28 23:23:03.898727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.375 [2024-11-28 23:23:03.898752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.375 qpair failed and we were unable to recover it. 00:31:00.375 [2024-11-28 23:23:03.898837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.375 [2024-11-28 23:23:03.898952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.375 [2024-11-28 23:23:03.898977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.375 qpair failed and we were unable to recover it. 00:31:00.375 [2024-11-28 23:23:03.899057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.375 [2024-11-28 23:23:03.899180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.375 [2024-11-28 23:23:03.899216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.375 qpair failed and we were unable to recover it. 00:31:00.375 [2024-11-28 23:23:03.899357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.375 [2024-11-28 23:23:03.899487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.375 [2024-11-28 23:23:03.899514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.375 qpair failed and we were unable to recover it. 00:31:00.375 [2024-11-28 23:23:03.899636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.375 [2024-11-28 23:23:03.899732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.375 [2024-11-28 23:23:03.899757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.375 qpair failed and we were unable to recover it. 00:31:00.375 [2024-11-28 23:23:03.899841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.375 [2024-11-28 23:23:03.899921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.375 [2024-11-28 23:23:03.899946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.375 qpair failed and we were unable to recover it. 00:31:00.375 [2024-11-28 23:23:03.900040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.375 [2024-11-28 23:23:03.900155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.375 [2024-11-28 23:23:03.900180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.375 qpair failed and we were unable to recover it. 00:31:00.375 [2024-11-28 23:23:03.900260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.375 [2024-11-28 23:23:03.900344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.375 [2024-11-28 23:23:03.900370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.375 qpair failed and we were unable to recover it. 00:31:00.375 [2024-11-28 23:23:03.900489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.375 [2024-11-28 23:23:03.900572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.375 [2024-11-28 23:23:03.900598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.375 qpair failed and we were unable to recover it. 00:31:00.375 [2024-11-28 23:23:03.900699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.375 [2024-11-28 23:23:03.900780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.375 [2024-11-28 23:23:03.900806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.375 qpair failed and we were unable to recover it. 00:31:00.375 [2024-11-28 23:23:03.900893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.375 [2024-11-28 23:23:03.901014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.375 [2024-11-28 23:23:03.901050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.375 qpair failed and we were unable to recover it. 00:31:00.670 [2024-11-28 23:23:03.901204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.670 [2024-11-28 23:23:03.901335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.670 [2024-11-28 23:23:03.901373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.670 qpair failed and we were unable to recover it. 00:31:00.670 [2024-11-28 23:23:03.901524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.670 [2024-11-28 23:23:03.901651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.670 [2024-11-28 23:23:03.901705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.670 qpair failed and we were unable to recover it. 00:31:00.670 [2024-11-28 23:23:03.901881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.670 [2024-11-28 23:23:03.902019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.670 [2024-11-28 23:23:03.902071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.670 qpair failed and we were unable to recover it. 00:31:00.670 [2024-11-28 23:23:03.902204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.670 [2024-11-28 23:23:03.902328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.670 [2024-11-28 23:23:03.902365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.670 qpair failed and we were unable to recover it. 00:31:00.670 [2024-11-28 23:23:03.902531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.670 [2024-11-28 23:23:03.902670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.670 [2024-11-28 23:23:03.902710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.670 qpair failed and we were unable to recover it. 00:31:00.670 [2024-11-28 23:23:03.902800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.670 [2024-11-28 23:23:03.902881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.670 [2024-11-28 23:23:03.902907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.670 qpair failed and we were unable to recover it. 00:31:00.670 [2024-11-28 23:23:03.903006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.670 [2024-11-28 23:23:03.903123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.670 [2024-11-28 23:23:03.903149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.670 qpair failed and we were unable to recover it. 00:31:00.670 [2024-11-28 23:23:03.903236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.670 [2024-11-28 23:23:03.903316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.670 [2024-11-28 23:23:03.903342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.670 qpair failed and we were unable to recover it. 00:31:00.670 [2024-11-28 23:23:03.903445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.670 [2024-11-28 23:23:03.903526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.670 [2024-11-28 23:23:03.903552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.670 qpair failed and we were unable to recover it. 00:31:00.670 [2024-11-28 23:23:03.903639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.670 [2024-11-28 23:23:03.903729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.670 [2024-11-28 23:23:03.903754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.670 qpair failed and we were unable to recover it. 00:31:00.670 [2024-11-28 23:23:03.903868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.670 [2024-11-28 23:23:03.903980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.670 [2024-11-28 23:23:03.904005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.670 qpair failed and we were unable to recover it. 00:31:00.670 [2024-11-28 23:23:03.904122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.670 [2024-11-28 23:23:03.904201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.670 [2024-11-28 23:23:03.904235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.670 qpair failed and we were unable to recover it. 00:31:00.670 [2024-11-28 23:23:03.904349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.670 [2024-11-28 23:23:03.904438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.670 [2024-11-28 23:23:03.904465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.670 qpair failed and we were unable to recover it. 00:31:00.670 [2024-11-28 23:23:03.904565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.670 [2024-11-28 23:23:03.904677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.670 [2024-11-28 23:23:03.904702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.670 qpair failed and we were unable to recover it. 00:31:00.670 [2024-11-28 23:23:03.904795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.670 [2024-11-28 23:23:03.904881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.670 [2024-11-28 23:23:03.904909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.670 qpair failed and we were unable to recover it. 00:31:00.670 [2024-11-28 23:23:03.905004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.670 [2024-11-28 23:23:03.905089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.670 [2024-11-28 23:23:03.905115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.670 qpair failed and we were unable to recover it. 00:31:00.670 [2024-11-28 23:23:03.905230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.670 [2024-11-28 23:23:03.905318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.670 [2024-11-28 23:23:03.905345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.670 qpair failed and we were unable to recover it. 00:31:00.670 [2024-11-28 23:23:03.905455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.905544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.905572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.671 qpair failed and we were unable to recover it. 00:31:00.671 [2024-11-28 23:23:03.905661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.905745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.905771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.671 qpair failed and we were unable to recover it. 00:31:00.671 [2024-11-28 23:23:03.905885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.905995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.906021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.671 qpair failed and we were unable to recover it. 00:31:00.671 [2024-11-28 23:23:03.906112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.906198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.906225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.671 qpair failed and we were unable to recover it. 00:31:00.671 [2024-11-28 23:23:03.906338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.906464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.906495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.671 qpair failed and we were unable to recover it. 00:31:00.671 [2024-11-28 23:23:03.906583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.906695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.906721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.671 qpair failed and we were unable to recover it. 00:31:00.671 [2024-11-28 23:23:03.906804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.906888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.906913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.671 qpair failed and we were unable to recover it. 00:31:00.671 [2024-11-28 23:23:03.907034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.907121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.907146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.671 qpair failed and we were unable to recover it. 00:31:00.671 [2024-11-28 23:23:03.907223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.907305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.907331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.671 qpair failed and we were unable to recover it. 00:31:00.671 [2024-11-28 23:23:03.907446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.907529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.907555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.671 qpair failed and we were unable to recover it. 00:31:00.671 [2024-11-28 23:23:03.907636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.907718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.907744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.671 qpair failed and we were unable to recover it. 00:31:00.671 [2024-11-28 23:23:03.907877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.907962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.907988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.671 qpair failed and we were unable to recover it. 00:31:00.671 [2024-11-28 23:23:03.908104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.908192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.908219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.671 qpair failed and we were unable to recover it. 00:31:00.671 [2024-11-28 23:23:03.908309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.908430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.908456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.671 qpair failed and we were unable to recover it. 00:31:00.671 [2024-11-28 23:23:03.908553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.908666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.908696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.671 qpair failed and we were unable to recover it. 00:31:00.671 [2024-11-28 23:23:03.908790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.908921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.908950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.671 qpair failed and we were unable to recover it. 00:31:00.671 [2024-11-28 23:23:03.909036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.909119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.909144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.671 qpair failed and we were unable to recover it. 00:31:00.671 [2024-11-28 23:23:03.909235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.909353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.909385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.671 qpair failed and we were unable to recover it. 00:31:00.671 [2024-11-28 23:23:03.909485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.909566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.909592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.671 qpair failed and we were unable to recover it. 00:31:00.671 [2024-11-28 23:23:03.909711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.909798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.909825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.671 qpair failed and we were unable to recover it. 00:31:00.671 [2024-11-28 23:23:03.909919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.909998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.910022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.671 qpair failed and we were unable to recover it. 00:31:00.671 [2024-11-28 23:23:03.910105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.910221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.910248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.671 qpair failed and we were unable to recover it. 00:31:00.671 [2024-11-28 23:23:03.910332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.910421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.910446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.671 qpair failed and we were unable to recover it. 00:31:00.671 [2024-11-28 23:23:03.910567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.910648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.910672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.671 qpair failed and we were unable to recover it. 00:31:00.671 [2024-11-28 23:23:03.910759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.910836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.910862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.671 qpair failed and we were unable to recover it. 00:31:00.671 [2024-11-28 23:23:03.910954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.911039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.911063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.671 qpair failed and we were unable to recover it. 00:31:00.671 [2024-11-28 23:23:03.911143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.911218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.911242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.671 qpair failed and we were unable to recover it. 00:31:00.671 [2024-11-28 23:23:03.911327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.911426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.911452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.671 qpair failed and we were unable to recover it. 00:31:00.671 [2024-11-28 23:23:03.911535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.911616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.671 [2024-11-28 23:23:03.911641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.671 qpair failed and we were unable to recover it. 00:31:00.671 [2024-11-28 23:23:03.911734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.911843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.911868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.672 qpair failed and we were unable to recover it. 00:31:00.672 [2024-11-28 23:23:03.911985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.912065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.912089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.672 qpair failed and we were unable to recover it. 00:31:00.672 [2024-11-28 23:23:03.912186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.912272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.912297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.672 qpair failed and we were unable to recover it. 00:31:00.672 [2024-11-28 23:23:03.912386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.912479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.912504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.672 qpair failed and we were unable to recover it. 00:31:00.672 [2024-11-28 23:23:03.912589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.912668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.912693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.672 qpair failed and we were unable to recover it. 00:31:00.672 [2024-11-28 23:23:03.912804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.912916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.912941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.672 qpair failed and we were unable to recover it. 00:31:00.672 [2024-11-28 23:23:03.913035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.913153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.913177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.672 qpair failed and we were unable to recover it. 00:31:00.672 [2024-11-28 23:23:03.913263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.913341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.913365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.672 qpair failed and we were unable to recover it. 00:31:00.672 [2024-11-28 23:23:03.913484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.913569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.913595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.672 qpair failed and we were unable to recover it. 00:31:00.672 [2024-11-28 23:23:03.913740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.913824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.913850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.672 qpair failed and we were unable to recover it. 00:31:00.672 [2024-11-28 23:23:03.913930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.914011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.914035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.672 qpair failed and we were unable to recover it. 00:31:00.672 [2024-11-28 23:23:03.914124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.914208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.914233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.672 qpair failed and we were unable to recover it. 00:31:00.672 [2024-11-28 23:23:03.914310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.914425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.914450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.672 qpair failed and we were unable to recover it. 00:31:00.672 [2024-11-28 23:23:03.914560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.914649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.914674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.672 qpair failed and we were unable to recover it. 00:31:00.672 [2024-11-28 23:23:03.914760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.914873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.914898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.672 qpair failed and we were unable to recover it. 00:31:00.672 [2024-11-28 23:23:03.914977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.915057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.915081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.672 qpair failed and we were unable to recover it. 00:31:00.672 [2024-11-28 23:23:03.915167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.915267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.915292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.672 qpair failed and we were unable to recover it. 00:31:00.672 [2024-11-28 23:23:03.915370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.915450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.915475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.672 qpair failed and we were unable to recover it. 00:31:00.672 [2024-11-28 23:23:03.915569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.915655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.915681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.672 qpair failed and we were unable to recover it. 00:31:00.672 [2024-11-28 23:23:03.915796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.915879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.915904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.672 qpair failed and we were unable to recover it. 00:31:00.672 [2024-11-28 23:23:03.915990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.916072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.916097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.672 qpair failed and we were unable to recover it. 00:31:00.672 [2024-11-28 23:23:03.916211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.916322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.916347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.672 qpair failed and we were unable to recover it. 00:31:00.672 [2024-11-28 23:23:03.916436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.916525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.916550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.672 qpair failed and we were unable to recover it. 00:31:00.672 [2024-11-28 23:23:03.916639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.916732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.916757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.672 qpair failed and we were unable to recover it. 00:31:00.672 [2024-11-28 23:23:03.916847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.916933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.916957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.672 qpair failed and we were unable to recover it. 00:31:00.672 [2024-11-28 23:23:03.917044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.917124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.917149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.672 qpair failed and we were unable to recover it. 00:31:00.672 [2024-11-28 23:23:03.917242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.917334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.917359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.672 qpair failed and we were unable to recover it. 00:31:00.672 [2024-11-28 23:23:03.917450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.917535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.917560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.672 qpair failed and we were unable to recover it. 00:31:00.672 [2024-11-28 23:23:03.917642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.917720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.917743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.672 qpair failed and we were unable to recover it. 00:31:00.672 [2024-11-28 23:23:03.917833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.672 [2024-11-28 23:23:03.917927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.917953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.673 qpair failed and we were unable to recover it. 00:31:00.673 [2024-11-28 23:23:03.918030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.918110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.918134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.673 qpair failed and we were unable to recover it. 00:31:00.673 [2024-11-28 23:23:03.918250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.918333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.918358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.673 qpair failed and we were unable to recover it. 00:31:00.673 [2024-11-28 23:23:03.918476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.918564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.918590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.673 qpair failed and we were unable to recover it. 00:31:00.673 [2024-11-28 23:23:03.918679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.918790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.918816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.673 qpair failed and we were unable to recover it. 00:31:00.673 [2024-11-28 23:23:03.918933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.919039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.919064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.673 qpair failed and we were unable to recover it. 00:31:00.673 [2024-11-28 23:23:03.919147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.919240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.919264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.673 qpair failed and we were unable to recover it. 00:31:00.673 [2024-11-28 23:23:03.919357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.919457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.919487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.673 qpair failed and we were unable to recover it. 00:31:00.673 [2024-11-28 23:23:03.919600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.919714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.919739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.673 qpair failed and we were unable to recover it. 00:31:00.673 [2024-11-28 23:23:03.919822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.919929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.919955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.673 qpair failed and we were unable to recover it. 00:31:00.673 [2024-11-28 23:23:03.920036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.920126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.920151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.673 qpair failed and we were unable to recover it. 00:31:00.673 [2024-11-28 23:23:03.920231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.920313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.920338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.673 qpair failed and we were unable to recover it. 00:31:00.673 [2024-11-28 23:23:03.920426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.920511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.920535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.673 qpair failed and we were unable to recover it. 00:31:00.673 [2024-11-28 23:23:03.920620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.920757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.920782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.673 qpair failed and we were unable to recover it. 00:31:00.673 [2024-11-28 23:23:03.920898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.920979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.921004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.673 qpair failed and we were unable to recover it. 00:31:00.673 [2024-11-28 23:23:03.921099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.921185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.921209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.673 qpair failed and we were unable to recover it. 00:31:00.673 [2024-11-28 23:23:03.921287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.921361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.921385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.673 qpair failed and we were unable to recover it. 00:31:00.673 [2024-11-28 23:23:03.921483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.921571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.921596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.673 qpair failed and we were unable to recover it. 00:31:00.673 [2024-11-28 23:23:03.921682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.921762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.921786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.673 qpair failed and we were unable to recover it. 00:31:00.673 [2024-11-28 23:23:03.921910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.922022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.922046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.673 qpair failed and we were unable to recover it. 00:31:00.673 [2024-11-28 23:23:03.922132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.922238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.922263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.673 qpair failed and we were unable to recover it. 00:31:00.673 [2024-11-28 23:23:03.922343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.922446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.922473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.673 qpair failed and we were unable to recover it. 00:31:00.673 [2024-11-28 23:23:03.922558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.922693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.922718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.673 qpair failed and we were unable to recover it. 00:31:00.673 [2024-11-28 23:23:03.922802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.922920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.922945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.673 qpair failed and we were unable to recover it. 00:31:00.673 [2024-11-28 23:23:03.923036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.923121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.923145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.673 qpair failed and we were unable to recover it. 00:31:00.673 [2024-11-28 23:23:03.923225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.923306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.923330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.673 qpair failed and we were unable to recover it. 00:31:00.673 [2024-11-28 23:23:03.923423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.923500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.923524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.673 qpair failed and we were unable to recover it. 00:31:00.673 [2024-11-28 23:23:03.923617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.923731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.923756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.673 qpair failed and we were unable to recover it. 00:31:00.673 [2024-11-28 23:23:03.923879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.923958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.923983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.673 qpair failed and we were unable to recover it. 00:31:00.673 [2024-11-28 23:23:03.924076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.924156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.673 [2024-11-28 23:23:03.924181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.674 qpair failed and we were unable to recover it. 00:31:00.674 [2024-11-28 23:23:03.924266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.924347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.924371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.674 qpair failed and we were unable to recover it. 00:31:00.674 [2024-11-28 23:23:03.924492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.924577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.924601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.674 qpair failed and we were unable to recover it. 00:31:00.674 [2024-11-28 23:23:03.924685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.924808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.924833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.674 qpair failed and we were unable to recover it. 00:31:00.674 [2024-11-28 23:23:03.924918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.925037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.925062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.674 qpair failed and we were unable to recover it. 00:31:00.674 [2024-11-28 23:23:03.925143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.925225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.925250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.674 qpair failed and we were unable to recover it. 00:31:00.674 [2024-11-28 23:23:03.925333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.925427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.925452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.674 qpair failed and we were unable to recover it. 00:31:00.674 [2024-11-28 23:23:03.925573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.925687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.925711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.674 qpair failed and we were unable to recover it. 00:31:00.674 [2024-11-28 23:23:03.925792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.925872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.925897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.674 qpair failed and we were unable to recover it. 00:31:00.674 [2024-11-28 23:23:03.925979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.926089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.926114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.674 qpair failed and we were unable to recover it. 00:31:00.674 [2024-11-28 23:23:03.926230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.926317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.926341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.674 qpair failed and we were unable to recover it. 00:31:00.674 [2024-11-28 23:23:03.926434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.926556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.926580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.674 qpair failed and we were unable to recover it. 00:31:00.674 [2024-11-28 23:23:03.926668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.926778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.926803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.674 qpair failed and we were unable to recover it. 00:31:00.674 [2024-11-28 23:23:03.926896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.926979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.927004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.674 qpair failed and we were unable to recover it. 00:31:00.674 [2024-11-28 23:23:03.927115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.927205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.927229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.674 qpair failed and we were unable to recover it. 00:31:00.674 [2024-11-28 23:23:03.927306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.927419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.927444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.674 qpair failed and we were unable to recover it. 00:31:00.674 [2024-11-28 23:23:03.927526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.927614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.927640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.674 qpair failed and we were unable to recover it. 00:31:00.674 [2024-11-28 23:23:03.927726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.927821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.927845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.674 qpair failed and we were unable to recover it. 00:31:00.674 [2024-11-28 23:23:03.927963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.928046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.928071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.674 qpair failed and we were unable to recover it. 00:31:00.674 [2024-11-28 23:23:03.928184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.928275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.928304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.674 qpair failed and we were unable to recover it. 00:31:00.674 [2024-11-28 23:23:03.928386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.928508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.928533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.674 qpair failed and we were unable to recover it. 00:31:00.674 [2024-11-28 23:23:03.928640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.928727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.928752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.674 qpair failed and we were unable to recover it. 00:31:00.674 [2024-11-28 23:23:03.928843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.928956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.928982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.674 qpair failed and we were unable to recover it. 00:31:00.674 [2024-11-28 23:23:03.929079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.929158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.929183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.674 qpair failed and we were unable to recover it. 00:31:00.674 [2024-11-28 23:23:03.929292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.929378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.674 [2024-11-28 23:23:03.929410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.674 qpair failed and we were unable to recover it. 00:31:00.675 [2024-11-28 23:23:03.929500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.929591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.929615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.675 qpair failed and we were unable to recover it. 00:31:00.675 [2024-11-28 23:23:03.929740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.929849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.929874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.675 qpair failed and we were unable to recover it. 00:31:00.675 [2024-11-28 23:23:03.929964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.930053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.930079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.675 qpair failed and we were unable to recover it. 00:31:00.675 [2024-11-28 23:23:03.930200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.930281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.930305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.675 qpair failed and we were unable to recover it. 00:31:00.675 [2024-11-28 23:23:03.930400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.930495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.930521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.675 qpair failed and we were unable to recover it. 00:31:00.675 [2024-11-28 23:23:03.930614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.930702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.930727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.675 qpair failed and we were unable to recover it. 00:31:00.675 [2024-11-28 23:23:03.930814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.930958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.930983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.675 qpair failed and we were unable to recover it. 00:31:00.675 [2024-11-28 23:23:03.931061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.931144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.931168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.675 qpair failed and we were unable to recover it. 00:31:00.675 [2024-11-28 23:23:03.931253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.931336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.931360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.675 qpair failed and we were unable to recover it. 00:31:00.675 [2024-11-28 23:23:03.931483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.931575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.931601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.675 qpair failed and we were unable to recover it. 00:31:00.675 [2024-11-28 23:23:03.931709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.931794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.931819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.675 qpair failed and we were unable to recover it. 00:31:00.675 [2024-11-28 23:23:03.931912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.931993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.932019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.675 qpair failed and we were unable to recover it. 00:31:00.675 [2024-11-28 23:23:03.932111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.932222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.932247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.675 qpair failed and we were unable to recover it. 00:31:00.675 [2024-11-28 23:23:03.932339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.932454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.932479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.675 qpair failed and we were unable to recover it. 00:31:00.675 [2024-11-28 23:23:03.932571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.932656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.932681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.675 qpair failed and we were unable to recover it. 00:31:00.675 [2024-11-28 23:23:03.932776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.932864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.932889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.675 qpair failed and we were unable to recover it. 00:31:00.675 [2024-11-28 23:23:03.932969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.933059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.933083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.675 qpair failed and we were unable to recover it. 00:31:00.675 [2024-11-28 23:23:03.933229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.933320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.933344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.675 qpair failed and we were unable to recover it. 00:31:00.675 [2024-11-28 23:23:03.933469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.933556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.933582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.675 qpair failed and we were unable to recover it. 00:31:00.675 [2024-11-28 23:23:03.933695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.933778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.933802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.675 qpair failed and we were unable to recover it. 00:31:00.675 [2024-11-28 23:23:03.933887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.933971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.933996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.675 qpair failed and we were unable to recover it. 00:31:00.675 [2024-11-28 23:23:03.934087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.934197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.934222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.675 qpair failed and we were unable to recover it. 00:31:00.675 [2024-11-28 23:23:03.934313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.934403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.934429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.675 qpair failed and we were unable to recover it. 00:31:00.675 [2024-11-28 23:23:03.934520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.934598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.934622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.675 qpair failed and we were unable to recover it. 00:31:00.675 [2024-11-28 23:23:03.934714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.934837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.934861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.675 qpair failed and we were unable to recover it. 00:31:00.675 [2024-11-28 23:23:03.934950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.935065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.935090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.675 qpair failed and we were unable to recover it. 00:31:00.675 [2024-11-28 23:23:03.935174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.935262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.935286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.675 qpair failed and we were unable to recover it. 00:31:00.675 [2024-11-28 23:23:03.935370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.935467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.935492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.675 qpair failed and we were unable to recover it. 00:31:00.675 [2024-11-28 23:23:03.935582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.935691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.675 [2024-11-28 23:23:03.935716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.675 qpair failed and we were unable to recover it. 00:31:00.676 [2024-11-28 23:23:03.935804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.935889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.935913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.676 qpair failed and we were unable to recover it. 00:31:00.676 [2024-11-28 23:23:03.936024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.936100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.936125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.676 qpair failed and we were unable to recover it. 00:31:00.676 [2024-11-28 23:23:03.936240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.936327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.936352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.676 qpair failed and we were unable to recover it. 00:31:00.676 [2024-11-28 23:23:03.936478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.936563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.936588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.676 qpair failed and we were unable to recover it. 00:31:00.676 [2024-11-28 23:23:03.936731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.936820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.936845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.676 qpair failed and we were unable to recover it. 00:31:00.676 [2024-11-28 23:23:03.936927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.937037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.937061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.676 qpair failed and we were unable to recover it. 00:31:00.676 [2024-11-28 23:23:03.937153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.937264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.937288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.676 qpair failed and we were unable to recover it. 00:31:00.676 [2024-11-28 23:23:03.937377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.937478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.937503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.676 qpair failed and we were unable to recover it. 00:31:00.676 [2024-11-28 23:23:03.937643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.937755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.937780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.676 qpair failed and we were unable to recover it. 00:31:00.676 [2024-11-28 23:23:03.937894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.937983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.938008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.676 qpair failed and we were unable to recover it. 00:31:00.676 [2024-11-28 23:23:03.938098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.938184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.938209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.676 qpair failed and we were unable to recover it. 00:31:00.676 [2024-11-28 23:23:03.938289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.938407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.938433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.676 qpair failed and we were unable to recover it. 00:31:00.676 [2024-11-28 23:23:03.938514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.938594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.938618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.676 qpair failed and we were unable to recover it. 00:31:00.676 [2024-11-28 23:23:03.938710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.938831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.938857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.676 qpair failed and we were unable to recover it. 00:31:00.676 [2024-11-28 23:23:03.938974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.939090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.939115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.676 qpair failed and we were unable to recover it. 00:31:00.676 [2024-11-28 23:23:03.939201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.939279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.939304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.676 qpair failed and we were unable to recover it. 00:31:00.676 [2024-11-28 23:23:03.939417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.939501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.939531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.676 qpair failed and we were unable to recover it. 00:31:00.676 [2024-11-28 23:23:03.939620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.939739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.939764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.676 qpair failed and we were unable to recover it. 00:31:00.676 [2024-11-28 23:23:03.939846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.939926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.939950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.676 qpair failed and we were unable to recover it. 00:31:00.676 [2024-11-28 23:23:03.940034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.940113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.940139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.676 qpair failed and we were unable to recover it. 00:31:00.676 [2024-11-28 23:23:03.940232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.940339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.940363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.676 qpair failed and we were unable to recover it. 00:31:00.676 [2024-11-28 23:23:03.940459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.940539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.940564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.676 qpair failed and we were unable to recover it. 00:31:00.676 [2024-11-28 23:23:03.940654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.940745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.940769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.676 qpair failed and we were unable to recover it. 00:31:00.676 [2024-11-28 23:23:03.940849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.940923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.940948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.676 qpair failed and we were unable to recover it. 00:31:00.676 [2024-11-28 23:23:03.941042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.941183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.941208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.676 qpair failed and we were unable to recover it. 00:31:00.676 [2024-11-28 23:23:03.941341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.941429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.941455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.676 qpair failed and we were unable to recover it. 00:31:00.676 [2024-11-28 23:23:03.941569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.941655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.941680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.676 qpair failed and we were unable to recover it. 00:31:00.676 [2024-11-28 23:23:03.941766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.941878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.941904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.676 qpair failed and we were unable to recover it. 00:31:00.676 [2024-11-28 23:23:03.941992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.942069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.676 [2024-11-28 23:23:03.942095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.676 qpair failed and we were unable to recover it. 00:31:00.676 [2024-11-28 23:23:03.942177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.942257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.942282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.677 qpair failed and we were unable to recover it. 00:31:00.677 [2024-11-28 23:23:03.942370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.942461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.942487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.677 qpair failed and we were unable to recover it. 00:31:00.677 [2024-11-28 23:23:03.942605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.942725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.942750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.677 qpair failed and we were unable to recover it. 00:31:00.677 [2024-11-28 23:23:03.942871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.942979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.943004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.677 qpair failed and we were unable to recover it. 00:31:00.677 [2024-11-28 23:23:03.943154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.943259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.943284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.677 qpair failed and we were unable to recover it. 00:31:00.677 [2024-11-28 23:23:03.943424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.943510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.943535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.677 qpair failed and we were unable to recover it. 00:31:00.677 [2024-11-28 23:23:03.943618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.943697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.943721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.677 qpair failed and we were unable to recover it. 00:31:00.677 [2024-11-28 23:23:03.943803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.943917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.943941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.677 qpair failed and we were unable to recover it. 00:31:00.677 [2024-11-28 23:23:03.944059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.944146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.944171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.677 qpair failed and we were unable to recover it. 00:31:00.677 [2024-11-28 23:23:03.944282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.944399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.944426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.677 qpair failed and we were unable to recover it. 00:31:00.677 [2024-11-28 23:23:03.944511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.944601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.944626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.677 qpair failed and we were unable to recover it. 00:31:00.677 [2024-11-28 23:23:03.944716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.944826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.944851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.677 qpair failed and we were unable to recover it. 00:31:00.677 [2024-11-28 23:23:03.944938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.945016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.945040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.677 qpair failed and we were unable to recover it. 00:31:00.677 [2024-11-28 23:23:03.945163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.945275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.945312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.677 qpair failed and we were unable to recover it. 00:31:00.677 [2024-11-28 23:23:03.945405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.945488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.945513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.677 qpair failed and we were unable to recover it. 00:31:00.677 [2024-11-28 23:23:03.945630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.945714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.945739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.677 qpair failed and we were unable to recover it. 00:31:00.677 [2024-11-28 23:23:03.945848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.945928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.945952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.677 qpair failed and we were unable to recover it. 00:31:00.677 [2024-11-28 23:23:03.946040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.946153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.946178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.677 qpair failed and we were unable to recover it. 00:31:00.677 [2024-11-28 23:23:03.946261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.946349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.946375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.677 qpair failed and we were unable to recover it. 00:31:00.677 [2024-11-28 23:23:03.946461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.946543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.946568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.677 qpair failed and we were unable to recover it. 00:31:00.677 [2024-11-28 23:23:03.946662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.946748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.946773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.677 qpair failed and we were unable to recover it. 00:31:00.677 [2024-11-28 23:23:03.946856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.946978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.947002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.677 qpair failed and we were unable to recover it. 00:31:00.677 [2024-11-28 23:23:03.947088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.947198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.947225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.677 qpair failed and we were unable to recover it. 00:31:00.677 [2024-11-28 23:23:03.947313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.947421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.947447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.677 qpair failed and we were unable to recover it. 00:31:00.677 [2024-11-28 23:23:03.947558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.947671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.947696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.677 qpair failed and we were unable to recover it. 00:31:00.677 [2024-11-28 23:23:03.947794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.947883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.947908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.677 qpair failed and we were unable to recover it. 00:31:00.677 [2024-11-28 23:23:03.947993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.948100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.948124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.677 qpair failed and we were unable to recover it. 00:31:00.677 [2024-11-28 23:23:03.948209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.948289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.948315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.677 qpair failed and we were unable to recover it. 00:31:00.677 [2024-11-28 23:23:03.948403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.948499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.948523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.677 qpair failed and we were unable to recover it. 00:31:00.677 [2024-11-28 23:23:03.948602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.677 [2024-11-28 23:23:03.948718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.948743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.678 qpair failed and we were unable to recover it. 00:31:00.678 [2024-11-28 23:23:03.948833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.948915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.948939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.678 qpair failed and we were unable to recover it. 00:31:00.678 [2024-11-28 23:23:03.949022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.949102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.949128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.678 qpair failed and we were unable to recover it. 00:31:00.678 [2024-11-28 23:23:03.949215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.949297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.949321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.678 qpair failed and we were unable to recover it. 00:31:00.678 [2024-11-28 23:23:03.949421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.949533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.949558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.678 qpair failed and we were unable to recover it. 00:31:00.678 [2024-11-28 23:23:03.949638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.949752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.949777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.678 qpair failed and we were unable to recover it. 00:31:00.678 [2024-11-28 23:23:03.949866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.949945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.949969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.678 qpair failed and we were unable to recover it. 00:31:00.678 [2024-11-28 23:23:03.950048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.950155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.950180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.678 qpair failed and we were unable to recover it. 00:31:00.678 [2024-11-28 23:23:03.950264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.950350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.950375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.678 qpair failed and we were unable to recover it. 00:31:00.678 [2024-11-28 23:23:03.950492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.950588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.950617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.678 qpair failed and we were unable to recover it. 00:31:00.678 [2024-11-28 23:23:03.950729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.950809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.950835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.678 qpair failed and we were unable to recover it. 00:31:00.678 [2024-11-28 23:23:03.950926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.951008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.951033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.678 qpair failed and we were unable to recover it. 00:31:00.678 [2024-11-28 23:23:03.951144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.951219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.951244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.678 qpair failed and we were unable to recover it. 00:31:00.678 [2024-11-28 23:23:03.951324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.951428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.951454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.678 qpair failed and we were unable to recover it. 00:31:00.678 [2024-11-28 23:23:03.951539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.951624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.951648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.678 qpair failed and we were unable to recover it. 00:31:00.678 [2024-11-28 23:23:03.951789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.951879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.951903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.678 qpair failed and we were unable to recover it. 00:31:00.678 [2024-11-28 23:23:03.952013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.952101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.952126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.678 qpair failed and we were unable to recover it. 00:31:00.678 [2024-11-28 23:23:03.952217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.952300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.952325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.678 qpair failed and we were unable to recover it. 00:31:00.678 [2024-11-28 23:23:03.952442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.952559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.952584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.678 qpair failed and we were unable to recover it. 00:31:00.678 [2024-11-28 23:23:03.952669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.952752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.952776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.678 qpair failed and we were unable to recover it. 00:31:00.678 [2024-11-28 23:23:03.952866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.952953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.952978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.678 qpair failed and we were unable to recover it. 00:31:00.678 [2024-11-28 23:23:03.953101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.953189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.953213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.678 qpair failed and we were unable to recover it. 00:31:00.678 [2024-11-28 23:23:03.953303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.953388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.953418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.678 qpair failed and we were unable to recover it. 00:31:00.678 [2024-11-28 23:23:03.953527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.953636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.953661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.678 qpair failed and we were unable to recover it. 00:31:00.678 [2024-11-28 23:23:03.953745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.953885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.953910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.678 qpair failed and we were unable to recover it. 00:31:00.678 [2024-11-28 23:23:03.953996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.954071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.954096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.678 qpair failed and we were unable to recover it. 00:31:00.678 [2024-11-28 23:23:03.954180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.954322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.954346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.678 qpair failed and we were unable to recover it. 00:31:00.678 [2024-11-28 23:23:03.954440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.954526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.954550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.678 qpair failed and we were unable to recover it. 00:31:00.678 [2024-11-28 23:23:03.954636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.954751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.954775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.678 qpair failed and we were unable to recover it. 00:31:00.678 [2024-11-28 23:23:03.954852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.678 [2024-11-28 23:23:03.954935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.954960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.679 qpair failed and we were unable to recover it. 00:31:00.679 [2024-11-28 23:23:03.955059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.955147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.955172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.679 qpair failed and we were unable to recover it. 00:31:00.679 [2024-11-28 23:23:03.955286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.955383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.955415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.679 qpair failed and we were unable to recover it. 00:31:00.679 [2024-11-28 23:23:03.955500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.955589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.955614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.679 qpair failed and we were unable to recover it. 00:31:00.679 [2024-11-28 23:23:03.955703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.955784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.955810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.679 qpair failed and we were unable to recover it. 00:31:00.679 [2024-11-28 23:23:03.955919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.955998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.956022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.679 qpair failed and we were unable to recover it. 00:31:00.679 [2024-11-28 23:23:03.956140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.956247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.956271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.679 qpair failed and we were unable to recover it. 00:31:00.679 [2024-11-28 23:23:03.956355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.956457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.956482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.679 qpair failed and we were unable to recover it. 00:31:00.679 [2024-11-28 23:23:03.956564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.956648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.956673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.679 qpair failed and we were unable to recover it. 00:31:00.679 [2024-11-28 23:23:03.956754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.956841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.956866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.679 qpair failed and we were unable to recover it. 00:31:00.679 [2024-11-28 23:23:03.957018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.957094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.957118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.679 qpair failed and we were unable to recover it. 00:31:00.679 [2024-11-28 23:23:03.957209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.957301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.957325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.679 qpair failed and we were unable to recover it. 00:31:00.679 [2024-11-28 23:23:03.957420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.957503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.957527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.679 qpair failed and we were unable to recover it. 00:31:00.679 [2024-11-28 23:23:03.957640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.957755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.957779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.679 qpair failed and we were unable to recover it. 00:31:00.679 [2024-11-28 23:23:03.957861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.957977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.958004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.679 qpair failed and we were unable to recover it. 00:31:00.679 [2024-11-28 23:23:03.958099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.958236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.958261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.679 qpair failed and we were unable to recover it. 00:31:00.679 [2024-11-28 23:23:03.958348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.958440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.958466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.679 qpair failed and we were unable to recover it. 00:31:00.679 [2024-11-28 23:23:03.958578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.958694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.958719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.679 qpair failed and we were unable to recover it. 00:31:00.679 [2024-11-28 23:23:03.958803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.958893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.958919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.679 qpair failed and we were unable to recover it. 00:31:00.679 [2024-11-28 23:23:03.958999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.959082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.959107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.679 qpair failed and we were unable to recover it. 00:31:00.679 [2024-11-28 23:23:03.959195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.959273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.959298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.679 qpair failed and we were unable to recover it. 00:31:00.679 [2024-11-28 23:23:03.959423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.959532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.959561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.679 qpair failed and we were unable to recover it. 00:31:00.679 [2024-11-28 23:23:03.959657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.959738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.959763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.679 qpair failed and we were unable to recover it. 00:31:00.679 [2024-11-28 23:23:03.959848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.959929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.959954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.679 qpair failed and we were unable to recover it. 00:31:00.679 [2024-11-28 23:23:03.960095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.960180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.960205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.679 qpair failed and we were unable to recover it. 00:31:00.679 [2024-11-28 23:23:03.960287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.960367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.960398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.679 qpair failed and we were unable to recover it. 00:31:00.679 [2024-11-28 23:23:03.960521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.679 [2024-11-28 23:23:03.960607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.960632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.680 qpair failed and we were unable to recover it. 00:31:00.680 [2024-11-28 23:23:03.960713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.960791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.960815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.680 qpair failed and we were unable to recover it. 00:31:00.680 [2024-11-28 23:23:03.960907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.961020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.961045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.680 qpair failed and we were unable to recover it. 00:31:00.680 [2024-11-28 23:23:03.961134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.961244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.961268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.680 qpair failed and we were unable to recover it. 00:31:00.680 [2024-11-28 23:23:03.961348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.961433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.961459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.680 qpair failed and we were unable to recover it. 00:31:00.680 [2024-11-28 23:23:03.961573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.961652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.961676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.680 qpair failed and we were unable to recover it. 00:31:00.680 [2024-11-28 23:23:03.961762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.961880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.961905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.680 qpair failed and we were unable to recover it. 00:31:00.680 [2024-11-28 23:23:03.961986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.962065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.962089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.680 qpair failed and we were unable to recover it. 00:31:00.680 [2024-11-28 23:23:03.962201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.962286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.962311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.680 qpair failed and we were unable to recover it. 00:31:00.680 [2024-11-28 23:23:03.962421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.962501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.962526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.680 qpair failed and we were unable to recover it. 00:31:00.680 [2024-11-28 23:23:03.962640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.962747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.962772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.680 qpair failed and we were unable to recover it. 00:31:00.680 [2024-11-28 23:23:03.962851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.962964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.962988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.680 qpair failed and we were unable to recover it. 00:31:00.680 [2024-11-28 23:23:03.963099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.963179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.963203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.680 qpair failed and we were unable to recover it. 00:31:00.680 [2024-11-28 23:23:03.963288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.963380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.963435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.680 qpair failed and we were unable to recover it. 00:31:00.680 [2024-11-28 23:23:03.963529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.963615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.963639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.680 qpair failed and we were unable to recover it. 00:31:00.680 [2024-11-28 23:23:03.963725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.963810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.963836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.680 qpair failed and we were unable to recover it. 00:31:00.680 [2024-11-28 23:23:03.963961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.964041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.964066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.680 qpair failed and we were unable to recover it. 00:31:00.680 [2024-11-28 23:23:03.964150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.964242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.964266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.680 qpair failed and we were unable to recover it. 00:31:00.680 [2024-11-28 23:23:03.964350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.964467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.964492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.680 qpair failed and we were unable to recover it. 00:31:00.680 [2024-11-28 23:23:03.964578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.964662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.964686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.680 qpair failed and we were unable to recover it. 00:31:00.680 [2024-11-28 23:23:03.964767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.964880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.964906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.680 qpair failed and we were unable to recover it. 00:31:00.680 [2024-11-28 23:23:03.964990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.965127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.965152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.680 qpair failed and we were unable to recover it. 00:31:00.680 [2024-11-28 23:23:03.965240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.965325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.965352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.680 qpair failed and we were unable to recover it. 00:31:00.680 [2024-11-28 23:23:03.965452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.965567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.965592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.680 qpair failed and we were unable to recover it. 00:31:00.680 [2024-11-28 23:23:03.965679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.965763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.965787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.680 qpair failed and we were unable to recover it. 00:31:00.680 [2024-11-28 23:23:03.965872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.965956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.965980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.680 qpair failed and we were unable to recover it. 00:31:00.680 [2024-11-28 23:23:03.966098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.966205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.966230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.680 qpair failed and we were unable to recover it. 00:31:00.680 [2024-11-28 23:23:03.966351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.966473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.966498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.680 qpair failed and we were unable to recover it. 00:31:00.680 [2024-11-28 23:23:03.966582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.966703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.966728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.680 qpair failed and we were unable to recover it. 00:31:00.680 [2024-11-28 23:23:03.966810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.680 [2024-11-28 23:23:03.966890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.966915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.681 qpair failed and we were unable to recover it. 00:31:00.681 [2024-11-28 23:23:03.967003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.967117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.967141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.681 qpair failed and we were unable to recover it. 00:31:00.681 [2024-11-28 23:23:03.967252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.967361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.967386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.681 qpair failed and we were unable to recover it. 00:31:00.681 [2024-11-28 23:23:03.967509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.967624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.967649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.681 qpair failed and we were unable to recover it. 00:31:00.681 [2024-11-28 23:23:03.967791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.967872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.967896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.681 qpair failed and we were unable to recover it. 00:31:00.681 [2024-11-28 23:23:03.967995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.968110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.968136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.681 qpair failed and we were unable to recover it. 00:31:00.681 [2024-11-28 23:23:03.968257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.968366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.968390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.681 qpair failed and we were unable to recover it. 00:31:00.681 [2024-11-28 23:23:03.968515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.968612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.968636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.681 qpair failed and we were unable to recover it. 00:31:00.681 [2024-11-28 23:23:03.968739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.968818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.968843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.681 qpair failed and we were unable to recover it. 00:31:00.681 [2024-11-28 23:23:03.968986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.969074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.969099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.681 qpair failed and we were unable to recover it. 00:31:00.681 [2024-11-28 23:23:03.969191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.969271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.969304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.681 qpair failed and we were unable to recover it. 00:31:00.681 [2024-11-28 23:23:03.969417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.969497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.969522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.681 qpair failed and we were unable to recover it. 00:31:00.681 [2024-11-28 23:23:03.969604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.969732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.969756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.681 qpair failed and we were unable to recover it. 00:31:00.681 [2024-11-28 23:23:03.969847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.969962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.969988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.681 qpair failed and we were unable to recover it. 00:31:00.681 [2024-11-28 23:23:03.970078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.970167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.970191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.681 qpair failed and we were unable to recover it. 00:31:00.681 [2024-11-28 23:23:03.970276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.970356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.970381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.681 qpair failed and we were unable to recover it. 00:31:00.681 [2024-11-28 23:23:03.970477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.970564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.970588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.681 qpair failed and we were unable to recover it. 00:31:00.681 [2024-11-28 23:23:03.970678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.970762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.970791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.681 qpair failed and we were unable to recover it. 00:31:00.681 [2024-11-28 23:23:03.970891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.971009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.971034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.681 qpair failed and we were unable to recover it. 00:31:00.681 [2024-11-28 23:23:03.971114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.971221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.971246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.681 qpair failed and we were unable to recover it. 00:31:00.681 [2024-11-28 23:23:03.971330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.971435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.971462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.681 qpair failed and we were unable to recover it. 00:31:00.681 [2024-11-28 23:23:03.971579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.971695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.971721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.681 qpair failed and we were unable to recover it. 00:31:00.681 [2024-11-28 23:23:03.971802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.971884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.971909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.681 qpair failed and we were unable to recover it. 00:31:00.681 [2024-11-28 23:23:03.972021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.972128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.972153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.681 qpair failed and we were unable to recover it. 00:31:00.681 [2024-11-28 23:23:03.972267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.972351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.972376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.681 qpair failed and we were unable to recover it. 00:31:00.681 [2024-11-28 23:23:03.972467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.972560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.972584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.681 qpair failed and we were unable to recover it. 00:31:00.681 [2024-11-28 23:23:03.972676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.972797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.972822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.681 qpair failed and we were unable to recover it. 00:31:00.681 [2024-11-28 23:23:03.972926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.973041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.973065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.681 qpair failed and we were unable to recover it. 00:31:00.681 [2024-11-28 23:23:03.973155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.973235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.973259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.681 qpair failed and we were unable to recover it. 00:31:00.681 [2024-11-28 23:23:03.973334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.973445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.681 [2024-11-28 23:23:03.973472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.681 qpair failed and we were unable to recover it. 00:31:00.682 [2024-11-28 23:23:03.973583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.973693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.973724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.682 qpair failed and we were unable to recover it. 00:31:00.682 [2024-11-28 23:23:03.973840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.973926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.973951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.682 qpair failed and we were unable to recover it. 00:31:00.682 [2024-11-28 23:23:03.974039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.974122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.974147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.682 qpair failed and we were unable to recover it. 00:31:00.682 [2024-11-28 23:23:03.974243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.974329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.974355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.682 qpair failed and we were unable to recover it. 00:31:00.682 [2024-11-28 23:23:03.974445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.974524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.974548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.682 qpair failed and we were unable to recover it. 00:31:00.682 [2024-11-28 23:23:03.974665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.974789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.974814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.682 qpair failed and we were unable to recover it. 00:31:00.682 [2024-11-28 23:23:03.974917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.975003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.975027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.682 qpair failed and we were unable to recover it. 00:31:00.682 [2024-11-28 23:23:03.975139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.975226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.975252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.682 qpair failed and we were unable to recover it. 00:31:00.682 [2024-11-28 23:23:03.975365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.975452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.975478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.682 qpair failed and we were unable to recover it. 00:31:00.682 [2024-11-28 23:23:03.975592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.975681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.975710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.682 qpair failed and we were unable to recover it. 00:31:00.682 [2024-11-28 23:23:03.975803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.975890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.975915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.682 qpair failed and we were unable to recover it. 00:31:00.682 [2024-11-28 23:23:03.976001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.976118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.976143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.682 qpair failed and we were unable to recover it. 00:31:00.682 [2024-11-28 23:23:03.976229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.976317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.976341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.682 qpair failed and we were unable to recover it. 00:31:00.682 [2024-11-28 23:23:03.976458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.976548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.976575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.682 qpair failed and we were unable to recover it. 00:31:00.682 [2024-11-28 23:23:03.976659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.976784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.976810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.682 qpair failed and we were unable to recover it. 00:31:00.682 [2024-11-28 23:23:03.976898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.976979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.977004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.682 qpair failed and we were unable to recover it. 00:31:00.682 [2024-11-28 23:23:03.977086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.977198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.977223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.682 qpair failed and we were unable to recover it. 00:31:00.682 [2024-11-28 23:23:03.977304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.977401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.977427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.682 qpair failed and we were unable to recover it. 00:31:00.682 [2024-11-28 23:23:03.977521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.977640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.977665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.682 qpair failed and we were unable to recover it. 00:31:00.682 [2024-11-28 23:23:03.977782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.977927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.977953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.682 qpair failed and we were unable to recover it. 00:31:00.682 [2024-11-28 23:23:03.978044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.978130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.978156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.682 qpair failed and we were unable to recover it. 00:31:00.682 [2024-11-28 23:23:03.978246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.978337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.978361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.682 qpair failed and we were unable to recover it. 00:31:00.682 [2024-11-28 23:23:03.978454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.978554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.978580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.682 qpair failed and we were unable to recover it. 00:31:00.682 [2024-11-28 23:23:03.978694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.978781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.978806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.682 qpair failed and we were unable to recover it. 00:31:00.682 [2024-11-28 23:23:03.978928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.979016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.979042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.682 qpair failed and we were unable to recover it. 00:31:00.682 [2024-11-28 23:23:03.979128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.979224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.979250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.682 qpair failed and we were unable to recover it. 00:31:00.682 [2024-11-28 23:23:03.979343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.979452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.979477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.682 qpair failed and we were unable to recover it. 00:31:00.682 [2024-11-28 23:23:03.979587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.979677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.979702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.682 qpair failed and we were unable to recover it. 00:31:00.682 [2024-11-28 23:23:03.979790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.682 [2024-11-28 23:23:03.979875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.979900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.683 qpair failed and we were unable to recover it. 00:31:00.683 [2024-11-28 23:23:03.980029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.980137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.980162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.683 qpair failed and we were unable to recover it. 00:31:00.683 [2024-11-28 23:23:03.980275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.980391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.980423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.683 qpair failed and we were unable to recover it. 00:31:00.683 [2024-11-28 23:23:03.980543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.980651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.980676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.683 qpair failed and we were unable to recover it. 00:31:00.683 [2024-11-28 23:23:03.980777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.980890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.980914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.683 qpair failed and we were unable to recover it. 00:31:00.683 [2024-11-28 23:23:03.981033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.981118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.981142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.683 qpair failed and we were unable to recover it. 00:31:00.683 [2024-11-28 23:23:03.981256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.981369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.981412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.683 qpair failed and we were unable to recover it. 00:31:00.683 [2024-11-28 23:23:03.981509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.981596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.981620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.683 qpair failed and we were unable to recover it. 00:31:00.683 [2024-11-28 23:23:03.981726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.981817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.981841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.683 qpair failed and we were unable to recover it. 00:31:00.683 [2024-11-28 23:23:03.981949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.982060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.982092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.683 qpair failed and we were unable to recover it. 00:31:00.683 [2024-11-28 23:23:03.982185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.982294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.982324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.683 qpair failed and we were unable to recover it. 00:31:00.683 [2024-11-28 23:23:03.982421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.982517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.982542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.683 qpair failed and we were unable to recover it. 00:31:00.683 [2024-11-28 23:23:03.982627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.982747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.982772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.683 qpair failed and we were unable to recover it. 00:31:00.683 [2024-11-28 23:23:03.982858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.982944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.982969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.683 qpair failed and we were unable to recover it. 00:31:00.683 [2024-11-28 23:23:03.983087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.983181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.983206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.683 qpair failed and we were unable to recover it. 00:31:00.683 [2024-11-28 23:23:03.983319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.983406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.983431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.683 qpair failed and we were unable to recover it. 00:31:00.683 [2024-11-28 23:23:03.983520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.983633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.983657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.683 qpair failed and we were unable to recover it. 00:31:00.683 [2024-11-28 23:23:03.983771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.983859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.983883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.683 qpair failed and we were unable to recover it. 00:31:00.683 [2024-11-28 23:23:03.983969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.984058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.984084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.683 qpair failed and we were unable to recover it. 00:31:00.683 [2024-11-28 23:23:03.984167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.984252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.984278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.683 qpair failed and we were unable to recover it. 00:31:00.683 [2024-11-28 23:23:03.984403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.984512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.984537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.683 qpair failed and we were unable to recover it. 00:31:00.683 [2024-11-28 23:23:03.984624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.984706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.984731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.683 qpair failed and we were unable to recover it. 00:31:00.683 [2024-11-28 23:23:03.984822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.984902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.984927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.683 qpair failed and we were unable to recover it. 00:31:00.683 [2024-11-28 23:23:03.985038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.985130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.985155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.683 qpair failed and we were unable to recover it. 00:31:00.683 [2024-11-28 23:23:03.985234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.985344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.985369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.683 qpair failed and we were unable to recover it. 00:31:00.683 [2024-11-28 23:23:03.985463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.985547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.985573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.683 qpair failed and we were unable to recover it. 00:31:00.683 [2024-11-28 23:23:03.985669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.985751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.985776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.683 qpair failed and we were unable to recover it. 00:31:00.683 [2024-11-28 23:23:03.985894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.985978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.683 [2024-11-28 23:23:03.986003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.684 qpair failed and we were unable to recover it. 00:31:00.684 [2024-11-28 23:23:03.986089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.986184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.986208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.684 qpair failed and we were unable to recover it. 00:31:00.684 [2024-11-28 23:23:03.986308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.986382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.986419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.684 qpair failed and we were unable to recover it. 00:31:00.684 [2024-11-28 23:23:03.986534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.986617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.986643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.684 qpair failed and we were unable to recover it. 00:31:00.684 [2024-11-28 23:23:03.986739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.986822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.986847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.684 qpair failed and we were unable to recover it. 00:31:00.684 [2024-11-28 23:23:03.986966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.987082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.987107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.684 qpair failed and we were unable to recover it. 00:31:00.684 [2024-11-28 23:23:03.987202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.987287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.987311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.684 qpair failed and we were unable to recover it. 00:31:00.684 [2024-11-28 23:23:03.987426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.987520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.987545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.684 qpair failed and we were unable to recover it. 00:31:00.684 [2024-11-28 23:23:03.987640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.987762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.987787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.684 qpair failed and we were unable to recover it. 00:31:00.684 [2024-11-28 23:23:03.987880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.988002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.988027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.684 qpair failed and we were unable to recover it. 00:31:00.684 [2024-11-28 23:23:03.988112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.988229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.988254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.684 qpair failed and we were unable to recover it. 00:31:00.684 [2024-11-28 23:23:03.988343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.988442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.988467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.684 qpair failed and we were unable to recover it. 00:31:00.684 [2024-11-28 23:23:03.988551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.988633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.988658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.684 qpair failed and we were unable to recover it. 00:31:00.684 [2024-11-28 23:23:03.988745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.988832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.988857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.684 qpair failed and we were unable to recover it. 00:31:00.684 [2024-11-28 23:23:03.988945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.989071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.989097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.684 qpair failed and we were unable to recover it. 00:31:00.684 [2024-11-28 23:23:03.989220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.989311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.989335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.684 qpair failed and we were unable to recover it. 00:31:00.684 [2024-11-28 23:23:03.989481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.989569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.989594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.684 qpair failed and we were unable to recover it. 00:31:00.684 [2024-11-28 23:23:03.989681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.989758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.989783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.684 qpair failed and we were unable to recover it. 00:31:00.684 [2024-11-28 23:23:03.989867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.989974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.989999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.684 qpair failed and we were unable to recover it. 00:31:00.684 [2024-11-28 23:23:03.990090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.990175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.990200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.684 qpair failed and we were unable to recover it. 00:31:00.684 [2024-11-28 23:23:03.990286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.990401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.990427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.684 qpair failed and we were unable to recover it. 00:31:00.684 [2024-11-28 23:23:03.990512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.990602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.990627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.684 qpair failed and we were unable to recover it. 00:31:00.684 [2024-11-28 23:23:03.990747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.990831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.990857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.684 qpair failed and we were unable to recover it. 00:31:00.684 [2024-11-28 23:23:03.990957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.991054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.991080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.684 qpair failed and we were unable to recover it. 00:31:00.684 [2024-11-28 23:23:03.991168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.991256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.991285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.684 qpair failed and we were unable to recover it. 00:31:00.684 [2024-11-28 23:23:03.991377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.991478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.991503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.684 qpair failed and we were unable to recover it. 00:31:00.684 [2024-11-28 23:23:03.991588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.991677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.991702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.684 qpair failed and we were unable to recover it. 00:31:00.684 [2024-11-28 23:23:03.991791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.991871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.684 [2024-11-28 23:23:03.991896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.684 qpair failed and we were unable to recover it. 00:31:00.684 [2024-11-28 23:23:03.991985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.992120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.992145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.685 qpair failed and we were unable to recover it. 00:31:00.685 [2024-11-28 23:23:03.992268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.992362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.992403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.685 qpair failed and we were unable to recover it. 00:31:00.685 [2024-11-28 23:23:03.992502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.992584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.992608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.685 qpair failed and we were unable to recover it. 00:31:00.685 [2024-11-28 23:23:03.992703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.992820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.992854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.685 qpair failed and we were unable to recover it. 00:31:00.685 [2024-11-28 23:23:03.992942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.993030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.993062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.685 qpair failed and we were unable to recover it. 00:31:00.685 [2024-11-28 23:23:03.993164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.993295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.993319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.685 qpair failed and we were unable to recover it. 00:31:00.685 [2024-11-28 23:23:03.993408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.993495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.993520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.685 qpair failed and we were unable to recover it. 00:31:00.685 [2024-11-28 23:23:03.993617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.993704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.993729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.685 qpair failed and we were unable to recover it. 00:31:00.685 [2024-11-28 23:23:03.993816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.993926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.993951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.685 qpair failed and we were unable to recover it. 00:31:00.685 [2024-11-28 23:23:03.994040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.994128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.994153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.685 qpair failed and we were unable to recover it. 00:31:00.685 [2024-11-28 23:23:03.994263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.994345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.994371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.685 qpair failed and we were unable to recover it. 00:31:00.685 [2024-11-28 23:23:03.994462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.994545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.994570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.685 qpair failed and we were unable to recover it. 00:31:00.685 [2024-11-28 23:23:03.994653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.994751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.994782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.685 qpair failed and we were unable to recover it. 00:31:00.685 [2024-11-28 23:23:03.994871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.994958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.994983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.685 qpair failed and we were unable to recover it. 00:31:00.685 [2024-11-28 23:23:03.995068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.995175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.995202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.685 qpair failed and we were unable to recover it. 00:31:00.685 [2024-11-28 23:23:03.995291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.995377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.995435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.685 qpair failed and we were unable to recover it. 00:31:00.685 [2024-11-28 23:23:03.995520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.995615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.995640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.685 qpair failed and we were unable to recover it. 00:31:00.685 [2024-11-28 23:23:03.995745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.995830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.995856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.685 qpair failed and we were unable to recover it. 00:31:00.685 [2024-11-28 23:23:03.995933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.996051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.996076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.685 qpair failed and we were unable to recover it. 00:31:00.685 [2024-11-28 23:23:03.996157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.996243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.996268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.685 qpair failed and we were unable to recover it. 00:31:00.685 [2024-11-28 23:23:03.996353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.996444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.996469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.685 qpair failed and we were unable to recover it. 00:31:00.685 [2024-11-28 23:23:03.996554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.996640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.996665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.685 qpair failed and we were unable to recover it. 00:31:00.685 [2024-11-28 23:23:03.996747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.996829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.996854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.685 qpair failed and we were unable to recover it. 00:31:00.685 [2024-11-28 23:23:03.996935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.997024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.997049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.685 qpair failed and we were unable to recover it. 00:31:00.685 [2024-11-28 23:23:03.997141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.997225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.997249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.685 qpair failed and we were unable to recover it. 00:31:00.685 [2024-11-28 23:23:03.997332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.997421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.997446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.685 qpair failed and we were unable to recover it. 00:31:00.685 [2024-11-28 23:23:03.997528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.997641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.997665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.685 qpair failed and we were unable to recover it. 00:31:00.685 [2024-11-28 23:23:03.997774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.997878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.997908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.685 qpair failed and we were unable to recover it. 00:31:00.685 [2024-11-28 23:23:03.998004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.998096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.685 [2024-11-28 23:23:03.998123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.685 qpair failed and we were unable to recover it. 00:31:00.685 [2024-11-28 23:23:03.998238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:03.998324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:03.998350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.686 qpair failed and we were unable to recover it. 00:31:00.686 [2024-11-28 23:23:03.998449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:03.998540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:03.998567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.686 qpair failed and we were unable to recover it. 00:31:00.686 [2024-11-28 23:23:03.998651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:03.998745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:03.998770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.686 qpair failed and we were unable to recover it. 00:31:00.686 [2024-11-28 23:23:03.998873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:03.998960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:03.998986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.686 qpair failed and we were unable to recover it. 00:31:00.686 [2024-11-28 23:23:03.999071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:03.999163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:03.999190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.686 qpair failed and we were unable to recover it. 00:31:00.686 [2024-11-28 23:23:03.999288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:03.999402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:03.999429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.686 qpair failed and we were unable to recover it. 00:31:00.686 [2024-11-28 23:23:03.999564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:03.999657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:03.999685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.686 qpair failed and we were unable to recover it. 00:31:00.686 [2024-11-28 23:23:03.999817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:03.999904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:03.999930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.686 qpair failed and we were unable to recover it. 00:31:00.686 [2024-11-28 23:23:04.000058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:04.000156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:04.000186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.686 qpair failed and we were unable to recover it. 00:31:00.686 [2024-11-28 23:23:04.000301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:04.000382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:04.000416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.686 qpair failed and we were unable to recover it. 00:31:00.686 [2024-11-28 23:23:04.000521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:04.000608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:04.000633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.686 qpair failed and we were unable to recover it. 00:31:00.686 [2024-11-28 23:23:04.000772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:04.000866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:04.000891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.686 qpair failed and we were unable to recover it. 00:31:00.686 [2024-11-28 23:23:04.001001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:04.001087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:04.001112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.686 qpair failed and we were unable to recover it. 00:31:00.686 [2024-11-28 23:23:04.001232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:04.001361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:04.001386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.686 qpair failed and we were unable to recover it. 00:31:00.686 [2024-11-28 23:23:04.001484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:04.001565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:04.001591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.686 qpair failed and we were unable to recover it. 00:31:00.686 [2024-11-28 23:23:04.001675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:04.001775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:04.001802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.686 qpair failed and we were unable to recover it. 00:31:00.686 [2024-11-28 23:23:04.001893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:04.002036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:04.002061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.686 qpair failed and we were unable to recover it. 00:31:00.686 [2024-11-28 23:23:04.002178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:04.002259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:04.002285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.686 qpair failed and we were unable to recover it. 00:31:00.686 [2024-11-28 23:23:04.002367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:04.002470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:04.002497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.686 qpair failed and we were unable to recover it. 00:31:00.686 [2024-11-28 23:23:04.002586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:04.002714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:04.002741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.686 qpair failed and we were unable to recover it. 00:31:00.686 [2024-11-28 23:23:04.002889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:04.003009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:04.003035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.686 qpair failed and we were unable to recover it. 00:31:00.686 [2024-11-28 23:23:04.003125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:04.003208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:04.003233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.686 qpair failed and we were unable to recover it. 00:31:00.686 [2024-11-28 23:23:04.003347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:04.003490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:04.003516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.686 qpair failed and we were unable to recover it. 00:31:00.686 [2024-11-28 23:23:04.003595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:04.003686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:04.003712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.686 qpair failed and we were unable to recover it. 00:31:00.686 [2024-11-28 23:23:04.003798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:04.003882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:04.003907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.686 qpair failed and we were unable to recover it. 00:31:00.686 [2024-11-28 23:23:04.004003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:04.004126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:04.004153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.686 qpair failed and we were unable to recover it. 00:31:00.686 [2024-11-28 23:23:04.004271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:04.004356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:04.004382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.686 qpair failed and we were unable to recover it. 00:31:00.686 [2024-11-28 23:23:04.004494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:04.004607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:04.004633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.686 qpair failed and we were unable to recover it. 00:31:00.686 [2024-11-28 23:23:04.004751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:04.004915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.686 [2024-11-28 23:23:04.004949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.686 qpair failed and we were unable to recover it. 00:31:00.686 [2024-11-28 23:23:04.005065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.005150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.005176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.687 qpair failed and we were unable to recover it. 00:31:00.687 [2024-11-28 23:23:04.005256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.005368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.005401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.687 qpair failed and we were unable to recover it. 00:31:00.687 [2024-11-28 23:23:04.005518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.005601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.005627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.687 qpair failed and we were unable to recover it. 00:31:00.687 [2024-11-28 23:23:04.005717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.005832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.005858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.687 qpair failed and we were unable to recover it. 00:31:00.687 [2024-11-28 23:23:04.005975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.006059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.006084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.687 qpair failed and we were unable to recover it. 00:31:00.687 [2024-11-28 23:23:04.006203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.006318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.006343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.687 qpair failed and we were unable to recover it. 00:31:00.687 [2024-11-28 23:23:04.006479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.006567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.006594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.687 qpair failed and we were unable to recover it. 00:31:00.687 [2024-11-28 23:23:04.006677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.006789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.006816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.687 qpair failed and we were unable to recover it. 00:31:00.687 [2024-11-28 23:23:04.006903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.007028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.007053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.687 qpair failed and we were unable to recover it. 00:31:00.687 [2024-11-28 23:23:04.007207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.007302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.007328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.687 qpair failed and we were unable to recover it. 00:31:00.687 [2024-11-28 23:23:04.007434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.007530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.007556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.687 qpair failed and we were unable to recover it. 00:31:00.687 [2024-11-28 23:23:04.007642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.007764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.007789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.687 qpair failed and we were unable to recover it. 00:31:00.687 [2024-11-28 23:23:04.007884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.007975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.008001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.687 qpair failed and we were unable to recover it. 00:31:00.687 [2024-11-28 23:23:04.008086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.008167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.008193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.687 qpair failed and we were unable to recover it. 00:31:00.687 [2024-11-28 23:23:04.008306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.008450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.008477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.687 qpair failed and we were unable to recover it. 00:31:00.687 [2024-11-28 23:23:04.008559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.008638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.008664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.687 qpair failed and we were unable to recover it. 00:31:00.687 [2024-11-28 23:23:04.008755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.008901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.008927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.687 qpair failed and we were unable to recover it. 00:31:00.687 [2024-11-28 23:23:04.009009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.009146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.009172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.687 qpair failed and we were unable to recover it. 00:31:00.687 [2024-11-28 23:23:04.009286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.009377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.009423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.687 qpair failed and we were unable to recover it. 00:31:00.687 [2024-11-28 23:23:04.009513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.009631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.009661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.687 qpair failed and we were unable to recover it. 00:31:00.687 [2024-11-28 23:23:04.009748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.009831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.009861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.687 qpair failed and we were unable to recover it. 00:31:00.687 [2024-11-28 23:23:04.010006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.010095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.010123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.687 qpair failed and we were unable to recover it. 00:31:00.687 [2024-11-28 23:23:04.010203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.010340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.010366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.687 qpair failed and we were unable to recover it. 00:31:00.687 [2024-11-28 23:23:04.010465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.010549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.010575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.687 qpair failed and we were unable to recover it. 00:31:00.687 [2024-11-28 23:23:04.010687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.010769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.010796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.687 qpair failed and we were unable to recover it. 00:31:00.687 [2024-11-28 23:23:04.010884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.011002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.011028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.687 qpair failed and we were unable to recover it. 00:31:00.687 [2024-11-28 23:23:04.011122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.011218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.011244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.687 qpair failed and we were unable to recover it. 00:31:00.687 [2024-11-28 23:23:04.011324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.011421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.011448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.687 qpair failed and we were unable to recover it. 00:31:00.687 [2024-11-28 23:23:04.011542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.011629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.687 [2024-11-28 23:23:04.011656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.687 qpair failed and we were unable to recover it. 00:31:00.687 [2024-11-28 23:23:04.011743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.011830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.011863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.688 qpair failed and we were unable to recover it. 00:31:00.688 [2024-11-28 23:23:04.011954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.012042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.012069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.688 qpair failed and we were unable to recover it. 00:31:00.688 [2024-11-28 23:23:04.012190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.012306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.012333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.688 qpair failed and we were unable to recover it. 00:31:00.688 [2024-11-28 23:23:04.012453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.012537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.012564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.688 qpair failed and we were unable to recover it. 00:31:00.688 [2024-11-28 23:23:04.012651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.012738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.012764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.688 qpair failed and we were unable to recover it. 00:31:00.688 [2024-11-28 23:23:04.012866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.012979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.013005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.688 qpair failed and we were unable to recover it. 00:31:00.688 [2024-11-28 23:23:04.013094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.013207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.013233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.688 qpair failed and we were unable to recover it. 00:31:00.688 [2024-11-28 23:23:04.013363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.013463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.013489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.688 qpair failed and we were unable to recover it. 00:31:00.688 [2024-11-28 23:23:04.013579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.013663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.013689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.688 qpair failed and we were unable to recover it. 00:31:00.688 [2024-11-28 23:23:04.013808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.013948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.013975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.688 qpair failed and we were unable to recover it. 00:31:00.688 [2024-11-28 23:23:04.014068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.014155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.014187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.688 qpair failed and we were unable to recover it. 00:31:00.688 [2024-11-28 23:23:04.014290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.014399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.014427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.688 qpair failed and we were unable to recover it. 00:31:00.688 [2024-11-28 23:23:04.014516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.014656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.014682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.688 qpair failed and we were unable to recover it. 00:31:00.688 [2024-11-28 23:23:04.014772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.014889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.014916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.688 qpair failed and we were unable to recover it. 00:31:00.688 [2024-11-28 23:23:04.015001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.015089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.015116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.688 qpair failed and we were unable to recover it. 00:31:00.688 [2024-11-28 23:23:04.015228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.015326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.015352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.688 qpair failed and we were unable to recover it. 00:31:00.688 [2024-11-28 23:23:04.015455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.015579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.015605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.688 qpair failed and we were unable to recover it. 00:31:00.688 [2024-11-28 23:23:04.015698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.015798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.015824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.688 qpair failed and we were unable to recover it. 00:31:00.688 [2024-11-28 23:23:04.015965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.016059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.016085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.688 qpair failed and we were unable to recover it. 00:31:00.688 [2024-11-28 23:23:04.016210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.016288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.016314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.688 qpair failed and we were unable to recover it. 00:31:00.688 [2024-11-28 23:23:04.016421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.016504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.016534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.688 qpair failed and we were unable to recover it. 00:31:00.688 [2024-11-28 23:23:04.016620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.016740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.016766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.688 qpair failed and we were unable to recover it. 00:31:00.688 [2024-11-28 23:23:04.016882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.016967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.016992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.688 qpair failed and we were unable to recover it. 00:31:00.688 [2024-11-28 23:23:04.017106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.017196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.017223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.688 qpair failed and we were unable to recover it. 00:31:00.688 [2024-11-28 23:23:04.017323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.017415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.017442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.688 qpair failed and we were unable to recover it. 00:31:00.688 [2024-11-28 23:23:04.017542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.017656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.688 [2024-11-28 23:23:04.017682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.689 qpair failed and we were unable to recover it. 00:31:00.689 [2024-11-28 23:23:04.017784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.017875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.017902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.689 qpair failed and we were unable to recover it. 00:31:00.689 [2024-11-28 23:23:04.017987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.018103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.018128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.689 qpair failed and we were unable to recover it. 00:31:00.689 [2024-11-28 23:23:04.018208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.018349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.018375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.689 qpair failed and we were unable to recover it. 00:31:00.689 [2024-11-28 23:23:04.018502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.018580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.018606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.689 qpair failed and we were unable to recover it. 00:31:00.689 [2024-11-28 23:23:04.018688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.018810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.018835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.689 qpair failed and we were unable to recover it. 00:31:00.689 [2024-11-28 23:23:04.018921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.019032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.019058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.689 qpair failed and we were unable to recover it. 00:31:00.689 [2024-11-28 23:23:04.019154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.019249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.019279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.689 qpair failed and we were unable to recover it. 00:31:00.689 [2024-11-28 23:23:04.019401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.019513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.019538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.689 qpair failed and we were unable to recover it. 00:31:00.689 [2024-11-28 23:23:04.019624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.019718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.019745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.689 qpair failed and we were unable to recover it. 00:31:00.689 [2024-11-28 23:23:04.019858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.019949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.019975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.689 qpair failed and we were unable to recover it. 00:31:00.689 [2024-11-28 23:23:04.020093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.020200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.020226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.689 qpair failed and we were unable to recover it. 00:31:00.689 [2024-11-28 23:23:04.020340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.020426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.020453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.689 qpair failed and we were unable to recover it. 00:31:00.689 [2024-11-28 23:23:04.020543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.020626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.020652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.689 qpair failed and we were unable to recover it. 00:31:00.689 [2024-11-28 23:23:04.020740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.020888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.020913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.689 qpair failed and we were unable to recover it. 00:31:00.689 [2024-11-28 23:23:04.021000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.021086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.021113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.689 qpair failed and we were unable to recover it. 00:31:00.689 [2024-11-28 23:23:04.021196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.021279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.021305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.689 qpair failed and we were unable to recover it. 00:31:00.689 [2024-11-28 23:23:04.021424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.021513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.021541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.689 qpair failed and we were unable to recover it. 00:31:00.689 [2024-11-28 23:23:04.021633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.021746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.021772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.689 qpair failed and we were unable to recover it. 00:31:00.689 [2024-11-28 23:23:04.021853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.021966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.021992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.689 qpair failed and we were unable to recover it. 00:31:00.689 [2024-11-28 23:23:04.022078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.022154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.022180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.689 qpair failed and we were unable to recover it. 00:31:00.689 [2024-11-28 23:23:04.022305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.022425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.022452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.689 qpair failed and we were unable to recover it. 00:31:00.689 [2024-11-28 23:23:04.022573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.022654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.022680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.689 qpair failed and we were unable to recover it. 00:31:00.689 [2024-11-28 23:23:04.022794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.022877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.022902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.689 qpair failed and we were unable to recover it. 00:31:00.689 [2024-11-28 23:23:04.023026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.023113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.023138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.689 qpair failed and we were unable to recover it. 00:31:00.689 [2024-11-28 23:23:04.023247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.023331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.023357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.689 qpair failed and we were unable to recover it. 00:31:00.689 [2024-11-28 23:23:04.023459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.023546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.023573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.689 qpair failed and we were unable to recover it. 00:31:00.689 [2024-11-28 23:23:04.023691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.023773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.023799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.689 qpair failed and we were unable to recover it. 00:31:00.689 [2024-11-28 23:23:04.023886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.024006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.024032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.689 qpair failed and we were unable to recover it. 00:31:00.689 [2024-11-28 23:23:04.024144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.689 [2024-11-28 23:23:04.024220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.024246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.690 qpair failed and we were unable to recover it. 00:31:00.690 [2024-11-28 23:23:04.024371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.024499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.024525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.690 qpair failed and we were unable to recover it. 00:31:00.690 [2024-11-28 23:23:04.024636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.024720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.024750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.690 qpair failed and we were unable to recover it. 00:31:00.690 [2024-11-28 23:23:04.024835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.024948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.024973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.690 qpair failed and we were unable to recover it. 00:31:00.690 [2024-11-28 23:23:04.025067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.025150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.025177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.690 qpair failed and we were unable to recover it. 00:31:00.690 [2024-11-28 23:23:04.025302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.025407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.025435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.690 qpair failed and we were unable to recover it. 00:31:00.690 [2024-11-28 23:23:04.025549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.025637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.025663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.690 qpair failed and we were unable to recover it. 00:31:00.690 [2024-11-28 23:23:04.025797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.025893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.025919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.690 qpair failed and we were unable to recover it. 00:31:00.690 [2024-11-28 23:23:04.026004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.026092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.026119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.690 qpair failed and we were unable to recover it. 00:31:00.690 [2024-11-28 23:23:04.026245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.026327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.026353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.690 qpair failed and we were unable to recover it. 00:31:00.690 [2024-11-28 23:23:04.026450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.026539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.026565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.690 qpair failed and we were unable to recover it. 00:31:00.690 [2024-11-28 23:23:04.026652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.026744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.026778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.690 qpair failed and we were unable to recover it. 00:31:00.690 [2024-11-28 23:23:04.026893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.026974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.027000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.690 qpair failed and we were unable to recover it. 00:31:00.690 [2024-11-28 23:23:04.027119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.027212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.027237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.690 qpair failed and we were unable to recover it. 00:31:00.690 [2024-11-28 23:23:04.027328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.027497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.027524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.690 qpair failed and we were unable to recover it. 00:31:00.690 [2024-11-28 23:23:04.027614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.027707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.027732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.690 qpair failed and we were unable to recover it. 00:31:00.690 [2024-11-28 23:23:04.027853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.027951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.027979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.690 qpair failed and we were unable to recover it. 00:31:00.690 [2024-11-28 23:23:04.028072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.028153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.028179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.690 qpair failed and we were unable to recover it. 00:31:00.690 [2024-11-28 23:23:04.028308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.028421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.028447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.690 qpair failed and we were unable to recover it. 00:31:00.690 [2024-11-28 23:23:04.028541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.028631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.028659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.690 qpair failed and we were unable to recover it. 00:31:00.690 [2024-11-28 23:23:04.028754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.028846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.028872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.690 qpair failed and we were unable to recover it. 00:31:00.690 [2024-11-28 23:23:04.028989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.029100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.029126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.690 qpair failed and we were unable to recover it. 00:31:00.690 [2024-11-28 23:23:04.029210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.029298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.029323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.690 qpair failed and we were unable to recover it. 00:31:00.690 [2024-11-28 23:23:04.029419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.029506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.029531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.690 qpair failed and we were unable to recover it. 00:31:00.690 [2024-11-28 23:23:04.029656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.029743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.029769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.690 qpair failed and we were unable to recover it. 00:31:00.690 [2024-11-28 23:23:04.029850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.029939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.029965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.690 qpair failed and we were unable to recover it. 00:31:00.690 [2024-11-28 23:23:04.030059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.030146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.030172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.690 qpair failed and we were unable to recover it. 00:31:00.690 [2024-11-28 23:23:04.030271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.030358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.030386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.690 qpair failed and we were unable to recover it. 00:31:00.690 [2024-11-28 23:23:04.030479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.030591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.030616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.690 qpair failed and we were unable to recover it. 00:31:00.690 [2024-11-28 23:23:04.030738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.690 [2024-11-28 23:23:04.030820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.030846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.691 qpair failed and we were unable to recover it. 00:31:00.691 [2024-11-28 23:23:04.030932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.031025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.031051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.691 qpair failed and we were unable to recover it. 00:31:00.691 [2024-11-28 23:23:04.031172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.031252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.031278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.691 qpair failed and we were unable to recover it. 00:31:00.691 [2024-11-28 23:23:04.031402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.031481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.031507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.691 qpair failed and we were unable to recover it. 00:31:00.691 [2024-11-28 23:23:04.031594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.031710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.031736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.691 qpair failed and we were unable to recover it. 00:31:00.691 [2024-11-28 23:23:04.031897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.032008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.032034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.691 qpair failed and we were unable to recover it. 00:31:00.691 [2024-11-28 23:23:04.032149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.032233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.032259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.691 qpair failed and we were unable to recover it. 00:31:00.691 [2024-11-28 23:23:04.032341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.032424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.032451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.691 qpair failed and we were unable to recover it. 00:31:00.691 [2024-11-28 23:23:04.032573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.032655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.032681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.691 qpair failed and we were unable to recover it. 00:31:00.691 [2024-11-28 23:23:04.032804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.032929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.032954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.691 qpair failed and we were unable to recover it. 00:31:00.691 [2024-11-28 23:23:04.033068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.033155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.033180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.691 qpair failed and we were unable to recover it. 00:31:00.691 [2024-11-28 23:23:04.033281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.033372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.033406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.691 qpair failed and we were unable to recover it. 00:31:00.691 [2024-11-28 23:23:04.033497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.033619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.033645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.691 qpair failed and we were unable to recover it. 00:31:00.691 [2024-11-28 23:23:04.033723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.033831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.033857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.691 qpair failed and we were unable to recover it. 00:31:00.691 [2024-11-28 23:23:04.033972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.034089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.034115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.691 qpair failed and we were unable to recover it. 00:31:00.691 [2024-11-28 23:23:04.034203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.034301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.034328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.691 qpair failed and we were unable to recover it. 00:31:00.691 [2024-11-28 23:23:04.034424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.034518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.034545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.691 qpair failed and we were unable to recover it. 00:31:00.691 [2024-11-28 23:23:04.034661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.034755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.034781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.691 qpair failed and we were unable to recover it. 00:31:00.691 [2024-11-28 23:23:04.034868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.034960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.034985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.691 qpair failed and we were unable to recover it. 00:31:00.691 [2024-11-28 23:23:04.035110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.035201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.035226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.691 qpair failed and we were unable to recover it. 00:31:00.691 [2024-11-28 23:23:04.035373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.035477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.035504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.691 qpair failed and we were unable to recover it. 00:31:00.691 [2024-11-28 23:23:04.035601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.035695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.035721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.691 qpair failed and we were unable to recover it. 00:31:00.691 [2024-11-28 23:23:04.035807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.035916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.035942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.691 qpair failed and we were unable to recover it. 00:31:00.691 [2024-11-28 23:23:04.036026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.036138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.036164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.691 qpair failed and we were unable to recover it. 00:31:00.691 [2024-11-28 23:23:04.036257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.036339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.036364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.691 qpair failed and we were unable to recover it. 00:31:00.691 [2024-11-28 23:23:04.036462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.036603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.036629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.691 qpair failed and we were unable to recover it. 00:31:00.691 [2024-11-28 23:23:04.036731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.036811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.036837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.691 qpair failed and we were unable to recover it. 00:31:00.691 [2024-11-28 23:23:04.036927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.037015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.037042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.691 qpair failed and we were unable to recover it. 00:31:00.691 [2024-11-28 23:23:04.037163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.037249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.037275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.691 qpair failed and we were unable to recover it. 00:31:00.691 [2024-11-28 23:23:04.037361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.691 [2024-11-28 23:23:04.037482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.037510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.692 qpair failed and we were unable to recover it. 00:31:00.692 [2024-11-28 23:23:04.037634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.037763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.037789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.692 qpair failed and we were unable to recover it. 00:31:00.692 [2024-11-28 23:23:04.037914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.037995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.038023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.692 qpair failed and we were unable to recover it. 00:31:00.692 [2024-11-28 23:23:04.038107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.038217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.038243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.692 qpair failed and we were unable to recover it. 00:31:00.692 [2024-11-28 23:23:04.038326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.038416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.038442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.692 qpair failed and we were unable to recover it. 00:31:00.692 [2024-11-28 23:23:04.038532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.038613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.038640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.692 qpair failed and we were unable to recover it. 00:31:00.692 [2024-11-28 23:23:04.038771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.038859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.038884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.692 qpair failed and we were unable to recover it. 00:31:00.692 [2024-11-28 23:23:04.038974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.039062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.039088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.692 qpair failed and we were unable to recover it. 00:31:00.692 [2024-11-28 23:23:04.039183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.039267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.039293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.692 qpair failed and we were unable to recover it. 00:31:00.692 [2024-11-28 23:23:04.039383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.039503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.039529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.692 qpair failed and we were unable to recover it. 00:31:00.692 [2024-11-28 23:23:04.039624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.039711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.039737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.692 qpair failed and we were unable to recover it. 00:31:00.692 [2024-11-28 23:23:04.039829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.039939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.039964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.692 qpair failed and we were unable to recover it. 00:31:00.692 [2024-11-28 23:23:04.040079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.040163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.040190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.692 qpair failed and we were unable to recover it. 00:31:00.692 [2024-11-28 23:23:04.040304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.040421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.040448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.692 qpair failed and we were unable to recover it. 00:31:00.692 [2024-11-28 23:23:04.040534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.040645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.040671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.692 qpair failed and we were unable to recover it. 00:31:00.692 [2024-11-28 23:23:04.040753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.040834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.040860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.692 qpair failed and we were unable to recover it. 00:31:00.692 [2024-11-28 23:23:04.040951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.041043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.041068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.692 qpair failed and we were unable to recover it. 00:31:00.692 [2024-11-28 23:23:04.041151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.041239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.041266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.692 qpair failed and we were unable to recover it. 00:31:00.692 [2024-11-28 23:23:04.041354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.041441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.041467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.692 qpair failed and we were unable to recover it. 00:31:00.692 [2024-11-28 23:23:04.041566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.041684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.041711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.692 qpair failed and we were unable to recover it. 00:31:00.692 [2024-11-28 23:23:04.041825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.041905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.041931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.692 qpair failed and we were unable to recover it. 00:31:00.692 [2024-11-28 23:23:04.042016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.042130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.042156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.692 qpair failed and we were unable to recover it. 00:31:00.692 [2024-11-28 23:23:04.042250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.042358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.042385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.692 qpair failed and we were unable to recover it. 00:31:00.692 [2024-11-28 23:23:04.042556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.042671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.042698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.692 qpair failed and we were unable to recover it. 00:31:00.692 [2024-11-28 23:23:04.042779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.042862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.042887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.692 qpair failed and we were unable to recover it. 00:31:00.692 [2024-11-28 23:23:04.042974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.043110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.043137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.692 qpair failed and we were unable to recover it. 00:31:00.692 [2024-11-28 23:23:04.043222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.043362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.043387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.692 qpair failed and we were unable to recover it. 00:31:00.692 [2024-11-28 23:23:04.043514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.043606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.043632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.692 qpair failed and we were unable to recover it. 00:31:00.692 [2024-11-28 23:23:04.043720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.043847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.692 [2024-11-28 23:23:04.043873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.693 qpair failed and we were unable to recover it. 00:31:00.693 [2024-11-28 23:23:04.043961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.044079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.044106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.693 qpair failed and we were unable to recover it. 00:31:00.693 [2024-11-28 23:23:04.044224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.044337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.044363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.693 qpair failed and we were unable to recover it. 00:31:00.693 [2024-11-28 23:23:04.044468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.044585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.044611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.693 qpair failed and we were unable to recover it. 00:31:00.693 [2024-11-28 23:23:04.044694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.044774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.044800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.693 qpair failed and we were unable to recover it. 00:31:00.693 [2024-11-28 23:23:04.044908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.044997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.045024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.693 qpair failed and we were unable to recover it. 00:31:00.693 [2024-11-28 23:23:04.045157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.045237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.045273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.693 qpair failed and we were unable to recover it. 00:31:00.693 [2024-11-28 23:23:04.045353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.045473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.045500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.693 qpair failed and we were unable to recover it. 00:31:00.693 [2024-11-28 23:23:04.045591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.045672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.045699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.693 qpair failed and we were unable to recover it. 00:31:00.693 [2024-11-28 23:23:04.045787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.045879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.045905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.693 qpair failed and we were unable to recover it. 00:31:00.693 [2024-11-28 23:23:04.045988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.046076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.046102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.693 qpair failed and we were unable to recover it. 00:31:00.693 [2024-11-28 23:23:04.046186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.046291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.046321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.693 qpair failed and we were unable to recover it. 00:31:00.693 [2024-11-28 23:23:04.046450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.046542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.046568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.693 qpair failed and we were unable to recover it. 00:31:00.693 [2024-11-28 23:23:04.046659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.046771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.046797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.693 qpair failed and we were unable to recover it. 00:31:00.693 [2024-11-28 23:23:04.046886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.047010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.047036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.693 qpair failed and we were unable to recover it. 00:31:00.693 [2024-11-28 23:23:04.047134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.047248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.047274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.693 qpair failed and we were unable to recover it. 00:31:00.693 [2024-11-28 23:23:04.047356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.047448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.047475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.693 qpair failed and we were unable to recover it. 00:31:00.693 [2024-11-28 23:23:04.047560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.047657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.047683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.693 qpair failed and we were unable to recover it. 00:31:00.693 [2024-11-28 23:23:04.047777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.047871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.047896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.693 qpair failed and we were unable to recover it. 00:31:00.693 [2024-11-28 23:23:04.047981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.048065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.048091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.693 qpair failed and we were unable to recover it. 00:31:00.693 [2024-11-28 23:23:04.048232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.048332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.048358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.693 qpair failed and we were unable to recover it. 00:31:00.693 [2024-11-28 23:23:04.048461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.048546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.048576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.693 qpair failed and we were unable to recover it. 00:31:00.693 [2024-11-28 23:23:04.048659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.048749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.048776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.693 qpair failed and we were unable to recover it. 00:31:00.693 [2024-11-28 23:23:04.048861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.048973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.048999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.693 qpair failed and we were unable to recover it. 00:31:00.693 [2024-11-28 23:23:04.049077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.049195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.049222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.693 qpair failed and we were unable to recover it. 00:31:00.693 [2024-11-28 23:23:04.049307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.049390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.693 [2024-11-28 23:23:04.049422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.694 qpair failed and we were unable to recover it. 00:31:00.694 [2024-11-28 23:23:04.049526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.049614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.049640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.694 qpair failed and we were unable to recover it. 00:31:00.694 [2024-11-28 23:23:04.049754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.049863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.049889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.694 qpair failed and we were unable to recover it. 00:31:00.694 [2024-11-28 23:23:04.050003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.050092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.050118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.694 qpair failed and we were unable to recover it. 00:31:00.694 [2024-11-28 23:23:04.050237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.050321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.050346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.694 qpair failed and we were unable to recover it. 00:31:00.694 [2024-11-28 23:23:04.050453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.050531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.050557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.694 qpair failed and we were unable to recover it. 00:31:00.694 [2024-11-28 23:23:04.050669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.050782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.050812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.694 qpair failed and we were unable to recover it. 00:31:00.694 [2024-11-28 23:23:04.050902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.051002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.051028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.694 qpair failed and we were unable to recover it. 00:31:00.694 [2024-11-28 23:23:04.051114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.051197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.051223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.694 qpair failed and we were unable to recover it. 00:31:00.694 [2024-11-28 23:23:04.051304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.051454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.051481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.694 qpair failed and we were unable to recover it. 00:31:00.694 [2024-11-28 23:23:04.051596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.051692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.051718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.694 qpair failed and we were unable to recover it. 00:31:00.694 [2024-11-28 23:23:04.051811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.051896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.051921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.694 qpair failed and we were unable to recover it. 00:31:00.694 [2024-11-28 23:23:04.052001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.052089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.052114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.694 qpair failed and we were unable to recover it. 00:31:00.694 [2024-11-28 23:23:04.052203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.052312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.052338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.694 qpair failed and we were unable to recover it. 00:31:00.694 [2024-11-28 23:23:04.052442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.052554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.052581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.694 qpair failed and we were unable to recover it. 00:31:00.694 [2024-11-28 23:23:04.052704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.052795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.052820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.694 qpair failed and we were unable to recover it. 00:31:00.694 [2024-11-28 23:23:04.052899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.052987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.053019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.694 qpair failed and we were unable to recover it. 00:31:00.694 [2024-11-28 23:23:04.053140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.053251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.053277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.694 qpair failed and we were unable to recover it. 00:31:00.694 [2024-11-28 23:23:04.053377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.053479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.053505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.694 qpair failed and we were unable to recover it. 00:31:00.694 [2024-11-28 23:23:04.053590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.053673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.053699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.694 qpair failed and we were unable to recover it. 00:31:00.694 [2024-11-28 23:23:04.053786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.053904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.053930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.694 qpair failed and we were unable to recover it. 00:31:00.694 [2024-11-28 23:23:04.054014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.054129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.054155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.694 qpair failed and we were unable to recover it. 00:31:00.694 [2024-11-28 23:23:04.054246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.054324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.054350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.694 qpair failed and we were unable to recover it. 00:31:00.694 [2024-11-28 23:23:04.054457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.054574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.054602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.694 qpair failed and we were unable to recover it. 00:31:00.694 [2024-11-28 23:23:04.054722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.054849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.054877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.694 qpair failed and we were unable to recover it. 00:31:00.694 [2024-11-28 23:23:04.054965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.055061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.055089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.694 qpair failed and we were unable to recover it. 00:31:00.694 [2024-11-28 23:23:04.055204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.055318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.055344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.694 qpair failed and we were unable to recover it. 00:31:00.694 [2024-11-28 23:23:04.055439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.055554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.055582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.694 qpair failed and we were unable to recover it. 00:31:00.694 [2024-11-28 23:23:04.055666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.055780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.055806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.694 qpair failed and we were unable to recover it. 00:31:00.694 [2024-11-28 23:23:04.055902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.055994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.694 [2024-11-28 23:23:04.056020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.695 qpair failed and we were unable to recover it. 00:31:00.695 [2024-11-28 23:23:04.056115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.056230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.056257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.695 qpair failed and we were unable to recover it. 00:31:00.695 [2024-11-28 23:23:04.056345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.056431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.056458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.695 qpair failed and we were unable to recover it. 00:31:00.695 [2024-11-28 23:23:04.056574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.056699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.056725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.695 qpair failed and we were unable to recover it. 00:31:00.695 [2024-11-28 23:23:04.056826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.056948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.056974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.695 qpair failed and we were unable to recover it. 00:31:00.695 [2024-11-28 23:23:04.057061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.057150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.057178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.695 qpair failed and we were unable to recover it. 00:31:00.695 [2024-11-28 23:23:04.057295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.057441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.057468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.695 qpair failed and we were unable to recover it. 00:31:00.695 [2024-11-28 23:23:04.057551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.057663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.057690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.695 qpair failed and we were unable to recover it. 00:31:00.695 [2024-11-28 23:23:04.057822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.057909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.057937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.695 qpair failed and we were unable to recover it. 00:31:00.695 [2024-11-28 23:23:04.058037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.058119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.058145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.695 qpair failed and we were unable to recover it. 00:31:00.695 [2024-11-28 23:23:04.058230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.058313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.058339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.695 qpair failed and we were unable to recover it. 00:31:00.695 [2024-11-28 23:23:04.058429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.058575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.058601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.695 qpair failed and we were unable to recover it. 00:31:00.695 [2024-11-28 23:23:04.058699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.058818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.058844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.695 qpair failed and we were unable to recover it. 00:31:00.695 [2024-11-28 23:23:04.058931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.059046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.059072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.695 qpair failed and we were unable to recover it. 00:31:00.695 [2024-11-28 23:23:04.059203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.059316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.059342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.695 qpair failed and we were unable to recover it. 00:31:00.695 [2024-11-28 23:23:04.059431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.059513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.059539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.695 qpair failed and we were unable to recover it. 00:31:00.695 [2024-11-28 23:23:04.059622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.059704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.059730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.695 qpair failed and we were unable to recover it. 00:31:00.695 [2024-11-28 23:23:04.059851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.059951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.059978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.695 qpair failed and we were unable to recover it. 00:31:00.695 [2024-11-28 23:23:04.060075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.060187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.060213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.695 qpair failed and we were unable to recover it. 00:31:00.695 [2024-11-28 23:23:04.060329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.060440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.060467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.695 qpair failed and we were unable to recover it. 00:31:00.695 [2024-11-28 23:23:04.060609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.060700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.060727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.695 qpair failed and we were unable to recover it. 00:31:00.695 [2024-11-28 23:23:04.060827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.060915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.060942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.695 qpair failed and we were unable to recover it. 00:31:00.695 [2024-11-28 23:23:04.061069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.061207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.061242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.695 qpair failed and we were unable to recover it. 00:31:00.695 [2024-11-28 23:23:04.061362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.061510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.061537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.695 qpair failed and we were unable to recover it. 00:31:00.695 [2024-11-28 23:23:04.061635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.061736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.061766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.695 qpair failed and we were unable to recover it. 00:31:00.695 [2024-11-28 23:23:04.061854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.061974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.062001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.695 qpair failed and we were unable to recover it. 00:31:00.695 [2024-11-28 23:23:04.062092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.062202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.062228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.695 qpair failed and we were unable to recover it. 00:31:00.695 [2024-11-28 23:23:04.062313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.062409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.062446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.695 qpair failed and we were unable to recover it. 00:31:00.695 [2024-11-28 23:23:04.062568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.062680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.062707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.695 qpair failed and we were unable to recover it. 00:31:00.695 [2024-11-28 23:23:04.062798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.695 [2024-11-28 23:23:04.062894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.062921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.696 qpair failed and we were unable to recover it. 00:31:00.696 [2024-11-28 23:23:04.063032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.063149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.063177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.696 qpair failed and we were unable to recover it. 00:31:00.696 [2024-11-28 23:23:04.063260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.063372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.063405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.696 qpair failed and we were unable to recover it. 00:31:00.696 [2024-11-28 23:23:04.063524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.063638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.063664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.696 qpair failed and we were unable to recover it. 00:31:00.696 [2024-11-28 23:23:04.063783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.063877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.063905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.696 qpair failed and we were unable to recover it. 00:31:00.696 [2024-11-28 23:23:04.064003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.064113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.064139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.696 qpair failed and we were unable to recover it. 00:31:00.696 [2024-11-28 23:23:04.064256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.064341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.064367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.696 qpair failed and we were unable to recover it. 00:31:00.696 [2024-11-28 23:23:04.064457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.064544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.064570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.696 qpair failed and we were unable to recover it. 00:31:00.696 [2024-11-28 23:23:04.064682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.064767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.064798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.696 qpair failed and we were unable to recover it. 00:31:00.696 [2024-11-28 23:23:04.064918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.064999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.065025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.696 qpair failed and we were unable to recover it. 00:31:00.696 [2024-11-28 23:23:04.065120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.065261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.065286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.696 qpair failed and we were unable to recover it. 00:31:00.696 [2024-11-28 23:23:04.065368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.065458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.065485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.696 qpair failed and we were unable to recover it. 00:31:00.696 [2024-11-28 23:23:04.065573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.065675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.065701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.696 qpair failed and we were unable to recover it. 00:31:00.696 [2024-11-28 23:23:04.065803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.065884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.065921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.696 qpair failed and we were unable to recover it. 00:31:00.696 [2024-11-28 23:23:04.066034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.066113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.066139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.696 qpair failed and we were unable to recover it. 00:31:00.696 [2024-11-28 23:23:04.066229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.066351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.066378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.696 qpair failed and we were unable to recover it. 00:31:00.696 [2024-11-28 23:23:04.066477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.066557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.066583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.696 qpair failed and we were unable to recover it. 00:31:00.696 [2024-11-28 23:23:04.066668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.066756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.066783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.696 qpair failed and we were unable to recover it. 00:31:00.696 [2024-11-28 23:23:04.066904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.066987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.067024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.696 qpair failed and we were unable to recover it. 00:31:00.696 [2024-11-28 23:23:04.067128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.067244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.067270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.696 qpair failed and we were unable to recover it. 00:31:00.696 [2024-11-28 23:23:04.067385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.067476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.067501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.696 qpair failed and we were unable to recover it. 00:31:00.696 [2024-11-28 23:23:04.067593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.067709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.067735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.696 qpair failed and we were unable to recover it. 00:31:00.696 [2024-11-28 23:23:04.067818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.067942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.067968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.696 qpair failed and we were unable to recover it. 00:31:00.696 [2024-11-28 23:23:04.068086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.068176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.068202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.696 qpair failed and we were unable to recover it. 00:31:00.696 [2024-11-28 23:23:04.068294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.068424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.068451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.696 qpair failed and we were unable to recover it. 00:31:00.696 [2024-11-28 23:23:04.068539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.068652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.068677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.696 qpair failed and we were unable to recover it. 00:31:00.696 [2024-11-28 23:23:04.068783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.068881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.068907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.696 qpair failed and we were unable to recover it. 00:31:00.696 [2024-11-28 23:23:04.068991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.069106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.069133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.696 qpair failed and we were unable to recover it. 00:31:00.696 [2024-11-28 23:23:04.069217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.069331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.696 [2024-11-28 23:23:04.069358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.696 qpair failed and we were unable to recover it. 00:31:00.697 [2024-11-28 23:23:04.069512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.069609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.069639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.697 qpair failed and we were unable to recover it. 00:31:00.697 [2024-11-28 23:23:04.069724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.069822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.069850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.697 qpair failed and we were unable to recover it. 00:31:00.697 [2024-11-28 23:23:04.069951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.070036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.070060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.697 qpair failed and we were unable to recover it. 00:31:00.697 [2024-11-28 23:23:04.070143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.070232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.070257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.697 qpair failed and we were unable to recover it. 00:31:00.697 [2024-11-28 23:23:04.070418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.070506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.070532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.697 qpair failed and we were unable to recover it. 00:31:00.697 [2024-11-28 23:23:04.070648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.070736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.070761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.697 qpair failed and we were unable to recover it. 00:31:00.697 [2024-11-28 23:23:04.070840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.070937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.070963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.697 qpair failed and we were unable to recover it. 00:31:00.697 [2024-11-28 23:23:04.071049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.071138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.071163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.697 qpair failed and we were unable to recover it. 00:31:00.697 [2024-11-28 23:23:04.071245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.071326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.071351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.697 qpair failed and we were unable to recover it. 00:31:00.697 [2024-11-28 23:23:04.071474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.071563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.071588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.697 qpair failed and we were unable to recover it. 00:31:00.697 [2024-11-28 23:23:04.071670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.071759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.071784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.697 qpair failed and we were unable to recover it. 00:31:00.697 [2024-11-28 23:23:04.071869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.071948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.071985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.697 qpair failed and we were unable to recover it. 00:31:00.697 [2024-11-28 23:23:04.072086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.072171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.072196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.697 qpair failed and we were unable to recover it. 00:31:00.697 [2024-11-28 23:23:04.072285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.072363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.072387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.697 qpair failed and we were unable to recover it. 00:31:00.697 [2024-11-28 23:23:04.072475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.072561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.072587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.697 qpair failed and we were unable to recover it. 00:31:00.697 [2024-11-28 23:23:04.072701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.072796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.072821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.697 qpair failed and we were unable to recover it. 00:31:00.697 [2024-11-28 23:23:04.072909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.072992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.073018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.697 qpair failed and we were unable to recover it. 00:31:00.697 [2024-11-28 23:23:04.073116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.073193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.073217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.697 qpair failed and we were unable to recover it. 00:31:00.697 [2024-11-28 23:23:04.073335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.073458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.073484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.697 qpair failed and we were unable to recover it. 00:31:00.697 [2024-11-28 23:23:04.073571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.073663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.073688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.697 qpair failed and we were unable to recover it. 00:31:00.697 [2024-11-28 23:23:04.073811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.073939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.073970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.697 qpair failed and we were unable to recover it. 00:31:00.697 [2024-11-28 23:23:04.074057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.074142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.074166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.697 qpair failed and we were unable to recover it. 00:31:00.697 [2024-11-28 23:23:04.074322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.074415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.074441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.697 qpair failed and we were unable to recover it. 00:31:00.697 [2024-11-28 23:23:04.074528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.074613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.074639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.697 qpair failed and we were unable to recover it. 00:31:00.697 [2024-11-28 23:23:04.074719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.074875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.074900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.697 qpair failed and we were unable to recover it. 00:31:00.697 [2024-11-28 23:23:04.075012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.075103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.697 [2024-11-28 23:23:04.075128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.698 qpair failed and we were unable to recover it. 00:31:00.698 [2024-11-28 23:23:04.075212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.075342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.075378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.698 qpair failed and we were unable to recover it. 00:31:00.698 [2024-11-28 23:23:04.075475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.075582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.075607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.698 qpair failed and we were unable to recover it. 00:31:00.698 [2024-11-28 23:23:04.075695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.075817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.075841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.698 qpair failed and we were unable to recover it. 00:31:00.698 [2024-11-28 23:23:04.075935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.076048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.076082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.698 qpair failed and we were unable to recover it. 00:31:00.698 [2024-11-28 23:23:04.076169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.076244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.076269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.698 qpair failed and we were unable to recover it. 00:31:00.698 [2024-11-28 23:23:04.076361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.076449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.076475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.698 qpair failed and we were unable to recover it. 00:31:00.698 [2024-11-28 23:23:04.076569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.076648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.076674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.698 qpair failed and we were unable to recover it. 00:31:00.698 [2024-11-28 23:23:04.076760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.076883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.076913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.698 qpair failed and we were unable to recover it. 00:31:00.698 [2024-11-28 23:23:04.076993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.077075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.077099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.698 qpair failed and we were unable to recover it. 00:31:00.698 [2024-11-28 23:23:04.077244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.077333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.077359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.698 qpair failed and we were unable to recover it. 00:31:00.698 [2024-11-28 23:23:04.077453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.077534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.077559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.698 qpair failed and we were unable to recover it. 00:31:00.698 [2024-11-28 23:23:04.077652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.077765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.077790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.698 qpair failed and we were unable to recover it. 00:31:00.698 [2024-11-28 23:23:04.077879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.078000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.078025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.698 qpair failed and we were unable to recover it. 00:31:00.698 [2024-11-28 23:23:04.078138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.078257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.078283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.698 qpair failed and we were unable to recover it. 00:31:00.698 [2024-11-28 23:23:04.078370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.078459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.078485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.698 qpair failed and we were unable to recover it. 00:31:00.698 [2024-11-28 23:23:04.078578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.078660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.078685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.698 qpair failed and we were unable to recover it. 00:31:00.698 [2024-11-28 23:23:04.078775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.078925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.078950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.698 qpair failed and we were unable to recover it. 00:31:00.698 [2024-11-28 23:23:04.079033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.079124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.079149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.698 qpair failed and we were unable to recover it. 00:31:00.698 [2024-11-28 23:23:04.079271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.079362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.079387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.698 qpair failed and we were unable to recover it. 00:31:00.698 [2024-11-28 23:23:04.079481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.079591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.079616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.698 qpair failed and we were unable to recover it. 00:31:00.698 [2024-11-28 23:23:04.079701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.079782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.079807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.698 qpair failed and we were unable to recover it. 00:31:00.698 [2024-11-28 23:23:04.079889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.079968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.079994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.698 qpair failed and we were unable to recover it. 00:31:00.698 [2024-11-28 23:23:04.080094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.080203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.080227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.698 qpair failed and we were unable to recover it. 00:31:00.698 [2024-11-28 23:23:04.080317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.080405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.080432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.698 qpair failed and we were unable to recover it. 00:31:00.698 [2024-11-28 23:23:04.080518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.080606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.080631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.698 qpair failed and we were unable to recover it. 00:31:00.698 [2024-11-28 23:23:04.080730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.080819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.080844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.698 qpair failed and we were unable to recover it. 00:31:00.698 [2024-11-28 23:23:04.080928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.081023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.081048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.698 qpair failed and we were unable to recover it. 00:31:00.698 [2024-11-28 23:23:04.081138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.081216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.081240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.698 qpair failed and we were unable to recover it. 00:31:00.698 [2024-11-28 23:23:04.081364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.081464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.698 [2024-11-28 23:23:04.081489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.698 qpair failed and we were unable to recover it. 00:31:00.699 [2024-11-28 23:23:04.081577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.081661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.081686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.699 qpair failed and we were unable to recover it. 00:31:00.699 [2024-11-28 23:23:04.081797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.081872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.081898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.699 qpair failed and we were unable to recover it. 00:31:00.699 [2024-11-28 23:23:04.082017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.082096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.082121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.699 qpair failed and we were unable to recover it. 00:31:00.699 [2024-11-28 23:23:04.082211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.082293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.082319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.699 qpair failed and we were unable to recover it. 00:31:00.699 [2024-11-28 23:23:04.082413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.082508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.082533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.699 qpair failed and we were unable to recover it. 00:31:00.699 [2024-11-28 23:23:04.082644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.082740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.082766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.699 qpair failed and we were unable to recover it. 00:31:00.699 [2024-11-28 23:23:04.082849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.082935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.082960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.699 qpair failed and we were unable to recover it. 00:31:00.699 [2024-11-28 23:23:04.083075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.083161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.083187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.699 qpair failed and we were unable to recover it. 00:31:00.699 [2024-11-28 23:23:04.083271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.083378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.083417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.699 qpair failed and we were unable to recover it. 00:31:00.699 [2024-11-28 23:23:04.083507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.083594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.083620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.699 qpair failed and we were unable to recover it. 00:31:00.699 [2024-11-28 23:23:04.083718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.083797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.083821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.699 qpair failed and we were unable to recover it. 00:31:00.699 [2024-11-28 23:23:04.083912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.083997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.084022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.699 qpair failed and we were unable to recover it. 00:31:00.699 [2024-11-28 23:23:04.084109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.084203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.084227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.699 qpair failed and we were unable to recover it. 00:31:00.699 [2024-11-28 23:23:04.084314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.084390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.084423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.699 qpair failed and we were unable to recover it. 00:31:00.699 [2024-11-28 23:23:04.084510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.084597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.084622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.699 qpair failed and we were unable to recover it. 00:31:00.699 [2024-11-28 23:23:04.084699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.084779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.084803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.699 qpair failed and we were unable to recover it. 00:31:00.699 [2024-11-28 23:23:04.084887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.084962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.084995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.699 qpair failed and we were unable to recover it. 00:31:00.699 [2024-11-28 23:23:04.085086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.085203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.085228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.699 qpair failed and we were unable to recover it. 00:31:00.699 [2024-11-28 23:23:04.085315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.085414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.085440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.699 qpair failed and we were unable to recover it. 00:31:00.699 [2024-11-28 23:23:04.085535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.085648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.085674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.699 qpair failed and we were unable to recover it. 00:31:00.699 [2024-11-28 23:23:04.085761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.085843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.085867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.699 qpair failed and we were unable to recover it. 00:31:00.699 [2024-11-28 23:23:04.085958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.086046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.086070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.699 qpair failed and we were unable to recover it. 00:31:00.699 [2024-11-28 23:23:04.086184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.086268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.086293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.699 qpair failed and we were unable to recover it. 00:31:00.699 [2024-11-28 23:23:04.086411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.086506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.086531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.699 qpair failed and we were unable to recover it. 00:31:00.699 [2024-11-28 23:23:04.086617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.086703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.086731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.699 qpair failed and we were unable to recover it. 00:31:00.699 [2024-11-28 23:23:04.086818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.086900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.086925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.699 qpair failed and we were unable to recover it. 00:31:00.699 [2024-11-28 23:23:04.087004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.087121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.087146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.699 qpair failed and we were unable to recover it. 00:31:00.699 [2024-11-28 23:23:04.087240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.087322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.087348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.699 qpair failed and we were unable to recover it. 00:31:00.699 [2024-11-28 23:23:04.087452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.087533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.699 [2024-11-28 23:23:04.087558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.699 qpair failed and we were unable to recover it. 00:31:00.699 [2024-11-28 23:23:04.087635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.087746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.087771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.700 qpair failed and we were unable to recover it. 00:31:00.700 [2024-11-28 23:23:04.087888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.087965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.087991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.700 qpair failed and we were unable to recover it. 00:31:00.700 [2024-11-28 23:23:04.088069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.088162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.088187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.700 qpair failed and we were unable to recover it. 00:31:00.700 [2024-11-28 23:23:04.088299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.088377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.088420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.700 qpair failed and we were unable to recover it. 00:31:00.700 [2024-11-28 23:23:04.088540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.088659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.088684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.700 qpair failed and we were unable to recover it. 00:31:00.700 [2024-11-28 23:23:04.088770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.088852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.088877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.700 qpair failed and we were unable to recover it. 00:31:00.700 [2024-11-28 23:23:04.088956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.089039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.089065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.700 qpair failed and we were unable to recover it. 00:31:00.700 [2024-11-28 23:23:04.089165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.089289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.089314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.700 qpair failed and we were unable to recover it. 00:31:00.700 [2024-11-28 23:23:04.089416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.089532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.089558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.700 qpair failed and we were unable to recover it. 00:31:00.700 [2024-11-28 23:23:04.089673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.089759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.089784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.700 qpair failed and we were unable to recover it. 00:31:00.700 [2024-11-28 23:23:04.089867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.089993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.090019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.700 qpair failed and we were unable to recover it. 00:31:00.700 [2024-11-28 23:23:04.090159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.090248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.090272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.700 qpair failed and we were unable to recover it. 00:31:00.700 [2024-11-28 23:23:04.090351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.090471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.090496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.700 qpair failed and we were unable to recover it. 00:31:00.700 [2024-11-28 23:23:04.090581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.090668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.090692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.700 qpair failed and we were unable to recover it. 00:31:00.700 [2024-11-28 23:23:04.090776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.090900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.090925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.700 qpair failed and we were unable to recover it. 00:31:00.700 [2024-11-28 23:23:04.091021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.091105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.091130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.700 qpair failed and we were unable to recover it. 00:31:00.700 [2024-11-28 23:23:04.091247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.091363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.091389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.700 qpair failed and we were unable to recover it. 00:31:00.700 [2024-11-28 23:23:04.091483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.091571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.091597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.700 qpair failed and we were unable to recover it. 00:31:00.700 [2024-11-28 23:23:04.091688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.091807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.091832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.700 qpair failed and we were unable to recover it. 00:31:00.700 [2024-11-28 23:23:04.091942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.092035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.092059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.700 qpair failed and we were unable to recover it. 00:31:00.700 [2024-11-28 23:23:04.092148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.092226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.092250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.700 qpair failed and we were unable to recover it. 00:31:00.700 [2024-11-28 23:23:04.092337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.092458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.092483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.700 qpair failed and we were unable to recover it. 00:31:00.700 [2024-11-28 23:23:04.092564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.092652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.092677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.700 qpair failed and we were unable to recover it. 00:31:00.700 [2024-11-28 23:23:04.092799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.092876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.092901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.700 qpair failed and we were unable to recover it. 00:31:00.700 [2024-11-28 23:23:04.093016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.093122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.093147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.700 qpair failed and we were unable to recover it. 00:31:00.700 [2024-11-28 23:23:04.093228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.093339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.093364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.700 qpair failed and we were unable to recover it. 00:31:00.700 [2024-11-28 23:23:04.093480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.093592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.093617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.700 qpair failed and we were unable to recover it. 00:31:00.700 [2024-11-28 23:23:04.093708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.093799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.093823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.700 qpair failed and we were unable to recover it. 00:31:00.700 [2024-11-28 23:23:04.093904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.093979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.094008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.700 qpair failed and we were unable to recover it. 00:31:00.700 [2024-11-28 23:23:04.094089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.700 [2024-11-28 23:23:04.094199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.094223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.701 qpair failed and we were unable to recover it. 00:31:00.701 [2024-11-28 23:23:04.094339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.094422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.094448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.701 qpair failed and we were unable to recover it. 00:31:00.701 [2024-11-28 23:23:04.094532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.094611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.094636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.701 qpair failed and we were unable to recover it. 00:31:00.701 [2024-11-28 23:23:04.094725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.094814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.094841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.701 qpair failed and we were unable to recover it. 00:31:00.701 [2024-11-28 23:23:04.094921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.095013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.095039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.701 qpair failed and we were unable to recover it. 00:31:00.701 [2024-11-28 23:23:04.095120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.095205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.095234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.701 qpair failed and we were unable to recover it. 00:31:00.701 [2024-11-28 23:23:04.095355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.095455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.095479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.701 qpair failed and we were unable to recover it. 00:31:00.701 [2024-11-28 23:23:04.095571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.095663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.095688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.701 qpair failed and we were unable to recover it. 00:31:00.701 [2024-11-28 23:23:04.095773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.095868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.095893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.701 qpair failed and we were unable to recover it. 00:31:00.701 [2024-11-28 23:23:04.095975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.096095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.096120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.701 qpair failed and we were unable to recover it. 00:31:00.701 [2024-11-28 23:23:04.096244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.096334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.096359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.701 qpair failed and we were unable to recover it. 00:31:00.701 [2024-11-28 23:23:04.096452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.096566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.096591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.701 qpair failed and we were unable to recover it. 00:31:00.701 [2024-11-28 23:23:04.096671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.096753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.096778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.701 qpair failed and we were unable to recover it. 00:31:00.701 [2024-11-28 23:23:04.096879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.096987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.097012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.701 qpair failed and we were unable to recover it. 00:31:00.701 [2024-11-28 23:23:04.097122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.097207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.097232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.701 qpair failed and we were unable to recover it. 00:31:00.701 [2024-11-28 23:23:04.097310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.097427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.097453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.701 qpair failed and we were unable to recover it. 00:31:00.701 [2024-11-28 23:23:04.097538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.097621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.097647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.701 qpair failed and we were unable to recover it. 00:31:00.701 [2024-11-28 23:23:04.097739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.097815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.097840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.701 qpair failed and we were unable to recover it. 00:31:00.701 [2024-11-28 23:23:04.097932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.098016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.098040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.701 qpair failed and we were unable to recover it. 00:31:00.701 [2024-11-28 23:23:04.098156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.098239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.098265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.701 qpair failed and we were unable to recover it. 00:31:00.701 [2024-11-28 23:23:04.098358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.098456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.098481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.701 qpair failed and we were unable to recover it. 00:31:00.701 [2024-11-28 23:23:04.098567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.098674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.098699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.701 qpair failed and we were unable to recover it. 00:31:00.701 [2024-11-28 23:23:04.098817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.098899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.098923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.701 qpair failed and we were unable to recover it. 00:31:00.701 [2024-11-28 23:23:04.099040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.099120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.099145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.701 qpair failed and we were unable to recover it. 00:31:00.701 [2024-11-28 23:23:04.099260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.099342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.099366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.701 qpair failed and we were unable to recover it. 00:31:00.701 [2024-11-28 23:23:04.099482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.099570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.099595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.701 qpair failed and we were unable to recover it. 00:31:00.701 [2024-11-28 23:23:04.099680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.099769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.099793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.701 qpair failed and we were unable to recover it. 00:31:00.701 [2024-11-28 23:23:04.099886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.099962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.099987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.701 qpair failed and we were unable to recover it. 00:31:00.701 [2024-11-28 23:23:04.100100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.100177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.100203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.701 qpair failed and we were unable to recover it. 00:31:00.701 [2024-11-28 23:23:04.100323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.100439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.701 [2024-11-28 23:23:04.100464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.702 qpair failed and we were unable to recover it. 00:31:00.702 [2024-11-28 23:23:04.100612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.100735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.100772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.702 qpair failed and we were unable to recover it. 00:31:00.702 [2024-11-28 23:23:04.100854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.100940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.100965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.702 qpair failed and we were unable to recover it. 00:31:00.702 [2024-11-28 23:23:04.101049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.101164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.101188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.702 qpair failed and we were unable to recover it. 00:31:00.702 [2024-11-28 23:23:04.101274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.101357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.101383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.702 qpair failed and we were unable to recover it. 00:31:00.702 [2024-11-28 23:23:04.101496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.101581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.101606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.702 qpair failed and we were unable to recover it. 00:31:00.702 [2024-11-28 23:23:04.101685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.101768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.101798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.702 qpair failed and we were unable to recover it. 00:31:00.702 [2024-11-28 23:23:04.101917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.101997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.102023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.702 qpair failed and we were unable to recover it. 00:31:00.702 [2024-11-28 23:23:04.102114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.102197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.102221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.702 qpair failed and we were unable to recover it. 00:31:00.702 [2024-11-28 23:23:04.102336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.102457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.102484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.702 qpair failed and we were unable to recover it. 00:31:00.702 [2024-11-28 23:23:04.102576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.102717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.102742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.702 qpair failed and we were unable to recover it. 00:31:00.702 [2024-11-28 23:23:04.102858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.102977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.103002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.702 qpair failed and we were unable to recover it. 00:31:00.702 [2024-11-28 23:23:04.103090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.103176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.103202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.702 qpair failed and we were unable to recover it. 00:31:00.702 [2024-11-28 23:23:04.103281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.103368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.103399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.702 qpair failed and we were unable to recover it. 00:31:00.702 [2024-11-28 23:23:04.103491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.103577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.103602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.702 qpair failed and we were unable to recover it. 00:31:00.702 [2024-11-28 23:23:04.103689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.103803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.103828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.702 qpair failed and we were unable to recover it. 00:31:00.702 [2024-11-28 23:23:04.103909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.103988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.104012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.702 qpair failed and we were unable to recover it. 00:31:00.702 [2024-11-28 23:23:04.104126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.104208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.104234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.702 qpair failed and we were unable to recover it. 00:31:00.702 [2024-11-28 23:23:04.104349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.104474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.104500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.702 qpair failed and we were unable to recover it. 00:31:00.702 [2024-11-28 23:23:04.104579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.104679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.104705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.702 qpair failed and we were unable to recover it. 00:31:00.702 [2024-11-28 23:23:04.104791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.104930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.104955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.702 qpair failed and we were unable to recover it. 00:31:00.702 [2024-11-28 23:23:04.105048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.105157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.105187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.702 qpair failed and we were unable to recover it. 00:31:00.702 [2024-11-28 23:23:04.105271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.105385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.105414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.702 qpair failed and we were unable to recover it. 00:31:00.702 [2024-11-28 23:23:04.105504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.105625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.105650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.702 qpair failed and we were unable to recover it. 00:31:00.702 [2024-11-28 23:23:04.105731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.105809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.105833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.702 qpair failed and we were unable to recover it. 00:31:00.702 [2024-11-28 23:23:04.105955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.106095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.106120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.702 qpair failed and we were unable to recover it. 00:31:00.702 [2024-11-28 23:23:04.106206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.106289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.702 [2024-11-28 23:23:04.106315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.702 qpair failed and we were unable to recover it. 00:31:00.703 [2024-11-28 23:23:04.106409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.106523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.106548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.703 qpair failed and we were unable to recover it. 00:31:00.703 [2024-11-28 23:23:04.106629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.106747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.106771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.703 qpair failed and we were unable to recover it. 00:31:00.703 [2024-11-28 23:23:04.106850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.106932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.106956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.703 qpair failed and we were unable to recover it. 00:31:00.703 [2024-11-28 23:23:04.107032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.107111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.107136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.703 qpair failed and we were unable to recover it. 00:31:00.703 [2024-11-28 23:23:04.107217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.107330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.107355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.703 qpair failed and we were unable to recover it. 00:31:00.703 [2024-11-28 23:23:04.107465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.107554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.107579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.703 qpair failed and we were unable to recover it. 00:31:00.703 [2024-11-28 23:23:04.107658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.107746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.107771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.703 qpair failed and we were unable to recover it. 00:31:00.703 [2024-11-28 23:23:04.107885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.107973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.107999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.703 qpair failed and we were unable to recover it. 00:31:00.703 [2024-11-28 23:23:04.108084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.108167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.108192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.703 qpair failed and we were unable to recover it. 00:31:00.703 [2024-11-28 23:23:04.108309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.108391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.108422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.703 qpair failed and we were unable to recover it. 00:31:00.703 [2024-11-28 23:23:04.108512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.108591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.108616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.703 qpair failed and we were unable to recover it. 00:31:00.703 [2024-11-28 23:23:04.108698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.108780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.108805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.703 qpair failed and we were unable to recover it. 00:31:00.703 [2024-11-28 23:23:04.108928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.109014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.109038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.703 qpair failed and we were unable to recover it. 00:31:00.703 [2024-11-28 23:23:04.109124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.109240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.109265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.703 qpair failed and we were unable to recover it. 00:31:00.703 [2024-11-28 23:23:04.109380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.109498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.109523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.703 qpair failed and we were unable to recover it. 00:31:00.703 [2024-11-28 23:23:04.109640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.109728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.109752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.703 qpair failed and we were unable to recover it. 00:31:00.703 [2024-11-28 23:23:04.109863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.109951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.109977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.703 qpair failed and we were unable to recover it. 00:31:00.703 [2024-11-28 23:23:04.110097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.110183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.110209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.703 qpair failed and we were unable to recover it. 00:31:00.703 [2024-11-28 23:23:04.110293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.110409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.110435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.703 qpair failed and we were unable to recover it. 00:31:00.703 [2024-11-28 23:23:04.110550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.110633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.110658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.703 qpair failed and we were unable to recover it. 00:31:00.703 [2024-11-28 23:23:04.110777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.110863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.110888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.703 qpair failed and we were unable to recover it. 00:31:00.703 [2024-11-28 23:23:04.110966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.111076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.111101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.703 qpair failed and we were unable to recover it. 00:31:00.703 [2024-11-28 23:23:04.111187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.111302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.111327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.703 qpair failed and we were unable to recover it. 00:31:00.703 [2024-11-28 23:23:04.111421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.111511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.111537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.703 qpair failed and we were unable to recover it. 00:31:00.703 [2024-11-28 23:23:04.111620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.111721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.111745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.703 qpair failed and we were unable to recover it. 00:31:00.703 [2024-11-28 23:23:04.111836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.111923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.111947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.703 qpair failed and we were unable to recover it. 00:31:00.703 [2024-11-28 23:23:04.112064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.112175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.112200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.703 qpair failed and we were unable to recover it. 00:31:00.703 [2024-11-28 23:23:04.112281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.112426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.112452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.703 qpair failed and we were unable to recover it. 00:31:00.703 [2024-11-28 23:23:04.112575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.112655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.703 [2024-11-28 23:23:04.112680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.703 qpair failed and we were unable to recover it. 00:31:00.703 [2024-11-28 23:23:04.112785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.112867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.112892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.704 qpair failed and we were unable to recover it. 00:31:00.704 [2024-11-28 23:23:04.113003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.113098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.113124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.704 qpair failed and we were unable to recover it. 00:31:00.704 [2024-11-28 23:23:04.113204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.113329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.113354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.704 qpair failed and we were unable to recover it. 00:31:00.704 [2024-11-28 23:23:04.113472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.113560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.113585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.704 qpair failed and we were unable to recover it. 00:31:00.704 [2024-11-28 23:23:04.113668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.113748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.113772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.704 qpair failed and we were unable to recover it. 00:31:00.704 [2024-11-28 23:23:04.113851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.113970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.113995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.704 qpair failed and we were unable to recover it. 00:31:00.704 [2024-11-28 23:23:04.114075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.114156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.114181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.704 qpair failed and we were unable to recover it. 00:31:00.704 [2024-11-28 23:23:04.114262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.114348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.114374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.704 qpair failed and we were unable to recover it. 00:31:00.704 [2024-11-28 23:23:04.114470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.114556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.114580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.704 qpair failed and we were unable to recover it. 00:31:00.704 [2024-11-28 23:23:04.114671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.114791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.114816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.704 qpair failed and we were unable to recover it. 00:31:00.704 [2024-11-28 23:23:04.114934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.115026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.115051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.704 qpair failed and we were unable to recover it. 00:31:00.704 [2024-11-28 23:23:04.115134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.115216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.115240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.704 qpair failed and we were unable to recover it. 00:31:00.704 [2024-11-28 23:23:04.115352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.115447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.115473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.704 qpair failed and we were unable to recover it. 00:31:00.704 [2024-11-28 23:23:04.115593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.115686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.115711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.704 qpair failed and we were unable to recover it. 00:31:00.704 [2024-11-28 23:23:04.115800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.115939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.115965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.704 qpair failed and we were unable to recover it. 00:31:00.704 [2024-11-28 23:23:04.116054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.116160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.116185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.704 qpair failed and we were unable to recover it. 00:31:00.704 [2024-11-28 23:23:04.116294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.116383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.116421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.704 qpair failed and we were unable to recover it. 00:31:00.704 [2024-11-28 23:23:04.116504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.116622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.116647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.704 qpair failed and we were unable to recover it. 00:31:00.704 [2024-11-28 23:23:04.116730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.116843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.116868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.704 qpair failed and we were unable to recover it. 00:31:00.704 [2024-11-28 23:23:04.116957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.117038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.117062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.704 qpair failed and we were unable to recover it. 00:31:00.704 [2024-11-28 23:23:04.117139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.117223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.117248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.704 qpair failed and we were unable to recover it. 00:31:00.704 [2024-11-28 23:23:04.117358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.117478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.117504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.704 qpair failed and we were unable to recover it. 00:31:00.704 [2024-11-28 23:23:04.117588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.117667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.117692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.704 qpair failed and we were unable to recover it. 00:31:00.704 [2024-11-28 23:23:04.117813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.117927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.117954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.704 qpair failed and we were unable to recover it. 00:31:00.704 [2024-11-28 23:23:04.118045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.118158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.118182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.704 qpair failed and we were unable to recover it. 00:31:00.704 [2024-11-28 23:23:04.118266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.118360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.118386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.704 qpair failed and we were unable to recover it. 00:31:00.704 [2024-11-28 23:23:04.118511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.118618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.118644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.704 qpair failed and we were unable to recover it. 00:31:00.704 [2024-11-28 23:23:04.118753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.118838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.118864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.704 qpair failed and we were unable to recover it. 00:31:00.704 [2024-11-28 23:23:04.118950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.119063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.119087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.704 qpair failed and we were unable to recover it. 00:31:00.704 [2024-11-28 23:23:04.119201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.704 [2024-11-28 23:23:04.119338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.119362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.705 qpair failed and we were unable to recover it. 00:31:00.705 [2024-11-28 23:23:04.119456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.119541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.119566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.705 qpair failed and we were unable to recover it. 00:31:00.705 [2024-11-28 23:23:04.119657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.119745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.119770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.705 qpair failed and we were unable to recover it. 00:31:00.705 [2024-11-28 23:23:04.119857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.119935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.119959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.705 qpair failed and we were unable to recover it. 00:31:00.705 [2024-11-28 23:23:04.120040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.120152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.120176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.705 qpair failed and we were unable to recover it. 00:31:00.705 [2024-11-28 23:23:04.120258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.120372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.120402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.705 qpair failed and we were unable to recover it. 00:31:00.705 [2024-11-28 23:23:04.120484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.120561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.120586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.705 qpair failed and we were unable to recover it. 00:31:00.705 [2024-11-28 23:23:04.120738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.120820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.120845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.705 qpair failed and we were unable to recover it. 00:31:00.705 [2024-11-28 23:23:04.120938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.121045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.121071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.705 qpair failed and we were unable to recover it. 00:31:00.705 [2024-11-28 23:23:04.121157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.121235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.121259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.705 qpair failed and we were unable to recover it. 00:31:00.705 [2024-11-28 23:23:04.121342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.121434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.121459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.705 qpair failed and we were unable to recover it. 00:31:00.705 [2024-11-28 23:23:04.121542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.121631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.121656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.705 qpair failed and we were unable to recover it. 00:31:00.705 [2024-11-28 23:23:04.121735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.121821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.121846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.705 qpair failed and we were unable to recover it. 00:31:00.705 [2024-11-28 23:23:04.121932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.122014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.122039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.705 qpair failed and we were unable to recover it. 00:31:00.705 [2024-11-28 23:23:04.122151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.122282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.122307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.705 qpair failed and we were unable to recover it. 00:31:00.705 [2024-11-28 23:23:04.122408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.122520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.122544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.705 qpair failed and we were unable to recover it. 00:31:00.705 [2024-11-28 23:23:04.122631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.122714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.122738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.705 qpair failed and we were unable to recover it. 00:31:00.705 [2024-11-28 23:23:04.122852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.122955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.122981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.705 qpair failed and we were unable to recover it. 00:31:00.705 [2024-11-28 23:23:04.123065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.123154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.123180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.705 qpair failed and we were unable to recover it. 00:31:00.705 [2024-11-28 23:23:04.123278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.123386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.123416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.705 qpair failed and we were unable to recover it. 00:31:00.705 [2024-11-28 23:23:04.123516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.123606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.123630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.705 qpair failed and we were unable to recover it. 00:31:00.705 [2024-11-28 23:23:04.123743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.123822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.123847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.705 qpair failed and we were unable to recover it. 00:31:00.705 [2024-11-28 23:23:04.123926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.124010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.124034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.705 qpair failed and we were unable to recover it. 00:31:00.705 [2024-11-28 23:23:04.124127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.124218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.124244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.705 qpair failed and we were unable to recover it. 00:31:00.705 [2024-11-28 23:23:04.124329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.124423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.124448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.705 qpair failed and we were unable to recover it. 00:31:00.705 [2024-11-28 23:23:04.124535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.124619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.124644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.705 qpair failed and we were unable to recover it. 00:31:00.705 [2024-11-28 23:23:04.124743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.124855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.124879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.705 qpair failed and we were unable to recover it. 00:31:00.705 [2024-11-28 23:23:04.124958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.125073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.125097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.705 qpair failed and we were unable to recover it. 00:31:00.705 [2024-11-28 23:23:04.125181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.125266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.125296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.705 qpair failed and we were unable to recover it. 00:31:00.705 [2024-11-28 23:23:04.125422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.125541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.705 [2024-11-28 23:23:04.125566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.705 qpair failed and we were unable to recover it. 00:31:00.706 [2024-11-28 23:23:04.125647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.125796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.125822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.706 qpair failed and we were unable to recover it. 00:31:00.706 [2024-11-28 23:23:04.125912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.125996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.126021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.706 qpair failed and we were unable to recover it. 00:31:00.706 [2024-11-28 23:23:04.126138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.126257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.126282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.706 qpair failed and we were unable to recover it. 00:31:00.706 [2024-11-28 23:23:04.126367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.126459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.126484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.706 qpair failed and we were unable to recover it. 00:31:00.706 [2024-11-28 23:23:04.126580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.126669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.126693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.706 qpair failed and we were unable to recover it. 00:31:00.706 [2024-11-28 23:23:04.126785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.126869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.126894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.706 qpair failed and we were unable to recover it. 00:31:00.706 [2024-11-28 23:23:04.126982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.127070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.127094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.706 qpair failed and we were unable to recover it. 00:31:00.706 [2024-11-28 23:23:04.127186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.127316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.127341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.706 qpair failed and we were unable to recover it. 00:31:00.706 [2024-11-28 23:23:04.127448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.127543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.127569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.706 qpair failed and we were unable to recover it. 00:31:00.706 [2024-11-28 23:23:04.127657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.127737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.127762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.706 qpair failed and we were unable to recover it. 00:31:00.706 [2024-11-28 23:23:04.127842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.127931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.127956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.706 qpair failed and we were unable to recover it. 00:31:00.706 [2024-11-28 23:23:04.128044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.128172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.128197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.706 qpair failed and we were unable to recover it. 00:31:00.706 [2024-11-28 23:23:04.128277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.128352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.128376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.706 qpair failed and we were unable to recover it. 00:31:00.706 [2024-11-28 23:23:04.128475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.128568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.128593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.706 qpair failed and we were unable to recover it. 00:31:00.706 [2024-11-28 23:23:04.128677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.128760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.128785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.706 qpair failed and we were unable to recover it. 00:31:00.706 [2024-11-28 23:23:04.128872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.128957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.128983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.706 qpair failed and we were unable to recover it. 00:31:00.706 [2024-11-28 23:23:04.129069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.129155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.129180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.706 qpair failed and we were unable to recover it. 00:31:00.706 [2024-11-28 23:23:04.129273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.129382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.129413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.706 qpair failed and we were unable to recover it. 00:31:00.706 [2024-11-28 23:23:04.129494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.129585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.129609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.706 qpair failed and we were unable to recover it. 00:31:00.706 [2024-11-28 23:23:04.129698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.129792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.129817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.706 qpair failed and we were unable to recover it. 00:31:00.706 [2024-11-28 23:23:04.129901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.130014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.130039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.706 qpair failed and we were unable to recover it. 00:31:00.706 [2024-11-28 23:23:04.130157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.130243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.130268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.706 qpair failed and we were unable to recover it. 00:31:00.706 [2024-11-28 23:23:04.130359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.130444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.130469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.706 qpair failed and we were unable to recover it. 00:31:00.706 [2024-11-28 23:23:04.130557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.130638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.130663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.706 qpair failed and we were unable to recover it. 00:31:00.706 [2024-11-28 23:23:04.130752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.130862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.706 [2024-11-28 23:23:04.130887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.706 qpair failed and we were unable to recover it. 00:31:00.706 [2024-11-28 23:23:04.130971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.131052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.131077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.707 qpair failed and we were unable to recover it. 00:31:00.707 [2024-11-28 23:23:04.131159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.131297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.131323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.707 qpair failed and we were unable to recover it. 00:31:00.707 [2024-11-28 23:23:04.131433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.131513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.131539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.707 qpair failed and we were unable to recover it. 00:31:00.707 [2024-11-28 23:23:04.131649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.131739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.131763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.707 qpair failed and we were unable to recover it. 00:31:00.707 [2024-11-28 23:23:04.131876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.131979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.132010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:31:00.707 qpair failed and we were unable to recover it. 00:31:00.707 [2024-11-28 23:23:04.132105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.132193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.132222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:31:00.707 qpair failed and we were unable to recover it. 00:31:00.707 [2024-11-28 23:23:04.132313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.132404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.132432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:31:00.707 qpair failed and we were unable to recover it. 00:31:00.707 [2024-11-28 23:23:04.132550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.132639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.132664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:31:00.707 qpair failed and we were unable to recover it. 00:31:00.707 [2024-11-28 23:23:04.132746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.132843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.132870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:31:00.707 qpair failed and we were unable to recover it. 00:31:00.707 [2024-11-28 23:23:04.132960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.133080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.133107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:31:00.707 qpair failed and we were unable to recover it. 00:31:00.707 [2024-11-28 23:23:04.133205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.133285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.133310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.707 qpair failed and we were unable to recover it. 00:31:00.707 [2024-11-28 23:23:04.133404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.133485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.133509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.707 qpair failed and we were unable to recover it. 00:31:00.707 [2024-11-28 23:23:04.133590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.133677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.133702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.707 qpair failed and we were unable to recover it. 00:31:00.707 [2024-11-28 23:23:04.133784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.133858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.133882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.707 qpair failed and we were unable to recover it. 00:31:00.707 [2024-11-28 23:23:04.134001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.134083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.134107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.707 qpair failed and we were unable to recover it. 00:31:00.707 [2024-11-28 23:23:04.134188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.134273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.134299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.707 qpair failed and we were unable to recover it. 00:31:00.707 [2024-11-28 23:23:04.134381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.134522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.134547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.707 qpair failed and we were unable to recover it. 00:31:00.707 [2024-11-28 23:23:04.134630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.134723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.134748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.707 qpair failed and we were unable to recover it. 00:31:00.707 [2024-11-28 23:23:04.134831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.134951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.134976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.707 qpair failed and we were unable to recover it. 00:31:00.707 [2024-11-28 23:23:04.135062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.135141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.135165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.707 qpair failed and we were unable to recover it. 00:31:00.707 [2024-11-28 23:23:04.135278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.135364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.135388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.707 qpair failed and we were unable to recover it. 00:31:00.707 [2024-11-28 23:23:04.135482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.135564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.135588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.707 qpair failed and we were unable to recover it. 00:31:00.707 [2024-11-28 23:23:04.135677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.135766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.135791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.707 qpair failed and we were unable to recover it. 00:31:00.707 [2024-11-28 23:23:04.135879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.135960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.135985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.707 qpair failed and we were unable to recover it. 00:31:00.707 [2024-11-28 23:23:04.136078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.136163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.136192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.707 qpair failed and we were unable to recover it. 00:31:00.707 [2024-11-28 23:23:04.136292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.136406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.136431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.707 qpair failed and we were unable to recover it. 00:31:00.707 [2024-11-28 23:23:04.136518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.136602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.136626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.707 qpair failed and we were unable to recover it. 00:31:00.707 [2024-11-28 23:23:04.136743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.136826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.136851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.707 qpair failed and we were unable to recover it. 00:31:00.707 [2024-11-28 23:23:04.136935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.137056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.137081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.707 qpair failed and we were unable to recover it. 00:31:00.707 [2024-11-28 23:23:04.137162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.707 [2024-11-28 23:23:04.137258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.137282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.708 qpair failed and we were unable to recover it. 00:31:00.708 [2024-11-28 23:23:04.137370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.137460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.137486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.708 qpair failed and we were unable to recover it. 00:31:00.708 [2024-11-28 23:23:04.137581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.137661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.137686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.708 qpair failed and we were unable to recover it. 00:31:00.708 [2024-11-28 23:23:04.137764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.137851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.137876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.708 qpair failed and we were unable to recover it. 00:31:00.708 [2024-11-28 23:23:04.137962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.138079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.138104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.708 qpair failed and we were unable to recover it. 00:31:00.708 [2024-11-28 23:23:04.138192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.138300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.138329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.708 qpair failed and we were unable to recover it. 00:31:00.708 [2024-11-28 23:23:04.138421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.138496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.138520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.708 qpair failed and we were unable to recover it. 00:31:00.708 [2024-11-28 23:23:04.138606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.138748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.138773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.708 qpair failed and we were unable to recover it. 00:31:00.708 [2024-11-28 23:23:04.138865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.138976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.139001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.708 qpair failed and we were unable to recover it. 00:31:00.708 [2024-11-28 23:23:04.139080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.139203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.139228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.708 qpair failed and we were unable to recover it. 00:31:00.708 [2024-11-28 23:23:04.139309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.139400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.139431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.708 qpair failed and we were unable to recover it. 00:31:00.708 [2024-11-28 23:23:04.139513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.139599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.139624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.708 qpair failed and we were unable to recover it. 00:31:00.708 [2024-11-28 23:23:04.139719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 23:23:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:31:00.708 [2024-11-28 23:23:04.139830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 23:23:04 -- common/autotest_common.sh@862 -- # return 0 00:31:00.708 [2024-11-28 23:23:04.139855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.708 qpair failed and we were unable to recover it. 00:31:00.708 [2024-11-28 23:23:04.139934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 23:23:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:31:00.708 [2024-11-28 23:23:04.140021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.140047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.708 qpair failed and we were unable to recover it. 00:31:00.708 23:23:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:00.708 [2024-11-28 23:23:04.140135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 23:23:04 -- common/autotest_common.sh@10 -- # set +x 00:31:00.708 [2024-11-28 23:23:04.140246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.140271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.708 qpair failed and we were unable to recover it. 00:31:00.708 [2024-11-28 23:23:04.140357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.140446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.140471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.708 qpair failed and we were unable to recover it. 00:31:00.708 [2024-11-28 23:23:04.140557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.140638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.140663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.708 qpair failed and we were unable to recover it. 00:31:00.708 [2024-11-28 23:23:04.140745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.140833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.140858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.708 qpair failed and we were unable to recover it. 00:31:00.708 [2024-11-28 23:23:04.140944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.141029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.141055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.708 qpair failed and we were unable to recover it. 00:31:00.708 [2024-11-28 23:23:04.141133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.141253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.141277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.708 qpair failed and we were unable to recover it. 00:31:00.708 [2024-11-28 23:23:04.141360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.141480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.141506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.708 qpair failed and we were unable to recover it. 00:31:00.708 [2024-11-28 23:23:04.141586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.141704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.141730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.708 qpair failed and we were unable to recover it. 00:31:00.708 [2024-11-28 23:23:04.141855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.141939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.141966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.708 qpair failed and we were unable to recover it. 00:31:00.708 [2024-11-28 23:23:04.142076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.142156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.142181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.708 qpair failed and we were unable to recover it. 00:31:00.708 [2024-11-28 23:23:04.142299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.142385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.142416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.708 qpair failed and we were unable to recover it. 00:31:00.708 [2024-11-28 23:23:04.142502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.142587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.142612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.708 qpair failed and we were unable to recover it. 00:31:00.708 [2024-11-28 23:23:04.142695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.142783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.142809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.708 qpair failed and we were unable to recover it. 00:31:00.708 [2024-11-28 23:23:04.142905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.142986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.143010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.708 qpair failed and we were unable to recover it. 00:31:00.708 [2024-11-28 23:23:04.143097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.143179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.708 [2024-11-28 23:23:04.143205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.708 qpair failed and we were unable to recover it. 00:31:00.709 [2024-11-28 23:23:04.143286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.143390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.143421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.709 qpair failed and we were unable to recover it. 00:31:00.709 [2024-11-28 23:23:04.143507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.143594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.143621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.709 qpair failed and we were unable to recover it. 00:31:00.709 [2024-11-28 23:23:04.143724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.143831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.143857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.709 qpair failed and we were unable to recover it. 00:31:00.709 [2024-11-28 23:23:04.143945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.144042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.144067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.709 qpair failed and we were unable to recover it. 00:31:00.709 [2024-11-28 23:23:04.144155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.144243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.144272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.709 qpair failed and we were unable to recover it. 00:31:00.709 [2024-11-28 23:23:04.144357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.144444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.144469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.709 qpair failed and we were unable to recover it. 00:31:00.709 [2024-11-28 23:23:04.144556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.144640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.144670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.709 qpair failed and we were unable to recover it. 00:31:00.709 [2024-11-28 23:23:04.144752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.144837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.144861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.709 qpair failed and we were unable to recover it. 00:31:00.709 [2024-11-28 23:23:04.144939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.145057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.145083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.709 qpair failed and we were unable to recover it. 00:31:00.709 [2024-11-28 23:23:04.145175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.145258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.145285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.709 qpair failed and we were unable to recover it. 00:31:00.709 [2024-11-28 23:23:04.145381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.145468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.145493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.709 qpair failed and we were unable to recover it. 00:31:00.709 [2024-11-28 23:23:04.145579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.145674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.145708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.709 qpair failed and we were unable to recover it. 00:31:00.709 [2024-11-28 23:23:04.145799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.145909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.145933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.709 qpair failed and we were unable to recover it. 00:31:00.709 [2024-11-28 23:23:04.146047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.146128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.146153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.709 qpair failed and we were unable to recover it. 00:31:00.709 [2024-11-28 23:23:04.146236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.146321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.146348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.709 qpair failed and we were unable to recover it. 00:31:00.709 [2024-11-28 23:23:04.146467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.146549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.146574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.709 qpair failed and we were unable to recover it. 00:31:00.709 [2024-11-28 23:23:04.146658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.146741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.146766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.709 qpair failed and we were unable to recover it. 00:31:00.709 [2024-11-28 23:23:04.146886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.146966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.146991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.709 qpair failed and we were unable to recover it. 00:31:00.709 [2024-11-28 23:23:04.147073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.147189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.147214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.709 qpair failed and we were unable to recover it. 00:31:00.709 [2024-11-28 23:23:04.147300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.147439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.147465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.709 qpair failed and we were unable to recover it. 00:31:00.709 [2024-11-28 23:23:04.147549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.147629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.147654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.709 qpair failed and we were unable to recover it. 00:31:00.709 [2024-11-28 23:23:04.147747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.147835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.147860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.709 qpair failed and we were unable to recover it. 00:31:00.709 [2024-11-28 23:23:04.147972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.148053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.148085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.709 qpair failed and we were unable to recover it. 00:31:00.709 [2024-11-28 23:23:04.148198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.148289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.148315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.709 qpair failed and we were unable to recover it. 00:31:00.709 [2024-11-28 23:23:04.148405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.148523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.148549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.709 qpair failed and we were unable to recover it. 00:31:00.709 [2024-11-28 23:23:04.148632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.148719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.148744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.709 qpair failed and we were unable to recover it. 00:31:00.709 [2024-11-28 23:23:04.148836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.148919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.148945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.709 qpair failed and we were unable to recover it. 00:31:00.709 [2024-11-28 23:23:04.149063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.149204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.149229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.709 qpair failed and we were unable to recover it. 00:31:00.709 [2024-11-28 23:23:04.149320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.149427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.709 [2024-11-28 23:23:04.149453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.709 qpair failed and we were unable to recover it. 00:31:00.709 [2024-11-28 23:23:04.149535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.149621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.149647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.710 qpair failed and we were unable to recover it. 00:31:00.710 [2024-11-28 23:23:04.149736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.149818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.149844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.710 qpair failed and we were unable to recover it. 00:31:00.710 [2024-11-28 23:23:04.149922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.150009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.150034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.710 qpair failed and we were unable to recover it. 00:31:00.710 [2024-11-28 23:23:04.150134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.150273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.150299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.710 qpair failed and we were unable to recover it. 00:31:00.710 [2024-11-28 23:23:04.150398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.150484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.150509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.710 qpair failed and we were unable to recover it. 00:31:00.710 [2024-11-28 23:23:04.150621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.150709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.150736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.710 qpair failed and we were unable to recover it. 00:31:00.710 [2024-11-28 23:23:04.150845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.150965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.150992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.710 qpair failed and we were unable to recover it. 00:31:00.710 [2024-11-28 23:23:04.151082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.151198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.151223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.710 qpair failed and we were unable to recover it. 00:31:00.710 [2024-11-28 23:23:04.151371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.151507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.151532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.710 qpair failed and we were unable to recover it. 00:31:00.710 [2024-11-28 23:23:04.151610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.151729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.151755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.710 qpair failed and we were unable to recover it. 00:31:00.710 [2024-11-28 23:23:04.151842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.151951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.151976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.710 qpair failed and we were unable to recover it. 00:31:00.710 [2024-11-28 23:23:04.152058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.152143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.152168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.710 qpair failed and we were unable to recover it. 00:31:00.710 [2024-11-28 23:23:04.152256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.152336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.152361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.710 qpair failed and we were unable to recover it. 00:31:00.710 [2024-11-28 23:23:04.152459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.152558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.152584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.710 qpair failed and we were unable to recover it. 00:31:00.710 [2024-11-28 23:23:04.152669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.152767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.152792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.710 qpair failed and we were unable to recover it. 00:31:00.710 [2024-11-28 23:23:04.152903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.153020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.153045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.710 qpair failed and we were unable to recover it. 00:31:00.710 [2024-11-28 23:23:04.153127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.153217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.153243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.710 qpair failed and we were unable to recover it. 00:31:00.710 [2024-11-28 23:23:04.153322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.153432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.153458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.710 qpair failed and we were unable to recover it. 00:31:00.710 [2024-11-28 23:23:04.153552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.153667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.153706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.710 qpair failed and we were unable to recover it. 00:31:00.710 [2024-11-28 23:23:04.153796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.153873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.153898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.710 qpair failed and we were unable to recover it. 00:31:00.710 [2024-11-28 23:23:04.154009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.154124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.154153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.710 qpair failed and we were unable to recover it. 00:31:00.710 [2024-11-28 23:23:04.154238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.154325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.154349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.710 qpair failed and we were unable to recover it. 00:31:00.710 [2024-11-28 23:23:04.154446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.154532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.154557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.710 qpair failed and we were unable to recover it. 00:31:00.710 [2024-11-28 23:23:04.154640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.154728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.154753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.710 qpair failed and we were unable to recover it. 00:31:00.710 [2024-11-28 23:23:04.154870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.154952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.154976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.710 qpair failed and we were unable to recover it. 00:31:00.710 [2024-11-28 23:23:04.155060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.155139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.155165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.710 qpair failed and we were unable to recover it. 00:31:00.710 [2024-11-28 23:23:04.155244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.155320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.155345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.710 qpair failed and we were unable to recover it. 00:31:00.710 [2024-11-28 23:23:04.155446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.155536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.155561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.710 qpair failed and we were unable to recover it. 00:31:00.710 [2024-11-28 23:23:04.155657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.155769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.155800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.710 qpair failed and we were unable to recover it. 00:31:00.710 [2024-11-28 23:23:04.155918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.710 [2024-11-28 23:23:04.155999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.156023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.711 qpair failed and we were unable to recover it. 00:31:00.711 [2024-11-28 23:23:04.156111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.156224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.156249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.711 qpair failed and we were unable to recover it. 00:31:00.711 [2024-11-28 23:23:04.156347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.156465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.156491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.711 qpair failed and we were unable to recover it. 00:31:00.711 [2024-11-28 23:23:04.156584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.156693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.156718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.711 qpair failed and we were unable to recover it. 00:31:00.711 23:23:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:31:00.711 [2024-11-28 23:23:04.156834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.156911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 23:23:04 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:31:00.711 [2024-11-28 23:23:04.156936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.711 qpair failed and we were unable to recover it. 00:31:00.711 [2024-11-28 23:23:04.157023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 23:23:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:00.711 [2024-11-28 23:23:04.157103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.157129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.711 qpair failed and we were unable to recover it. 00:31:00.711 23:23:04 -- common/autotest_common.sh@10 -- # set +x 00:31:00.711 [2024-11-28 23:23:04.157212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.157290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.157314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.711 qpair failed and we were unable to recover it. 00:31:00.711 [2024-11-28 23:23:04.157426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.157538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.157562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.711 qpair failed and we were unable to recover it. 00:31:00.711 [2024-11-28 23:23:04.157644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.157732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.157758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.711 qpair failed and we were unable to recover it. 00:31:00.711 [2024-11-28 23:23:04.157906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.158020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.158045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.711 qpair failed and we were unable to recover it. 00:31:00.711 [2024-11-28 23:23:04.158158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.158237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.158263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.711 qpair failed and we were unable to recover it. 00:31:00.711 [2024-11-28 23:23:04.158358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.158478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.158504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.711 qpair failed and we were unable to recover it. 00:31:00.711 [2024-11-28 23:23:04.158590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.158674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.158699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.711 qpair failed and we were unable to recover it. 00:31:00.711 [2024-11-28 23:23:04.158818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.158900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.158925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.711 qpair failed and we were unable to recover it. 00:31:00.711 [2024-11-28 23:23:04.159002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.159117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.159142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.711 qpair failed and we were unable to recover it. 00:31:00.711 [2024-11-28 23:23:04.159255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.159346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.159370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.711 qpair failed and we were unable to recover it. 00:31:00.711 [2024-11-28 23:23:04.159469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.159581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.159607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.711 qpair failed and we were unable to recover it. 00:31:00.711 [2024-11-28 23:23:04.159722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.159814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.159839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.711 qpair failed and we were unable to recover it. 00:31:00.711 [2024-11-28 23:23:04.159923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.160008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.160033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.711 qpair failed and we were unable to recover it. 00:31:00.711 [2024-11-28 23:23:04.160120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.160228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.160253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.711 qpair failed and we were unable to recover it. 00:31:00.711 [2024-11-28 23:23:04.160333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.160420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.160446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.711 qpair failed and we were unable to recover it. 00:31:00.711 [2024-11-28 23:23:04.160543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.160627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.160652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.711 qpair failed and we were unable to recover it. 00:31:00.711 [2024-11-28 23:23:04.160746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.160858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.160884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.711 qpair failed and we were unable to recover it. 00:31:00.711 [2024-11-28 23:23:04.160971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.161053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.161078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.711 qpair failed and we were unable to recover it. 00:31:00.711 [2024-11-28 23:23:04.161160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.161242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.161268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.711 qpair failed and we were unable to recover it. 00:31:00.711 [2024-11-28 23:23:04.161368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.161468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.711 [2024-11-28 23:23:04.161494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.712 qpair failed and we were unable to recover it. 00:31:00.712 [2024-11-28 23:23:04.161584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.161694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.161720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.712 qpair failed and we were unable to recover it. 00:31:00.712 [2024-11-28 23:23:04.161866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.161944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.161969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.712 qpair failed and we were unable to recover it. 00:31:00.712 [2024-11-28 23:23:04.162055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.162134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.162159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.712 qpair failed and we were unable to recover it. 00:31:00.712 [2024-11-28 23:23:04.162251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.162330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.162360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.712 qpair failed and we were unable to recover it. 00:31:00.712 [2024-11-28 23:23:04.162461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.162577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.162603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.712 qpair failed and we were unable to recover it. 00:31:00.712 [2024-11-28 23:23:04.162691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.162773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.162798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.712 qpair failed and we were unable to recover it. 00:31:00.712 [2024-11-28 23:23:04.162910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.163029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.163054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.712 qpair failed and we were unable to recover it. 00:31:00.712 [2024-11-28 23:23:04.163140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.163220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.163245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.712 qpair failed and we were unable to recover it. 00:31:00.712 [2024-11-28 23:23:04.163327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.163423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.163449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.712 qpair failed and we were unable to recover it. 00:31:00.712 [2024-11-28 23:23:04.163570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.163655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.163680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.712 qpair failed and we were unable to recover it. 00:31:00.712 [2024-11-28 23:23:04.163779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.163864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.163889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.712 qpair failed and we were unable to recover it. 00:31:00.712 [2024-11-28 23:23:04.163982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.164066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.164091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.712 qpair failed and we were unable to recover it. 00:31:00.712 [2024-11-28 23:23:04.164183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.164263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.164289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.712 qpair failed and we were unable to recover it. 00:31:00.712 [2024-11-28 23:23:04.164371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.164472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.164497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.712 qpair failed and we were unable to recover it. 00:31:00.712 [2024-11-28 23:23:04.164592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.164671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.164695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.712 qpair failed and we were unable to recover it. 00:31:00.712 [2024-11-28 23:23:04.164783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.164899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.164925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.712 qpair failed and we were unable to recover it. 00:31:00.712 [2024-11-28 23:23:04.165002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.165118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.165142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.712 qpair failed and we were unable to recover it. 00:31:00.712 [2024-11-28 23:23:04.165235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.165342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.165367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.712 qpair failed and we were unable to recover it. 00:31:00.712 [2024-11-28 23:23:04.165460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.165568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.165593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.712 qpair failed and we were unable to recover it. 00:31:00.712 [2024-11-28 23:23:04.165676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.165764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.165788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.712 qpair failed and we were unable to recover it. 00:31:00.712 [2024-11-28 23:23:04.165872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.165958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.165983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.712 qpair failed and we were unable to recover it. 00:31:00.712 [2024-11-28 23:23:04.166068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.166156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.166181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.712 qpair failed and we were unable to recover it. 00:31:00.712 [2024-11-28 23:23:04.166297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.166381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.166410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.712 qpair failed and we were unable to recover it. 00:31:00.712 [2024-11-28 23:23:04.166533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.166617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.166642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.712 qpair failed and we were unable to recover it. 00:31:00.712 [2024-11-28 23:23:04.166748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.166843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.166869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.712 qpair failed and we were unable to recover it. 00:31:00.712 [2024-11-28 23:23:04.166961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.167080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.167105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.712 qpair failed and we were unable to recover it. 00:31:00.712 [2024-11-28 23:23:04.167227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.167309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.167333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.712 qpair failed and we were unable to recover it. 00:31:00.712 [2024-11-28 23:23:04.167444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.167557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.167581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.712 qpair failed and we were unable to recover it. 00:31:00.712 [2024-11-28 23:23:04.167697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.712 [2024-11-28 23:23:04.167781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.167806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.713 qpair failed and we were unable to recover it. 00:31:00.713 [2024-11-28 23:23:04.167895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.167974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.167999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.713 qpair failed and we were unable to recover it. 00:31:00.713 [2024-11-28 23:23:04.168101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.168217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.168241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.713 qpair failed and we were unable to recover it. 00:31:00.713 [2024-11-28 23:23:04.168340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.168426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.168452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.713 qpair failed and we were unable to recover it. 00:31:00.713 [2024-11-28 23:23:04.168536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.168618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.168643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.713 qpair failed and we were unable to recover it. 00:31:00.713 [2024-11-28 23:23:04.168735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.168827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.168854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52ef20 with addr=10.0.0.2, port=4420 00:31:00.713 qpair failed and we were unable to recover it. 00:31:00.713 [2024-11-28 23:23:04.168991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.169098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.169128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.713 qpair failed and we were unable to recover it. 00:31:00.713 [2024-11-28 23:23:04.169257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.169346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.169373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.713 qpair failed and we were unable to recover it. 00:31:00.713 [2024-11-28 23:23:04.169487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.169571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.169597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.713 qpair failed and we were unable to recover it. 00:31:00.713 [2024-11-28 23:23:04.169682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.169764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.169790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.713 qpair failed and we were unable to recover it. 00:31:00.713 [2024-11-28 23:23:04.169872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.169966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.169991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.713 qpair failed and we were unable to recover it. 00:31:00.713 [2024-11-28 23:23:04.170106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.170199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.170225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.713 qpair failed and we were unable to recover it. 00:31:00.713 [2024-11-28 23:23:04.170310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.170424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.170450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.713 qpair failed and we were unable to recover it. 00:31:00.713 [2024-11-28 23:23:04.170532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.170614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.170639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.713 qpair failed and we were unable to recover it. 00:31:00.713 [2024-11-28 23:23:04.170726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.170855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.170880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.713 qpair failed and we were unable to recover it. 00:31:00.713 [2024-11-28 23:23:04.170974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.171088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.171114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.713 qpair failed and we were unable to recover it. 00:31:00.713 [2024-11-28 23:23:04.171199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.171320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.171346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.713 qpair failed and we were unable to recover it. 00:31:00.713 [2024-11-28 23:23:04.171441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.171531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.171557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.713 qpair failed and we were unable to recover it. 00:31:00.713 [2024-11-28 23:23:04.171644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.171729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.171754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.713 qpair failed and we were unable to recover it. 00:31:00.713 [2024-11-28 23:23:04.171843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.171985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.172010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.713 qpair failed and we were unable to recover it. 00:31:00.713 [2024-11-28 23:23:04.172109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.172222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.172248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.713 qpair failed and we were unable to recover it. 00:31:00.713 [2024-11-28 23:23:04.172375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.172471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.172497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.713 qpair failed and we were unable to recover it. 00:31:00.713 [2024-11-28 23:23:04.172586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.172675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.172703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.713 qpair failed and we were unable to recover it. 00:31:00.713 [2024-11-28 23:23:04.172794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.172874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.172899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.713 qpair failed and we were unable to recover it. 00:31:00.713 [2024-11-28 23:23:04.172992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.173076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.173102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.713 qpair failed and we were unable to recover it. 00:31:00.713 [2024-11-28 23:23:04.173184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.173273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.173299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.713 qpair failed and we were unable to recover it. 00:31:00.713 [2024-11-28 23:23:04.173415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.173513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.173538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.713 qpair failed and we were unable to recover it. 00:31:00.713 [2024-11-28 23:23:04.173624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.173702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.173729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.713 qpair failed and we were unable to recover it. 00:31:00.713 [2024-11-28 23:23:04.173814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.173931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.173957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.713 qpair failed and we were unable to recover it. 00:31:00.713 [2024-11-28 23:23:04.174086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.174197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.174223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.713 qpair failed and we were unable to recover it. 00:31:00.713 [2024-11-28 23:23:04.174307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.174449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.174475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.713 qpair failed and we were unable to recover it. 00:31:00.713 [2024-11-28 23:23:04.174594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.174689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.713 [2024-11-28 23:23:04.174721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.713 qpair failed and we were unable to recover it. 00:31:00.714 [2024-11-28 23:23:04.174846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.174929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.174955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.714 qpair failed and we were unable to recover it. 00:31:00.714 [2024-11-28 23:23:04.175041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.175168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.175194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.714 qpair failed and we were unable to recover it. 00:31:00.714 [2024-11-28 23:23:04.175278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.175400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.175426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.714 qpair failed and we were unable to recover it. 00:31:00.714 [2024-11-28 23:23:04.175547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.175640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.175666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.714 qpair failed and we were unable to recover it. 00:31:00.714 [2024-11-28 23:23:04.175762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.175861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.175886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.714 qpair failed and we were unable to recover it. 00:31:00.714 [2024-11-28 23:23:04.175970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.176087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.176115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.714 qpair failed and we were unable to recover it. 00:31:00.714 [2024-11-28 23:23:04.176205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.176285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.176311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.714 qpair failed and we were unable to recover it. 00:31:00.714 [2024-11-28 23:23:04.176403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.176489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.176515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.714 qpair failed and we were unable to recover it. 00:31:00.714 [2024-11-28 23:23:04.176596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.176709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.176734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.714 qpair failed and we were unable to recover it. 00:31:00.714 [2024-11-28 23:23:04.176823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.176907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.176933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.714 qpair failed and we were unable to recover it. 00:31:00.714 [2024-11-28 23:23:04.177015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.177142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.177167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.714 qpair failed and we were unable to recover it. 00:31:00.714 [2024-11-28 23:23:04.177251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.177335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.177360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.714 qpair failed and we were unable to recover it. 00:31:00.714 [2024-11-28 23:23:04.177462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.177558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.177583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.714 qpair failed and we were unable to recover it. 00:31:00.714 [2024-11-28 23:23:04.177664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.177776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.177803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.714 qpair failed and we were unable to recover it. 00:31:00.714 [2024-11-28 23:23:04.177923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.178011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.178038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.714 qpair failed and we were unable to recover it. 00:31:00.714 [2024-11-28 23:23:04.178141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.178229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.178255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.714 qpair failed and we were unable to recover it. 00:31:00.714 [2024-11-28 23:23:04.178346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.178436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.178463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.714 qpair failed and we were unable to recover it. 00:31:00.714 [2024-11-28 23:23:04.178584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.178664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.178689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.714 qpair failed and we were unable to recover it. 00:31:00.714 [2024-11-28 23:23:04.178779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.178892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.178918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.714 qpair failed and we were unable to recover it. 00:31:00.714 [2024-11-28 23:23:04.179033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.179119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.179144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.714 qpair failed and we were unable to recover it. 00:31:00.714 [2024-11-28 23:23:04.179223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.179318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.179343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.714 qpair failed and we were unable to recover it. 00:31:00.714 [2024-11-28 23:23:04.179428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.179509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.179534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.714 qpair failed and we were unable to recover it. 00:31:00.714 [2024-11-28 23:23:04.179655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.179744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.179771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.714 qpair failed and we were unable to recover it. 00:31:00.714 [2024-11-28 23:23:04.179853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.179938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.179964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.714 qpair failed and we were unable to recover it. 00:31:00.714 [2024-11-28 23:23:04.180049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.180132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.180163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.714 qpair failed and we were unable to recover it. 00:31:00.714 [2024-11-28 23:23:04.180262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.180348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.180375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.714 qpair failed and we were unable to recover it. 00:31:00.714 [2024-11-28 23:23:04.180474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 Malloc0 00:31:00.714 [2024-11-28 23:23:04.180617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.180646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.714 qpair failed and we were unable to recover it. 00:31:00.714 [2024-11-28 23:23:04.180741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.180820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.180846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.714 qpair failed and we were unable to recover it. 00:31:00.714 [2024-11-28 23:23:04.180928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 23:23:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:00.714 [2024-11-28 23:23:04.181044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.181070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.714 qpair failed and we were unable to recover it. 00:31:00.714 [2024-11-28 23:23:04.181149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 23:23:04 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:31:00.714 [2024-11-28 23:23:04.181263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 [2024-11-28 23:23:04.181288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.714 qpair failed and we were unable to recover it. 00:31:00.714 23:23:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:00.714 [2024-11-28 23:23:04.181387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.714 23:23:04 -- common/autotest_common.sh@10 -- # set +x 00:31:00.714 [2024-11-28 23:23:04.181476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.181502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.715 qpair failed and we were unable to recover it. 00:31:00.715 [2024-11-28 23:23:04.181597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.181719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.181744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.715 qpair failed and we were unable to recover it. 00:31:00.715 [2024-11-28 23:23:04.181834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.181925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.181951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.715 qpair failed and we were unable to recover it. 00:31:00.715 [2024-11-28 23:23:04.182037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.182160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.182185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.715 qpair failed and we were unable to recover it. 00:31:00.715 [2024-11-28 23:23:04.182288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.182379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.182410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.715 qpair failed and we were unable to recover it. 00:31:00.715 [2024-11-28 23:23:04.182507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.182601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.182627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.715 qpair failed and we were unable to recover it. 00:31:00.715 [2024-11-28 23:23:04.182725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.182839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.182864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.715 qpair failed and we were unable to recover it. 00:31:00.715 [2024-11-28 23:23:04.182951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.183039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.183065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.715 qpair failed and we were unable to recover it. 00:31:00.715 [2024-11-28 23:23:04.183157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.183272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.183298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.715 qpair failed and we were unable to recover it. 00:31:00.715 [2024-11-28 23:23:04.183391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.183489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.183514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.715 qpair failed and we were unable to recover it. 00:31:00.715 [2024-11-28 23:23:04.183599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.183689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.183715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.715 qpair failed and we were unable to recover it. 00:31:00.715 [2024-11-28 23:23:04.183844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.183927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.183953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.715 qpair failed and we were unable to recover it. 00:31:00.715 [2024-11-28 23:23:04.184045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.184127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.184153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.715 qpair failed and we were unable to recover it. 00:31:00.715 [2024-11-28 23:23:04.184236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.184296] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:00.715 [2024-11-28 23:23:04.184333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.184361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.715 qpair failed and we were unable to recover it. 00:31:00.715 [2024-11-28 23:23:04.184473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.184581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.184604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.715 qpair failed and we were unable to recover it. 00:31:00.715 [2024-11-28 23:23:04.184700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.184787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.184812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.715 qpair failed and we were unable to recover it. 00:31:00.715 [2024-11-28 23:23:04.184897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.184982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.185007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.715 qpair failed and we were unable to recover it. 00:31:00.715 [2024-11-28 23:23:04.185122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.185248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.185273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.715 qpair failed and we were unable to recover it. 00:31:00.715 [2024-11-28 23:23:04.185361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.185467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.185494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.715 qpair failed and we were unable to recover it. 00:31:00.715 [2024-11-28 23:23:04.185591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.185683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.185708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.715 qpair failed and we were unable to recover it. 00:31:00.715 [2024-11-28 23:23:04.185792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.185908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.185933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.715 qpair failed and we were unable to recover it. 00:31:00.715 [2024-11-28 23:23:04.186046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.186130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.186156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.715 qpair failed and we were unable to recover it. 00:31:00.715 [2024-11-28 23:23:04.186248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.186333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.186358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.715 qpair failed and we were unable to recover it. 00:31:00.715 [2024-11-28 23:23:04.186481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.186574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.186599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.715 qpair failed and we were unable to recover it. 00:31:00.715 [2024-11-28 23:23:04.186690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.186793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.186819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.715 qpair failed and we were unable to recover it. 00:31:00.715 [2024-11-28 23:23:04.186908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.186994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.187021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.715 qpair failed and we were unable to recover it. 00:31:00.715 [2024-11-28 23:23:04.187100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.187226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.187251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.715 qpair failed and we were unable to recover it. 00:31:00.715 [2024-11-28 23:23:04.187369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.715 [2024-11-28 23:23:04.187485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.716 [2024-11-28 23:23:04.187512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.716 qpair failed and we were unable to recover it. 00:31:00.716 [2024-11-28 23:23:04.187604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.716 [2024-11-28 23:23:04.187692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.716 [2024-11-28 23:23:04.187717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.716 qpair failed and we were unable to recover it. 00:31:00.716 [2024-11-28 23:23:04.187828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.716 [2024-11-28 23:23:04.187912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.716 [2024-11-28 23:23:04.187938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.716 qpair failed and we were unable to recover it. 00:31:00.716 [2024-11-28 23:23:04.188024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.716 [2024-11-28 23:23:04.188111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.716 [2024-11-28 23:23:04.188136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.716 qpair failed and we were unable to recover it. 00:31:00.716 [2024-11-28 23:23:04.188257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.716 [2024-11-28 23:23:04.188334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.716 [2024-11-28 23:23:04.188360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.716 qpair failed and we were unable to recover it. 00:31:00.716 [2024-11-28 23:23:04.188446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.716 [2024-11-28 23:23:04.188538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.716 [2024-11-28 23:23:04.188563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.716 qpair failed and we were unable to recover it. 00:31:00.716 [2024-11-28 23:23:04.188682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.716 [2024-11-28 23:23:04.188779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.716 [2024-11-28 23:23:04.188804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.716 qpair failed and we were unable to recover it. 00:31:00.716 [2024-11-28 23:23:04.188896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.716 [2024-11-28 23:23:04.188985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.716 [2024-11-28 23:23:04.189009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.716 qpair failed and we were unable to recover it. 00:31:00.716 [2024-11-28 23:23:04.189096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.716 [2024-11-28 23:23:04.189217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.716 [2024-11-28 23:23:04.189242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.716 qpair failed and we were unable to recover it. 00:31:00.716 [2024-11-28 23:23:04.189329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.716 [2024-11-28 23:23:04.189443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.716 [2024-11-28 23:23:04.189470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.716 qpair failed and we were unable to recover it. 00:31:00.716 [2024-11-28 23:23:04.189565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.716 [2024-11-28 23:23:04.189647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.716 [2024-11-28 23:23:04.189672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.716 qpair failed and we were unable to recover it. 00:31:00.716 [2024-11-28 23:23:04.189768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.716 [2024-11-28 23:23:04.189850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.716 [2024-11-28 23:23:04.189874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.716 qpair failed and we were unable to recover it. 00:31:00.716 [2024-11-28 23:23:04.189958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.716 [2024-11-28 23:23:04.190037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.716 [2024-11-28 23:23:04.190061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.716 qpair failed and we were unable to recover it. 00:31:00.716 [2024-11-28 23:23:04.190155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.716 [2024-11-28 23:23:04.190235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.716 [2024-11-28 23:23:04.190261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.716 qpair failed and we were unable to recover it. 00:31:00.716 [2024-11-28 23:23:04.190344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.716 [2024-11-28 23:23:04.190464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.716 [2024-11-28 23:23:04.190490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.716 qpair failed and we were unable to recover it. 00:31:00.716 [2024-11-28 23:23:04.190576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.716 [2024-11-28 23:23:04.190654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.716 [2024-11-28 23:23:04.190678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.716 qpair failed and we were unable to recover it. 00:31:00.716 [2024-11-28 23:23:04.190784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.716 [2024-11-28 23:23:04.190876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.716 [2024-11-28 23:23:04.190902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.716 qpair failed and we were unable to recover it. 00:31:00.716 [2024-11-28 23:23:04.190997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.716 [2024-11-28 23:23:04.191138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.716 [2024-11-28 23:23:04.191163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.716 qpair failed and we were unable to recover it. 00:31:00.716 [2024-11-28 23:23:04.191247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.716 [2024-11-28 23:23:04.191353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.716 [2024-11-28 23:23:04.191379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.716 qpair failed and we were unable to recover it. 00:31:00.716 [2024-11-28 23:23:04.191513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.716 [2024-11-28 23:23:04.191599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.191623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.717 qpair failed and we were unable to recover it. 00:31:00.717 [2024-11-28 23:23:04.191704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.191852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.191877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.717 qpair failed and we were unable to recover it. 00:31:00.717 [2024-11-28 23:23:04.191961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.192040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.192065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.717 qpair failed and we were unable to recover it. 00:31:00.717 [2024-11-28 23:23:04.192184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.192295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.192320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.717 qpair failed and we were unable to recover it. 00:31:00.717 [2024-11-28 23:23:04.192440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 23:23:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:00.717 [2024-11-28 23:23:04.192528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.192553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.717 qpair failed and we were unable to recover it. 00:31:00.717 23:23:04 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:31:00.717 [2024-11-28 23:23:04.192651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 23:23:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:00.717 [2024-11-28 23:23:04.192780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.192805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.717 qpair failed and we were unable to recover it. 00:31:00.717 23:23:04 -- common/autotest_common.sh@10 -- # set +x 00:31:00.717 [2024-11-28 23:23:04.192887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.192983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.193008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.717 qpair failed and we were unable to recover it. 00:31:00.717 [2024-11-28 23:23:04.193104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.193190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.193215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.717 qpair failed and we were unable to recover it. 00:31:00.717 [2024-11-28 23:23:04.193303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.193413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.193439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.717 qpair failed and we were unable to recover it. 00:31:00.717 [2024-11-28 23:23:04.193537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.193650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.193676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.717 qpair failed and we were unable to recover it. 00:31:00.717 [2024-11-28 23:23:04.193778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.193867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.193893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.717 qpair failed and we were unable to recover it. 00:31:00.717 [2024-11-28 23:23:04.194002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.194085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.194110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.717 qpair failed and we were unable to recover it. 00:31:00.717 [2024-11-28 23:23:04.194197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.194335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.194359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.717 qpair failed and we were unable to recover it. 00:31:00.717 [2024-11-28 23:23:04.194452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.194534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.194559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.717 qpair failed and we were unable to recover it. 00:31:00.717 [2024-11-28 23:23:04.194677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.194804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.194829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.717 qpair failed and we were unable to recover it. 00:31:00.717 [2024-11-28 23:23:04.194943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.195032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.195058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.717 qpair failed and we were unable to recover it. 00:31:00.717 [2024-11-28 23:23:04.195177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.195287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.195312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.717 qpair failed and we were unable to recover it. 00:31:00.717 [2024-11-28 23:23:04.195441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.195537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.195563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.717 qpair failed and we were unable to recover it. 00:31:00.717 [2024-11-28 23:23:04.195667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.195755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.195780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.717 qpair failed and we were unable to recover it. 00:31:00.717 [2024-11-28 23:23:04.195895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.195982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.196008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.717 qpair failed and we were unable to recover it. 00:31:00.717 [2024-11-28 23:23:04.196099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.196214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.196239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.717 qpair failed and we were unable to recover it. 00:31:00.717 [2024-11-28 23:23:04.196331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.196417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.196443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.717 qpair failed and we were unable to recover it. 00:31:00.717 [2024-11-28 23:23:04.196535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.196619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.196645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.717 qpair failed and we were unable to recover it. 00:31:00.717 [2024-11-28 23:23:04.196734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.196816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.196841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.717 qpair failed and we were unable to recover it. 00:31:00.717 [2024-11-28 23:23:04.196957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.197070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.197094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.717 qpair failed and we were unable to recover it. 00:31:00.717 [2024-11-28 23:23:04.197183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.197262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.197287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.717 qpair failed and we were unable to recover it. 00:31:00.717 [2024-11-28 23:23:04.197375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.197565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.197590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.717 qpair failed and we were unable to recover it. 00:31:00.717 [2024-11-28 23:23:04.197683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.197806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.717 [2024-11-28 23:23:04.197831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.717 qpair failed and we were unable to recover it. 00:31:00.717 [2024-11-28 23:23:04.197922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.198005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.198030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.718 qpair failed and we were unable to recover it. 00:31:00.718 [2024-11-28 23:23:04.198115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.198195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.198220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.718 qpair failed and we were unable to recover it. 00:31:00.718 [2024-11-28 23:23:04.198308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.198405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.198433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.718 qpair failed and we were unable to recover it. 00:31:00.718 [2024-11-28 23:23:04.198517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.198597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.198623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.718 qpair failed and we were unable to recover it. 00:31:00.718 [2024-11-28 23:23:04.198708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.198791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.198816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.718 qpair failed and we were unable to recover it. 00:31:00.718 [2024-11-28 23:23:04.198902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.198980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.199005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.718 qpair failed and we were unable to recover it. 00:31:00.718 [2024-11-28 23:23:04.199149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.199236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.199261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.718 qpair failed and we were unable to recover it. 00:31:00.718 [2024-11-28 23:23:04.199350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.199481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.199507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.718 qpair failed and we were unable to recover it. 00:31:00.718 [2024-11-28 23:23:04.199596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.199721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.199745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.718 qpair failed and we were unable to recover it. 00:31:00.718 [2024-11-28 23:23:04.199830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.199918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.199943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.718 qpair failed and we were unable to recover it. 00:31:00.718 [2024-11-28 23:23:04.200028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.200117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.200141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.718 qpair failed and we were unable to recover it. 00:31:00.718 [2024-11-28 23:23:04.200238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.200334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.200359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.718 qpair failed and we were unable to recover it. 00:31:00.718 [2024-11-28 23:23:04.200476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.200564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.200590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.718 23:23:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:00.718 qpair failed and we were unable to recover it. 00:31:00.718 [2024-11-28 23:23:04.200677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 23:23:04 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:31:00.718 [2024-11-28 23:23:04.200768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.200794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.718 qpair failed and we were unable to recover it. 00:31:00.718 23:23:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:00.718 [2024-11-28 23:23:04.200889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 23:23:04 -- common/autotest_common.sh@10 -- # set +x 00:31:00.718 [2024-11-28 23:23:04.200988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.201013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.718 qpair failed and we were unable to recover it. 00:31:00.718 [2024-11-28 23:23:04.201096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.201177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.201202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.718 qpair failed and we were unable to recover it. 00:31:00.718 [2024-11-28 23:23:04.201288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.201384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.201416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.718 qpair failed and we were unable to recover it. 00:31:00.718 [2024-11-28 23:23:04.201507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.201589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.201615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.718 qpair failed and we were unable to recover it. 00:31:00.718 [2024-11-28 23:23:04.201701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.201818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.201844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.718 qpair failed and we were unable to recover it. 00:31:00.718 [2024-11-28 23:23:04.201929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.202015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.202039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.718 qpair failed and we were unable to recover it. 00:31:00.718 [2024-11-28 23:23:04.202161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.202268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.202292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.718 qpair failed and we were unable to recover it. 00:31:00.718 [2024-11-28 23:23:04.202379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.202497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.202522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.718 qpair failed and we were unable to recover it. 00:31:00.718 [2024-11-28 23:23:04.202613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.202700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.202727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.718 qpair failed and we were unable to recover it. 00:31:00.718 [2024-11-28 23:23:04.202818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.202907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.202933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.718 qpair failed and we were unable to recover it. 00:31:00.718 [2024-11-28 23:23:04.203021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.203096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.203122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.718 qpair failed and we were unable to recover it. 00:31:00.718 [2024-11-28 23:23:04.203239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.203331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.203356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.718 qpair failed and we were unable to recover it. 00:31:00.718 [2024-11-28 23:23:04.203443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.203529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.203553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.718 qpair failed and we were unable to recover it. 00:31:00.718 [2024-11-28 23:23:04.203631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.203737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.718 [2024-11-28 23:23:04.203762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.718 qpair failed and we were unable to recover it. 00:31:00.719 [2024-11-28 23:23:04.203886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.203966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.203991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.719 qpair failed and we were unable to recover it. 00:31:00.719 [2024-11-28 23:23:04.204089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.204176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.204201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.719 qpair failed and we were unable to recover it. 00:31:00.719 [2024-11-28 23:23:04.204317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.204407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.204433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.719 qpair failed and we were unable to recover it. 00:31:00.719 [2024-11-28 23:23:04.204526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.204615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.204641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.719 qpair failed and we were unable to recover it. 00:31:00.719 [2024-11-28 23:23:04.204762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.204878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.204904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.719 qpair failed and we were unable to recover it. 00:31:00.719 [2024-11-28 23:23:04.205019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.205109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.205135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.719 qpair failed and we were unable to recover it. 00:31:00.719 [2024-11-28 23:23:04.205223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.205329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.205354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.719 qpair failed and we were unable to recover it. 00:31:00.719 [2024-11-28 23:23:04.205452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.205541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.205565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.719 qpair failed and we were unable to recover it. 00:31:00.719 [2024-11-28 23:23:04.205656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.205772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.205797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.719 qpair failed and we were unable to recover it. 00:31:00.719 [2024-11-28 23:23:04.205882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.205971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.205997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.719 qpair failed and we were unable to recover it. 00:31:00.719 [2024-11-28 23:23:04.206083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.206165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.206191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.719 qpair failed and we were unable to recover it. 00:31:00.719 [2024-11-28 23:23:04.206281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.206361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.206385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.719 qpair failed and we were unable to recover it. 00:31:00.719 [2024-11-28 23:23:04.206514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.206604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.206629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.719 qpair failed and we were unable to recover it. 00:31:00.719 [2024-11-28 23:23:04.206745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.206826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.206851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.719 qpair failed and we were unable to recover it. 00:31:00.719 [2024-11-28 23:23:04.206962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.207076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.207101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.719 qpair failed and we were unable to recover it. 00:31:00.719 [2024-11-28 23:23:04.207180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.207289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.207314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.719 qpair failed and we were unable to recover it. 00:31:00.719 [2024-11-28 23:23:04.207404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.207490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.207516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.719 qpair failed and we were unable to recover it. 00:31:00.719 [2024-11-28 23:23:04.207630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.207741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.207767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.719 qpair failed and we were unable to recover it. 00:31:00.719 [2024-11-28 23:23:04.207851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.207932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.207958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.719 qpair failed and we were unable to recover it. 00:31:00.719 [2024-11-28 23:23:04.208069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.208148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.208173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.719 qpair failed and we were unable to recover it. 00:31:00.719 [2024-11-28 23:23:04.208264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.208378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.208410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.719 qpair failed and we were unable to recover it. 00:31:00.719 [2024-11-28 23:23:04.208555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 23:23:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:00.719 [2024-11-28 23:23:04.208641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.208667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.719 qpair failed and we were unable to recover it. 00:31:00.719 23:23:04 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:00.719 [2024-11-28 23:23:04.208758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.208845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.208870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.719 23:23:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:00.719 qpair failed and we were unable to recover it. 00:31:00.719 [2024-11-28 23:23:04.208967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 23:23:04 -- common/autotest_common.sh@10 -- # set +x 00:31:00.719 [2024-11-28 23:23:04.209055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.209080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.719 qpair failed and we were unable to recover it. 00:31:00.719 [2024-11-28 23:23:04.209162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.209248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.209273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.719 qpair failed and we were unable to recover it. 00:31:00.719 [2024-11-28 23:23:04.209363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.209492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.209518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.719 qpair failed and we were unable to recover it. 00:31:00.719 [2024-11-28 23:23:04.209620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.209712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.209737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.719 qpair failed and we were unable to recover it. 00:31:00.719 [2024-11-28 23:23:04.209826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.209903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.719 [2024-11-28 23:23:04.209928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.719 qpair failed and we were unable to recover it. 00:31:00.720 [2024-11-28 23:23:04.210050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.720 [2024-11-28 23:23:04.210129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.720 [2024-11-28 23:23:04.210155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.720 qpair failed and we were unable to recover it. 00:31:00.720 [2024-11-28 23:23:04.210272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.720 [2024-11-28 23:23:04.210349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.720 [2024-11-28 23:23:04.210374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa68000b90 with addr=10.0.0.2, port=4420 00:31:00.720 qpair failed and we were unable to recover it. 00:31:00.720 [2024-11-28 23:23:04.210507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.720 [2024-11-28 23:23:04.210616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.720 [2024-11-28 23:23:04.210646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa60000b90 with addr=10.0.0.2, port=4420 00:31:00.720 qpair failed and we were unable to recover it. 00:31:00.720 [2024-11-28 23:23:04.210790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.720 [2024-11-28 23:23:04.210894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.720 [2024-11-28 23:23:04.210924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:31:00.720 qpair failed and we were unable to recover it. 00:31:00.720 [2024-11-28 23:23:04.211051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.720 [2024-11-28 23:23:04.211133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.720 [2024-11-28 23:23:04.211159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:31:00.720 qpair failed and we were unable to recover it. 00:31:00.720 [2024-11-28 23:23:04.211245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.720 [2024-11-28 23:23:04.211331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.720 [2024-11-28 23:23:04.211357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:31:00.720 qpair failed and we were unable to recover it. 00:31:00.720 [2024-11-28 23:23:04.211458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.720 [2024-11-28 23:23:04.211551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.720 [2024-11-28 23:23:04.211578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:31:00.720 qpair failed and we were unable to recover it. 00:31:00.720 [2024-11-28 23:23:04.211672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.720 [2024-11-28 23:23:04.211751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.720 [2024-11-28 23:23:04.211777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:31:00.720 qpair failed and we were unable to recover it. 00:31:00.720 [2024-11-28 23:23:04.211864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.720 [2024-11-28 23:23:04.211984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.720 [2024-11-28 23:23:04.212010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:31:00.720 qpair failed and we were unable to recover it. 00:31:00.720 [2024-11-28 23:23:04.212095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.720 [2024-11-28 23:23:04.212217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.720 [2024-11-28 23:23:04.212243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:31:00.720 qpair failed and we were unable to recover it. 00:31:00.720 [2024-11-28 23:23:04.212337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.720 [2024-11-28 23:23:04.212432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.720 [2024-11-28 23:23:04.212460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa5c000b90 with addr=10.0.0.2, port=4420 00:31:00.720 qpair failed and we were unable to recover it. 00:31:00.720 [2024-11-28 23:23:04.212551] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:00.720 [2024-11-28 23:23:04.215059] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:00.720 [2024-11-28 23:23:04.215210] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:00.720 [2024-11-28 23:23:04.215238] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:00.720 [2024-11-28 23:23:04.215260] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:00.720 [2024-11-28 23:23:04.215274] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:00.720 [2024-11-28 23:23:04.215311] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:00.720 qpair failed and we were unable to recover it. 00:31:00.720 23:23:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:00.720 23:23:04 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:31:00.720 23:23:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:00.720 23:23:04 -- common/autotest_common.sh@10 -- # set +x 00:31:00.720 23:23:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:00.720 [2024-11-28 23:23:04.224831] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:00.720 23:23:04 -- host/target_disconnect.sh@58 -- # wait 2582554 00:31:00.720 [2024-11-28 23:23:04.224929] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:00.720 [2024-11-28 23:23:04.224956] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:00.720 [2024-11-28 23:23:04.224971] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:00.720 [2024-11-28 23:23:04.224985] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:00.720 [2024-11-28 23:23:04.225015] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:00.720 qpair failed and we were unable to recover it. 00:31:00.720 [2024-11-28 23:23:04.234890] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:00.720 [2024-11-28 23:23:04.234981] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:00.720 [2024-11-28 23:23:04.235012] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:00.720 [2024-11-28 23:23:04.235028] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:00.720 [2024-11-28 23:23:04.235041] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:00.720 [2024-11-28 23:23:04.235072] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:00.720 qpair failed and we were unable to recover it. 00:31:00.980 [2024-11-28 23:23:04.244883] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:00.980 [2024-11-28 23:23:04.244982] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:00.980 [2024-11-28 23:23:04.245009] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:00.980 [2024-11-28 23:23:04.245024] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:00.980 [2024-11-28 23:23:04.245037] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:00.980 [2024-11-28 23:23:04.245081] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:00.980 qpair failed and we were unable to recover it. 00:31:00.980 [2024-11-28 23:23:04.254952] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:00.980 [2024-11-28 23:23:04.255091] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:00.980 [2024-11-28 23:23:04.255117] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:00.980 [2024-11-28 23:23:04.255138] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:00.980 [2024-11-28 23:23:04.255153] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:00.980 [2024-11-28 23:23:04.255184] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:00.980 qpair failed and we were unable to recover it. 00:31:00.980 [2024-11-28 23:23:04.264997] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:00.980 [2024-11-28 23:23:04.265090] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:00.980 [2024-11-28 23:23:04.265121] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:00.980 [2024-11-28 23:23:04.265136] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:00.980 [2024-11-28 23:23:04.265149] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:00.980 [2024-11-28 23:23:04.265180] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:00.980 qpair failed and we were unable to recover it. 00:31:00.980 [2024-11-28 23:23:04.275007] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:00.980 [2024-11-28 23:23:04.275099] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:00.980 [2024-11-28 23:23:04.275126] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:00.980 [2024-11-28 23:23:04.275140] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:00.980 [2024-11-28 23:23:04.275153] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:00.980 [2024-11-28 23:23:04.275184] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:00.980 qpair failed and we were unable to recover it. 00:31:00.980 [2024-11-28 23:23:04.284905] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:00.980 [2024-11-28 23:23:04.285002] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:00.980 [2024-11-28 23:23:04.285028] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:00.980 [2024-11-28 23:23:04.285043] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:00.980 [2024-11-28 23:23:04.285056] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:00.980 [2024-11-28 23:23:04.285087] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:00.980 qpair failed and we were unable to recover it. 00:31:00.980 [2024-11-28 23:23:04.294941] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:00.980 [2024-11-28 23:23:04.295034] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:00.980 [2024-11-28 23:23:04.295060] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:00.980 [2024-11-28 23:23:04.295074] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:00.980 [2024-11-28 23:23:04.295087] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:00.980 [2024-11-28 23:23:04.295132] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:00.980 qpair failed and we were unable to recover it. 00:31:00.980 [2024-11-28 23:23:04.304983] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:00.980 [2024-11-28 23:23:04.305074] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:00.980 [2024-11-28 23:23:04.305100] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:00.980 [2024-11-28 23:23:04.305115] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:00.980 [2024-11-28 23:23:04.305128] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:00.980 [2024-11-28 23:23:04.305158] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:00.980 qpair failed and we were unable to recover it. 00:31:00.980 [2024-11-28 23:23:04.315095] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:00.980 [2024-11-28 23:23:04.315180] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:00.980 [2024-11-28 23:23:04.315206] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:00.980 [2024-11-28 23:23:04.315221] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:00.980 [2024-11-28 23:23:04.315234] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:00.980 [2024-11-28 23:23:04.315265] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:00.980 qpair failed and we were unable to recover it. 00:31:00.980 [2024-11-28 23:23:04.325121] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:00.980 [2024-11-28 23:23:04.325214] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:00.980 [2024-11-28 23:23:04.325239] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:00.981 [2024-11-28 23:23:04.325253] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:00.981 [2024-11-28 23:23:04.325266] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:00.981 [2024-11-28 23:23:04.325297] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:00.981 qpair failed and we were unable to recover it. 00:31:00.981 [2024-11-28 23:23:04.335063] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:00.981 [2024-11-28 23:23:04.335159] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:00.981 [2024-11-28 23:23:04.335185] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:00.981 [2024-11-28 23:23:04.335199] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:00.981 [2024-11-28 23:23:04.335212] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:00.981 [2024-11-28 23:23:04.335242] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:00.981 qpair failed and we were unable to recover it. 00:31:00.981 [2024-11-28 23:23:04.345801] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:00.981 [2024-11-28 23:23:04.345901] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:00.981 [2024-11-28 23:23:04.345932] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:00.981 [2024-11-28 23:23:04.345947] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:00.981 [2024-11-28 23:23:04.345960] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:00.981 [2024-11-28 23:23:04.345990] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:00.981 qpair failed and we were unable to recover it. 00:31:00.981 [2024-11-28 23:23:04.355245] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:00.981 [2024-11-28 23:23:04.355338] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:00.981 [2024-11-28 23:23:04.355365] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:00.981 [2024-11-28 23:23:04.355379] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:00.981 [2024-11-28 23:23:04.355399] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:00.981 [2024-11-28 23:23:04.355432] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:00.981 qpair failed and we were unable to recover it. 00:31:00.981 [2024-11-28 23:23:04.365224] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:00.981 [2024-11-28 23:23:04.365324] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:00.981 [2024-11-28 23:23:04.365349] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:00.981 [2024-11-28 23:23:04.365363] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:00.981 [2024-11-28 23:23:04.365376] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:00.981 [2024-11-28 23:23:04.365413] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:00.981 qpair failed and we were unable to recover it. 00:31:00.981 [2024-11-28 23:23:04.375247] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:00.981 [2024-11-28 23:23:04.375349] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:00.981 [2024-11-28 23:23:04.375375] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:00.981 [2024-11-28 23:23:04.375389] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:00.981 [2024-11-28 23:23:04.375413] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:00.981 [2024-11-28 23:23:04.375444] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:00.981 qpair failed and we were unable to recover it. 00:31:00.981 [2024-11-28 23:23:04.385220] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:00.981 [2024-11-28 23:23:04.385317] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:00.981 [2024-11-28 23:23:04.385347] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:00.981 [2024-11-28 23:23:04.385363] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:00.981 [2024-11-28 23:23:04.385376] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:00.981 [2024-11-28 23:23:04.385426] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:00.981 qpair failed and we were unable to recover it. 00:31:00.981 [2024-11-28 23:23:04.395256] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:00.981 [2024-11-28 23:23:04.395342] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:00.981 [2024-11-28 23:23:04.395371] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:00.981 [2024-11-28 23:23:04.395386] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:00.981 [2024-11-28 23:23:04.395407] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:00.981 [2024-11-28 23:23:04.395438] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:00.981 qpair failed and we were unable to recover it. 00:31:00.981 [2024-11-28 23:23:04.405307] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:00.981 [2024-11-28 23:23:04.405408] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:00.981 [2024-11-28 23:23:04.405434] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:00.981 [2024-11-28 23:23:04.405448] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:00.981 [2024-11-28 23:23:04.405460] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:00.981 [2024-11-28 23:23:04.405491] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:00.981 qpair failed and we were unable to recover it. 00:31:00.981 [2024-11-28 23:23:04.415302] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:00.981 [2024-11-28 23:23:04.415399] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:00.981 [2024-11-28 23:23:04.415426] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:00.981 [2024-11-28 23:23:04.415440] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:00.981 [2024-11-28 23:23:04.415453] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:00.981 [2024-11-28 23:23:04.415484] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:00.981 qpair failed and we were unable to recover it. 00:31:00.981 [2024-11-28 23:23:04.425319] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:00.981 [2024-11-28 23:23:04.425426] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:00.981 [2024-11-28 23:23:04.425452] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:00.981 [2024-11-28 23:23:04.425468] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:00.981 [2024-11-28 23:23:04.425481] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:00.981 [2024-11-28 23:23:04.425513] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:00.981 qpair failed and we were unable to recover it. 00:31:00.981 [2024-11-28 23:23:04.435360] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:00.981 [2024-11-28 23:23:04.435456] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:00.981 [2024-11-28 23:23:04.435487] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:00.981 [2024-11-28 23:23:04.435503] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:00.981 [2024-11-28 23:23:04.435515] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:00.981 [2024-11-28 23:23:04.435548] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:00.981 qpair failed and we were unable to recover it. 00:31:00.981 [2024-11-28 23:23:04.445421] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:00.981 [2024-11-28 23:23:04.445515] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:00.981 [2024-11-28 23:23:04.445542] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:00.981 [2024-11-28 23:23:04.445557] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:00.981 [2024-11-28 23:23:04.445570] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:00.981 [2024-11-28 23:23:04.445614] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:00.981 qpair failed and we were unable to recover it. 00:31:00.981 [2024-11-28 23:23:04.455434] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:00.981 [2024-11-28 23:23:04.455541] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:00.981 [2024-11-28 23:23:04.455568] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:00.981 [2024-11-28 23:23:04.455582] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:00.981 [2024-11-28 23:23:04.455595] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:00.981 [2024-11-28 23:23:04.455625] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:00.981 qpair failed and we were unable to recover it. 00:31:00.982 [2024-11-28 23:23:04.465457] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:00.982 [2024-11-28 23:23:04.465546] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:00.982 [2024-11-28 23:23:04.465572] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:00.982 [2024-11-28 23:23:04.465586] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:00.982 [2024-11-28 23:23:04.465599] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:00.982 [2024-11-28 23:23:04.465629] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:00.982 qpair failed and we were unable to recover it. 00:31:00.982 [2024-11-28 23:23:04.475496] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:00.982 [2024-11-28 23:23:04.475580] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:00.982 [2024-11-28 23:23:04.475606] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:00.982 [2024-11-28 23:23:04.475620] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:00.982 [2024-11-28 23:23:04.475638] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:00.982 [2024-11-28 23:23:04.475670] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:00.982 qpair failed and we were unable to recover it. 00:31:00.982 [2024-11-28 23:23:04.485523] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:00.982 [2024-11-28 23:23:04.485609] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:00.982 [2024-11-28 23:23:04.485635] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:00.982 [2024-11-28 23:23:04.485649] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:00.982 [2024-11-28 23:23:04.485662] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:00.982 [2024-11-28 23:23:04.485693] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:00.982 qpair failed and we were unable to recover it. 00:31:00.982 [2024-11-28 23:23:04.495530] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:00.982 [2024-11-28 23:23:04.495624] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:00.982 [2024-11-28 23:23:04.495650] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:00.982 [2024-11-28 23:23:04.495664] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:00.982 [2024-11-28 23:23:04.495677] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:00.982 [2024-11-28 23:23:04.495707] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:00.982 qpair failed and we were unable to recover it. 00:31:00.982 [2024-11-28 23:23:04.505574] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:00.982 [2024-11-28 23:23:04.505673] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:00.982 [2024-11-28 23:23:04.505699] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:00.982 [2024-11-28 23:23:04.505714] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:00.982 [2024-11-28 23:23:04.505727] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:00.982 [2024-11-28 23:23:04.505756] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:00.982 qpair failed and we were unable to recover it. 00:31:00.982 [2024-11-28 23:23:04.515666] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:00.982 [2024-11-28 23:23:04.515752] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:00.982 [2024-11-28 23:23:04.515778] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:00.982 [2024-11-28 23:23:04.515792] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:00.982 [2024-11-28 23:23:04.515805] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:00.982 [2024-11-28 23:23:04.515836] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:00.982 qpair failed and we were unable to recover it. 00:31:00.982 [2024-11-28 23:23:04.525660] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:00.982 [2024-11-28 23:23:04.525768] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:00.982 [2024-11-28 23:23:04.525795] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:00.982 [2024-11-28 23:23:04.525810] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:00.982 [2024-11-28 23:23:04.525823] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:00.982 [2024-11-28 23:23:04.525853] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:00.982 qpair failed and we were unable to recover it. 00:31:00.982 [2024-11-28 23:23:04.535637] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:00.982 [2024-11-28 23:23:04.535746] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:00.982 [2024-11-28 23:23:04.535772] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:00.982 [2024-11-28 23:23:04.535786] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:00.982 [2024-11-28 23:23:04.535799] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:00.982 [2024-11-28 23:23:04.535829] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:00.982 qpair failed and we were unable to recover it. 00:31:00.982 [2024-11-28 23:23:04.545737] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:00.982 [2024-11-28 23:23:04.545850] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:00.982 [2024-11-28 23:23:04.545876] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:00.982 [2024-11-28 23:23:04.545890] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:00.982 [2024-11-28 23:23:04.545904] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:00.982 [2024-11-28 23:23:04.545935] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:00.982 qpair failed and we were unable to recover it. 00:31:00.982 [2024-11-28 23:23:04.555849] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:00.982 [2024-11-28 23:23:04.555935] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:00.982 [2024-11-28 23:23:04.555962] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:00.982 [2024-11-28 23:23:04.555976] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:00.982 [2024-11-28 23:23:04.555989] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:00.982 [2024-11-28 23:23:04.556019] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:00.982 qpair failed and we were unable to recover it. 00:31:00.982 [2024-11-28 23:23:04.565860] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:00.982 [2024-11-28 23:23:04.565953] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:00.982 [2024-11-28 23:23:04.565979] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:00.982 [2024-11-28 23:23:04.565993] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:00.982 [2024-11-28 23:23:04.566012] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:00.982 [2024-11-28 23:23:04.566043] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:00.982 qpair failed and we were unable to recover it. 00:31:00.982 [2024-11-28 23:23:04.575801] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:00.982 [2024-11-28 23:23:04.575885] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:00.982 [2024-11-28 23:23:04.575911] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:00.982 [2024-11-28 23:23:04.575925] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:00.982 [2024-11-28 23:23:04.575938] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:00.982 [2024-11-28 23:23:04.575968] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:00.982 qpair failed and we were unable to recover it. 00:31:01.242 [2024-11-28 23:23:04.585786] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.242 [2024-11-28 23:23:04.585884] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.242 [2024-11-28 23:23:04.585910] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.242 [2024-11-28 23:23:04.585924] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.242 [2024-11-28 23:23:04.585937] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.242 [2024-11-28 23:23:04.585967] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.242 qpair failed and we were unable to recover it. 00:31:01.242 [2024-11-28 23:23:04.595873] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.242 [2024-11-28 23:23:04.595973] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.242 [2024-11-28 23:23:04.595999] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.242 [2024-11-28 23:23:04.596012] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.242 [2024-11-28 23:23:04.596025] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.242 [2024-11-28 23:23:04.596055] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.242 qpair failed and we were unable to recover it. 00:31:01.242 [2024-11-28 23:23:04.605912] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.242 [2024-11-28 23:23:04.606006] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.242 [2024-11-28 23:23:04.606031] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.242 [2024-11-28 23:23:04.606045] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.242 [2024-11-28 23:23:04.606059] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.243 [2024-11-28 23:23:04.606090] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.243 qpair failed and we were unable to recover it. 00:31:01.243 [2024-11-28 23:23:04.615936] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.243 [2024-11-28 23:23:04.616028] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.243 [2024-11-28 23:23:04.616055] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.243 [2024-11-28 23:23:04.616069] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.243 [2024-11-28 23:23:04.616082] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.243 [2024-11-28 23:23:04.616112] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.243 qpair failed and we were unable to recover it. 00:31:01.243 [2024-11-28 23:23:04.625970] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.243 [2024-11-28 23:23:04.626062] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.243 [2024-11-28 23:23:04.626090] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.243 [2024-11-28 23:23:04.626106] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.243 [2024-11-28 23:23:04.626119] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.243 [2024-11-28 23:23:04.626148] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.243 qpair failed and we were unable to recover it. 00:31:01.243 [2024-11-28 23:23:04.636076] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.243 [2024-11-28 23:23:04.636200] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.243 [2024-11-28 23:23:04.636227] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.243 [2024-11-28 23:23:04.636241] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.243 [2024-11-28 23:23:04.636253] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.243 [2024-11-28 23:23:04.636283] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.243 qpair failed and we were unable to recover it. 00:31:01.243 [2024-11-28 23:23:04.645996] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.243 [2024-11-28 23:23:04.646087] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.243 [2024-11-28 23:23:04.646113] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.243 [2024-11-28 23:23:04.646127] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.243 [2024-11-28 23:23:04.646140] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.243 [2024-11-28 23:23:04.646172] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.243 qpair failed and we were unable to recover it. 00:31:01.243 [2024-11-28 23:23:04.656023] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.243 [2024-11-28 23:23:04.656150] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.243 [2024-11-28 23:23:04.656175] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.243 [2024-11-28 23:23:04.656196] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.243 [2024-11-28 23:23:04.656209] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.243 [2024-11-28 23:23:04.656240] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.243 qpair failed and we were unable to recover it. 00:31:01.243 [2024-11-28 23:23:04.666068] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.243 [2024-11-28 23:23:04.666155] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.243 [2024-11-28 23:23:04.666180] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.243 [2024-11-28 23:23:04.666194] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.243 [2024-11-28 23:23:04.666207] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.243 [2024-11-28 23:23:04.666238] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.243 qpair failed and we were unable to recover it. 00:31:01.243 [2024-11-28 23:23:04.676083] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.243 [2024-11-28 23:23:04.676174] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.243 [2024-11-28 23:23:04.676200] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.243 [2024-11-28 23:23:04.676214] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.243 [2024-11-28 23:23:04.676227] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.243 [2024-11-28 23:23:04.676259] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.243 qpair failed and we were unable to recover it. 00:31:01.243 [2024-11-28 23:23:04.686146] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.243 [2024-11-28 23:23:04.686243] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.243 [2024-11-28 23:23:04.686269] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.243 [2024-11-28 23:23:04.686283] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.243 [2024-11-28 23:23:04.686297] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.243 [2024-11-28 23:23:04.686327] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.243 qpair failed and we were unable to recover it. 00:31:01.243 [2024-11-28 23:23:04.696145] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.243 [2024-11-28 23:23:04.696237] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.243 [2024-11-28 23:23:04.696263] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.243 [2024-11-28 23:23:04.696278] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.243 [2024-11-28 23:23:04.696291] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.243 [2024-11-28 23:23:04.696320] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.243 qpair failed and we were unable to recover it. 00:31:01.243 [2024-11-28 23:23:04.706178] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.243 [2024-11-28 23:23:04.706271] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.243 [2024-11-28 23:23:04.706297] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.243 [2024-11-28 23:23:04.706311] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.243 [2024-11-28 23:23:04.706324] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.243 [2024-11-28 23:23:04.706353] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.243 qpair failed and we were unable to recover it. 00:31:01.243 [2024-11-28 23:23:04.716196] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.243 [2024-11-28 23:23:04.716291] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.243 [2024-11-28 23:23:04.716317] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.243 [2024-11-28 23:23:04.716331] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.243 [2024-11-28 23:23:04.716344] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.243 [2024-11-28 23:23:04.716374] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.243 qpair failed and we were unable to recover it. 00:31:01.243 [2024-11-28 23:23:04.726283] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.243 [2024-11-28 23:23:04.726390] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.243 [2024-11-28 23:23:04.726423] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.243 [2024-11-28 23:23:04.726437] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.243 [2024-11-28 23:23:04.726450] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.243 [2024-11-28 23:23:04.726481] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.243 qpair failed and we were unable to recover it. 00:31:01.243 [2024-11-28 23:23:04.736351] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.243 [2024-11-28 23:23:04.736451] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.243 [2024-11-28 23:23:04.736477] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.243 [2024-11-28 23:23:04.736491] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.243 [2024-11-28 23:23:04.736504] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.243 [2024-11-28 23:23:04.736535] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.243 qpair failed and we were unable to recover it. 00:31:01.243 [2024-11-28 23:23:04.746289] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.244 [2024-11-28 23:23:04.746374] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.244 [2024-11-28 23:23:04.746411] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.244 [2024-11-28 23:23:04.746433] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.244 [2024-11-28 23:23:04.746447] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.244 [2024-11-28 23:23:04.746480] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.244 qpair failed and we were unable to recover it. 00:31:01.244 [2024-11-28 23:23:04.756298] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.244 [2024-11-28 23:23:04.756399] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.244 [2024-11-28 23:23:04.756425] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.244 [2024-11-28 23:23:04.756439] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.244 [2024-11-28 23:23:04.756452] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.244 [2024-11-28 23:23:04.756483] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.244 qpair failed and we were unable to recover it. 00:31:01.244 [2024-11-28 23:23:04.766426] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.244 [2024-11-28 23:23:04.766554] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.244 [2024-11-28 23:23:04.766580] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.244 [2024-11-28 23:23:04.766594] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.244 [2024-11-28 23:23:04.766607] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.244 [2024-11-28 23:23:04.766638] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.244 qpair failed and we were unable to recover it. 00:31:01.244 [2024-11-28 23:23:04.776459] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.244 [2024-11-28 23:23:04.776582] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.244 [2024-11-28 23:23:04.776608] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.244 [2024-11-28 23:23:04.776622] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.244 [2024-11-28 23:23:04.776634] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.244 [2024-11-28 23:23:04.776664] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.244 qpair failed and we were unable to recover it. 00:31:01.244 [2024-11-28 23:23:04.786445] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.244 [2024-11-28 23:23:04.786553] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.244 [2024-11-28 23:23:04.786578] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.244 [2024-11-28 23:23:04.786593] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.244 [2024-11-28 23:23:04.786606] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.244 [2024-11-28 23:23:04.786637] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.244 qpair failed and we were unable to recover it. 00:31:01.244 [2024-11-28 23:23:04.796428] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.244 [2024-11-28 23:23:04.796511] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.244 [2024-11-28 23:23:04.796536] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.244 [2024-11-28 23:23:04.796550] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.244 [2024-11-28 23:23:04.796563] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.244 [2024-11-28 23:23:04.796593] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.244 qpair failed and we were unable to recover it. 00:31:01.244 [2024-11-28 23:23:04.806513] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.244 [2024-11-28 23:23:04.806614] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.244 [2024-11-28 23:23:04.806640] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.244 [2024-11-28 23:23:04.806654] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.244 [2024-11-28 23:23:04.806667] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.244 [2024-11-28 23:23:04.806697] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.244 qpair failed and we were unable to recover it. 00:31:01.244 [2024-11-28 23:23:04.816490] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.244 [2024-11-28 23:23:04.816587] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.244 [2024-11-28 23:23:04.816613] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.244 [2024-11-28 23:23:04.816627] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.244 [2024-11-28 23:23:04.816640] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.244 [2024-11-28 23:23:04.816669] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.244 qpair failed and we were unable to recover it. 00:31:01.244 [2024-11-28 23:23:04.826512] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.244 [2024-11-28 23:23:04.826639] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.244 [2024-11-28 23:23:04.826665] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.244 [2024-11-28 23:23:04.826679] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.244 [2024-11-28 23:23:04.826691] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.244 [2024-11-28 23:23:04.826721] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.244 qpair failed and we were unable to recover it. 00:31:01.244 [2024-11-28 23:23:04.836535] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.244 [2024-11-28 23:23:04.836663] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.244 [2024-11-28 23:23:04.836694] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.244 [2024-11-28 23:23:04.836710] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.244 [2024-11-28 23:23:04.836724] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.244 [2024-11-28 23:23:04.836754] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.244 qpair failed and we were unable to recover it. 00:31:01.504 [2024-11-28 23:23:04.846576] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.504 [2024-11-28 23:23:04.846682] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.504 [2024-11-28 23:23:04.846708] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.504 [2024-11-28 23:23:04.846722] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.504 [2024-11-28 23:23:04.846735] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.504 [2024-11-28 23:23:04.846766] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.504 qpair failed and we were unable to recover it. 00:31:01.504 [2024-11-28 23:23:04.856655] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.504 [2024-11-28 23:23:04.856798] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.504 [2024-11-28 23:23:04.856824] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.504 [2024-11-28 23:23:04.856839] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.504 [2024-11-28 23:23:04.856852] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.504 [2024-11-28 23:23:04.856884] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.504 qpair failed and we were unable to recover it. 00:31:01.504 [2024-11-28 23:23:04.866628] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.504 [2024-11-28 23:23:04.866713] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.504 [2024-11-28 23:23:04.866739] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.504 [2024-11-28 23:23:04.866753] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.504 [2024-11-28 23:23:04.866766] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.505 [2024-11-28 23:23:04.866795] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.505 qpair failed and we were unable to recover it. 00:31:01.505 [2024-11-28 23:23:04.876689] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.505 [2024-11-28 23:23:04.876777] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.505 [2024-11-28 23:23:04.876803] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.505 [2024-11-28 23:23:04.876816] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.505 [2024-11-28 23:23:04.876829] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.505 [2024-11-28 23:23:04.876865] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.505 qpair failed and we were unable to recover it. 00:31:01.505 [2024-11-28 23:23:04.886690] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.505 [2024-11-28 23:23:04.886781] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.505 [2024-11-28 23:23:04.886806] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.505 [2024-11-28 23:23:04.886821] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.505 [2024-11-28 23:23:04.886834] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.505 [2024-11-28 23:23:04.886864] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.505 qpair failed and we were unable to recover it. 00:31:01.505 [2024-11-28 23:23:04.896806] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.505 [2024-11-28 23:23:04.896897] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.505 [2024-11-28 23:23:04.896923] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.505 [2024-11-28 23:23:04.896937] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.505 [2024-11-28 23:23:04.896950] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.505 [2024-11-28 23:23:04.896980] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.505 qpair failed and we were unable to recover it. 00:31:01.505 [2024-11-28 23:23:04.906739] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.505 [2024-11-28 23:23:04.906831] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.505 [2024-11-28 23:23:04.906857] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.505 [2024-11-28 23:23:04.906871] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.505 [2024-11-28 23:23:04.906884] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.505 [2024-11-28 23:23:04.906913] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.505 qpair failed and we were unable to recover it. 00:31:01.505 [2024-11-28 23:23:04.916762] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.505 [2024-11-28 23:23:04.916844] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.505 [2024-11-28 23:23:04.916870] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.505 [2024-11-28 23:23:04.916884] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.505 [2024-11-28 23:23:04.916897] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.505 [2024-11-28 23:23:04.916926] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.505 qpair failed and we were unable to recover it. 00:31:01.505 [2024-11-28 23:23:04.926815] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.505 [2024-11-28 23:23:04.926908] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.505 [2024-11-28 23:23:04.926939] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.505 [2024-11-28 23:23:04.926954] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.505 [2024-11-28 23:23:04.926967] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.505 [2024-11-28 23:23:04.926997] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.505 qpair failed and we were unable to recover it. 00:31:01.505 [2024-11-28 23:23:04.936836] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.505 [2024-11-28 23:23:04.936932] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.505 [2024-11-28 23:23:04.936957] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.505 [2024-11-28 23:23:04.936971] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.505 [2024-11-28 23:23:04.936984] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.505 [2024-11-28 23:23:04.937015] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.505 qpair failed and we were unable to recover it. 00:31:01.505 [2024-11-28 23:23:04.946867] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.505 [2024-11-28 23:23:04.946989] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.505 [2024-11-28 23:23:04.947014] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.505 [2024-11-28 23:23:04.947029] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.505 [2024-11-28 23:23:04.947042] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.505 [2024-11-28 23:23:04.947073] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.505 qpair failed and we were unable to recover it. 00:31:01.505 [2024-11-28 23:23:04.956927] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.505 [2024-11-28 23:23:04.957024] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.505 [2024-11-28 23:23:04.957049] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.505 [2024-11-28 23:23:04.957063] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.505 [2024-11-28 23:23:04.957076] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.505 [2024-11-28 23:23:04.957105] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.505 qpair failed and we were unable to recover it. 00:31:01.505 [2024-11-28 23:23:04.966981] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.505 [2024-11-28 23:23:04.967092] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.505 [2024-11-28 23:23:04.967118] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.505 [2024-11-28 23:23:04.967132] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.505 [2024-11-28 23:23:04.967145] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.505 [2024-11-28 23:23:04.967181] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.505 qpair failed and we were unable to recover it. 00:31:01.505 [2024-11-28 23:23:04.976944] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.505 [2024-11-28 23:23:04.977033] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.505 [2024-11-28 23:23:04.977059] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.505 [2024-11-28 23:23:04.977073] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.505 [2024-11-28 23:23:04.977086] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.505 [2024-11-28 23:23:04.977115] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.505 qpair failed and we were unable to recover it. 00:31:01.505 [2024-11-28 23:23:04.986987] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.505 [2024-11-28 23:23:04.987075] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.505 [2024-11-28 23:23:04.987101] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.505 [2024-11-28 23:23:04.987115] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.505 [2024-11-28 23:23:04.987128] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.505 [2024-11-28 23:23:04.987158] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.505 qpair failed and we were unable to recover it. 00:31:01.505 [2024-11-28 23:23:04.997041] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.505 [2024-11-28 23:23:04.997140] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.505 [2024-11-28 23:23:04.997165] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.505 [2024-11-28 23:23:04.997181] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.505 [2024-11-28 23:23:04.997195] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.505 [2024-11-28 23:23:04.997225] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.505 qpair failed and we were unable to recover it. 00:31:01.505 [2024-11-28 23:23:05.007034] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.505 [2024-11-28 23:23:05.007126] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.506 [2024-11-28 23:23:05.007152] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.506 [2024-11-28 23:23:05.007166] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.506 [2024-11-28 23:23:05.007179] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.506 [2024-11-28 23:23:05.007208] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.506 qpair failed and we were unable to recover it. 00:31:01.506 [2024-11-28 23:23:05.017079] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.506 [2024-11-28 23:23:05.017170] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.506 [2024-11-28 23:23:05.017201] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.506 [2024-11-28 23:23:05.017216] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.506 [2024-11-28 23:23:05.017229] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.506 [2024-11-28 23:23:05.017259] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.506 qpair failed and we were unable to recover it. 00:31:01.506 [2024-11-28 23:23:05.027118] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.506 [2024-11-28 23:23:05.027263] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.506 [2024-11-28 23:23:05.027288] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.506 [2024-11-28 23:23:05.027302] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.506 [2024-11-28 23:23:05.027315] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.506 [2024-11-28 23:23:05.027345] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.506 qpair failed and we were unable to recover it. 00:31:01.506 [2024-11-28 23:23:05.037122] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.506 [2024-11-28 23:23:05.037215] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.506 [2024-11-28 23:23:05.037244] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.506 [2024-11-28 23:23:05.037260] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.506 [2024-11-28 23:23:05.037273] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.506 [2024-11-28 23:23:05.037304] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.506 qpair failed and we were unable to recover it. 00:31:01.506 [2024-11-28 23:23:05.047174] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.506 [2024-11-28 23:23:05.047267] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.506 [2024-11-28 23:23:05.047293] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.506 [2024-11-28 23:23:05.047307] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.506 [2024-11-28 23:23:05.047320] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.506 [2024-11-28 23:23:05.047351] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.506 qpair failed and we were unable to recover it. 00:31:01.506 [2024-11-28 23:23:05.057183] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.506 [2024-11-28 23:23:05.057299] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.506 [2024-11-28 23:23:05.057324] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.506 [2024-11-28 23:23:05.057338] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.506 [2024-11-28 23:23:05.057357] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.506 [2024-11-28 23:23:05.057389] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.506 qpair failed and we were unable to recover it. 00:31:01.506 [2024-11-28 23:23:05.067195] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.506 [2024-11-28 23:23:05.067291] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.506 [2024-11-28 23:23:05.067316] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.506 [2024-11-28 23:23:05.067330] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.506 [2024-11-28 23:23:05.067343] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.506 [2024-11-28 23:23:05.067372] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.506 qpair failed and we were unable to recover it. 00:31:01.506 [2024-11-28 23:23:05.077332] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.506 [2024-11-28 23:23:05.077424] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.506 [2024-11-28 23:23:05.077450] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.506 [2024-11-28 23:23:05.077464] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.506 [2024-11-28 23:23:05.077477] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.506 [2024-11-28 23:23:05.077507] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.506 qpair failed and we were unable to recover it. 00:31:01.506 [2024-11-28 23:23:05.087292] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.506 [2024-11-28 23:23:05.087403] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.506 [2024-11-28 23:23:05.087429] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.506 [2024-11-28 23:23:05.087452] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.506 [2024-11-28 23:23:05.087466] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.506 [2024-11-28 23:23:05.087497] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.506 qpair failed and we were unable to recover it. 00:31:01.506 [2024-11-28 23:23:05.097294] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.506 [2024-11-28 23:23:05.097389] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.506 [2024-11-28 23:23:05.097423] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.506 [2024-11-28 23:23:05.097438] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.506 [2024-11-28 23:23:05.097451] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.506 [2024-11-28 23:23:05.097482] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.506 qpair failed and we were unable to recover it. 00:31:01.506 [2024-11-28 23:23:05.107330] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.506 [2024-11-28 23:23:05.107447] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.506 [2024-11-28 23:23:05.107473] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.506 [2024-11-28 23:23:05.107488] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.506 [2024-11-28 23:23:05.107500] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.506 [2024-11-28 23:23:05.107532] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.506 qpair failed and we were unable to recover it. 00:31:01.765 [2024-11-28 23:23:05.117403] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.765 [2024-11-28 23:23:05.117491] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.765 [2024-11-28 23:23:05.117518] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.765 [2024-11-28 23:23:05.117535] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.765 [2024-11-28 23:23:05.117549] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.765 [2024-11-28 23:23:05.117578] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.765 qpair failed and we were unable to recover it. 00:31:01.765 [2024-11-28 23:23:05.127400] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.765 [2024-11-28 23:23:05.127505] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.765 [2024-11-28 23:23:05.127530] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.765 [2024-11-28 23:23:05.127545] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.765 [2024-11-28 23:23:05.127558] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.765 [2024-11-28 23:23:05.127588] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.765 qpair failed and we were unable to recover it. 00:31:01.765 [2024-11-28 23:23:05.137406] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.765 [2024-11-28 23:23:05.137512] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.765 [2024-11-28 23:23:05.137538] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.765 [2024-11-28 23:23:05.137552] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.765 [2024-11-28 23:23:05.137563] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.765 [2024-11-28 23:23:05.137593] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.765 qpair failed and we were unable to recover it. 00:31:01.765 [2024-11-28 23:23:05.147553] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.765 [2024-11-28 23:23:05.147645] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.765 [2024-11-28 23:23:05.147671] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.765 [2024-11-28 23:23:05.147692] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.765 [2024-11-28 23:23:05.147707] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.765 [2024-11-28 23:23:05.147738] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.765 qpair failed and we were unable to recover it. 00:31:01.765 [2024-11-28 23:23:05.157468] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.765 [2024-11-28 23:23:05.157558] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.765 [2024-11-28 23:23:05.157587] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.765 [2024-11-28 23:23:05.157605] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.765 [2024-11-28 23:23:05.157618] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.765 [2024-11-28 23:23:05.157662] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.765 qpair failed and we were unable to recover it. 00:31:01.765 [2024-11-28 23:23:05.167514] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.765 [2024-11-28 23:23:05.167653] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.765 [2024-11-28 23:23:05.167685] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.765 [2024-11-28 23:23:05.167699] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.765 [2024-11-28 23:23:05.167711] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.765 [2024-11-28 23:23:05.167743] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.765 qpair failed and we were unable to recover it. 00:31:01.765 [2024-11-28 23:23:05.177503] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.765 [2024-11-28 23:23:05.177597] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.765 [2024-11-28 23:23:05.177624] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.765 [2024-11-28 23:23:05.177638] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.765 [2024-11-28 23:23:05.177651] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.765 [2024-11-28 23:23:05.177680] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.765 qpair failed and we were unable to recover it. 00:31:01.765 [2024-11-28 23:23:05.187543] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.765 [2024-11-28 23:23:05.187628] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.765 [2024-11-28 23:23:05.187652] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.765 [2024-11-28 23:23:05.187666] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.765 [2024-11-28 23:23:05.187678] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.765 [2024-11-28 23:23:05.187708] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.765 qpair failed and we were unable to recover it. 00:31:01.765 [2024-11-28 23:23:05.197596] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.765 [2024-11-28 23:23:05.197683] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.765 [2024-11-28 23:23:05.197709] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.765 [2024-11-28 23:23:05.197723] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.765 [2024-11-28 23:23:05.197736] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.765 [2024-11-28 23:23:05.197766] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.765 qpair failed and we were unable to recover it. 00:31:01.765 [2024-11-28 23:23:05.207631] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.765 [2024-11-28 23:23:05.207724] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.765 [2024-11-28 23:23:05.207750] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.765 [2024-11-28 23:23:05.207764] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.765 [2024-11-28 23:23:05.207778] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.765 [2024-11-28 23:23:05.207807] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.765 qpair failed and we were unable to recover it. 00:31:01.765 [2024-11-28 23:23:05.217742] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.766 [2024-11-28 23:23:05.217834] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.766 [2024-11-28 23:23:05.217860] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.766 [2024-11-28 23:23:05.217874] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.766 [2024-11-28 23:23:05.217888] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.766 [2024-11-28 23:23:05.217918] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.766 qpair failed and we were unable to recover it. 00:31:01.766 [2024-11-28 23:23:05.227659] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.766 [2024-11-28 23:23:05.227744] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.766 [2024-11-28 23:23:05.227770] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.766 [2024-11-28 23:23:05.227784] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.766 [2024-11-28 23:23:05.227797] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.766 [2024-11-28 23:23:05.227827] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.766 qpair failed and we were unable to recover it. 00:31:01.766 [2024-11-28 23:23:05.237751] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.766 [2024-11-28 23:23:05.237838] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.766 [2024-11-28 23:23:05.237864] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.766 [2024-11-28 23:23:05.237884] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.766 [2024-11-28 23:23:05.237898] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.766 [2024-11-28 23:23:05.237929] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.766 qpair failed and we were unable to recover it. 00:31:01.766 [2024-11-28 23:23:05.247722] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.766 [2024-11-28 23:23:05.247815] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.766 [2024-11-28 23:23:05.247841] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.766 [2024-11-28 23:23:05.247855] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.766 [2024-11-28 23:23:05.247868] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.766 [2024-11-28 23:23:05.247899] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.766 qpair failed and we were unable to recover it. 00:31:01.766 [2024-11-28 23:23:05.257793] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.766 [2024-11-28 23:23:05.257910] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.766 [2024-11-28 23:23:05.257936] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.766 [2024-11-28 23:23:05.257950] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.766 [2024-11-28 23:23:05.257962] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.766 [2024-11-28 23:23:05.257992] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.766 qpair failed and we were unable to recover it. 00:31:01.766 [2024-11-28 23:23:05.267787] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.766 [2024-11-28 23:23:05.267872] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.766 [2024-11-28 23:23:05.267898] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.766 [2024-11-28 23:23:05.267912] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.766 [2024-11-28 23:23:05.267925] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.766 [2024-11-28 23:23:05.267956] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.766 qpair failed and we were unable to recover it. 00:31:01.766 [2024-11-28 23:23:05.277850] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.766 [2024-11-28 23:23:05.277939] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.766 [2024-11-28 23:23:05.277965] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.766 [2024-11-28 23:23:05.277979] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.766 [2024-11-28 23:23:05.277992] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.766 [2024-11-28 23:23:05.278022] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.766 qpair failed and we were unable to recover it. 00:31:01.766 [2024-11-28 23:23:05.287882] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.766 [2024-11-28 23:23:05.287979] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.766 [2024-11-28 23:23:05.288004] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.766 [2024-11-28 23:23:05.288018] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.766 [2024-11-28 23:23:05.288031] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.766 [2024-11-28 23:23:05.288061] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.766 qpair failed and we were unable to recover it. 00:31:01.766 [2024-11-28 23:23:05.297849] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.766 [2024-11-28 23:23:05.297940] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.766 [2024-11-28 23:23:05.297967] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.766 [2024-11-28 23:23:05.297981] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.766 [2024-11-28 23:23:05.297994] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.766 [2024-11-28 23:23:05.298023] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.766 qpair failed and we were unable to recover it. 00:31:01.766 [2024-11-28 23:23:05.307930] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.766 [2024-11-28 23:23:05.308029] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.766 [2024-11-28 23:23:05.308059] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.766 [2024-11-28 23:23:05.308075] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.766 [2024-11-28 23:23:05.308088] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.766 [2024-11-28 23:23:05.308120] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.766 qpair failed and we were unable to recover it. 00:31:01.766 [2024-11-28 23:23:05.317935] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.766 [2024-11-28 23:23:05.318027] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.766 [2024-11-28 23:23:05.318053] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.766 [2024-11-28 23:23:05.318067] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.766 [2024-11-28 23:23:05.318081] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.766 [2024-11-28 23:23:05.318111] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.766 qpair failed and we were unable to recover it. 00:31:01.766 [2024-11-28 23:23:05.327984] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.766 [2024-11-28 23:23:05.328081] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.766 [2024-11-28 23:23:05.328112] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.766 [2024-11-28 23:23:05.328127] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.766 [2024-11-28 23:23:05.328140] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.766 [2024-11-28 23:23:05.328170] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.766 qpair failed and we were unable to recover it. 00:31:01.766 [2024-11-28 23:23:05.338070] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.766 [2024-11-28 23:23:05.338167] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.766 [2024-11-28 23:23:05.338192] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.766 [2024-11-28 23:23:05.338207] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.766 [2024-11-28 23:23:05.338220] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.766 [2024-11-28 23:23:05.338250] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.766 qpair failed and we were unable to recover it. 00:31:01.766 [2024-11-28 23:23:05.348027] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.766 [2024-11-28 23:23:05.348113] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.766 [2024-11-28 23:23:05.348139] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.766 [2024-11-28 23:23:05.348153] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.767 [2024-11-28 23:23:05.348166] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.767 [2024-11-28 23:23:05.348197] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.767 qpair failed and we were unable to recover it. 00:31:01.767 [2024-11-28 23:23:05.358065] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.767 [2024-11-28 23:23:05.358148] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.767 [2024-11-28 23:23:05.358174] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.767 [2024-11-28 23:23:05.358188] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.767 [2024-11-28 23:23:05.358201] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.767 [2024-11-28 23:23:05.358230] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.767 qpair failed and we were unable to recover it. 00:31:01.767 [2024-11-28 23:23:05.368176] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:01.767 [2024-11-28 23:23:05.368267] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:01.767 [2024-11-28 23:23:05.368293] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:01.767 [2024-11-28 23:23:05.368307] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:01.767 [2024-11-28 23:23:05.368320] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:01.767 [2024-11-28 23:23:05.368356] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.767 qpair failed and we were unable to recover it. 00:31:02.025 [2024-11-28 23:23:05.378110] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.025 [2024-11-28 23:23:05.378205] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.025 [2024-11-28 23:23:05.378231] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.025 [2024-11-28 23:23:05.378245] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.025 [2024-11-28 23:23:05.378257] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.025 [2024-11-28 23:23:05.378287] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.025 qpair failed and we were unable to recover it. 00:31:02.025 [2024-11-28 23:23:05.388144] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.025 [2024-11-28 23:23:05.388231] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.025 [2024-11-28 23:23:05.388257] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.025 [2024-11-28 23:23:05.388272] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.025 [2024-11-28 23:23:05.388284] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.025 [2024-11-28 23:23:05.388315] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.025 qpair failed and we were unable to recover it. 00:31:02.025 [2024-11-28 23:23:05.398177] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.025 [2024-11-28 23:23:05.398265] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.025 [2024-11-28 23:23:05.398291] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.025 [2024-11-28 23:23:05.398305] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.025 [2024-11-28 23:23:05.398319] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.025 [2024-11-28 23:23:05.398351] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.025 qpair failed and we were unable to recover it. 00:31:02.025 [2024-11-28 23:23:05.408212] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.025 [2024-11-28 23:23:05.408309] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.025 [2024-11-28 23:23:05.408338] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.025 [2024-11-28 23:23:05.408354] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.025 [2024-11-28 23:23:05.408367] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.025 [2024-11-28 23:23:05.408406] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.025 qpair failed and we were unable to recover it. 00:31:02.025 [2024-11-28 23:23:05.418207] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.025 [2024-11-28 23:23:05.418300] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.025 [2024-11-28 23:23:05.418332] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.025 [2024-11-28 23:23:05.418347] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.025 [2024-11-28 23:23:05.418360] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.025 [2024-11-28 23:23:05.418390] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.025 qpair failed and we were unable to recover it. 00:31:02.025 [2024-11-28 23:23:05.428267] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.025 [2024-11-28 23:23:05.428353] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.025 [2024-11-28 23:23:05.428379] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.025 [2024-11-28 23:23:05.428400] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.025 [2024-11-28 23:23:05.428416] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.025 [2024-11-28 23:23:05.428447] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.025 qpair failed and we were unable to recover it. 00:31:02.025 [2024-11-28 23:23:05.438307] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.025 [2024-11-28 23:23:05.438407] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.025 [2024-11-28 23:23:05.438434] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.025 [2024-11-28 23:23:05.438448] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.025 [2024-11-28 23:23:05.438461] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.025 [2024-11-28 23:23:05.438491] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.025 qpair failed and we were unable to recover it. 00:31:02.025 [2024-11-28 23:23:05.448418] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.025 [2024-11-28 23:23:05.448559] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.025 [2024-11-28 23:23:05.448585] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.025 [2024-11-28 23:23:05.448599] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.025 [2024-11-28 23:23:05.448612] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.025 [2024-11-28 23:23:05.448642] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.025 qpair failed and we were unable to recover it. 00:31:02.025 [2024-11-28 23:23:05.458337] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.025 [2024-11-28 23:23:05.458436] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.025 [2024-11-28 23:23:05.458463] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.025 [2024-11-28 23:23:05.458477] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.025 [2024-11-28 23:23:05.458490] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.025 [2024-11-28 23:23:05.458526] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.025 qpair failed and we were unable to recover it. 00:31:02.025 [2024-11-28 23:23:05.468369] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.025 [2024-11-28 23:23:05.468462] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.025 [2024-11-28 23:23:05.468488] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.025 [2024-11-28 23:23:05.468502] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.025 [2024-11-28 23:23:05.468515] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.025 [2024-11-28 23:23:05.468545] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.025 qpair failed and we were unable to recover it. 00:31:02.025 [2024-11-28 23:23:05.478479] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.025 [2024-11-28 23:23:05.478565] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.025 [2024-11-28 23:23:05.478590] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.025 [2024-11-28 23:23:05.478605] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.025 [2024-11-28 23:23:05.478619] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.025 [2024-11-28 23:23:05.478649] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.025 qpair failed and we were unable to recover it. 00:31:02.025 [2024-11-28 23:23:05.488444] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.026 [2024-11-28 23:23:05.488537] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.026 [2024-11-28 23:23:05.488563] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.026 [2024-11-28 23:23:05.488577] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.026 [2024-11-28 23:23:05.488590] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.026 [2024-11-28 23:23:05.488634] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.026 qpair failed and we were unable to recover it. 00:31:02.026 [2024-11-28 23:23:05.498484] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.026 [2024-11-28 23:23:05.498573] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.026 [2024-11-28 23:23:05.498599] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.026 [2024-11-28 23:23:05.498613] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.026 [2024-11-28 23:23:05.498625] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.026 [2024-11-28 23:23:05.498655] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.026 qpair failed and we were unable to recover it. 00:31:02.026 [2024-11-28 23:23:05.508517] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.026 [2024-11-28 23:23:05.508621] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.026 [2024-11-28 23:23:05.508656] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.026 [2024-11-28 23:23:05.508671] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.026 [2024-11-28 23:23:05.508684] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.026 [2024-11-28 23:23:05.508715] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.026 qpair failed and we were unable to recover it. 00:31:02.026 [2024-11-28 23:23:05.518532] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.026 [2024-11-28 23:23:05.518619] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.026 [2024-11-28 23:23:05.518644] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.026 [2024-11-28 23:23:05.518659] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.026 [2024-11-28 23:23:05.518672] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.026 [2024-11-28 23:23:05.518702] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.026 qpair failed and we were unable to recover it. 00:31:02.026 [2024-11-28 23:23:05.528640] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.026 [2024-11-28 23:23:05.528772] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.026 [2024-11-28 23:23:05.528798] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.026 [2024-11-28 23:23:05.528812] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.026 [2024-11-28 23:23:05.528825] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.026 [2024-11-28 23:23:05.528855] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.026 qpair failed and we were unable to recover it. 00:31:02.026 [2024-11-28 23:23:05.538566] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.026 [2024-11-28 23:23:05.538658] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.026 [2024-11-28 23:23:05.538683] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.026 [2024-11-28 23:23:05.538697] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.026 [2024-11-28 23:23:05.538710] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.026 [2024-11-28 23:23:05.538740] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.026 qpair failed and we were unable to recover it. 00:31:02.026 [2024-11-28 23:23:05.548635] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.026 [2024-11-28 23:23:05.548727] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.026 [2024-11-28 23:23:05.548753] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.026 [2024-11-28 23:23:05.548767] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.026 [2024-11-28 23:23:05.548785] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.026 [2024-11-28 23:23:05.548817] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.026 qpair failed and we were unable to recover it. 00:31:02.026 [2024-11-28 23:23:05.558633] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.026 [2024-11-28 23:23:05.558725] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.026 [2024-11-28 23:23:05.558751] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.026 [2024-11-28 23:23:05.558765] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.026 [2024-11-28 23:23:05.558778] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.026 [2024-11-28 23:23:05.558808] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.026 qpair failed and we were unable to recover it. 00:31:02.026 [2024-11-28 23:23:05.568721] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.026 [2024-11-28 23:23:05.568819] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.026 [2024-11-28 23:23:05.568845] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.026 [2024-11-28 23:23:05.568859] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.026 [2024-11-28 23:23:05.568873] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.026 [2024-11-28 23:23:05.568906] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.026 qpair failed and we were unable to recover it. 00:31:02.026 [2024-11-28 23:23:05.578692] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.026 [2024-11-28 23:23:05.578787] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.026 [2024-11-28 23:23:05.578812] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.026 [2024-11-28 23:23:05.578826] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.026 [2024-11-28 23:23:05.578839] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.026 [2024-11-28 23:23:05.578869] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.026 qpair failed and we were unable to recover it. 00:31:02.026 [2024-11-28 23:23:05.588718] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.026 [2024-11-28 23:23:05.588808] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.026 [2024-11-28 23:23:05.588834] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.026 [2024-11-28 23:23:05.588848] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.026 [2024-11-28 23:23:05.588861] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.026 [2024-11-28 23:23:05.588892] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.026 qpair failed and we were unable to recover it. 00:31:02.026 [2024-11-28 23:23:05.598840] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.026 [2024-11-28 23:23:05.598936] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.026 [2024-11-28 23:23:05.598963] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.026 [2024-11-28 23:23:05.598977] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.026 [2024-11-28 23:23:05.598990] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.026 [2024-11-28 23:23:05.599020] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.026 qpair failed and we were unable to recover it. 00:31:02.026 [2024-11-28 23:23:05.608887] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.026 [2024-11-28 23:23:05.608983] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.026 [2024-11-28 23:23:05.609012] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.026 [2024-11-28 23:23:05.609027] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.026 [2024-11-28 23:23:05.609040] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.026 [2024-11-28 23:23:05.609070] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.026 qpair failed and we were unable to recover it. 00:31:02.026 [2024-11-28 23:23:05.618834] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.026 [2024-11-28 23:23:05.618925] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.026 [2024-11-28 23:23:05.618951] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.026 [2024-11-28 23:23:05.618965] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.026 [2024-11-28 23:23:05.618978] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.027 [2024-11-28 23:23:05.619008] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.027 qpair failed and we were unable to recover it. 00:31:02.027 [2024-11-28 23:23:05.628872] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.027 [2024-11-28 23:23:05.628997] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.027 [2024-11-28 23:23:05.629022] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.027 [2024-11-28 23:23:05.629038] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.027 [2024-11-28 23:23:05.629051] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.027 [2024-11-28 23:23:05.629082] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.027 qpair failed and we were unable to recover it. 00:31:02.285 [2024-11-28 23:23:05.638881] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.285 [2024-11-28 23:23:05.638966] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.285 [2024-11-28 23:23:05.638992] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.285 [2024-11-28 23:23:05.639006] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.285 [2024-11-28 23:23:05.639025] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.285 [2024-11-28 23:23:05.639056] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.285 qpair failed and we were unable to recover it. 00:31:02.285 [2024-11-28 23:23:05.648969] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.285 [2024-11-28 23:23:05.649085] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.285 [2024-11-28 23:23:05.649110] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.285 [2024-11-28 23:23:05.649124] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.285 [2024-11-28 23:23:05.649137] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.285 [2024-11-28 23:23:05.649168] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.285 qpair failed and we were unable to recover it. 00:31:02.285 [2024-11-28 23:23:05.658950] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.285 [2024-11-28 23:23:05.659048] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.285 [2024-11-28 23:23:05.659073] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.285 [2024-11-28 23:23:05.659087] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.285 [2024-11-28 23:23:05.659100] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.285 [2024-11-28 23:23:05.659130] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.285 qpair failed and we were unable to recover it. 00:31:02.285 [2024-11-28 23:23:05.669050] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.285 [2024-11-28 23:23:05.669184] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.285 [2024-11-28 23:23:05.669209] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.285 [2024-11-28 23:23:05.669224] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.285 [2024-11-28 23:23:05.669237] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.285 [2024-11-28 23:23:05.669267] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.285 qpair failed and we were unable to recover it. 00:31:02.285 [2024-11-28 23:23:05.678973] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.285 [2024-11-28 23:23:05.679060] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.285 [2024-11-28 23:23:05.679085] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.285 [2024-11-28 23:23:05.679099] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.285 [2024-11-28 23:23:05.679112] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.285 [2024-11-28 23:23:05.679143] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.285 qpair failed and we were unable to recover it. 00:31:02.285 [2024-11-28 23:23:05.689044] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.285 [2024-11-28 23:23:05.689138] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.285 [2024-11-28 23:23:05.689164] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.285 [2024-11-28 23:23:05.689178] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.285 [2024-11-28 23:23:05.689191] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.285 [2024-11-28 23:23:05.689221] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.285 qpair failed and we were unable to recover it. 00:31:02.285 [2024-11-28 23:23:05.699024] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.285 [2024-11-28 23:23:05.699117] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.285 [2024-11-28 23:23:05.699143] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.285 [2024-11-28 23:23:05.699157] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.285 [2024-11-28 23:23:05.699170] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.285 [2024-11-28 23:23:05.699200] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.285 qpair failed and we were unable to recover it. 00:31:02.285 [2024-11-28 23:23:05.709065] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.286 [2024-11-28 23:23:05.709153] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.286 [2024-11-28 23:23:05.709179] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.286 [2024-11-28 23:23:05.709194] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.286 [2024-11-28 23:23:05.709207] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.286 [2024-11-28 23:23:05.709249] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.286 qpair failed and we were unable to recover it. 00:31:02.286 [2024-11-28 23:23:05.719103] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.286 [2024-11-28 23:23:05.719200] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.286 [2024-11-28 23:23:05.719227] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.286 [2024-11-28 23:23:05.719242] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.286 [2024-11-28 23:23:05.719255] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.286 [2024-11-28 23:23:05.719284] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.286 qpair failed and we were unable to recover it. 00:31:02.286 [2024-11-28 23:23:05.729117] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.286 [2024-11-28 23:23:05.729209] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.286 [2024-11-28 23:23:05.729235] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.286 [2024-11-28 23:23:05.729255] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.286 [2024-11-28 23:23:05.729269] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.286 [2024-11-28 23:23:05.729299] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.286 qpair failed and we were unable to recover it. 00:31:02.286 [2024-11-28 23:23:05.739260] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.286 [2024-11-28 23:23:05.739354] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.286 [2024-11-28 23:23:05.739380] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.286 [2024-11-28 23:23:05.739403] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.286 [2024-11-28 23:23:05.739419] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.286 [2024-11-28 23:23:05.739450] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.286 qpair failed and we were unable to recover it. 00:31:02.286 [2024-11-28 23:23:05.749203] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.286 [2024-11-28 23:23:05.749302] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.286 [2024-11-28 23:23:05.749328] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.286 [2024-11-28 23:23:05.749342] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.286 [2024-11-28 23:23:05.749355] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.286 [2024-11-28 23:23:05.749384] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.286 qpair failed and we were unable to recover it. 00:31:02.286 [2024-11-28 23:23:05.759235] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.286 [2024-11-28 23:23:05.759318] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.286 [2024-11-28 23:23:05.759343] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.286 [2024-11-28 23:23:05.759358] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.286 [2024-11-28 23:23:05.759370] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.286 [2024-11-28 23:23:05.759411] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.286 qpair failed and we were unable to recover it. 00:31:02.286 [2024-11-28 23:23:05.769295] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.286 [2024-11-28 23:23:05.769401] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.286 [2024-11-28 23:23:05.769431] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.286 [2024-11-28 23:23:05.769446] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.286 [2024-11-28 23:23:05.769460] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.286 [2024-11-28 23:23:05.769491] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.286 qpair failed and we were unable to recover it. 00:31:02.286 [2024-11-28 23:23:05.779263] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.286 [2024-11-28 23:23:05.779362] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.286 [2024-11-28 23:23:05.779387] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.286 [2024-11-28 23:23:05.779412] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.286 [2024-11-28 23:23:05.779426] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.286 [2024-11-28 23:23:05.779457] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.286 qpair failed and we were unable to recover it. 00:31:02.286 [2024-11-28 23:23:05.789295] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.286 [2024-11-28 23:23:05.789384] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.286 [2024-11-28 23:23:05.789418] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.286 [2024-11-28 23:23:05.789435] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.286 [2024-11-28 23:23:05.789448] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.286 [2024-11-28 23:23:05.789479] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.286 qpair failed and we were unable to recover it. 00:31:02.286 [2024-11-28 23:23:05.799347] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.286 [2024-11-28 23:23:05.799439] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.286 [2024-11-28 23:23:05.799465] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.286 [2024-11-28 23:23:05.799480] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.286 [2024-11-28 23:23:05.799494] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.286 [2024-11-28 23:23:05.799525] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.286 qpair failed and we were unable to recover it. 00:31:02.286 [2024-11-28 23:23:05.809379] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.286 [2024-11-28 23:23:05.809485] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.286 [2024-11-28 23:23:05.809512] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.286 [2024-11-28 23:23:05.809526] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.286 [2024-11-28 23:23:05.809540] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.286 [2024-11-28 23:23:05.809584] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.286 qpair failed and we were unable to recover it. 00:31:02.286 [2024-11-28 23:23:05.819390] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.286 [2024-11-28 23:23:05.819482] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.286 [2024-11-28 23:23:05.819509] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.286 [2024-11-28 23:23:05.819529] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.286 [2024-11-28 23:23:05.819543] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.286 [2024-11-28 23:23:05.819574] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.286 qpair failed and we were unable to recover it. 00:31:02.286 [2024-11-28 23:23:05.829424] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.286 [2024-11-28 23:23:05.829510] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.286 [2024-11-28 23:23:05.829536] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.286 [2024-11-28 23:23:05.829550] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.286 [2024-11-28 23:23:05.829563] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.286 [2024-11-28 23:23:05.829593] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.286 qpair failed and we were unable to recover it. 00:31:02.286 [2024-11-28 23:23:05.839459] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.286 [2024-11-28 23:23:05.839556] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.286 [2024-11-28 23:23:05.839586] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.286 [2024-11-28 23:23:05.839602] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.287 [2024-11-28 23:23:05.839615] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.287 [2024-11-28 23:23:05.839646] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.287 qpair failed and we were unable to recover it. 00:31:02.287 [2024-11-28 23:23:05.849489] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.287 [2024-11-28 23:23:05.849592] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.287 [2024-11-28 23:23:05.849626] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.287 [2024-11-28 23:23:05.849641] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.287 [2024-11-28 23:23:05.849653] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.287 [2024-11-28 23:23:05.849689] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.287 qpair failed and we were unable to recover it. 00:31:02.287 [2024-11-28 23:23:05.859540] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.287 [2024-11-28 23:23:05.859636] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.287 [2024-11-28 23:23:05.859663] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.287 [2024-11-28 23:23:05.859677] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.287 [2024-11-28 23:23:05.859691] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.287 [2024-11-28 23:23:05.859733] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.287 qpair failed and we were unable to recover it. 00:31:02.287 [2024-11-28 23:23:05.869582] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.287 [2024-11-28 23:23:05.869676] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.287 [2024-11-28 23:23:05.869705] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.287 [2024-11-28 23:23:05.869720] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.287 [2024-11-28 23:23:05.869733] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.287 [2024-11-28 23:23:05.869763] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.287 qpair failed and we were unable to recover it. 00:31:02.287 [2024-11-28 23:23:05.879566] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.287 [2024-11-28 23:23:05.879648] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.287 [2024-11-28 23:23:05.879674] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.287 [2024-11-28 23:23:05.879689] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.287 [2024-11-28 23:23:05.879702] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.287 [2024-11-28 23:23:05.879732] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.287 qpair failed and we were unable to recover it. 00:31:02.546 [2024-11-28 23:23:05.889604] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.546 [2024-11-28 23:23:05.889700] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.546 [2024-11-28 23:23:05.889726] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.546 [2024-11-28 23:23:05.889740] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.546 [2024-11-28 23:23:05.889754] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.546 [2024-11-28 23:23:05.889785] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.546 qpair failed and we were unable to recover it. 00:31:02.546 [2024-11-28 23:23:05.899651] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.546 [2024-11-28 23:23:05.899735] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.546 [2024-11-28 23:23:05.899761] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.546 [2024-11-28 23:23:05.899775] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.546 [2024-11-28 23:23:05.899788] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.546 [2024-11-28 23:23:05.899818] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.546 qpair failed and we were unable to recover it. 00:31:02.546 [2024-11-28 23:23:05.909705] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.546 [2024-11-28 23:23:05.909790] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.546 [2024-11-28 23:23:05.909822] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.546 [2024-11-28 23:23:05.909838] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.546 [2024-11-28 23:23:05.909851] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.546 [2024-11-28 23:23:05.909881] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.546 qpair failed and we were unable to recover it. 00:31:02.546 [2024-11-28 23:23:05.919719] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.546 [2024-11-28 23:23:05.919811] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.546 [2024-11-28 23:23:05.919836] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.546 [2024-11-28 23:23:05.919850] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.546 [2024-11-28 23:23:05.919863] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.546 [2024-11-28 23:23:05.919894] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.546 qpair failed and we were unable to recover it. 00:31:02.546 [2024-11-28 23:23:05.929729] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.546 [2024-11-28 23:23:05.929823] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.546 [2024-11-28 23:23:05.929849] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.546 [2024-11-28 23:23:05.929863] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.546 [2024-11-28 23:23:05.929876] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.546 [2024-11-28 23:23:05.929907] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.546 qpair failed and we were unable to recover it. 00:31:02.546 [2024-11-28 23:23:05.939762] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.546 [2024-11-28 23:23:05.939851] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.546 [2024-11-28 23:23:05.939878] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.546 [2024-11-28 23:23:05.939892] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.546 [2024-11-28 23:23:05.939905] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.546 [2024-11-28 23:23:05.939935] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.546 qpair failed and we were unable to recover it. 00:31:02.546 [2024-11-28 23:23:05.949770] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.546 [2024-11-28 23:23:05.949889] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.546 [2024-11-28 23:23:05.949915] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.546 [2024-11-28 23:23:05.949929] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.546 [2024-11-28 23:23:05.949942] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.546 [2024-11-28 23:23:05.949977] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.546 qpair failed and we were unable to recover it. 00:31:02.546 [2024-11-28 23:23:05.959942] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.546 [2024-11-28 23:23:05.960065] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.546 [2024-11-28 23:23:05.960090] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.546 [2024-11-28 23:23:05.960104] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.546 [2024-11-28 23:23:05.960116] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.546 [2024-11-28 23:23:05.960146] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.546 qpair failed and we were unable to recover it. 00:31:02.546 [2024-11-28 23:23:05.969829] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.546 [2024-11-28 23:23:05.969923] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.546 [2024-11-28 23:23:05.969949] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.546 [2024-11-28 23:23:05.969964] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.546 [2024-11-28 23:23:05.969976] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.546 [2024-11-28 23:23:05.970007] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.546 qpair failed and we were unable to recover it. 00:31:02.546 [2024-11-28 23:23:05.979881] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.546 [2024-11-28 23:23:05.979969] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.546 [2024-11-28 23:23:05.979995] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.546 [2024-11-28 23:23:05.980009] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.546 [2024-11-28 23:23:05.980022] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.546 [2024-11-28 23:23:05.980051] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.546 qpair failed and we were unable to recover it. 00:31:02.546 [2024-11-28 23:23:05.989972] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.546 [2024-11-28 23:23:05.990066] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.546 [2024-11-28 23:23:05.990093] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.546 [2024-11-28 23:23:05.990107] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.546 [2024-11-28 23:23:05.990119] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.546 [2024-11-28 23:23:05.990150] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.546 qpair failed and we were unable to recover it. 00:31:02.546 [2024-11-28 23:23:05.999921] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.546 [2024-11-28 23:23:06.000009] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.546 [2024-11-28 23:23:06.000043] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.546 [2024-11-28 23:23:06.000058] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.546 [2024-11-28 23:23:06.000071] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.546 [2024-11-28 23:23:06.000114] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.546 qpair failed and we were unable to recover it. 00:31:02.546 [2024-11-28 23:23:06.009952] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.546 [2024-11-28 23:23:06.010044] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.546 [2024-11-28 23:23:06.010070] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.546 [2024-11-28 23:23:06.010084] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.546 [2024-11-28 23:23:06.010097] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.547 [2024-11-28 23:23:06.010128] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.547 qpair failed and we were unable to recover it. 00:31:02.547 [2024-11-28 23:23:06.019993] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.547 [2024-11-28 23:23:06.020114] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.547 [2024-11-28 23:23:06.020140] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.547 [2024-11-28 23:23:06.020154] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.547 [2024-11-28 23:23:06.020167] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.547 [2024-11-28 23:23:06.020197] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.547 qpair failed and we were unable to recover it. 00:31:02.547 [2024-11-28 23:23:06.030036] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.547 [2024-11-28 23:23:06.030147] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.547 [2024-11-28 23:23:06.030173] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.547 [2024-11-28 23:23:06.030187] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.547 [2024-11-28 23:23:06.030200] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.547 [2024-11-28 23:23:06.030230] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.547 qpair failed and we were unable to recover it. 00:31:02.547 [2024-11-28 23:23:06.040007] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.547 [2024-11-28 23:23:06.040091] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.547 [2024-11-28 23:23:06.040117] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.547 [2024-11-28 23:23:06.040131] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.547 [2024-11-28 23:23:06.040149] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.547 [2024-11-28 23:23:06.040180] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.547 qpair failed and we were unable to recover it. 00:31:02.547 [2024-11-28 23:23:06.050094] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.547 [2024-11-28 23:23:06.050189] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.547 [2024-11-28 23:23:06.050215] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.547 [2024-11-28 23:23:06.050229] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.547 [2024-11-28 23:23:06.050242] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.547 [2024-11-28 23:23:06.050271] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.547 qpair failed and we were unable to recover it. 00:31:02.547 [2024-11-28 23:23:06.060071] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.547 [2024-11-28 23:23:06.060167] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.547 [2024-11-28 23:23:06.060192] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.547 [2024-11-28 23:23:06.060206] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.547 [2024-11-28 23:23:06.060219] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.547 [2024-11-28 23:23:06.060248] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.547 qpair failed and we were unable to recover it. 00:31:02.547 [2024-11-28 23:23:06.070120] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.547 [2024-11-28 23:23:06.070243] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.547 [2024-11-28 23:23:06.070268] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.547 [2024-11-28 23:23:06.070282] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.547 [2024-11-28 23:23:06.070295] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.547 [2024-11-28 23:23:06.070325] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.547 qpair failed and we were unable to recover it. 00:31:02.547 [2024-11-28 23:23:06.080144] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.547 [2024-11-28 23:23:06.080233] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.547 [2024-11-28 23:23:06.080259] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.547 [2024-11-28 23:23:06.080273] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.547 [2024-11-28 23:23:06.080286] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.547 [2024-11-28 23:23:06.080329] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.547 qpair failed and we were unable to recover it. 00:31:02.547 [2024-11-28 23:23:06.090153] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.547 [2024-11-28 23:23:06.090256] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.547 [2024-11-28 23:23:06.090283] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.547 [2024-11-28 23:23:06.090297] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.547 [2024-11-28 23:23:06.090310] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.547 [2024-11-28 23:23:06.090340] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.547 qpair failed and we were unable to recover it. 00:31:02.547 [2024-11-28 23:23:06.100211] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.547 [2024-11-28 23:23:06.100303] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.547 [2024-11-28 23:23:06.100329] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.547 [2024-11-28 23:23:06.100344] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.547 [2024-11-28 23:23:06.100357] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.547 [2024-11-28 23:23:06.100388] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.547 qpair failed and we were unable to recover it. 00:31:02.547 [2024-11-28 23:23:06.110239] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.547 [2024-11-28 23:23:06.110331] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.547 [2024-11-28 23:23:06.110357] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.547 [2024-11-28 23:23:06.110371] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.547 [2024-11-28 23:23:06.110384] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.547 [2024-11-28 23:23:06.110423] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.547 qpair failed and we were unable to recover it. 00:31:02.547 [2024-11-28 23:23:06.120257] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.547 [2024-11-28 23:23:06.120345] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.547 [2024-11-28 23:23:06.120371] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.547 [2024-11-28 23:23:06.120386] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.547 [2024-11-28 23:23:06.120408] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.547 [2024-11-28 23:23:06.120440] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.547 qpair failed and we were unable to recover it. 00:31:02.547 [2024-11-28 23:23:06.130317] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.547 [2024-11-28 23:23:06.130423] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.547 [2024-11-28 23:23:06.130449] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.547 [2024-11-28 23:23:06.130463] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.547 [2024-11-28 23:23:06.130482] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.547 [2024-11-28 23:23:06.130514] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.547 qpair failed and we were unable to recover it. 00:31:02.547 [2024-11-28 23:23:06.140337] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.547 [2024-11-28 23:23:06.140431] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.547 [2024-11-28 23:23:06.140457] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.547 [2024-11-28 23:23:06.140471] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.547 [2024-11-28 23:23:06.140483] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.547 [2024-11-28 23:23:06.140513] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.547 qpair failed and we were unable to recover it. 00:31:02.806 [2024-11-28 23:23:06.150333] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.806 [2024-11-28 23:23:06.150435] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.806 [2024-11-28 23:23:06.150461] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.806 [2024-11-28 23:23:06.150475] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.806 [2024-11-28 23:23:06.150488] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.806 [2024-11-28 23:23:06.150518] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.806 qpair failed and we were unable to recover it. 00:31:02.806 [2024-11-28 23:23:06.160365] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.806 [2024-11-28 23:23:06.160457] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.806 [2024-11-28 23:23:06.160487] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.806 [2024-11-28 23:23:06.160501] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.806 [2024-11-28 23:23:06.160514] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.806 [2024-11-28 23:23:06.160544] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.806 qpair failed and we were unable to recover it. 00:31:02.806 [2024-11-28 23:23:06.170427] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.806 [2024-11-28 23:23:06.170533] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.806 [2024-11-28 23:23:06.170559] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.806 [2024-11-28 23:23:06.170573] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.806 [2024-11-28 23:23:06.170586] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.806 [2024-11-28 23:23:06.170616] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.806 qpair failed and we were unable to recover it. 00:31:02.806 [2024-11-28 23:23:06.180435] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.807 [2024-11-28 23:23:06.180536] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.807 [2024-11-28 23:23:06.180562] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.807 [2024-11-28 23:23:06.180576] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.807 [2024-11-28 23:23:06.180589] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.807 [2024-11-28 23:23:06.180620] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.807 qpair failed and we were unable to recover it. 00:31:02.807 [2024-11-28 23:23:06.190456] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.807 [2024-11-28 23:23:06.190547] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.807 [2024-11-28 23:23:06.190572] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.807 [2024-11-28 23:23:06.190586] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.807 [2024-11-28 23:23:06.190598] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.807 [2024-11-28 23:23:06.190630] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.807 qpair failed and we were unable to recover it. 00:31:02.807 [2024-11-28 23:23:06.200472] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.807 [2024-11-28 23:23:06.200561] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.807 [2024-11-28 23:23:06.200587] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.807 [2024-11-28 23:23:06.200601] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.807 [2024-11-28 23:23:06.200613] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.807 [2024-11-28 23:23:06.200643] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.807 qpair failed and we were unable to recover it. 00:31:02.807 [2024-11-28 23:23:06.210585] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.807 [2024-11-28 23:23:06.210728] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.807 [2024-11-28 23:23:06.210754] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.807 [2024-11-28 23:23:06.210768] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.807 [2024-11-28 23:23:06.210781] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.807 [2024-11-28 23:23:06.210811] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.807 qpair failed and we were unable to recover it. 00:31:02.807 [2024-11-28 23:23:06.220600] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.807 [2024-11-28 23:23:06.220692] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.807 [2024-11-28 23:23:06.220717] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.807 [2024-11-28 23:23:06.220738] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.807 [2024-11-28 23:23:06.220752] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.807 [2024-11-28 23:23:06.220782] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.807 qpair failed and we were unable to recover it. 00:31:02.807 [2024-11-28 23:23:06.230575] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.807 [2024-11-28 23:23:06.230709] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.807 [2024-11-28 23:23:06.230735] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.807 [2024-11-28 23:23:06.230749] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.807 [2024-11-28 23:23:06.230763] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.807 [2024-11-28 23:23:06.230792] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.807 qpair failed and we were unable to recover it. 00:31:02.807 [2024-11-28 23:23:06.240586] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.807 [2024-11-28 23:23:06.240670] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.807 [2024-11-28 23:23:06.240696] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.807 [2024-11-28 23:23:06.240712] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.807 [2024-11-28 23:23:06.240725] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.807 [2024-11-28 23:23:06.240754] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.807 qpair failed and we were unable to recover it. 00:31:02.807 [2024-11-28 23:23:06.250635] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.807 [2024-11-28 23:23:06.250725] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.807 [2024-11-28 23:23:06.250751] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.807 [2024-11-28 23:23:06.250766] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.807 [2024-11-28 23:23:06.250780] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.807 [2024-11-28 23:23:06.250824] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.807 qpair failed and we were unable to recover it. 00:31:02.807 [2024-11-28 23:23:06.260650] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.807 [2024-11-28 23:23:06.260738] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.807 [2024-11-28 23:23:06.260765] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.807 [2024-11-28 23:23:06.260779] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.807 [2024-11-28 23:23:06.260794] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.807 [2024-11-28 23:23:06.260824] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.807 qpair failed and we were unable to recover it. 00:31:02.807 [2024-11-28 23:23:06.270719] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.807 [2024-11-28 23:23:06.270825] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.807 [2024-11-28 23:23:06.270851] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.807 [2024-11-28 23:23:06.270865] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.807 [2024-11-28 23:23:06.270878] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.807 [2024-11-28 23:23:06.270909] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.807 qpair failed and we were unable to recover it. 00:31:02.807 [2024-11-28 23:23:06.280733] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.807 [2024-11-28 23:23:06.280819] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.807 [2024-11-28 23:23:06.280848] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.807 [2024-11-28 23:23:06.280863] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.807 [2024-11-28 23:23:06.280876] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.807 [2024-11-28 23:23:06.280905] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.807 qpair failed and we were unable to recover it. 00:31:02.807 [2024-11-28 23:23:06.290773] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.807 [2024-11-28 23:23:06.290868] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.807 [2024-11-28 23:23:06.290894] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.807 [2024-11-28 23:23:06.290908] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.807 [2024-11-28 23:23:06.290921] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.807 [2024-11-28 23:23:06.290951] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.807 qpair failed and we were unable to recover it. 00:31:02.807 [2024-11-28 23:23:06.300767] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.807 [2024-11-28 23:23:06.300860] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.807 [2024-11-28 23:23:06.300887] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.807 [2024-11-28 23:23:06.300901] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.807 [2024-11-28 23:23:06.300914] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.807 [2024-11-28 23:23:06.300943] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.807 qpair failed and we were unable to recover it. 00:31:02.807 [2024-11-28 23:23:06.310788] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.807 [2024-11-28 23:23:06.310876] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.807 [2024-11-28 23:23:06.310902] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.807 [2024-11-28 23:23:06.310922] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.807 [2024-11-28 23:23:06.310936] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.808 [2024-11-28 23:23:06.310967] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.808 qpair failed and we were unable to recover it. 00:31:02.808 [2024-11-28 23:23:06.320836] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.808 [2024-11-28 23:23:06.320924] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.808 [2024-11-28 23:23:06.320950] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.808 [2024-11-28 23:23:06.320964] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.808 [2024-11-28 23:23:06.320976] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.808 [2024-11-28 23:23:06.321019] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.808 qpair failed and we were unable to recover it. 00:31:02.808 [2024-11-28 23:23:06.330925] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.808 [2024-11-28 23:23:06.331016] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.808 [2024-11-28 23:23:06.331042] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.808 [2024-11-28 23:23:06.331056] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.808 [2024-11-28 23:23:06.331070] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.808 [2024-11-28 23:23:06.331101] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.808 qpair failed and we were unable to recover it. 00:31:02.808 [2024-11-28 23:23:06.340925] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.808 [2024-11-28 23:23:06.341018] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.808 [2024-11-28 23:23:06.341044] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.808 [2024-11-28 23:23:06.341058] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.808 [2024-11-28 23:23:06.341071] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.808 [2024-11-28 23:23:06.341101] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.808 qpair failed and we were unable to recover it. 00:31:02.808 [2024-11-28 23:23:06.351003] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.808 [2024-11-28 23:23:06.351091] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.808 [2024-11-28 23:23:06.351116] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.808 [2024-11-28 23:23:06.351130] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.808 [2024-11-28 23:23:06.351144] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.808 [2024-11-28 23:23:06.351174] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.808 qpair failed and we were unable to recover it. 00:31:02.808 [2024-11-28 23:23:06.361063] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.808 [2024-11-28 23:23:06.361153] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.808 [2024-11-28 23:23:06.361179] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.808 [2024-11-28 23:23:06.361193] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.808 [2024-11-28 23:23:06.361207] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.808 [2024-11-28 23:23:06.361237] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.808 qpair failed and we were unable to recover it. 00:31:02.808 [2024-11-28 23:23:06.371046] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.808 [2024-11-28 23:23:06.371134] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.808 [2024-11-28 23:23:06.371159] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.808 [2024-11-28 23:23:06.371173] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.808 [2024-11-28 23:23:06.371187] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.808 [2024-11-28 23:23:06.371230] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.808 qpair failed and we were unable to recover it. 00:31:02.808 [2024-11-28 23:23:06.381149] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.808 [2024-11-28 23:23:06.381241] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.808 [2024-11-28 23:23:06.381267] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.808 [2024-11-28 23:23:06.381282] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.808 [2024-11-28 23:23:06.381295] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.808 [2024-11-28 23:23:06.381325] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.808 qpair failed and we were unable to recover it. 00:31:02.808 [2024-11-28 23:23:06.391110] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.808 [2024-11-28 23:23:06.391216] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.808 [2024-11-28 23:23:06.391242] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.808 [2024-11-28 23:23:06.391257] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.808 [2024-11-28 23:23:06.391269] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.808 [2024-11-28 23:23:06.391313] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.808 qpair failed and we were unable to recover it. 00:31:02.808 [2024-11-28 23:23:06.401166] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:02.808 [2024-11-28 23:23:06.401295] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:02.808 [2024-11-28 23:23:06.401327] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:02.808 [2024-11-28 23:23:06.401342] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:02.808 [2024-11-28 23:23:06.401355] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:02.808 [2024-11-28 23:23:06.401384] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:02.808 qpair failed and we were unable to recover it. 00:31:03.067 [2024-11-28 23:23:06.411124] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.067 [2024-11-28 23:23:06.411217] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.067 [2024-11-28 23:23:06.411243] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.067 [2024-11-28 23:23:06.411257] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.067 [2024-11-28 23:23:06.411270] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.067 [2024-11-28 23:23:06.411301] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.067 qpair failed and we were unable to recover it. 00:31:03.067 [2024-11-28 23:23:06.421132] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.067 [2024-11-28 23:23:06.421263] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.067 [2024-11-28 23:23:06.421289] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.067 [2024-11-28 23:23:06.421303] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.067 [2024-11-28 23:23:06.421317] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.067 [2024-11-28 23:23:06.421347] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.067 qpair failed and we were unable to recover it. 00:31:03.067 [2024-11-28 23:23:06.431194] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.067 [2024-11-28 23:23:06.431278] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.067 [2024-11-28 23:23:06.431305] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.067 [2024-11-28 23:23:06.431319] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.067 [2024-11-28 23:23:06.431332] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.067 [2024-11-28 23:23:06.431361] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.067 qpair failed and we were unable to recover it. 00:31:03.067 [2024-11-28 23:23:06.441231] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.067 [2024-11-28 23:23:06.441333] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.067 [2024-11-28 23:23:06.441359] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.067 [2024-11-28 23:23:06.441373] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.067 [2024-11-28 23:23:06.441386] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.067 [2024-11-28 23:23:06.441431] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.067 qpair failed and we were unable to recover it. 00:31:03.067 [2024-11-28 23:23:06.451359] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.067 [2024-11-28 23:23:06.451484] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.067 [2024-11-28 23:23:06.451510] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.067 [2024-11-28 23:23:06.451524] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.067 [2024-11-28 23:23:06.451537] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.067 [2024-11-28 23:23:06.451568] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.067 qpair failed and we were unable to recover it. 00:31:03.067 [2024-11-28 23:23:06.461233] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.067 [2024-11-28 23:23:06.461319] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.067 [2024-11-28 23:23:06.461344] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.067 [2024-11-28 23:23:06.461358] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.067 [2024-11-28 23:23:06.461371] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.067 [2024-11-28 23:23:06.461406] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.067 qpair failed and we were unable to recover it. 00:31:03.067 [2024-11-28 23:23:06.471346] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.067 [2024-11-28 23:23:06.471463] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.067 [2024-11-28 23:23:06.471513] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.067 [2024-11-28 23:23:06.471537] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.067 [2024-11-28 23:23:06.471553] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.067 [2024-11-28 23:23:06.471598] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.067 qpair failed and we were unable to recover it. 00:31:03.067 [2024-11-28 23:23:06.481403] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.067 [2024-11-28 23:23:06.481489] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.067 [2024-11-28 23:23:06.481515] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.067 [2024-11-28 23:23:06.481529] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.067 [2024-11-28 23:23:06.481542] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.067 [2024-11-28 23:23:06.481572] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.067 qpair failed and we were unable to recover it. 00:31:03.067 [2024-11-28 23:23:06.491410] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.067 [2024-11-28 23:23:06.491542] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.067 [2024-11-28 23:23:06.491573] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.067 [2024-11-28 23:23:06.491588] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.067 [2024-11-28 23:23:06.491601] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.067 [2024-11-28 23:23:06.491630] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.068 qpair failed and we were unable to recover it. 00:31:03.068 [2024-11-28 23:23:06.501389] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.068 [2024-11-28 23:23:06.501488] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.068 [2024-11-28 23:23:06.501514] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.068 [2024-11-28 23:23:06.501528] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.068 [2024-11-28 23:23:06.501541] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.068 [2024-11-28 23:23:06.501571] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.068 qpair failed and we were unable to recover it. 00:31:03.068 [2024-11-28 23:23:06.511409] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.068 [2024-11-28 23:23:06.511494] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.068 [2024-11-28 23:23:06.511521] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.068 [2024-11-28 23:23:06.511535] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.068 [2024-11-28 23:23:06.511548] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.068 [2024-11-28 23:23:06.511578] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.068 qpair failed and we were unable to recover it. 00:31:03.068 [2024-11-28 23:23:06.521427] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.068 [2024-11-28 23:23:06.521518] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.068 [2024-11-28 23:23:06.521544] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.068 [2024-11-28 23:23:06.521558] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.068 [2024-11-28 23:23:06.521571] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.068 [2024-11-28 23:23:06.521614] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.068 qpair failed and we were unable to recover it. 00:31:03.068 [2024-11-28 23:23:06.531457] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.068 [2024-11-28 23:23:06.531576] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.068 [2024-11-28 23:23:06.531602] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.068 [2024-11-28 23:23:06.531616] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.068 [2024-11-28 23:23:06.531629] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.068 [2024-11-28 23:23:06.531666] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.068 qpair failed and we were unable to recover it. 00:31:03.068 [2024-11-28 23:23:06.541519] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.068 [2024-11-28 23:23:06.541639] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.068 [2024-11-28 23:23:06.541665] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.068 [2024-11-28 23:23:06.541678] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.068 [2024-11-28 23:23:06.541692] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.068 [2024-11-28 23:23:06.541721] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.068 qpair failed and we were unable to recover it. 00:31:03.068 [2024-11-28 23:23:06.551592] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.068 [2024-11-28 23:23:06.551678] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.068 [2024-11-28 23:23:06.551703] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.068 [2024-11-28 23:23:06.551717] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.068 [2024-11-28 23:23:06.551730] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.068 [2024-11-28 23:23:06.551759] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.068 qpair failed and we were unable to recover it. 00:31:03.068 [2024-11-28 23:23:06.561637] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.068 [2024-11-28 23:23:06.561726] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.068 [2024-11-28 23:23:06.561753] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.068 [2024-11-28 23:23:06.561768] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.068 [2024-11-28 23:23:06.561781] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.068 [2024-11-28 23:23:06.561811] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.068 qpair failed and we were unable to recover it. 00:31:03.068 [2024-11-28 23:23:06.571568] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.068 [2024-11-28 23:23:06.571693] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.068 [2024-11-28 23:23:06.571718] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.068 [2024-11-28 23:23:06.571732] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.068 [2024-11-28 23:23:06.571746] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.068 [2024-11-28 23:23:06.571775] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.068 qpair failed and we were unable to recover it. 00:31:03.068 [2024-11-28 23:23:06.581605] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.068 [2024-11-28 23:23:06.581743] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.068 [2024-11-28 23:23:06.581769] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.068 [2024-11-28 23:23:06.581784] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.068 [2024-11-28 23:23:06.581796] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.068 [2024-11-28 23:23:06.581825] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.068 qpair failed and we were unable to recover it. 00:31:03.068 [2024-11-28 23:23:06.591657] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.068 [2024-11-28 23:23:06.591786] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.068 [2024-11-28 23:23:06.591812] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.068 [2024-11-28 23:23:06.591826] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.068 [2024-11-28 23:23:06.591839] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.068 [2024-11-28 23:23:06.591870] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.068 qpair failed and we were unable to recover it. 00:31:03.068 [2024-11-28 23:23:06.601749] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.068 [2024-11-28 23:23:06.601851] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.068 [2024-11-28 23:23:06.601877] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.068 [2024-11-28 23:23:06.601891] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.068 [2024-11-28 23:23:06.601904] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.068 [2024-11-28 23:23:06.601934] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.068 qpair failed and we were unable to recover it. 00:31:03.068 [2024-11-28 23:23:06.611704] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.068 [2024-11-28 23:23:06.611816] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.068 [2024-11-28 23:23:06.611841] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.068 [2024-11-28 23:23:06.611855] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.068 [2024-11-28 23:23:06.611869] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.068 [2024-11-28 23:23:06.611898] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.068 qpair failed and we were unable to recover it. 00:31:03.068 [2024-11-28 23:23:06.621694] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.068 [2024-11-28 23:23:06.621831] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.068 [2024-11-28 23:23:06.621856] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.068 [2024-11-28 23:23:06.621870] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.068 [2024-11-28 23:23:06.621889] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.068 [2024-11-28 23:23:06.621920] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.068 qpair failed and we were unable to recover it. 00:31:03.068 [2024-11-28 23:23:06.631769] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.068 [2024-11-28 23:23:06.631855] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.068 [2024-11-28 23:23:06.631880] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.069 [2024-11-28 23:23:06.631895] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.069 [2024-11-28 23:23:06.631907] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.069 [2024-11-28 23:23:06.631938] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.069 qpair failed and we were unable to recover it. 00:31:03.069 [2024-11-28 23:23:06.641786] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.069 [2024-11-28 23:23:06.641874] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.069 [2024-11-28 23:23:06.641900] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.069 [2024-11-28 23:23:06.641914] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.069 [2024-11-28 23:23:06.641927] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.069 [2024-11-28 23:23:06.641956] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.069 qpair failed and we were unable to recover it. 00:31:03.069 [2024-11-28 23:23:06.651918] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.069 [2024-11-28 23:23:06.652039] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.069 [2024-11-28 23:23:06.652065] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.069 [2024-11-28 23:23:06.652079] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.069 [2024-11-28 23:23:06.652092] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.069 [2024-11-28 23:23:06.652122] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.069 qpair failed and we were unable to recover it. 00:31:03.069 [2024-11-28 23:23:06.661819] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.069 [2024-11-28 23:23:06.661907] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.069 [2024-11-28 23:23:06.661933] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.069 [2024-11-28 23:23:06.661947] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.069 [2024-11-28 23:23:06.661960] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.069 [2024-11-28 23:23:06.661991] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.069 qpair failed and we were unable to recover it. 00:31:03.327 [2024-11-28 23:23:06.671884] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.327 [2024-11-28 23:23:06.671982] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.327 [2024-11-28 23:23:06.672008] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.327 [2024-11-28 23:23:06.672022] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.327 [2024-11-28 23:23:06.672035] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.327 [2024-11-28 23:23:06.672064] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.327 qpair failed and we were unable to recover it. 00:31:03.327 [2024-11-28 23:23:06.681903] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.328 [2024-11-28 23:23:06.682019] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.328 [2024-11-28 23:23:06.682045] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.328 [2024-11-28 23:23:06.682060] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.328 [2024-11-28 23:23:06.682073] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.328 [2024-11-28 23:23:06.682105] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.328 qpair failed and we were unable to recover it. 00:31:03.328 [2024-11-28 23:23:06.692039] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.328 [2024-11-28 23:23:06.692138] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.328 [2024-11-28 23:23:06.692164] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.328 [2024-11-28 23:23:06.692179] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.328 [2024-11-28 23:23:06.692192] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.328 [2024-11-28 23:23:06.692222] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.328 qpair failed and we were unable to recover it. 00:31:03.328 [2024-11-28 23:23:06.701949] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.328 [2024-11-28 23:23:06.702069] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.328 [2024-11-28 23:23:06.702095] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.328 [2024-11-28 23:23:06.702109] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.328 [2024-11-28 23:23:06.702122] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.328 [2024-11-28 23:23:06.702151] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.328 qpair failed and we were unable to recover it. 00:31:03.328 [2024-11-28 23:23:06.711961] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.328 [2024-11-28 23:23:06.712052] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.328 [2024-11-28 23:23:06.712078] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.328 [2024-11-28 23:23:06.712099] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.328 [2024-11-28 23:23:06.712113] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.328 [2024-11-28 23:23:06.712144] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.328 qpair failed and we were unable to recover it. 00:31:03.328 [2024-11-28 23:23:06.721983] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.328 [2024-11-28 23:23:06.722076] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.328 [2024-11-28 23:23:06.722103] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.328 [2024-11-28 23:23:06.722119] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.328 [2024-11-28 23:23:06.722134] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.328 [2024-11-28 23:23:06.722164] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.328 qpair failed and we were unable to recover it. 00:31:03.328 [2024-11-28 23:23:06.732040] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.328 [2024-11-28 23:23:06.732133] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.328 [2024-11-28 23:23:06.732159] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.328 [2024-11-28 23:23:06.732174] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.328 [2024-11-28 23:23:06.732187] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.328 [2024-11-28 23:23:06.732230] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.328 qpair failed and we were unable to recover it. 00:31:03.328 [2024-11-28 23:23:06.742103] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.328 [2024-11-28 23:23:06.742217] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.328 [2024-11-28 23:23:06.742243] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.328 [2024-11-28 23:23:06.742258] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.328 [2024-11-28 23:23:06.742271] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.328 [2024-11-28 23:23:06.742303] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.328 qpair failed and we were unable to recover it. 00:31:03.328 [2024-11-28 23:23:06.752186] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.328 [2024-11-28 23:23:06.752270] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.328 [2024-11-28 23:23:06.752296] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.328 [2024-11-28 23:23:06.752311] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.328 [2024-11-28 23:23:06.752325] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.328 [2024-11-28 23:23:06.752355] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.328 qpair failed and we were unable to recover it. 00:31:03.328 [2024-11-28 23:23:06.762144] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.328 [2024-11-28 23:23:06.762247] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.328 [2024-11-28 23:23:06.762273] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.328 [2024-11-28 23:23:06.762287] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.328 [2024-11-28 23:23:06.762301] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.328 [2024-11-28 23:23:06.762331] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.328 qpair failed and we were unable to recover it. 00:31:03.328 [2024-11-28 23:23:06.772246] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.328 [2024-11-28 23:23:06.772342] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.328 [2024-11-28 23:23:06.772371] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.328 [2024-11-28 23:23:06.772386] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.328 [2024-11-28 23:23:06.772413] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.328 [2024-11-28 23:23:06.772445] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.328 qpair failed and we were unable to recover it. 00:31:03.328 [2024-11-28 23:23:06.782223] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.328 [2024-11-28 23:23:06.782318] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.328 [2024-11-28 23:23:06.782344] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.328 [2024-11-28 23:23:06.782360] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.328 [2024-11-28 23:23:06.782373] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.328 [2024-11-28 23:23:06.782414] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.328 qpair failed and we were unable to recover it. 00:31:03.328 [2024-11-28 23:23:06.792276] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.328 [2024-11-28 23:23:06.792363] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.328 [2024-11-28 23:23:06.792388] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.328 [2024-11-28 23:23:06.792413] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.328 [2024-11-28 23:23:06.792445] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.328 [2024-11-28 23:23:06.792476] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.328 qpair failed and we were unable to recover it. 00:31:03.328 [2024-11-28 23:23:06.802213] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.328 [2024-11-28 23:23:06.802300] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.328 [2024-11-28 23:23:06.802325] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.328 [2024-11-28 23:23:06.802346] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.328 [2024-11-28 23:23:06.802361] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.328 [2024-11-28 23:23:06.802398] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.328 qpair failed and we were unable to recover it. 00:31:03.328 [2024-11-28 23:23:06.812280] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.329 [2024-11-28 23:23:06.812401] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.329 [2024-11-28 23:23:06.812428] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.329 [2024-11-28 23:23:06.812443] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.329 [2024-11-28 23:23:06.812456] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.329 [2024-11-28 23:23:06.812487] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.329 qpair failed and we were unable to recover it. 00:31:03.329 [2024-11-28 23:23:06.822272] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.329 [2024-11-28 23:23:06.822365] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.329 [2024-11-28 23:23:06.822400] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.329 [2024-11-28 23:23:06.822418] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.329 [2024-11-28 23:23:06.822432] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.329 [2024-11-28 23:23:06.822465] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.329 qpair failed and we were unable to recover it. 00:31:03.329 [2024-11-28 23:23:06.832323] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.329 [2024-11-28 23:23:06.832446] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.329 [2024-11-28 23:23:06.832474] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.329 [2024-11-28 23:23:06.832488] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.329 [2024-11-28 23:23:06.832502] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.329 [2024-11-28 23:23:06.832532] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.329 qpair failed and we were unable to recover it. 00:31:03.329 [2024-11-28 23:23:06.842325] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.329 [2024-11-28 23:23:06.842427] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.329 [2024-11-28 23:23:06.842453] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.329 [2024-11-28 23:23:06.842467] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.329 [2024-11-28 23:23:06.842480] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.329 [2024-11-28 23:23:06.842511] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.329 qpair failed and we were unable to recover it. 00:31:03.329 [2024-11-28 23:23:06.852408] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.329 [2024-11-28 23:23:06.852502] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.329 [2024-11-28 23:23:06.852527] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.329 [2024-11-28 23:23:06.852541] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.329 [2024-11-28 23:23:06.852555] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.329 [2024-11-28 23:23:06.852584] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.329 qpair failed and we were unable to recover it. 00:31:03.329 [2024-11-28 23:23:06.862433] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.329 [2024-11-28 23:23:06.862535] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.329 [2024-11-28 23:23:06.862561] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.329 [2024-11-28 23:23:06.862576] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.329 [2024-11-28 23:23:06.862590] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.329 [2024-11-28 23:23:06.862620] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.329 qpair failed and we were unable to recover it. 00:31:03.329 [2024-11-28 23:23:06.872455] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.329 [2024-11-28 23:23:06.872552] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.329 [2024-11-28 23:23:06.872577] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.329 [2024-11-28 23:23:06.872591] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.329 [2024-11-28 23:23:06.872604] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.329 [2024-11-28 23:23:06.872636] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.329 qpair failed and we were unable to recover it. 00:31:03.329 [2024-11-28 23:23:06.882510] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.329 [2024-11-28 23:23:06.882609] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.329 [2024-11-28 23:23:06.882634] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.329 [2024-11-28 23:23:06.882649] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.329 [2024-11-28 23:23:06.882662] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.329 [2024-11-28 23:23:06.882691] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.329 qpair failed and we were unable to recover it. 00:31:03.329 [2024-11-28 23:23:06.892545] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.329 [2024-11-28 23:23:06.892682] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.329 [2024-11-28 23:23:06.892713] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.329 [2024-11-28 23:23:06.892728] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.329 [2024-11-28 23:23:06.892740] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.329 [2024-11-28 23:23:06.892770] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.329 qpair failed and we were unable to recover it. 00:31:03.329 [2024-11-28 23:23:06.902544] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.329 [2024-11-28 23:23:06.902630] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.329 [2024-11-28 23:23:06.902655] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.329 [2024-11-28 23:23:06.902670] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.329 [2024-11-28 23:23:06.902682] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.329 [2024-11-28 23:23:06.902712] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.329 qpair failed and we were unable to recover it. 00:31:03.329 [2024-11-28 23:23:06.912617] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.329 [2024-11-28 23:23:06.912752] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.329 [2024-11-28 23:23:06.912778] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.329 [2024-11-28 23:23:06.912793] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.329 [2024-11-28 23:23:06.912806] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.329 [2024-11-28 23:23:06.912835] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.329 qpair failed and we were unable to recover it. 00:31:03.329 [2024-11-28 23:23:06.922691] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.329 [2024-11-28 23:23:06.922773] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.329 [2024-11-28 23:23:06.922798] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.329 [2024-11-28 23:23:06.922812] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.329 [2024-11-28 23:23:06.922825] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.329 [2024-11-28 23:23:06.922854] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.329 qpair failed and we were unable to recover it. 00:31:03.588 [2024-11-28 23:23:06.932639] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.588 [2024-11-28 23:23:06.932770] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.588 [2024-11-28 23:23:06.932795] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.588 [2024-11-28 23:23:06.932809] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.588 [2024-11-28 23:23:06.932821] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.588 [2024-11-28 23:23:06.932857] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.588 qpair failed and we were unable to recover it. 00:31:03.588 [2024-11-28 23:23:06.942660] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.588 [2024-11-28 23:23:06.942770] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.588 [2024-11-28 23:23:06.942795] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.588 [2024-11-28 23:23:06.942809] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.588 [2024-11-28 23:23:06.942822] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.588 [2024-11-28 23:23:06.942852] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.588 qpair failed and we were unable to recover it. 00:31:03.588 [2024-11-28 23:23:06.952652] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.588 [2024-11-28 23:23:06.952739] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.588 [2024-11-28 23:23:06.952764] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.588 [2024-11-28 23:23:06.952778] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.588 [2024-11-28 23:23:06.952792] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.588 [2024-11-28 23:23:06.952821] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.588 qpair failed and we were unable to recover it. 00:31:03.588 [2024-11-28 23:23:06.962700] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.588 [2024-11-28 23:23:06.962787] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.588 [2024-11-28 23:23:06.962813] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.588 [2024-11-28 23:23:06.962827] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.588 [2024-11-28 23:23:06.962839] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.588 [2024-11-28 23:23:06.962869] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.588 qpair failed and we were unable to recover it. 00:31:03.588 [2024-11-28 23:23:06.972760] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.588 [2024-11-28 23:23:06.972850] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.588 [2024-11-28 23:23:06.972875] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.588 [2024-11-28 23:23:06.972890] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.588 [2024-11-28 23:23:06.972903] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.589 [2024-11-28 23:23:06.972933] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.589 qpair failed and we were unable to recover it. 00:31:03.589 [2024-11-28 23:23:06.982854] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.589 [2024-11-28 23:23:06.982941] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.589 [2024-11-28 23:23:06.982976] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.589 [2024-11-28 23:23:06.982992] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.589 [2024-11-28 23:23:06.983005] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.589 [2024-11-28 23:23:06.983035] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.589 qpair failed and we were unable to recover it. 00:31:03.589 [2024-11-28 23:23:06.992785] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.589 [2024-11-28 23:23:06.992902] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.589 [2024-11-28 23:23:06.992927] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.589 [2024-11-28 23:23:06.992941] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.589 [2024-11-28 23:23:06.992954] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.589 [2024-11-28 23:23:06.992984] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.589 qpair failed and we were unable to recover it. 00:31:03.589 [2024-11-28 23:23:07.002857] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.589 [2024-11-28 23:23:07.002981] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.589 [2024-11-28 23:23:07.003006] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.589 [2024-11-28 23:23:07.003021] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.589 [2024-11-28 23:23:07.003034] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.589 [2024-11-28 23:23:07.003063] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.589 qpair failed and we were unable to recover it. 00:31:03.589 [2024-11-28 23:23:07.012882] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.589 [2024-11-28 23:23:07.012987] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.589 [2024-11-28 23:23:07.013013] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.589 [2024-11-28 23:23:07.013027] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.589 [2024-11-28 23:23:07.013040] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.589 [2024-11-28 23:23:07.013070] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.589 qpair failed and we were unable to recover it. 00:31:03.589 [2024-11-28 23:23:07.022898] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.589 [2024-11-28 23:23:07.023025] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.589 [2024-11-28 23:23:07.023051] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.589 [2024-11-28 23:23:07.023065] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.589 [2024-11-28 23:23:07.023078] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.589 [2024-11-28 23:23:07.023114] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.589 qpair failed and we were unable to recover it. 00:31:03.589 [2024-11-28 23:23:07.032995] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.589 [2024-11-28 23:23:07.033116] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.589 [2024-11-28 23:23:07.033142] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.589 [2024-11-28 23:23:07.033157] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.589 [2024-11-28 23:23:07.033170] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.589 [2024-11-28 23:23:07.033199] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.589 qpair failed and we were unable to recover it. 00:31:03.589 [2024-11-28 23:23:07.042935] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.589 [2024-11-28 23:23:07.043021] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.589 [2024-11-28 23:23:07.043047] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.589 [2024-11-28 23:23:07.043062] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.589 [2024-11-28 23:23:07.043077] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.589 [2024-11-28 23:23:07.043107] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.589 qpair failed and we were unable to recover it. 00:31:03.589 [2024-11-28 23:23:07.053068] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.589 [2024-11-28 23:23:07.053164] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.589 [2024-11-28 23:23:07.053189] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.589 [2024-11-28 23:23:07.053204] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.589 [2024-11-28 23:23:07.053217] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.589 [2024-11-28 23:23:07.053247] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.589 qpair failed and we were unable to recover it. 00:31:03.589 [2024-11-28 23:23:07.063017] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.589 [2024-11-28 23:23:07.063119] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.589 [2024-11-28 23:23:07.063148] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.589 [2024-11-28 23:23:07.063163] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.589 [2024-11-28 23:23:07.063176] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.589 [2024-11-28 23:23:07.063207] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.589 qpair failed and we were unable to recover it. 00:31:03.589 [2024-11-28 23:23:07.073026] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.589 [2024-11-28 23:23:07.073111] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.589 [2024-11-28 23:23:07.073143] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.589 [2024-11-28 23:23:07.073158] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.589 [2024-11-28 23:23:07.073171] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.589 [2024-11-28 23:23:07.073203] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.589 qpair failed and we were unable to recover it. 00:31:03.589 [2024-11-28 23:23:07.083110] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.589 [2024-11-28 23:23:07.083206] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.589 [2024-11-28 23:23:07.083232] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.589 [2024-11-28 23:23:07.083247] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.589 [2024-11-28 23:23:07.083260] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.589 [2024-11-28 23:23:07.083289] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.589 qpair failed and we were unable to recover it. 00:31:03.589 [2024-11-28 23:23:07.093109] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.589 [2024-11-28 23:23:07.093201] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.589 [2024-11-28 23:23:07.093228] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.589 [2024-11-28 23:23:07.093242] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.589 [2024-11-28 23:23:07.093256] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.589 [2024-11-28 23:23:07.093285] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.589 qpair failed and we were unable to recover it. 00:31:03.589 [2024-11-28 23:23:07.103172] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.589 [2024-11-28 23:23:07.103268] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.589 [2024-11-28 23:23:07.103295] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.589 [2024-11-28 23:23:07.103310] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.589 [2024-11-28 23:23:07.103323] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.589 [2024-11-28 23:23:07.103355] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.589 qpair failed and we were unable to recover it. 00:31:03.589 [2024-11-28 23:23:07.113227] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.589 [2024-11-28 23:23:07.113325] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.589 [2024-11-28 23:23:07.113355] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.590 [2024-11-28 23:23:07.113370] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.590 [2024-11-28 23:23:07.113389] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.590 [2024-11-28 23:23:07.113434] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.590 qpair failed and we were unable to recover it. 00:31:03.590 [2024-11-28 23:23:07.123225] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.590 [2024-11-28 23:23:07.123321] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.590 [2024-11-28 23:23:07.123347] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.590 [2024-11-28 23:23:07.123362] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.590 [2024-11-28 23:23:07.123375] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.590 [2024-11-28 23:23:07.123412] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.590 qpair failed and we were unable to recover it. 00:31:03.590 [2024-11-28 23:23:07.133321] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.590 [2024-11-28 23:23:07.133453] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.590 [2024-11-28 23:23:07.133479] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.590 [2024-11-28 23:23:07.133494] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.590 [2024-11-28 23:23:07.133507] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.590 [2024-11-28 23:23:07.133537] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.590 qpair failed and we were unable to recover it. 00:31:03.590 [2024-11-28 23:23:07.143281] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.590 [2024-11-28 23:23:07.143376] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.590 [2024-11-28 23:23:07.143417] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.590 [2024-11-28 23:23:07.143434] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.590 [2024-11-28 23:23:07.143446] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.590 [2024-11-28 23:23:07.143477] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.590 qpair failed and we were unable to recover it. 00:31:03.590 [2024-11-28 23:23:07.153282] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.590 [2024-11-28 23:23:07.153374] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.590 [2024-11-28 23:23:07.153408] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.590 [2024-11-28 23:23:07.153425] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.590 [2024-11-28 23:23:07.153438] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.590 [2024-11-28 23:23:07.153469] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.590 qpair failed and we were unable to recover it. 00:31:03.590 [2024-11-28 23:23:07.163303] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.590 [2024-11-28 23:23:07.163404] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.590 [2024-11-28 23:23:07.163431] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.590 [2024-11-28 23:23:07.163446] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.590 [2024-11-28 23:23:07.163459] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.590 [2024-11-28 23:23:07.163492] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.590 qpair failed and we were unable to recover it. 00:31:03.590 [2024-11-28 23:23:07.173360] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.590 [2024-11-28 23:23:07.173463] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.590 [2024-11-28 23:23:07.173490] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.590 [2024-11-28 23:23:07.173504] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.590 [2024-11-28 23:23:07.173517] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.590 [2024-11-28 23:23:07.173547] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.590 qpair failed and we were unable to recover it. 00:31:03.590 [2024-11-28 23:23:07.183405] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.590 [2024-11-28 23:23:07.183510] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.590 [2024-11-28 23:23:07.183537] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.590 [2024-11-28 23:23:07.183552] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.590 [2024-11-28 23:23:07.183565] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.590 [2024-11-28 23:23:07.183595] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.590 qpair failed and we were unable to recover it. 00:31:03.849 [2024-11-28 23:23:07.193406] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.849 [2024-11-28 23:23:07.193512] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.849 [2024-11-28 23:23:07.193537] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.849 [2024-11-28 23:23:07.193551] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.849 [2024-11-28 23:23:07.193563] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.849 [2024-11-28 23:23:07.193592] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.849 qpair failed and we were unable to recover it. 00:31:03.849 [2024-11-28 23:23:07.203469] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.849 [2024-11-28 23:23:07.203551] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.849 [2024-11-28 23:23:07.203577] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.849 [2024-11-28 23:23:07.203592] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.849 [2024-11-28 23:23:07.203614] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.849 [2024-11-28 23:23:07.203646] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.849 qpair failed and we were unable to recover it. 00:31:03.849 [2024-11-28 23:23:07.213488] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.849 [2024-11-28 23:23:07.213612] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.849 [2024-11-28 23:23:07.213638] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.849 [2024-11-28 23:23:07.213653] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.849 [2024-11-28 23:23:07.213666] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.849 [2024-11-28 23:23:07.213696] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.849 qpair failed and we were unable to recover it. 00:31:03.849 [2024-11-28 23:23:07.223481] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.849 [2024-11-28 23:23:07.223570] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.849 [2024-11-28 23:23:07.223596] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.849 [2024-11-28 23:23:07.223611] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.849 [2024-11-28 23:23:07.223624] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.849 [2024-11-28 23:23:07.223653] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.849 qpair failed and we were unable to recover it. 00:31:03.849 [2024-11-28 23:23:07.233503] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.849 [2024-11-28 23:23:07.233593] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.849 [2024-11-28 23:23:07.233619] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.849 [2024-11-28 23:23:07.233633] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.849 [2024-11-28 23:23:07.233646] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.849 [2024-11-28 23:23:07.233676] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.849 qpair failed and we were unable to recover it. 00:31:03.849 [2024-11-28 23:23:07.243561] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.849 [2024-11-28 23:23:07.243643] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.849 [2024-11-28 23:23:07.243669] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.849 [2024-11-28 23:23:07.243683] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.849 [2024-11-28 23:23:07.243697] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.849 [2024-11-28 23:23:07.243728] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.849 qpair failed and we were unable to recover it. 00:31:03.849 [2024-11-28 23:23:07.253650] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.849 [2024-11-28 23:23:07.253747] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.849 [2024-11-28 23:23:07.253773] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.849 [2024-11-28 23:23:07.253787] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.849 [2024-11-28 23:23:07.253801] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.849 [2024-11-28 23:23:07.253831] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.849 qpair failed and we were unable to recover it. 00:31:03.849 [2024-11-28 23:23:07.263745] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.849 [2024-11-28 23:23:07.263867] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.849 [2024-11-28 23:23:07.263893] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.849 [2024-11-28 23:23:07.263907] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.850 [2024-11-28 23:23:07.263921] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.850 [2024-11-28 23:23:07.263950] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.850 qpair failed and we were unable to recover it. 00:31:03.850 [2024-11-28 23:23:07.273641] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.850 [2024-11-28 23:23:07.273764] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.850 [2024-11-28 23:23:07.273790] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.850 [2024-11-28 23:23:07.273806] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.850 [2024-11-28 23:23:07.273819] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.850 [2024-11-28 23:23:07.273851] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.850 qpair failed and we were unable to recover it. 00:31:03.850 [2024-11-28 23:23:07.283635] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.850 [2024-11-28 23:23:07.283724] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.850 [2024-11-28 23:23:07.283749] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.850 [2024-11-28 23:23:07.283764] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.850 [2024-11-28 23:23:07.283777] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.850 [2024-11-28 23:23:07.283809] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.850 qpair failed and we were unable to recover it. 00:31:03.850 [2024-11-28 23:23:07.293687] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.850 [2024-11-28 23:23:07.293782] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.850 [2024-11-28 23:23:07.293808] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.850 [2024-11-28 23:23:07.293829] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.850 [2024-11-28 23:23:07.293843] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.850 [2024-11-28 23:23:07.293875] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.850 qpair failed and we were unable to recover it. 00:31:03.850 [2024-11-28 23:23:07.303719] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.850 [2024-11-28 23:23:07.303808] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.850 [2024-11-28 23:23:07.303834] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.850 [2024-11-28 23:23:07.303848] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.850 [2024-11-28 23:23:07.303862] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.850 [2024-11-28 23:23:07.303891] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.850 qpair failed and we were unable to recover it. 00:31:03.850 [2024-11-28 23:23:07.313731] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.850 [2024-11-28 23:23:07.313828] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.850 [2024-11-28 23:23:07.313858] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.850 [2024-11-28 23:23:07.313874] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.850 [2024-11-28 23:23:07.313887] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.850 [2024-11-28 23:23:07.313917] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.850 qpair failed and we were unable to recover it. 00:31:03.850 [2024-11-28 23:23:07.323774] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.850 [2024-11-28 23:23:07.323890] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.850 [2024-11-28 23:23:07.323916] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.850 [2024-11-28 23:23:07.323930] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.850 [2024-11-28 23:23:07.323943] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.850 [2024-11-28 23:23:07.323974] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.850 qpair failed and we were unable to recover it. 00:31:03.850 [2024-11-28 23:23:07.333850] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.850 [2024-11-28 23:23:07.333943] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.850 [2024-11-28 23:23:07.333969] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.850 [2024-11-28 23:23:07.333984] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.850 [2024-11-28 23:23:07.333997] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.850 [2024-11-28 23:23:07.334027] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.850 qpair failed and we were unable to recover it. 00:31:03.850 [2024-11-28 23:23:07.343891] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.850 [2024-11-28 23:23:07.344028] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.850 [2024-11-28 23:23:07.344058] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.850 [2024-11-28 23:23:07.344073] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.850 [2024-11-28 23:23:07.344086] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.850 [2024-11-28 23:23:07.344116] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.850 qpair failed and we were unable to recover it. 00:31:03.850 [2024-11-28 23:23:07.353849] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.850 [2024-11-28 23:23:07.353960] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.850 [2024-11-28 23:23:07.353987] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.850 [2024-11-28 23:23:07.354001] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.850 [2024-11-28 23:23:07.354014] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.850 [2024-11-28 23:23:07.354045] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.850 qpair failed and we were unable to recover it. 00:31:03.850 [2024-11-28 23:23:07.363874] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.850 [2024-11-28 23:23:07.363960] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.850 [2024-11-28 23:23:07.363985] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.850 [2024-11-28 23:23:07.364000] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.850 [2024-11-28 23:23:07.364013] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.850 [2024-11-28 23:23:07.364043] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.850 qpair failed and we were unable to recover it. 00:31:03.850 [2024-11-28 23:23:07.373974] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.850 [2024-11-28 23:23:07.374067] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.850 [2024-11-28 23:23:07.374093] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.850 [2024-11-28 23:23:07.374108] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.850 [2024-11-28 23:23:07.374121] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.850 [2024-11-28 23:23:07.374151] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.850 qpair failed and we were unable to recover it. 00:31:03.850 [2024-11-28 23:23:07.383958] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.850 [2024-11-28 23:23:07.384049] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.850 [2024-11-28 23:23:07.384080] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.850 [2024-11-28 23:23:07.384096] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.850 [2024-11-28 23:23:07.384110] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.850 [2024-11-28 23:23:07.384140] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.850 qpair failed and we were unable to recover it. 00:31:03.850 [2024-11-28 23:23:07.393928] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.850 [2024-11-28 23:23:07.394014] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.850 [2024-11-28 23:23:07.394040] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.850 [2024-11-28 23:23:07.394054] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.850 [2024-11-28 23:23:07.394067] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.850 [2024-11-28 23:23:07.394097] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.850 qpair failed and we were unable to recover it. 00:31:03.850 [2024-11-28 23:23:07.404007] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.851 [2024-11-28 23:23:07.404097] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.851 [2024-11-28 23:23:07.404124] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.851 [2024-11-28 23:23:07.404138] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.851 [2024-11-28 23:23:07.404151] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.851 [2024-11-28 23:23:07.404181] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.851 qpair failed and we were unable to recover it. 00:31:03.851 [2024-11-28 23:23:07.414019] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.851 [2024-11-28 23:23:07.414128] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.851 [2024-11-28 23:23:07.414154] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.851 [2024-11-28 23:23:07.414169] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.851 [2024-11-28 23:23:07.414182] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.851 [2024-11-28 23:23:07.414212] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.851 qpair failed and we were unable to recover it. 00:31:03.851 [2024-11-28 23:23:07.424017] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.851 [2024-11-28 23:23:07.424117] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.851 [2024-11-28 23:23:07.424143] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.851 [2024-11-28 23:23:07.424157] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.851 [2024-11-28 23:23:07.424170] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.851 [2024-11-28 23:23:07.424200] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.851 qpair failed and we were unable to recover it. 00:31:03.851 [2024-11-28 23:23:07.434061] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.851 [2024-11-28 23:23:07.434183] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.851 [2024-11-28 23:23:07.434210] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.851 [2024-11-28 23:23:07.434224] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.851 [2024-11-28 23:23:07.434237] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.851 [2024-11-28 23:23:07.434267] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.851 qpair failed and we were unable to recover it. 00:31:03.851 [2024-11-28 23:23:07.444083] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:03.851 [2024-11-28 23:23:07.444170] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:03.851 [2024-11-28 23:23:07.444196] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:03.851 [2024-11-28 23:23:07.444210] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:03.851 [2024-11-28 23:23:07.444223] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:03.851 [2024-11-28 23:23:07.444252] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:03.851 qpair failed and we were unable to recover it. 00:31:04.111 [2024-11-28 23:23:07.454134] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.111 [2024-11-28 23:23:07.454240] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.111 [2024-11-28 23:23:07.454265] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.111 [2024-11-28 23:23:07.454281] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.111 [2024-11-28 23:23:07.454294] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.111 [2024-11-28 23:23:07.454323] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.111 qpair failed and we were unable to recover it. 00:31:04.111 [2024-11-28 23:23:07.464214] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.111 [2024-11-28 23:23:07.464310] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.111 [2024-11-28 23:23:07.464336] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.111 [2024-11-28 23:23:07.464351] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.111 [2024-11-28 23:23:07.464364] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.111 [2024-11-28 23:23:07.464402] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.111 qpair failed and we were unable to recover it. 00:31:04.111 [2024-11-28 23:23:07.474194] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.111 [2024-11-28 23:23:07.474280] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.111 [2024-11-28 23:23:07.474312] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.111 [2024-11-28 23:23:07.474327] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.111 [2024-11-28 23:23:07.474340] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.111 [2024-11-28 23:23:07.474370] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.111 qpair failed and we were unable to recover it. 00:31:04.111 [2024-11-28 23:23:07.484198] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.111 [2024-11-28 23:23:07.484286] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.111 [2024-11-28 23:23:07.484313] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.111 [2024-11-28 23:23:07.484327] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.111 [2024-11-28 23:23:07.484340] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.111 [2024-11-28 23:23:07.484369] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.111 qpair failed and we were unable to recover it. 00:31:04.111 [2024-11-28 23:23:07.494232] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.111 [2024-11-28 23:23:07.494326] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.111 [2024-11-28 23:23:07.494351] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.111 [2024-11-28 23:23:07.494366] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.111 [2024-11-28 23:23:07.494380] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.111 [2024-11-28 23:23:07.494419] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.111 qpair failed and we were unable to recover it. 00:31:04.111 [2024-11-28 23:23:07.504340] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.111 [2024-11-28 23:23:07.504441] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.111 [2024-11-28 23:23:07.504467] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.111 [2024-11-28 23:23:07.504481] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.111 [2024-11-28 23:23:07.504494] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.111 [2024-11-28 23:23:07.504525] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.111 qpair failed and we were unable to recover it. 00:31:04.111 [2024-11-28 23:23:07.514295] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.111 [2024-11-28 23:23:07.514422] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.111 [2024-11-28 23:23:07.514449] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.111 [2024-11-28 23:23:07.514463] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.111 [2024-11-28 23:23:07.514476] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.111 [2024-11-28 23:23:07.514526] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.111 qpair failed and we were unable to recover it. 00:31:04.111 [2024-11-28 23:23:07.524372] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.111 [2024-11-28 23:23:07.524466] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.111 [2024-11-28 23:23:07.524493] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.111 [2024-11-28 23:23:07.524507] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.111 [2024-11-28 23:23:07.524520] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.111 [2024-11-28 23:23:07.524550] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.111 qpair failed and we were unable to recover it. 00:31:04.111 [2024-11-28 23:23:07.534326] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.111 [2024-11-28 23:23:07.534420] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.111 [2024-11-28 23:23:07.534446] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.111 [2024-11-28 23:23:07.534460] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.111 [2024-11-28 23:23:07.534473] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.111 [2024-11-28 23:23:07.534505] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.111 qpair failed and we were unable to recover it. 00:31:04.111 [2024-11-28 23:23:07.544428] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.111 [2024-11-28 23:23:07.544564] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.111 [2024-11-28 23:23:07.544590] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.111 [2024-11-28 23:23:07.544604] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.111 [2024-11-28 23:23:07.544617] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.111 [2024-11-28 23:23:07.544649] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.111 qpair failed and we were unable to recover it. 00:31:04.111 [2024-11-28 23:23:07.554416] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.112 [2024-11-28 23:23:07.554503] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.112 [2024-11-28 23:23:07.554529] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.112 [2024-11-28 23:23:07.554544] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.112 [2024-11-28 23:23:07.554557] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.112 [2024-11-28 23:23:07.554588] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.112 qpair failed and we were unable to recover it. 00:31:04.112 [2024-11-28 23:23:07.564451] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.112 [2024-11-28 23:23:07.564550] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.112 [2024-11-28 23:23:07.564581] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.112 [2024-11-28 23:23:07.564596] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.112 [2024-11-28 23:23:07.564610] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.112 [2024-11-28 23:23:07.564639] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.112 qpair failed and we were unable to recover it. 00:31:04.112 [2024-11-28 23:23:07.574459] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.112 [2024-11-28 23:23:07.574549] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.112 [2024-11-28 23:23:07.574576] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.112 [2024-11-28 23:23:07.574591] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.112 [2024-11-28 23:23:07.574604] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.112 [2024-11-28 23:23:07.574633] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.112 qpair failed and we were unable to recover it. 00:31:04.112 [2024-11-28 23:23:07.584496] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.112 [2024-11-28 23:23:07.584587] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.112 [2024-11-28 23:23:07.584613] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.112 [2024-11-28 23:23:07.584627] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.112 [2024-11-28 23:23:07.584641] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.112 [2024-11-28 23:23:07.584670] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.112 qpair failed and we were unable to recover it. 00:31:04.112 [2024-11-28 23:23:07.594545] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.112 [2024-11-28 23:23:07.594628] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.112 [2024-11-28 23:23:07.594654] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.112 [2024-11-28 23:23:07.594668] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.112 [2024-11-28 23:23:07.594681] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.112 [2024-11-28 23:23:07.594710] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.112 qpair failed and we were unable to recover it. 00:31:04.112 [2024-11-28 23:23:07.604645] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.112 [2024-11-28 23:23:07.604727] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.112 [2024-11-28 23:23:07.604752] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.112 [2024-11-28 23:23:07.604767] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.112 [2024-11-28 23:23:07.604785] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.112 [2024-11-28 23:23:07.604816] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.112 qpair failed and we were unable to recover it. 00:31:04.112 [2024-11-28 23:23:07.614578] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.112 [2024-11-28 23:23:07.614667] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.112 [2024-11-28 23:23:07.614693] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.112 [2024-11-28 23:23:07.614708] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.112 [2024-11-28 23:23:07.614721] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.112 [2024-11-28 23:23:07.614751] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.112 qpair failed and we were unable to recover it. 00:31:04.112 [2024-11-28 23:23:07.624632] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.112 [2024-11-28 23:23:07.624739] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.112 [2024-11-28 23:23:07.624765] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.112 [2024-11-28 23:23:07.624780] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.112 [2024-11-28 23:23:07.624793] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.112 [2024-11-28 23:23:07.624822] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.112 qpair failed and we were unable to recover it. 00:31:04.112 [2024-11-28 23:23:07.634635] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.112 [2024-11-28 23:23:07.634752] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.112 [2024-11-28 23:23:07.634779] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.112 [2024-11-28 23:23:07.634793] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.112 [2024-11-28 23:23:07.634806] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.112 [2024-11-28 23:23:07.634839] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.112 qpair failed and we were unable to recover it. 00:31:04.112 [2024-11-28 23:23:07.644663] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.112 [2024-11-28 23:23:07.644769] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.112 [2024-11-28 23:23:07.644795] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.112 [2024-11-28 23:23:07.644810] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.112 [2024-11-28 23:23:07.644823] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.112 [2024-11-28 23:23:07.644853] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.112 qpair failed and we were unable to recover it. 00:31:04.112 [2024-11-28 23:23:07.654728] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.112 [2024-11-28 23:23:07.654843] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.112 [2024-11-28 23:23:07.654869] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.112 [2024-11-28 23:23:07.654884] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.112 [2024-11-28 23:23:07.654896] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.112 [2024-11-28 23:23:07.654927] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.112 qpair failed and we were unable to recover it. 00:31:04.112 [2024-11-28 23:23:07.664708] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.112 [2024-11-28 23:23:07.664798] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.112 [2024-11-28 23:23:07.664824] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.112 [2024-11-28 23:23:07.664840] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.112 [2024-11-28 23:23:07.664853] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.112 [2024-11-28 23:23:07.664884] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.112 qpair failed and we were unable to recover it. 00:31:04.112 [2024-11-28 23:23:07.674729] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.112 [2024-11-28 23:23:07.674824] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.112 [2024-11-28 23:23:07.674851] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.112 [2024-11-28 23:23:07.674866] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.112 [2024-11-28 23:23:07.674879] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.112 [2024-11-28 23:23:07.674908] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.112 qpair failed and we were unable to recover it. 00:31:04.112 [2024-11-28 23:23:07.684786] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.112 [2024-11-28 23:23:07.684872] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.112 [2024-11-28 23:23:07.684899] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.112 [2024-11-28 23:23:07.684913] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.113 [2024-11-28 23:23:07.684926] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.113 [2024-11-28 23:23:07.684956] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.113 qpair failed and we were unable to recover it. 00:31:04.113 [2024-11-28 23:23:07.694827] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.113 [2024-11-28 23:23:07.694919] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.113 [2024-11-28 23:23:07.694945] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.113 [2024-11-28 23:23:07.694959] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.113 [2024-11-28 23:23:07.694978] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.113 [2024-11-28 23:23:07.695011] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.113 qpair failed and we were unable to recover it. 00:31:04.113 [2024-11-28 23:23:07.704855] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.113 [2024-11-28 23:23:07.704950] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.113 [2024-11-28 23:23:07.704976] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.113 [2024-11-28 23:23:07.704991] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.113 [2024-11-28 23:23:07.705004] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.113 [2024-11-28 23:23:07.705033] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.113 qpair failed and we were unable to recover it. 00:31:04.372 [2024-11-28 23:23:07.714850] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.373 [2024-11-28 23:23:07.714951] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.373 [2024-11-28 23:23:07.714977] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.373 [2024-11-28 23:23:07.714992] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.373 [2024-11-28 23:23:07.715005] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.373 [2024-11-28 23:23:07.715036] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.373 qpair failed and we were unable to recover it. 00:31:04.373 [2024-11-28 23:23:07.724932] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.373 [2024-11-28 23:23:07.725050] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.373 [2024-11-28 23:23:07.725075] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.373 [2024-11-28 23:23:07.725090] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.373 [2024-11-28 23:23:07.725103] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.373 [2024-11-28 23:23:07.725133] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.373 qpair failed and we were unable to recover it. 00:31:04.373 [2024-11-28 23:23:07.734979] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.373 [2024-11-28 23:23:07.735069] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.373 [2024-11-28 23:23:07.735094] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.373 [2024-11-28 23:23:07.735109] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.373 [2024-11-28 23:23:07.735122] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.373 [2024-11-28 23:23:07.735153] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.373 qpair failed and we were unable to recover it. 00:31:04.373 [2024-11-28 23:23:07.744988] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.373 [2024-11-28 23:23:07.745125] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.373 [2024-11-28 23:23:07.745155] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.373 [2024-11-28 23:23:07.745171] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.373 [2024-11-28 23:23:07.745184] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.373 [2024-11-28 23:23:07.745215] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.373 qpair failed and we were unable to recover it. 00:31:04.373 [2024-11-28 23:23:07.755086] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.373 [2024-11-28 23:23:07.755176] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.373 [2024-11-28 23:23:07.755203] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.373 [2024-11-28 23:23:07.755217] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.373 [2024-11-28 23:23:07.755230] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.373 [2024-11-28 23:23:07.755260] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.373 qpair failed and we were unable to recover it. 00:31:04.373 [2024-11-28 23:23:07.765065] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.373 [2024-11-28 23:23:07.765158] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.373 [2024-11-28 23:23:07.765185] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.373 [2024-11-28 23:23:07.765199] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.373 [2024-11-28 23:23:07.765212] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.373 [2024-11-28 23:23:07.765242] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.373 qpair failed and we were unable to recover it. 00:31:04.373 [2024-11-28 23:23:07.775149] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.373 [2024-11-28 23:23:07.775244] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.373 [2024-11-28 23:23:07.775271] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.373 [2024-11-28 23:23:07.775286] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.373 [2024-11-28 23:23:07.775299] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.373 [2024-11-28 23:23:07.775329] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.373 qpair failed and we were unable to recover it. 00:31:04.373 [2024-11-28 23:23:07.785119] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.373 [2024-11-28 23:23:07.785249] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.373 [2024-11-28 23:23:07.785275] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.373 [2024-11-28 23:23:07.785295] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.373 [2024-11-28 23:23:07.785309] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.373 [2024-11-28 23:23:07.785340] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.373 qpair failed and we were unable to recover it. 00:31:04.373 [2024-11-28 23:23:07.795226] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.373 [2024-11-28 23:23:07.795353] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.373 [2024-11-28 23:23:07.795380] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.373 [2024-11-28 23:23:07.795402] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.373 [2024-11-28 23:23:07.795418] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.373 [2024-11-28 23:23:07.795449] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.373 qpair failed and we were unable to recover it. 00:31:04.373 [2024-11-28 23:23:07.805139] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.373 [2024-11-28 23:23:07.805224] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.373 [2024-11-28 23:23:07.805250] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.373 [2024-11-28 23:23:07.805264] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.373 [2024-11-28 23:23:07.805277] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.373 [2024-11-28 23:23:07.805307] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.373 qpair failed and we were unable to recover it. 00:31:04.373 [2024-11-28 23:23:07.815172] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.373 [2024-11-28 23:23:07.815266] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.373 [2024-11-28 23:23:07.815292] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.373 [2024-11-28 23:23:07.815307] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.373 [2024-11-28 23:23:07.815320] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.373 [2024-11-28 23:23:07.815350] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.373 qpair failed and we were unable to recover it. 00:31:04.373 [2024-11-28 23:23:07.825185] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.373 [2024-11-28 23:23:07.825273] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.373 [2024-11-28 23:23:07.825298] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.373 [2024-11-28 23:23:07.825312] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.373 [2024-11-28 23:23:07.825326] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.373 [2024-11-28 23:23:07.825355] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.373 qpair failed and we were unable to recover it. 00:31:04.373 [2024-11-28 23:23:07.835291] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.373 [2024-11-28 23:23:07.835375] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.373 [2024-11-28 23:23:07.835408] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.373 [2024-11-28 23:23:07.835424] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.373 [2024-11-28 23:23:07.835437] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.373 [2024-11-28 23:23:07.835467] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.373 qpair failed and we were unable to recover it. 00:31:04.373 [2024-11-28 23:23:07.845264] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.374 [2024-11-28 23:23:07.845381] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.374 [2024-11-28 23:23:07.845416] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.374 [2024-11-28 23:23:07.845431] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.374 [2024-11-28 23:23:07.845444] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.374 [2024-11-28 23:23:07.845474] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.374 qpair failed and we were unable to recover it. 00:31:04.374 [2024-11-28 23:23:07.855307] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.374 [2024-11-28 23:23:07.855407] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.374 [2024-11-28 23:23:07.855433] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.374 [2024-11-28 23:23:07.855448] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.374 [2024-11-28 23:23:07.855461] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.374 [2024-11-28 23:23:07.855504] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.374 qpair failed and we were unable to recover it. 00:31:04.374 [2024-11-28 23:23:07.865325] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.374 [2024-11-28 23:23:07.865437] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.374 [2024-11-28 23:23:07.865465] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.374 [2024-11-28 23:23:07.865479] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.374 [2024-11-28 23:23:07.865493] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.374 [2024-11-28 23:23:07.865524] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.374 qpair failed and we were unable to recover it. 00:31:04.374 [2024-11-28 23:23:07.875463] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.374 [2024-11-28 23:23:07.875600] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.374 [2024-11-28 23:23:07.875626] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.374 [2024-11-28 23:23:07.875648] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.374 [2024-11-28 23:23:07.875663] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.374 [2024-11-28 23:23:07.875694] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.374 qpair failed and we were unable to recover it. 00:31:04.374 [2024-11-28 23:23:07.885357] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.374 [2024-11-28 23:23:07.885480] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.374 [2024-11-28 23:23:07.885507] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.374 [2024-11-28 23:23:07.885521] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.374 [2024-11-28 23:23:07.885534] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.374 [2024-11-28 23:23:07.885565] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.374 qpair failed and we were unable to recover it. 00:31:04.374 [2024-11-28 23:23:07.895434] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.374 [2024-11-28 23:23:07.895528] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.374 [2024-11-28 23:23:07.895554] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.374 [2024-11-28 23:23:07.895569] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.374 [2024-11-28 23:23:07.895582] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.374 [2024-11-28 23:23:07.895613] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.374 qpair failed and we were unable to recover it. 00:31:04.374 [2024-11-28 23:23:07.905501] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.374 [2024-11-28 23:23:07.905599] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.374 [2024-11-28 23:23:07.905625] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.374 [2024-11-28 23:23:07.905639] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.374 [2024-11-28 23:23:07.905653] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.374 [2024-11-28 23:23:07.905684] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.374 qpair failed and we were unable to recover it. 00:31:04.374 [2024-11-28 23:23:07.915484] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.374 [2024-11-28 23:23:07.915582] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.374 [2024-11-28 23:23:07.915609] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.374 [2024-11-28 23:23:07.915623] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.374 [2024-11-28 23:23:07.915636] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.374 [2024-11-28 23:23:07.915669] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.374 qpair failed and we were unable to recover it. 00:31:04.374 [2024-11-28 23:23:07.925525] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.374 [2024-11-28 23:23:07.925622] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.374 [2024-11-28 23:23:07.925652] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.374 [2024-11-28 23:23:07.925668] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.374 [2024-11-28 23:23:07.925682] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.374 [2024-11-28 23:23:07.925713] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.374 qpair failed and we were unable to recover it. 00:31:04.374 [2024-11-28 23:23:07.935560] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.374 [2024-11-28 23:23:07.935657] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.374 [2024-11-28 23:23:07.935684] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.374 [2024-11-28 23:23:07.935699] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.374 [2024-11-28 23:23:07.935712] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.374 [2024-11-28 23:23:07.935743] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.374 qpair failed and we were unable to recover it. 00:31:04.374 [2024-11-28 23:23:07.945637] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.374 [2024-11-28 23:23:07.945743] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.374 [2024-11-28 23:23:07.945774] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.374 [2024-11-28 23:23:07.945790] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.374 [2024-11-28 23:23:07.945803] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.374 [2024-11-28 23:23:07.945834] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.374 qpair failed and we were unable to recover it. 00:31:04.374 [2024-11-28 23:23:07.955591] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.374 [2024-11-28 23:23:07.955680] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.374 [2024-11-28 23:23:07.955706] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.374 [2024-11-28 23:23:07.955721] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.374 [2024-11-28 23:23:07.955734] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.374 [2024-11-28 23:23:07.955765] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.374 qpair failed and we were unable to recover it. 00:31:04.374 [2024-11-28 23:23:07.965603] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.374 [2024-11-28 23:23:07.965697] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.374 [2024-11-28 23:23:07.965728] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.374 [2024-11-28 23:23:07.965744] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.374 [2024-11-28 23:23:07.965757] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.374 [2024-11-28 23:23:07.965787] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.374 qpair failed and we were unable to recover it. 00:31:04.374 [2024-11-28 23:23:07.975771] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.374 [2024-11-28 23:23:07.975903] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.374 [2024-11-28 23:23:07.975929] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.374 [2024-11-28 23:23:07.975944] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.374 [2024-11-28 23:23:07.975957] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.375 [2024-11-28 23:23:07.975987] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.375 qpair failed and we were unable to recover it. 00:31:04.634 [2024-11-28 23:23:07.985684] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.634 [2024-11-28 23:23:07.985774] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.634 [2024-11-28 23:23:07.985800] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.634 [2024-11-28 23:23:07.985814] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.634 [2024-11-28 23:23:07.985827] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.634 [2024-11-28 23:23:07.985856] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.634 qpair failed and we were unable to recover it. 00:31:04.634 [2024-11-28 23:23:07.995688] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.634 [2024-11-28 23:23:07.995788] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.634 [2024-11-28 23:23:07.995814] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.634 [2024-11-28 23:23:07.995829] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.634 [2024-11-28 23:23:07.995842] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.634 [2024-11-28 23:23:07.995872] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.634 qpair failed and we were unable to recover it. 00:31:04.634 [2024-11-28 23:23:08.005740] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.634 [2024-11-28 23:23:08.005829] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.634 [2024-11-28 23:23:08.005855] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.634 [2024-11-28 23:23:08.005870] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.634 [2024-11-28 23:23:08.005883] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.634 [2024-11-28 23:23:08.005920] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.634 qpair failed and we were unable to recover it. 00:31:04.634 [2024-11-28 23:23:08.015794] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.634 [2024-11-28 23:23:08.015930] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.634 [2024-11-28 23:23:08.015956] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.635 [2024-11-28 23:23:08.015970] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.635 [2024-11-28 23:23:08.015983] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.635 [2024-11-28 23:23:08.016014] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.635 qpair failed and we were unable to recover it. 00:31:04.635 [2024-11-28 23:23:08.025797] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.635 [2024-11-28 23:23:08.025888] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.635 [2024-11-28 23:23:08.025917] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.635 [2024-11-28 23:23:08.025932] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.635 [2024-11-28 23:23:08.025945] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.635 [2024-11-28 23:23:08.025975] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.635 qpair failed and we were unable to recover it. 00:31:04.635 [2024-11-28 23:23:08.035795] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.635 [2024-11-28 23:23:08.035888] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.635 [2024-11-28 23:23:08.035914] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.635 [2024-11-28 23:23:08.035929] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.635 [2024-11-28 23:23:08.035942] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.635 [2024-11-28 23:23:08.035973] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.635 qpair failed and we were unable to recover it. 00:31:04.635 [2024-11-28 23:23:08.045859] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.635 [2024-11-28 23:23:08.045985] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.635 [2024-11-28 23:23:08.046012] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.635 [2024-11-28 23:23:08.046026] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.635 [2024-11-28 23:23:08.046039] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.635 [2024-11-28 23:23:08.046069] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.635 qpair failed and we were unable to recover it. 00:31:04.635 [2024-11-28 23:23:08.055890] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.635 [2024-11-28 23:23:08.055983] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.635 [2024-11-28 23:23:08.056014] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.635 [2024-11-28 23:23:08.056029] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.635 [2024-11-28 23:23:08.056042] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.635 [2024-11-28 23:23:08.056072] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.635 qpair failed and we were unable to recover it. 00:31:04.635 [2024-11-28 23:23:08.065888] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.635 [2024-11-28 23:23:08.065986] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.635 [2024-11-28 23:23:08.066013] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.635 [2024-11-28 23:23:08.066028] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.635 [2024-11-28 23:23:08.066041] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.635 [2024-11-28 23:23:08.066073] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.635 qpair failed and we were unable to recover it. 00:31:04.635 [2024-11-28 23:23:08.075943] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.635 [2024-11-28 23:23:08.076033] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.635 [2024-11-28 23:23:08.076059] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.635 [2024-11-28 23:23:08.076074] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.635 [2024-11-28 23:23:08.076087] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.635 [2024-11-28 23:23:08.076129] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.635 qpair failed and we were unable to recover it. 00:31:04.635 [2024-11-28 23:23:08.085995] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.635 [2024-11-28 23:23:08.086086] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.635 [2024-11-28 23:23:08.086112] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.635 [2024-11-28 23:23:08.086126] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.635 [2024-11-28 23:23:08.086140] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.635 [2024-11-28 23:23:08.086170] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.635 qpair failed and we were unable to recover it. 00:31:04.635 [2024-11-28 23:23:08.095974] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.635 [2024-11-28 23:23:08.096068] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.635 [2024-11-28 23:23:08.096093] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.635 [2024-11-28 23:23:08.096108] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.635 [2024-11-28 23:23:08.096121] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.635 [2024-11-28 23:23:08.096156] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.635 qpair failed and we were unable to recover it. 00:31:04.635 [2024-11-28 23:23:08.105996] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.635 [2024-11-28 23:23:08.106082] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.635 [2024-11-28 23:23:08.106108] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.635 [2024-11-28 23:23:08.106122] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.635 [2024-11-28 23:23:08.106136] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.635 [2024-11-28 23:23:08.106166] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.635 qpair failed and we were unable to recover it. 00:31:04.635 [2024-11-28 23:23:08.116050] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.635 [2024-11-28 23:23:08.116133] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.635 [2024-11-28 23:23:08.116160] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.635 [2024-11-28 23:23:08.116174] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.635 [2024-11-28 23:23:08.116187] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.635 [2024-11-28 23:23:08.116216] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.635 qpair failed and we were unable to recover it. 00:31:04.635 [2024-11-28 23:23:08.126139] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.635 [2024-11-28 23:23:08.126249] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.635 [2024-11-28 23:23:08.126279] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.635 [2024-11-28 23:23:08.126295] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.635 [2024-11-28 23:23:08.126308] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.635 [2024-11-28 23:23:08.126340] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.635 qpair failed and we were unable to recover it. 00:31:04.635 [2024-11-28 23:23:08.136102] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.635 [2024-11-28 23:23:08.136212] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.635 [2024-11-28 23:23:08.136239] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.635 [2024-11-28 23:23:08.136253] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.635 [2024-11-28 23:23:08.136266] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.635 [2024-11-28 23:23:08.136297] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.635 qpair failed and we were unable to recover it. 00:31:04.635 [2024-11-28 23:23:08.146120] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.635 [2024-11-28 23:23:08.146233] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.635 [2024-11-28 23:23:08.146263] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.635 [2024-11-28 23:23:08.146278] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.635 [2024-11-28 23:23:08.146290] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.635 [2024-11-28 23:23:08.146320] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.635 qpair failed and we were unable to recover it. 00:31:04.635 [2024-11-28 23:23:08.156188] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.636 [2024-11-28 23:23:08.156287] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.636 [2024-11-28 23:23:08.156316] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.636 [2024-11-28 23:23:08.156331] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.636 [2024-11-28 23:23:08.156344] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.636 [2024-11-28 23:23:08.156374] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.636 qpair failed and we were unable to recover it. 00:31:04.636 [2024-11-28 23:23:08.166212] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.636 [2024-11-28 23:23:08.166301] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.636 [2024-11-28 23:23:08.166327] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.636 [2024-11-28 23:23:08.166342] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.636 [2024-11-28 23:23:08.166355] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.636 [2024-11-28 23:23:08.166384] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.636 qpair failed and we were unable to recover it. 00:31:04.636 [2024-11-28 23:23:08.176298] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.636 [2024-11-28 23:23:08.176390] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.636 [2024-11-28 23:23:08.176427] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.636 [2024-11-28 23:23:08.176442] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.636 [2024-11-28 23:23:08.176455] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.636 [2024-11-28 23:23:08.176485] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.636 qpair failed and we were unable to recover it. 00:31:04.636 [2024-11-28 23:23:08.186223] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.636 [2024-11-28 23:23:08.186355] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.636 [2024-11-28 23:23:08.186381] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.636 [2024-11-28 23:23:08.186406] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.636 [2024-11-28 23:23:08.186428] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.636 [2024-11-28 23:23:08.186460] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.636 qpair failed and we were unable to recover it. 00:31:04.636 [2024-11-28 23:23:08.196249] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.636 [2024-11-28 23:23:08.196338] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.636 [2024-11-28 23:23:08.196364] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.636 [2024-11-28 23:23:08.196378] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.636 [2024-11-28 23:23:08.196390] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.636 [2024-11-28 23:23:08.196429] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.636 qpair failed and we were unable to recover it. 00:31:04.636 [2024-11-28 23:23:08.206325] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.636 [2024-11-28 23:23:08.206420] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.636 [2024-11-28 23:23:08.206447] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.636 [2024-11-28 23:23:08.206461] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.636 [2024-11-28 23:23:08.206474] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.636 [2024-11-28 23:23:08.206506] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.636 qpair failed and we were unable to recover it. 00:31:04.636 [2024-11-28 23:23:08.216328] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.636 [2024-11-28 23:23:08.216441] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.636 [2024-11-28 23:23:08.216467] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.636 [2024-11-28 23:23:08.216482] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.636 [2024-11-28 23:23:08.216496] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.636 [2024-11-28 23:23:08.216526] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.636 qpair failed and we were unable to recover it. 00:31:04.636 [2024-11-28 23:23:08.226332] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.636 [2024-11-28 23:23:08.226425] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.636 [2024-11-28 23:23:08.226451] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.636 [2024-11-28 23:23:08.226466] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.636 [2024-11-28 23:23:08.226480] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.636 [2024-11-28 23:23:08.226511] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.636 qpair failed and we were unable to recover it. 00:31:04.636 [2024-11-28 23:23:08.236352] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.636 [2024-11-28 23:23:08.236453] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.636 [2024-11-28 23:23:08.236480] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.636 [2024-11-28 23:23:08.236494] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.636 [2024-11-28 23:23:08.236507] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.636 [2024-11-28 23:23:08.236537] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.636 qpair failed and we were unable to recover it. 00:31:04.896 [2024-11-28 23:23:08.246434] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.896 [2024-11-28 23:23:08.246523] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.896 [2024-11-28 23:23:08.246549] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.896 [2024-11-28 23:23:08.246564] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.896 [2024-11-28 23:23:08.246577] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.896 [2024-11-28 23:23:08.246607] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.896 qpair failed and we were unable to recover it. 00:31:04.896 [2024-11-28 23:23:08.256443] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.896 [2024-11-28 23:23:08.256574] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.896 [2024-11-28 23:23:08.256600] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.896 [2024-11-28 23:23:08.256614] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.896 [2024-11-28 23:23:08.256629] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.896 [2024-11-28 23:23:08.256674] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.896 qpair failed and we were unable to recover it. 00:31:04.896 [2024-11-28 23:23:08.266518] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.896 [2024-11-28 23:23:08.266612] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.896 [2024-11-28 23:23:08.266638] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.896 [2024-11-28 23:23:08.266652] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.896 [2024-11-28 23:23:08.266666] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.896 [2024-11-28 23:23:08.266695] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.896 qpair failed and we were unable to recover it. 00:31:04.896 [2024-11-28 23:23:08.276503] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.896 [2024-11-28 23:23:08.276588] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.896 [2024-11-28 23:23:08.276614] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.896 [2024-11-28 23:23:08.276634] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.896 [2024-11-28 23:23:08.276649] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.896 [2024-11-28 23:23:08.276679] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.896 qpair failed and we were unable to recover it. 00:31:04.896 [2024-11-28 23:23:08.286567] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.896 [2024-11-28 23:23:08.286694] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.896 [2024-11-28 23:23:08.286719] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.896 [2024-11-28 23:23:08.286734] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.896 [2024-11-28 23:23:08.286747] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.896 [2024-11-28 23:23:08.286776] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.896 qpair failed and we were unable to recover it. 00:31:04.896 [2024-11-28 23:23:08.296551] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.896 [2024-11-28 23:23:08.296642] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.896 [2024-11-28 23:23:08.296668] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.896 [2024-11-28 23:23:08.296682] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.896 [2024-11-28 23:23:08.296695] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.896 [2024-11-28 23:23:08.296726] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.896 qpair failed and we were unable to recover it. 00:31:04.896 [2024-11-28 23:23:08.306591] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.896 [2024-11-28 23:23:08.306679] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.896 [2024-11-28 23:23:08.306705] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.896 [2024-11-28 23:23:08.306719] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.896 [2024-11-28 23:23:08.306733] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.896 [2024-11-28 23:23:08.306764] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.896 qpair failed and we were unable to recover it. 00:31:04.896 [2024-11-28 23:23:08.316713] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.896 [2024-11-28 23:23:08.316849] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.896 [2024-11-28 23:23:08.316875] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.896 [2024-11-28 23:23:08.316890] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.896 [2024-11-28 23:23:08.316903] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.896 [2024-11-28 23:23:08.316934] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.896 qpair failed and we were unable to recover it. 00:31:04.896 [2024-11-28 23:23:08.326740] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.896 [2024-11-28 23:23:08.326838] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.896 [2024-11-28 23:23:08.326864] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.896 [2024-11-28 23:23:08.326878] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.896 [2024-11-28 23:23:08.326891] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.896 [2024-11-28 23:23:08.326921] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.896 qpair failed and we were unable to recover it. 00:31:04.896 [2024-11-28 23:23:08.336697] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.896 [2024-11-28 23:23:08.336788] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.896 [2024-11-28 23:23:08.336813] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.896 [2024-11-28 23:23:08.336827] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.896 [2024-11-28 23:23:08.336840] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.896 [2024-11-28 23:23:08.336871] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.896 qpair failed and we were unable to recover it. 00:31:04.896 [2024-11-28 23:23:08.346730] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.896 [2024-11-28 23:23:08.346822] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.896 [2024-11-28 23:23:08.346847] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.896 [2024-11-28 23:23:08.346861] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.896 [2024-11-28 23:23:08.346874] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.896 [2024-11-28 23:23:08.346905] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.896 qpair failed and we were unable to recover it. 00:31:04.896 [2024-11-28 23:23:08.356814] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.896 [2024-11-28 23:23:08.356946] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.896 [2024-11-28 23:23:08.356972] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.896 [2024-11-28 23:23:08.356986] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.897 [2024-11-28 23:23:08.356999] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.897 [2024-11-28 23:23:08.357028] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.897 qpair failed and we were unable to recover it. 00:31:04.897 [2024-11-28 23:23:08.366744] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.897 [2024-11-28 23:23:08.366828] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.897 [2024-11-28 23:23:08.366854] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.897 [2024-11-28 23:23:08.366874] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.897 [2024-11-28 23:23:08.366888] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.897 [2024-11-28 23:23:08.366918] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.897 qpair failed and we were unable to recover it. 00:31:04.897 [2024-11-28 23:23:08.376853] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.897 [2024-11-28 23:23:08.377000] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.897 [2024-11-28 23:23:08.377029] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.897 [2024-11-28 23:23:08.377045] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.897 [2024-11-28 23:23:08.377059] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.897 [2024-11-28 23:23:08.377090] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.897 qpair failed and we were unable to recover it. 00:31:04.897 [2024-11-28 23:23:08.386800] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.897 [2024-11-28 23:23:08.386890] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.897 [2024-11-28 23:23:08.386917] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.897 [2024-11-28 23:23:08.386931] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.897 [2024-11-28 23:23:08.386944] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.897 [2024-11-28 23:23:08.386973] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.897 qpair failed and we were unable to recover it. 00:31:04.897 [2024-11-28 23:23:08.396862] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.897 [2024-11-28 23:23:08.396956] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.897 [2024-11-28 23:23:08.396982] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.897 [2024-11-28 23:23:08.396997] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.897 [2024-11-28 23:23:08.397010] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.897 [2024-11-28 23:23:08.397040] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.897 qpair failed and we were unable to recover it. 00:31:04.897 [2024-11-28 23:23:08.406870] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.897 [2024-11-28 23:23:08.406958] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.897 [2024-11-28 23:23:08.406984] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.897 [2024-11-28 23:23:08.406998] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.897 [2024-11-28 23:23:08.407011] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.897 [2024-11-28 23:23:08.407055] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.897 qpair failed and we were unable to recover it. 00:31:04.897 [2024-11-28 23:23:08.416958] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.897 [2024-11-28 23:23:08.417050] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.897 [2024-11-28 23:23:08.417075] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.897 [2024-11-28 23:23:08.417089] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.897 [2024-11-28 23:23:08.417103] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.897 [2024-11-28 23:23:08.417133] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.897 qpair failed and we were unable to recover it. 00:31:04.897 [2024-11-28 23:23:08.427010] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.897 [2024-11-28 23:23:08.427111] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.897 [2024-11-28 23:23:08.427137] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.897 [2024-11-28 23:23:08.427151] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.897 [2024-11-28 23:23:08.427164] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.897 [2024-11-28 23:23:08.427193] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.897 qpair failed and we were unable to recover it. 00:31:04.897 [2024-11-28 23:23:08.437072] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.897 [2024-11-28 23:23:08.437157] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.897 [2024-11-28 23:23:08.437183] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.897 [2024-11-28 23:23:08.437197] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.897 [2024-11-28 23:23:08.437211] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.897 [2024-11-28 23:23:08.437240] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.897 qpair failed and we were unable to recover it. 00:31:04.897 [2024-11-28 23:23:08.446965] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.897 [2024-11-28 23:23:08.447053] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.897 [2024-11-28 23:23:08.447079] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.897 [2024-11-28 23:23:08.447093] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.897 [2024-11-28 23:23:08.447106] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.897 [2024-11-28 23:23:08.447137] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.897 qpair failed and we were unable to recover it. 00:31:04.897 [2024-11-28 23:23:08.457020] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.897 [2024-11-28 23:23:08.457113] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.897 [2024-11-28 23:23:08.457143] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.897 [2024-11-28 23:23:08.457158] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.897 [2024-11-28 23:23:08.457171] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.897 [2024-11-28 23:23:08.457201] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.897 qpair failed and we were unable to recover it. 00:31:04.897 [2024-11-28 23:23:08.467031] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.897 [2024-11-28 23:23:08.467124] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.897 [2024-11-28 23:23:08.467150] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.897 [2024-11-28 23:23:08.467165] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.897 [2024-11-28 23:23:08.467178] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.897 [2024-11-28 23:23:08.467207] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.897 qpair failed and we were unable to recover it. 00:31:04.897 [2024-11-28 23:23:08.477060] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.897 [2024-11-28 23:23:08.477145] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.897 [2024-11-28 23:23:08.477171] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.897 [2024-11-28 23:23:08.477186] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.897 [2024-11-28 23:23:08.477199] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.897 [2024-11-28 23:23:08.477242] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.897 qpair failed and we were unable to recover it. 00:31:04.897 [2024-11-28 23:23:08.487125] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.897 [2024-11-28 23:23:08.487207] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.897 [2024-11-28 23:23:08.487233] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.897 [2024-11-28 23:23:08.487247] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.897 [2024-11-28 23:23:08.487260] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.897 [2024-11-28 23:23:08.487291] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.897 qpair failed and we were unable to recover it. 00:31:04.897 [2024-11-28 23:23:08.497148] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.898 [2024-11-28 23:23:08.497238] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.898 [2024-11-28 23:23:08.497264] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.898 [2024-11-28 23:23:08.497279] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.898 [2024-11-28 23:23:08.497292] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:04.898 [2024-11-28 23:23:08.497328] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:04.898 qpair failed and we were unable to recover it. 00:31:05.157 [2024-11-28 23:23:08.507145] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.157 [2024-11-28 23:23:08.507239] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.157 [2024-11-28 23:23:08.507265] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.157 [2024-11-28 23:23:08.507279] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.157 [2024-11-28 23:23:08.507292] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.157 [2024-11-28 23:23:08.507322] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.157 qpair failed and we were unable to recover it. 00:31:05.157 [2024-11-28 23:23:08.517199] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.157 [2024-11-28 23:23:08.517286] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.157 [2024-11-28 23:23:08.517312] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.157 [2024-11-28 23:23:08.517326] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.157 [2024-11-28 23:23:08.517339] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.157 [2024-11-28 23:23:08.517368] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.157 qpair failed and we were unable to recover it. 00:31:05.157 [2024-11-28 23:23:08.527276] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.157 [2024-11-28 23:23:08.527356] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.157 [2024-11-28 23:23:08.527384] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.157 [2024-11-28 23:23:08.527409] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.157 [2024-11-28 23:23:08.527423] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.157 [2024-11-28 23:23:08.527453] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.157 qpair failed and we were unable to recover it. 00:31:05.157 [2024-11-28 23:23:08.537325] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.157 [2024-11-28 23:23:08.537426] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.157 [2024-11-28 23:23:08.537452] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.157 [2024-11-28 23:23:08.537466] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.157 [2024-11-28 23:23:08.537479] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.157 [2024-11-28 23:23:08.537510] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.157 qpair failed and we were unable to recover it. 00:31:05.157 [2024-11-28 23:23:08.547280] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.157 [2024-11-28 23:23:08.547371] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.157 [2024-11-28 23:23:08.547412] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.157 [2024-11-28 23:23:08.547428] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.157 [2024-11-28 23:23:08.547441] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.157 [2024-11-28 23:23:08.547471] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.157 qpair failed and we were unable to recover it. 00:31:05.157 [2024-11-28 23:23:08.557255] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.157 [2024-11-28 23:23:08.557355] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.157 [2024-11-28 23:23:08.557381] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.157 [2024-11-28 23:23:08.557405] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.157 [2024-11-28 23:23:08.557420] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.157 [2024-11-28 23:23:08.557450] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.157 qpair failed and we were unable to recover it. 00:31:05.157 [2024-11-28 23:23:08.567384] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.158 [2024-11-28 23:23:08.567479] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.158 [2024-11-28 23:23:08.567505] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.158 [2024-11-28 23:23:08.567520] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.158 [2024-11-28 23:23:08.567533] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.158 [2024-11-28 23:23:08.567562] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.158 qpair failed and we were unable to recover it. 00:31:05.158 [2024-11-28 23:23:08.577478] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.158 [2024-11-28 23:23:08.577606] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.158 [2024-11-28 23:23:08.577635] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.158 [2024-11-28 23:23:08.577650] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.158 [2024-11-28 23:23:08.577663] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.158 [2024-11-28 23:23:08.577693] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.158 qpair failed and we were unable to recover it. 00:31:05.158 [2024-11-28 23:23:08.587376] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.158 [2024-11-28 23:23:08.587481] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.158 [2024-11-28 23:23:08.587511] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.158 [2024-11-28 23:23:08.587527] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.158 [2024-11-28 23:23:08.587540] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.158 [2024-11-28 23:23:08.587576] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.158 qpair failed and we were unable to recover it. 00:31:05.158 [2024-11-28 23:23:08.597434] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.158 [2024-11-28 23:23:08.597539] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.158 [2024-11-28 23:23:08.597566] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.158 [2024-11-28 23:23:08.597580] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.158 [2024-11-28 23:23:08.597593] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.158 [2024-11-28 23:23:08.597637] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.158 qpair failed and we were unable to recover it. 00:31:05.158 [2024-11-28 23:23:08.607452] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.158 [2024-11-28 23:23:08.607545] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.158 [2024-11-28 23:23:08.607574] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.158 [2024-11-28 23:23:08.607590] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.158 [2024-11-28 23:23:08.607603] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.158 [2024-11-28 23:23:08.607633] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.158 qpair failed and we were unable to recover it. 00:31:05.158 [2024-11-28 23:23:08.617537] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.158 [2024-11-28 23:23:08.617628] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.158 [2024-11-28 23:23:08.617653] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.158 [2024-11-28 23:23:08.617668] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.158 [2024-11-28 23:23:08.617681] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.158 [2024-11-28 23:23:08.617712] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.158 qpair failed and we were unable to recover it. 00:31:05.158 [2024-11-28 23:23:08.627502] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.158 [2024-11-28 23:23:08.627597] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.158 [2024-11-28 23:23:08.627623] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.158 [2024-11-28 23:23:08.627637] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.158 [2024-11-28 23:23:08.627650] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.158 [2024-11-28 23:23:08.627679] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.158 qpair failed and we were unable to recover it. 00:31:05.158 [2024-11-28 23:23:08.637506] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.158 [2024-11-28 23:23:08.637593] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.158 [2024-11-28 23:23:08.637624] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.158 [2024-11-28 23:23:08.637640] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.158 [2024-11-28 23:23:08.637653] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.158 [2024-11-28 23:23:08.637685] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.158 qpair failed and we were unable to recover it. 00:31:05.158 [2024-11-28 23:23:08.647562] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.158 [2024-11-28 23:23:08.647649] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.158 [2024-11-28 23:23:08.647675] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.158 [2024-11-28 23:23:08.647689] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.158 [2024-11-28 23:23:08.647702] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.158 [2024-11-28 23:23:08.647732] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.158 qpair failed and we were unable to recover it. 00:31:05.158 [2024-11-28 23:23:08.657590] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.158 [2024-11-28 23:23:08.657711] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.158 [2024-11-28 23:23:08.657737] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.158 [2024-11-28 23:23:08.657752] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.158 [2024-11-28 23:23:08.657765] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.158 [2024-11-28 23:23:08.657795] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.158 qpair failed and we were unable to recover it. 00:31:05.158 [2024-11-28 23:23:08.667644] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.158 [2024-11-28 23:23:08.667744] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.158 [2024-11-28 23:23:08.667770] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.158 [2024-11-28 23:23:08.667785] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.158 [2024-11-28 23:23:08.667798] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.158 [2024-11-28 23:23:08.667828] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.158 qpair failed and we were unable to recover it. 00:31:05.158 [2024-11-28 23:23:08.677664] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.158 [2024-11-28 23:23:08.677749] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.158 [2024-11-28 23:23:08.677775] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.158 [2024-11-28 23:23:08.677789] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.158 [2024-11-28 23:23:08.677811] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.158 [2024-11-28 23:23:08.677843] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.158 qpair failed and we were unable to recover it. 00:31:05.158 [2024-11-28 23:23:08.687706] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.158 [2024-11-28 23:23:08.687804] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.158 [2024-11-28 23:23:08.687830] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.158 [2024-11-28 23:23:08.687844] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.158 [2024-11-28 23:23:08.687858] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.158 [2024-11-28 23:23:08.687888] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.158 qpair failed and we were unable to recover it. 00:31:05.158 [2024-11-28 23:23:08.697716] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.158 [2024-11-28 23:23:08.697810] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.158 [2024-11-28 23:23:08.697839] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.158 [2024-11-28 23:23:08.697855] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.159 [2024-11-28 23:23:08.697868] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.159 [2024-11-28 23:23:08.697899] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.159 qpair failed and we were unable to recover it. 00:31:05.159 [2024-11-28 23:23:08.707711] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.159 [2024-11-28 23:23:08.707809] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.159 [2024-11-28 23:23:08.707835] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.159 [2024-11-28 23:23:08.707851] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.159 [2024-11-28 23:23:08.707865] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.159 [2024-11-28 23:23:08.707896] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.159 qpair failed and we were unable to recover it. 00:31:05.159 [2024-11-28 23:23:08.717741] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.159 [2024-11-28 23:23:08.717835] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.159 [2024-11-28 23:23:08.717861] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.159 [2024-11-28 23:23:08.717875] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.159 [2024-11-28 23:23:08.717888] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.159 [2024-11-28 23:23:08.717921] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.159 qpair failed and we were unable to recover it. 00:31:05.159 [2024-11-28 23:23:08.727808] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.159 [2024-11-28 23:23:08.727910] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.159 [2024-11-28 23:23:08.727937] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.159 [2024-11-28 23:23:08.727951] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.159 [2024-11-28 23:23:08.727965] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.159 [2024-11-28 23:23:08.727995] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.159 qpair failed and we were unable to recover it. 00:31:05.159 [2024-11-28 23:23:08.737800] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.159 [2024-11-28 23:23:08.737887] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.159 [2024-11-28 23:23:08.737912] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.159 [2024-11-28 23:23:08.737926] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.159 [2024-11-28 23:23:08.737940] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.159 [2024-11-28 23:23:08.737971] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.159 qpair failed and we were unable to recover it. 00:31:05.159 [2024-11-28 23:23:08.747851] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.159 [2024-11-28 23:23:08.747988] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.159 [2024-11-28 23:23:08.748013] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.159 [2024-11-28 23:23:08.748028] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.159 [2024-11-28 23:23:08.748042] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.159 [2024-11-28 23:23:08.748071] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.159 qpair failed and we were unable to recover it. 00:31:05.159 [2024-11-28 23:23:08.757887] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.159 [2024-11-28 23:23:08.757972] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.159 [2024-11-28 23:23:08.757998] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.159 [2024-11-28 23:23:08.758013] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.159 [2024-11-28 23:23:08.758026] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.159 [2024-11-28 23:23:08.758057] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.159 qpair failed and we were unable to recover it. 00:31:05.418 [2024-11-28 23:23:08.767902] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.418 [2024-11-28 23:23:08.767989] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.418 [2024-11-28 23:23:08.768015] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.418 [2024-11-28 23:23:08.768030] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.419 [2024-11-28 23:23:08.768049] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.419 [2024-11-28 23:23:08.768080] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.419 qpair failed and we were unable to recover it. 00:31:05.419 [2024-11-28 23:23:08.777960] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.419 [2024-11-28 23:23:08.778052] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.419 [2024-11-28 23:23:08.778078] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.419 [2024-11-28 23:23:08.778093] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.419 [2024-11-28 23:23:08.778106] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.419 [2024-11-28 23:23:08.778136] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.419 qpair failed and we were unable to recover it. 00:31:05.419 [2024-11-28 23:23:08.787996] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.419 [2024-11-28 23:23:08.788133] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.419 [2024-11-28 23:23:08.788159] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.419 [2024-11-28 23:23:08.788173] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.419 [2024-11-28 23:23:08.788186] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.419 [2024-11-28 23:23:08.788216] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.419 qpair failed and we were unable to recover it. 00:31:05.419 [2024-11-28 23:23:08.798067] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.419 [2024-11-28 23:23:08.798211] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.419 [2024-11-28 23:23:08.798241] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.419 [2024-11-28 23:23:08.798257] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.419 [2024-11-28 23:23:08.798270] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.419 [2024-11-28 23:23:08.798301] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.419 qpair failed and we were unable to recover it. 00:31:05.419 [2024-11-28 23:23:08.808040] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.419 [2024-11-28 23:23:08.808128] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.419 [2024-11-28 23:23:08.808154] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.419 [2024-11-28 23:23:08.808168] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.419 [2024-11-28 23:23:08.808182] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.419 [2024-11-28 23:23:08.808212] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.419 qpair failed and we were unable to recover it. 00:31:05.419 [2024-11-28 23:23:08.818088] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.419 [2024-11-28 23:23:08.818190] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.419 [2024-11-28 23:23:08.818216] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.419 [2024-11-28 23:23:08.818231] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.419 [2024-11-28 23:23:08.818244] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.419 [2024-11-28 23:23:08.818274] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.419 qpair failed and we were unable to recover it. 00:31:05.419 [2024-11-28 23:23:08.828099] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.419 [2024-11-28 23:23:08.828187] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.419 [2024-11-28 23:23:08.828213] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.419 [2024-11-28 23:23:08.828228] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.419 [2024-11-28 23:23:08.828241] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.419 [2024-11-28 23:23:08.828271] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.419 qpair failed and we were unable to recover it. 00:31:05.419 [2024-11-28 23:23:08.838205] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.419 [2024-11-28 23:23:08.838297] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.419 [2024-11-28 23:23:08.838323] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.419 [2024-11-28 23:23:08.838337] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.419 [2024-11-28 23:23:08.838350] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.419 [2024-11-28 23:23:08.838380] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.419 qpair failed and we were unable to recover it. 00:31:05.419 [2024-11-28 23:23:08.848178] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.419 [2024-11-28 23:23:08.848281] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.419 [2024-11-28 23:23:08.848307] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.419 [2024-11-28 23:23:08.848321] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.419 [2024-11-28 23:23:08.848334] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.419 [2024-11-28 23:23:08.848364] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.419 qpair failed and we were unable to recover it. 00:31:05.419 [2024-11-28 23:23:08.858198] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.419 [2024-11-28 23:23:08.858309] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.419 [2024-11-28 23:23:08.858335] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.419 [2024-11-28 23:23:08.858356] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.419 [2024-11-28 23:23:08.858371] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.419 [2024-11-28 23:23:08.858427] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.419 qpair failed and we were unable to recover it. 00:31:05.419 [2024-11-28 23:23:08.868178] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.419 [2024-11-28 23:23:08.868315] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.419 [2024-11-28 23:23:08.868341] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.420 [2024-11-28 23:23:08.868355] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.420 [2024-11-28 23:23:08.868368] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.420 [2024-11-28 23:23:08.868408] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.420 qpair failed and we were unable to recover it. 00:31:05.420 [2024-11-28 23:23:08.878201] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.420 [2024-11-28 23:23:08.878325] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.420 [2024-11-28 23:23:08.878350] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.420 [2024-11-28 23:23:08.878364] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.420 [2024-11-28 23:23:08.878377] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.420 [2024-11-28 23:23:08.878414] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.420 qpair failed and we were unable to recover it. 00:31:05.420 [2024-11-28 23:23:08.888259] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.420 [2024-11-28 23:23:08.888345] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.420 [2024-11-28 23:23:08.888370] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.420 [2024-11-28 23:23:08.888384] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.420 [2024-11-28 23:23:08.888406] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.420 [2024-11-28 23:23:08.888448] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.420 qpair failed and we were unable to recover it. 00:31:05.420 [2024-11-28 23:23:08.898423] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.420 [2024-11-28 23:23:08.898537] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.420 [2024-11-28 23:23:08.898566] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.420 [2024-11-28 23:23:08.898580] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.420 [2024-11-28 23:23:08.898594] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.420 [2024-11-28 23:23:08.898624] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.420 qpair failed and we were unable to recover it. 00:31:05.420 [2024-11-28 23:23:08.908360] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.420 [2024-11-28 23:23:08.908489] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.420 [2024-11-28 23:23:08.908515] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.420 [2024-11-28 23:23:08.908530] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.420 [2024-11-28 23:23:08.908543] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.420 [2024-11-28 23:23:08.908572] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.420 qpair failed and we were unable to recover it. 00:31:05.420 [2024-11-28 23:23:08.918378] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.420 [2024-11-28 23:23:08.918482] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.420 [2024-11-28 23:23:08.918511] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.420 [2024-11-28 23:23:08.918526] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.420 [2024-11-28 23:23:08.918540] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.420 [2024-11-28 23:23:08.918569] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.420 qpair failed and we were unable to recover it. 00:31:05.420 [2024-11-28 23:23:08.928361] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.420 [2024-11-28 23:23:08.928454] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.420 [2024-11-28 23:23:08.928480] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.420 [2024-11-28 23:23:08.928495] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.420 [2024-11-28 23:23:08.928507] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.420 [2024-11-28 23:23:08.928537] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.420 qpair failed and we were unable to recover it. 00:31:05.420 [2024-11-28 23:23:08.938448] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.420 [2024-11-28 23:23:08.938542] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.420 [2024-11-28 23:23:08.938569] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.420 [2024-11-28 23:23:08.938587] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.420 [2024-11-28 23:23:08.938602] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.420 [2024-11-28 23:23:08.938635] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.420 qpair failed and we were unable to recover it. 00:31:05.420 [2024-11-28 23:23:08.948440] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.420 [2024-11-28 23:23:08.948539] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.420 [2024-11-28 23:23:08.948574] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.420 [2024-11-28 23:23:08.948591] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.420 [2024-11-28 23:23:08.948604] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.420 [2024-11-28 23:23:08.948650] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.420 qpair failed and we were unable to recover it. 00:31:05.420 [2024-11-28 23:23:08.958544] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.420 [2024-11-28 23:23:08.958627] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.420 [2024-11-28 23:23:08.958654] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.420 [2024-11-28 23:23:08.958668] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.420 [2024-11-28 23:23:08.958681] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.420 [2024-11-28 23:23:08.958711] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.420 qpair failed and we were unable to recover it. 00:31:05.420 [2024-11-28 23:23:08.968561] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.420 [2024-11-28 23:23:08.968680] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.420 [2024-11-28 23:23:08.968705] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.420 [2024-11-28 23:23:08.968719] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.420 [2024-11-28 23:23:08.968732] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.420 [2024-11-28 23:23:08.968761] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.421 qpair failed and we were unable to recover it. 00:31:05.421 [2024-11-28 23:23:08.978529] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.421 [2024-11-28 23:23:08.978624] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.421 [2024-11-28 23:23:08.978653] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.421 [2024-11-28 23:23:08.978668] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.421 [2024-11-28 23:23:08.978681] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.421 [2024-11-28 23:23:08.978711] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.421 qpair failed and we were unable to recover it. 00:31:05.421 [2024-11-28 23:23:08.988573] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.421 [2024-11-28 23:23:08.988679] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.421 [2024-11-28 23:23:08.988705] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.421 [2024-11-28 23:23:08.988719] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.421 [2024-11-28 23:23:08.988732] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.421 [2024-11-28 23:23:08.988761] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.421 qpair failed and we were unable to recover it. 00:31:05.421 [2024-11-28 23:23:08.998652] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.421 [2024-11-28 23:23:08.998736] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.421 [2024-11-28 23:23:08.998761] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.421 [2024-11-28 23:23:08.998775] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.421 [2024-11-28 23:23:08.998788] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.421 [2024-11-28 23:23:08.998817] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.421 qpair failed and we were unable to recover it. 00:31:05.421 [2024-11-28 23:23:09.008584] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.421 [2024-11-28 23:23:09.008674] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.421 [2024-11-28 23:23:09.008700] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.421 [2024-11-28 23:23:09.008714] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.421 [2024-11-28 23:23:09.008727] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.421 [2024-11-28 23:23:09.008758] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.421 qpair failed and we were unable to recover it. 00:31:05.421 [2024-11-28 23:23:09.018698] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.421 [2024-11-28 23:23:09.018790] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.421 [2024-11-28 23:23:09.018815] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.421 [2024-11-28 23:23:09.018830] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.421 [2024-11-28 23:23:09.018843] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.421 [2024-11-28 23:23:09.018873] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.421 qpair failed and we were unable to recover it. 00:31:05.681 [2024-11-28 23:23:09.028670] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.681 [2024-11-28 23:23:09.028775] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.681 [2024-11-28 23:23:09.028801] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.681 [2024-11-28 23:23:09.028816] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.681 [2024-11-28 23:23:09.028829] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.681 [2024-11-28 23:23:09.028861] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.681 qpair failed and we were unable to recover it. 00:31:05.681 [2024-11-28 23:23:09.038698] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.681 [2024-11-28 23:23:09.038791] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.681 [2024-11-28 23:23:09.038822] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.681 [2024-11-28 23:23:09.038837] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.681 [2024-11-28 23:23:09.038850] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.681 [2024-11-28 23:23:09.038880] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.681 qpair failed and we were unable to recover it. 00:31:05.681 [2024-11-28 23:23:09.048715] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.681 [2024-11-28 23:23:09.048804] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.681 [2024-11-28 23:23:09.048829] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.681 [2024-11-28 23:23:09.048844] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.681 [2024-11-28 23:23:09.048856] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.681 [2024-11-28 23:23:09.048886] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.681 qpair failed and we were unable to recover it. 00:31:05.681 [2024-11-28 23:23:09.058747] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.681 [2024-11-28 23:23:09.058843] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.681 [2024-11-28 23:23:09.058868] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.681 [2024-11-28 23:23:09.058882] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.681 [2024-11-28 23:23:09.058896] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.681 [2024-11-28 23:23:09.058926] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.681 qpair failed and we were unable to recover it. 00:31:05.681 [2024-11-28 23:23:09.068785] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.681 [2024-11-28 23:23:09.068872] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.681 [2024-11-28 23:23:09.068897] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.681 [2024-11-28 23:23:09.068912] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.681 [2024-11-28 23:23:09.068925] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.681 [2024-11-28 23:23:09.068956] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.681 qpair failed and we were unable to recover it. 00:31:05.681 [2024-11-28 23:23:09.078831] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.681 [2024-11-28 23:23:09.078923] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.681 [2024-11-28 23:23:09.078952] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.681 [2024-11-28 23:23:09.078968] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.681 [2024-11-28 23:23:09.078981] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.681 [2024-11-28 23:23:09.079019] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.681 qpair failed and we were unable to recover it. 00:31:05.681 [2024-11-28 23:23:09.088910] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.681 [2024-11-28 23:23:09.089015] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.681 [2024-11-28 23:23:09.089040] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.681 [2024-11-28 23:23:09.089055] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.681 [2024-11-28 23:23:09.089068] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.681 [2024-11-28 23:23:09.089098] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.681 qpair failed and we were unable to recover it. 00:31:05.682 [2024-11-28 23:23:09.098858] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.682 [2024-11-28 23:23:09.098947] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.682 [2024-11-28 23:23:09.098972] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.682 [2024-11-28 23:23:09.098987] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.682 [2024-11-28 23:23:09.099001] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.682 [2024-11-28 23:23:09.099031] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.682 qpair failed and we were unable to recover it. 00:31:05.682 [2024-11-28 23:23:09.108885] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.682 [2024-11-28 23:23:09.108971] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.682 [2024-11-28 23:23:09.108996] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.682 [2024-11-28 23:23:09.109010] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.682 [2024-11-28 23:23:09.109023] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.682 [2024-11-28 23:23:09.109052] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.682 qpair failed and we were unable to recover it. 00:31:05.682 [2024-11-28 23:23:09.118925] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.682 [2024-11-28 23:23:09.119056] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.682 [2024-11-28 23:23:09.119083] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.682 [2024-11-28 23:23:09.119097] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.682 [2024-11-28 23:23:09.119110] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.682 [2024-11-28 23:23:09.119142] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.682 qpair failed and we were unable to recover it. 00:31:05.682 [2024-11-28 23:23:09.129047] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.682 [2024-11-28 23:23:09.129181] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.682 [2024-11-28 23:23:09.129212] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.682 [2024-11-28 23:23:09.129227] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.682 [2024-11-28 23:23:09.129240] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.682 [2024-11-28 23:23:09.129269] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.682 qpair failed and we were unable to recover it. 00:31:05.682 [2024-11-28 23:23:09.138953] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.682 [2024-11-28 23:23:09.139063] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.682 [2024-11-28 23:23:09.139088] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.682 [2024-11-28 23:23:09.139102] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.682 [2024-11-28 23:23:09.139115] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.682 [2024-11-28 23:23:09.139144] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.682 qpair failed and we were unable to recover it. 00:31:05.682 [2024-11-28 23:23:09.149036] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.682 [2024-11-28 23:23:09.149121] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.682 [2024-11-28 23:23:09.149146] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.682 [2024-11-28 23:23:09.149160] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.682 [2024-11-28 23:23:09.149173] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.682 [2024-11-28 23:23:09.149201] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.682 qpair failed and we were unable to recover it. 00:31:05.682 [2024-11-28 23:23:09.159005] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.682 [2024-11-28 23:23:09.159095] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.682 [2024-11-28 23:23:09.159121] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.682 [2024-11-28 23:23:09.159135] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.682 [2024-11-28 23:23:09.159148] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.682 [2024-11-28 23:23:09.159177] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.682 qpair failed and we were unable to recover it. 00:31:05.682 [2024-11-28 23:23:09.169078] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.682 [2024-11-28 23:23:09.169201] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.682 [2024-11-28 23:23:09.169226] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.682 [2024-11-28 23:23:09.169240] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.682 [2024-11-28 23:23:09.169259] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.682 [2024-11-28 23:23:09.169291] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.682 qpair failed and we were unable to recover it. 00:31:05.682 [2024-11-28 23:23:09.179084] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.682 [2024-11-28 23:23:09.179176] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.682 [2024-11-28 23:23:09.179202] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.682 [2024-11-28 23:23:09.179215] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.682 [2024-11-28 23:23:09.179228] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.682 [2024-11-28 23:23:09.179258] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.682 qpair failed and we were unable to recover it. 00:31:05.682 [2024-11-28 23:23:09.189213] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.682 [2024-11-28 23:23:09.189344] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.682 [2024-11-28 23:23:09.189373] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.682 [2024-11-28 23:23:09.189388] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.682 [2024-11-28 23:23:09.189411] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.682 [2024-11-28 23:23:09.189443] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.682 qpair failed and we were unable to recover it. 00:31:05.683 [2024-11-28 23:23:09.199235] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.683 [2024-11-28 23:23:09.199324] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.683 [2024-11-28 23:23:09.199349] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.683 [2024-11-28 23:23:09.199363] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.683 [2024-11-28 23:23:09.199375] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.683 [2024-11-28 23:23:09.199413] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.683 qpair failed and we were unable to recover it. 00:31:05.683 [2024-11-28 23:23:09.209245] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.683 [2024-11-28 23:23:09.209343] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.683 [2024-11-28 23:23:09.209368] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.683 [2024-11-28 23:23:09.209383] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.683 [2024-11-28 23:23:09.209408] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.683 [2024-11-28 23:23:09.209442] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.683 qpair failed and we were unable to recover it. 00:31:05.683 [2024-11-28 23:23:09.219218] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.683 [2024-11-28 23:23:09.219316] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.683 [2024-11-28 23:23:09.219342] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.683 [2024-11-28 23:23:09.219356] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.683 [2024-11-28 23:23:09.219369] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.683 [2024-11-28 23:23:09.219406] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.683 qpair failed and we were unable to recover it. 00:31:05.683 [2024-11-28 23:23:09.229296] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.683 [2024-11-28 23:23:09.229434] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.683 [2024-11-28 23:23:09.229463] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.683 [2024-11-28 23:23:09.229479] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.683 [2024-11-28 23:23:09.229492] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.683 [2024-11-28 23:23:09.229522] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.683 qpair failed and we were unable to recover it. 00:31:05.683 [2024-11-28 23:23:09.239257] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.683 [2024-11-28 23:23:09.239350] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.683 [2024-11-28 23:23:09.239376] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.683 [2024-11-28 23:23:09.239391] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.683 [2024-11-28 23:23:09.239413] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.683 [2024-11-28 23:23:09.239445] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.683 qpair failed and we were unable to recover it. 00:31:05.683 [2024-11-28 23:23:09.249272] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.683 [2024-11-28 23:23:09.249359] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.683 [2024-11-28 23:23:09.249384] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.683 [2024-11-28 23:23:09.249407] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.683 [2024-11-28 23:23:09.249421] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.683 [2024-11-28 23:23:09.249451] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.683 qpair failed and we were unable to recover it. 00:31:05.683 [2024-11-28 23:23:09.259333] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.683 [2024-11-28 23:23:09.259431] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.683 [2024-11-28 23:23:09.259457] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.683 [2024-11-28 23:23:09.259471] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.683 [2024-11-28 23:23:09.259490] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.683 [2024-11-28 23:23:09.259523] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.683 qpair failed and we were unable to recover it. 00:31:05.683 [2024-11-28 23:23:09.269353] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.683 [2024-11-28 23:23:09.269461] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.683 [2024-11-28 23:23:09.269487] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.683 [2024-11-28 23:23:09.269501] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.683 [2024-11-28 23:23:09.269514] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.683 [2024-11-28 23:23:09.269545] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.683 qpair failed and we were unable to recover it. 00:31:05.683 [2024-11-28 23:23:09.279386] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.683 [2024-11-28 23:23:09.279498] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.683 [2024-11-28 23:23:09.279524] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.683 [2024-11-28 23:23:09.279539] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.683 [2024-11-28 23:23:09.279552] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.683 [2024-11-28 23:23:09.279581] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.683 qpair failed and we were unable to recover it. 00:31:05.942 [2024-11-28 23:23:09.289414] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.942 [2024-11-28 23:23:09.289529] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.942 [2024-11-28 23:23:09.289554] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.942 [2024-11-28 23:23:09.289569] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.942 [2024-11-28 23:23:09.289582] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.942 [2024-11-28 23:23:09.289612] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.942 qpair failed and we were unable to recover it. 00:31:05.942 [2024-11-28 23:23:09.299475] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.942 [2024-11-28 23:23:09.299583] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.942 [2024-11-28 23:23:09.299608] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.942 [2024-11-28 23:23:09.299622] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.942 [2024-11-28 23:23:09.299636] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.942 [2024-11-28 23:23:09.299666] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.942 qpair failed and we were unable to recover it. 00:31:05.942 [2024-11-28 23:23:09.309497] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.942 [2024-11-28 23:23:09.309589] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.942 [2024-11-28 23:23:09.309615] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.942 [2024-11-28 23:23:09.309629] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.942 [2024-11-28 23:23:09.309642] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.942 [2024-11-28 23:23:09.309672] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.942 qpair failed and we were unable to recover it. 00:31:05.942 [2024-11-28 23:23:09.319496] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.942 [2024-11-28 23:23:09.319584] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.942 [2024-11-28 23:23:09.319609] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.943 [2024-11-28 23:23:09.319623] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.943 [2024-11-28 23:23:09.319636] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.943 [2024-11-28 23:23:09.319666] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.943 qpair failed and we were unable to recover it. 00:31:05.943 [2024-11-28 23:23:09.329542] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.943 [2024-11-28 23:23:09.329655] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.943 [2024-11-28 23:23:09.329680] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.943 [2024-11-28 23:23:09.329694] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.943 [2024-11-28 23:23:09.329707] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.943 [2024-11-28 23:23:09.329737] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.943 qpair failed and we were unable to recover it. 00:31:05.943 [2024-11-28 23:23:09.339689] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.943 [2024-11-28 23:23:09.339778] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.943 [2024-11-28 23:23:09.339803] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.943 [2024-11-28 23:23:09.339817] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.943 [2024-11-28 23:23:09.339830] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.943 [2024-11-28 23:23:09.339860] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.943 qpair failed and we were unable to recover it. 00:31:05.943 [2024-11-28 23:23:09.349609] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.943 [2024-11-28 23:23:09.349710] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.943 [2024-11-28 23:23:09.349736] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.943 [2024-11-28 23:23:09.349756] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.943 [2024-11-28 23:23:09.349770] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.943 [2024-11-28 23:23:09.349800] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.943 qpair failed and we were unable to recover it. 00:31:05.943 [2024-11-28 23:23:09.359608] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.943 [2024-11-28 23:23:09.359700] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.943 [2024-11-28 23:23:09.359726] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.943 [2024-11-28 23:23:09.359741] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.943 [2024-11-28 23:23:09.359754] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.943 [2024-11-28 23:23:09.359783] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.943 qpair failed and we were unable to recover it. 00:31:05.943 [2024-11-28 23:23:09.369661] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.943 [2024-11-28 23:23:09.369767] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.943 [2024-11-28 23:23:09.369793] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.943 [2024-11-28 23:23:09.369808] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.943 [2024-11-28 23:23:09.369821] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.943 [2024-11-28 23:23:09.369851] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.943 qpair failed and we were unable to recover it. 00:31:05.943 [2024-11-28 23:23:09.379715] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.943 [2024-11-28 23:23:09.379815] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.943 [2024-11-28 23:23:09.379840] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.943 [2024-11-28 23:23:09.379854] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.943 [2024-11-28 23:23:09.379867] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.943 [2024-11-28 23:23:09.379898] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.943 qpair failed and we were unable to recover it. 00:31:05.943 [2024-11-28 23:23:09.389731] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.943 [2024-11-28 23:23:09.389823] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.943 [2024-11-28 23:23:09.389849] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.943 [2024-11-28 23:23:09.389863] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.943 [2024-11-28 23:23:09.389875] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.943 [2024-11-28 23:23:09.389904] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.943 qpair failed and we were unable to recover it. 00:31:05.943 [2024-11-28 23:23:09.399746] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.943 [2024-11-28 23:23:09.399847] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.943 [2024-11-28 23:23:09.399873] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.943 [2024-11-28 23:23:09.399887] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.943 [2024-11-28 23:23:09.399899] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.943 [2024-11-28 23:23:09.399930] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.943 qpair failed and we were unable to recover it. 00:31:05.943 [2024-11-28 23:23:09.409769] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.943 [2024-11-28 23:23:09.409861] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.943 [2024-11-28 23:23:09.409887] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.943 [2024-11-28 23:23:09.409902] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.943 [2024-11-28 23:23:09.409915] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.943 [2024-11-28 23:23:09.409945] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.943 qpair failed and we were unable to recover it. 00:31:05.943 [2024-11-28 23:23:09.419802] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.943 [2024-11-28 23:23:09.419898] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.943 [2024-11-28 23:23:09.419922] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.943 [2024-11-28 23:23:09.419936] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.943 [2024-11-28 23:23:09.419949] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.943 [2024-11-28 23:23:09.419979] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.943 qpair failed and we were unable to recover it. 00:31:05.943 [2024-11-28 23:23:09.429907] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.943 [2024-11-28 23:23:09.429998] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.943 [2024-11-28 23:23:09.430028] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.943 [2024-11-28 23:23:09.430044] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.943 [2024-11-28 23:23:09.430057] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.943 [2024-11-28 23:23:09.430087] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.943 qpair failed and we were unable to recover it. 00:31:05.943 [2024-11-28 23:23:09.439884] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.943 [2024-11-28 23:23:09.439972] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.943 [2024-11-28 23:23:09.439999] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.943 [2024-11-28 23:23:09.440022] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.943 [2024-11-28 23:23:09.440037] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.943 [2024-11-28 23:23:09.440070] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.943 qpair failed and we were unable to recover it. 00:31:05.943 [2024-11-28 23:23:09.449925] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.943 [2024-11-28 23:23:09.450052] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.943 [2024-11-28 23:23:09.450081] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.943 [2024-11-28 23:23:09.450096] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.943 [2024-11-28 23:23:09.450109] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.943 [2024-11-28 23:23:09.450139] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.944 qpair failed and we were unable to recover it. 00:31:05.944 [2024-11-28 23:23:09.459915] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.944 [2024-11-28 23:23:09.460003] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.944 [2024-11-28 23:23:09.460028] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.944 [2024-11-28 23:23:09.460042] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.944 [2024-11-28 23:23:09.460056] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa5c000b90 00:31:05.944 [2024-11-28 23:23:09.460086] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:05.944 qpair failed and we were unable to recover it. 00:31:05.944 [2024-11-28 23:23:09.469948] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.944 [2024-11-28 23:23:09.470043] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.944 [2024-11-28 23:23:09.470076] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.944 [2024-11-28 23:23:09.470093] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.944 [2024-11-28 23:23:09.470107] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa68000b90 00:31:05.944 [2024-11-28 23:23:09.470139] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.944 qpair failed and we were unable to recover it. 00:31:05.944 [2024-11-28 23:23:09.480000] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.944 [2024-11-28 23:23:09.480118] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.944 [2024-11-28 23:23:09.480145] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.944 [2024-11-28 23:23:09.480160] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.944 [2024-11-28 23:23:09.480174] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa68000b90 00:31:05.944 [2024-11-28 23:23:09.480203] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.944 qpair failed and we were unable to recover it. 00:31:05.944 [2024-11-28 23:23:09.480339] nvme_ctrlr.c:4339:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:31:05.944 A controller has encountered a failure and is being reset. 00:31:05.944 Controller properly reset. 00:31:06.202 Initializing NVMe Controllers 00:31:06.202 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:31:06.202 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:31:06.202 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:31:06.202 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:31:06.202 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:31:06.202 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:31:06.202 Initialization complete. Launching workers. 00:31:06.202 Starting thread on core 1 00:31:06.202 Starting thread on core 2 00:31:06.202 Starting thread on core 3 00:31:06.202 Starting thread on core 0 00:31:06.202 23:23:09 -- host/target_disconnect.sh@59 -- # sync 00:31:06.202 00:31:06.202 real 0m11.541s 00:31:06.202 user 0m21.273s 00:31:06.202 sys 0m5.204s 00:31:06.202 23:23:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:06.202 23:23:09 -- common/autotest_common.sh@10 -- # set +x 00:31:06.202 ************************************ 00:31:06.202 END TEST nvmf_target_disconnect_tc2 00:31:06.202 ************************************ 00:31:06.202 23:23:09 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:31:06.202 23:23:09 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:31:06.202 23:23:09 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:31:06.202 23:23:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:31:06.202 23:23:09 -- nvmf/common.sh@116 -- # sync 00:31:06.202 23:23:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:31:06.202 23:23:09 -- nvmf/common.sh@119 -- # set +e 00:31:06.202 23:23:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:31:06.202 23:23:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:31:06.202 rmmod nvme_tcp 00:31:06.202 rmmod nvme_fabrics 00:31:06.202 rmmod nvme_keyring 00:31:06.202 23:23:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:31:06.202 23:23:09 -- nvmf/common.sh@123 -- # set -e 00:31:06.202 23:23:09 -- nvmf/common.sh@124 -- # return 0 00:31:06.202 23:23:09 -- nvmf/common.sh@477 -- # '[' -n 2583092 ']' 00:31:06.202 23:23:09 -- nvmf/common.sh@478 -- # killprocess 2583092 00:31:06.202 23:23:09 -- common/autotest_common.sh@936 -- # '[' -z 2583092 ']' 00:31:06.202 23:23:09 -- common/autotest_common.sh@940 -- # kill -0 2583092 00:31:06.202 23:23:09 -- common/autotest_common.sh@941 -- # uname 00:31:06.202 23:23:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:06.202 23:23:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2583092 00:31:06.202 23:23:09 -- common/autotest_common.sh@942 -- # process_name=reactor_4 00:31:06.202 23:23:09 -- common/autotest_common.sh@946 -- # '[' reactor_4 = sudo ']' 00:31:06.202 23:23:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2583092' 00:31:06.202 killing process with pid 2583092 00:31:06.202 23:23:09 -- common/autotest_common.sh@955 -- # kill 2583092 00:31:06.202 23:23:09 -- common/autotest_common.sh@960 -- # wait 2583092 00:31:06.462 23:23:09 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:31:06.462 23:23:09 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:31:06.462 23:23:09 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:31:06.462 23:23:09 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:31:06.462 23:23:09 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:31:06.462 23:23:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:06.462 23:23:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:31:06.462 23:23:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:08.369 23:23:11 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:31:08.369 00:31:08.369 real 0m16.452s 00:31:08.369 user 0m47.829s 00:31:08.369 sys 0m7.274s 00:31:08.369 23:23:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:08.369 23:23:11 -- common/autotest_common.sh@10 -- # set +x 00:31:08.369 ************************************ 00:31:08.369 END TEST nvmf_target_disconnect 00:31:08.369 ************************************ 00:31:08.369 23:23:11 -- nvmf/nvmf.sh@127 -- # timing_exit host 00:31:08.369 23:23:11 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:08.369 23:23:11 -- common/autotest_common.sh@10 -- # set +x 00:31:08.628 23:23:11 -- nvmf/nvmf.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:31:08.628 00:31:08.628 real 23m0.126s 00:31:08.628 user 66m48.392s 00:31:08.628 sys 5m29.134s 00:31:08.628 23:23:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:08.628 23:23:11 -- common/autotest_common.sh@10 -- # set +x 00:31:08.628 ************************************ 00:31:08.628 END TEST nvmf_tcp 00:31:08.628 ************************************ 00:31:08.628 23:23:12 -- spdk/autotest.sh@283 -- # [[ 0 -eq 0 ]] 00:31:08.628 23:23:12 -- spdk/autotest.sh@284 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:31:08.628 23:23:12 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:31:08.628 23:23:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:08.628 23:23:12 -- common/autotest_common.sh@10 -- # set +x 00:31:08.628 ************************************ 00:31:08.628 START TEST spdkcli_nvmf_tcp 00:31:08.628 ************************************ 00:31:08.628 23:23:12 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:31:08.628 * Looking for test storage... 00:31:08.628 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:31:08.628 23:23:12 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:31:08.628 23:23:12 -- common/autotest_common.sh@1690 -- # lcov --version 00:31:08.628 23:23:12 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:31:08.628 23:23:12 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:31:08.628 23:23:12 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:31:08.628 23:23:12 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:31:08.628 23:23:12 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:31:08.628 23:23:12 -- scripts/common.sh@335 -- # IFS=.-: 00:31:08.628 23:23:12 -- scripts/common.sh@335 -- # read -ra ver1 00:31:08.628 23:23:12 -- scripts/common.sh@336 -- # IFS=.-: 00:31:08.628 23:23:12 -- scripts/common.sh@336 -- # read -ra ver2 00:31:08.628 23:23:12 -- scripts/common.sh@337 -- # local 'op=<' 00:31:08.628 23:23:12 -- scripts/common.sh@339 -- # ver1_l=2 00:31:08.628 23:23:12 -- scripts/common.sh@340 -- # ver2_l=1 00:31:08.628 23:23:12 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:31:08.628 23:23:12 -- scripts/common.sh@343 -- # case "$op" in 00:31:08.628 23:23:12 -- scripts/common.sh@344 -- # : 1 00:31:08.628 23:23:12 -- scripts/common.sh@363 -- # (( v = 0 )) 00:31:08.628 23:23:12 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:31:08.628 23:23:12 -- scripts/common.sh@364 -- # decimal 1 00:31:08.628 23:23:12 -- scripts/common.sh@352 -- # local d=1 00:31:08.628 23:23:12 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:31:08.628 23:23:12 -- scripts/common.sh@354 -- # echo 1 00:31:08.628 23:23:12 -- scripts/common.sh@364 -- # ver1[v]=1 00:31:08.628 23:23:12 -- scripts/common.sh@365 -- # decimal 2 00:31:08.628 23:23:12 -- scripts/common.sh@352 -- # local d=2 00:31:08.628 23:23:12 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:31:08.628 23:23:12 -- scripts/common.sh@354 -- # echo 2 00:31:08.628 23:23:12 -- scripts/common.sh@365 -- # ver2[v]=2 00:31:08.628 23:23:12 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:31:08.628 23:23:12 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:31:08.628 23:23:12 -- scripts/common.sh@367 -- # return 0 00:31:08.628 23:23:12 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:31:08.628 23:23:12 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:31:08.628 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:08.628 --rc genhtml_branch_coverage=1 00:31:08.628 --rc genhtml_function_coverage=1 00:31:08.628 --rc genhtml_legend=1 00:31:08.628 --rc geninfo_all_blocks=1 00:31:08.628 --rc geninfo_unexecuted_blocks=1 00:31:08.628 00:31:08.628 ' 00:31:08.628 23:23:12 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:31:08.628 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:08.628 --rc genhtml_branch_coverage=1 00:31:08.628 --rc genhtml_function_coverage=1 00:31:08.628 --rc genhtml_legend=1 00:31:08.628 --rc geninfo_all_blocks=1 00:31:08.628 --rc geninfo_unexecuted_blocks=1 00:31:08.628 00:31:08.628 ' 00:31:08.628 23:23:12 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:31:08.628 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:08.628 --rc genhtml_branch_coverage=1 00:31:08.628 --rc genhtml_function_coverage=1 00:31:08.628 --rc genhtml_legend=1 00:31:08.628 --rc geninfo_all_blocks=1 00:31:08.628 --rc geninfo_unexecuted_blocks=1 00:31:08.628 00:31:08.628 ' 00:31:08.628 23:23:12 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:31:08.628 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:08.628 --rc genhtml_branch_coverage=1 00:31:08.629 --rc genhtml_function_coverage=1 00:31:08.629 --rc genhtml_legend=1 00:31:08.629 --rc geninfo_all_blocks=1 00:31:08.629 --rc geninfo_unexecuted_blocks=1 00:31:08.629 00:31:08.629 ' 00:31:08.629 23:23:12 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:31:08.629 23:23:12 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:31:08.629 23:23:12 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:31:08.629 23:23:12 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:31:08.629 23:23:12 -- nvmf/common.sh@7 -- # uname -s 00:31:08.629 23:23:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:08.629 23:23:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:08.629 23:23:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:08.629 23:23:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:08.629 23:23:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:08.629 23:23:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:08.629 23:23:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:08.629 23:23:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:08.629 23:23:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:08.629 23:23:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:08.629 23:23:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:31:08.629 23:23:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:31:08.629 23:23:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:08.629 23:23:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:08.629 23:23:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:08.629 23:23:12 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:08.629 23:23:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:08.629 23:23:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:08.629 23:23:12 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:08.629 23:23:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:08.629 23:23:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:08.629 23:23:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:08.629 23:23:12 -- paths/export.sh@5 -- # export PATH 00:31:08.629 23:23:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:08.629 23:23:12 -- nvmf/common.sh@46 -- # : 0 00:31:08.629 23:23:12 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:31:08.629 23:23:12 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:31:08.629 23:23:12 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:31:08.629 23:23:12 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:08.629 23:23:12 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:08.629 23:23:12 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:31:08.629 23:23:12 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:31:08.629 23:23:12 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:31:08.629 23:23:12 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:31:08.629 23:23:12 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:31:08.629 23:23:12 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:31:08.629 23:23:12 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:31:08.629 23:23:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:08.629 23:23:12 -- common/autotest_common.sh@10 -- # set +x 00:31:08.629 23:23:12 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:31:08.629 23:23:12 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=2584322 00:31:08.629 23:23:12 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:31:08.629 23:23:12 -- spdkcli/common.sh@34 -- # waitforlisten 2584322 00:31:08.629 23:23:12 -- common/autotest_common.sh@829 -- # '[' -z 2584322 ']' 00:31:08.629 23:23:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:08.629 23:23:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:31:08.629 23:23:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:08.629 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:08.629 23:23:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:31:08.629 23:23:12 -- common/autotest_common.sh@10 -- # set +x 00:31:08.629 [2024-11-28 23:23:12.220074] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:31:08.629 [2024-11-28 23:23:12.220157] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2584322 ] 00:31:08.886 EAL: No free 2048 kB hugepages reported on node 1 00:31:08.886 [2024-11-28 23:23:12.280080] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:31:08.886 [2024-11-28 23:23:12.363246] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:31:08.886 [2024-11-28 23:23:12.363474] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:31:08.886 [2024-11-28 23:23:12.363479] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:09.819 23:23:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:31:09.819 23:23:13 -- common/autotest_common.sh@862 -- # return 0 00:31:09.819 23:23:13 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:31:09.819 23:23:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:09.819 23:23:13 -- common/autotest_common.sh@10 -- # set +x 00:31:09.819 23:23:13 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:31:09.819 23:23:13 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:31:09.819 23:23:13 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:31:09.819 23:23:13 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:09.819 23:23:13 -- common/autotest_common.sh@10 -- # set +x 00:31:09.819 23:23:13 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:31:09.819 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:31:09.819 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:31:09.819 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:31:09.819 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:31:09.819 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:31:09.819 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:31:09.819 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:31:09.819 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:31:09.819 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:31:09.819 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:31:09.819 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:31:09.819 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:31:09.819 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:31:09.819 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:31:09.819 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:31:09.819 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:31:09.819 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:31:09.819 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:31:09.819 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:31:09.819 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:31:09.819 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:31:09.819 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:31:09.819 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:31:09.819 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:31:09.819 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:31:09.819 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:31:09.819 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:31:09.819 ' 00:31:10.078 [2024-11-28 23:23:13.611312] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:31:12.609 [2024-11-28 23:23:15.770242] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:13.542 [2024-11-28 23:23:17.006879] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:31:16.067 [2024-11-28 23:23:19.294116] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:31:17.964 [2024-11-28 23:23:21.264648] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:31:19.335 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:31:19.335 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:31:19.335 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:31:19.335 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:31:19.335 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:31:19.335 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:31:19.335 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:31:19.335 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:31:19.336 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:31:19.336 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:31:19.336 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:31:19.336 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:31:19.336 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:31:19.336 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:31:19.336 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:31:19.336 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:31:19.336 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:31:19.336 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:31:19.336 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:31:19.336 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:31:19.336 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:31:19.336 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:31:19.336 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:31:19.336 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:31:19.336 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:31:19.336 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:31:19.336 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:31:19.336 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:31:19.336 23:23:22 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:31:19.336 23:23:22 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:19.336 23:23:22 -- common/autotest_common.sh@10 -- # set +x 00:31:19.336 23:23:22 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:31:19.336 23:23:22 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:19.336 23:23:22 -- common/autotest_common.sh@10 -- # set +x 00:31:19.336 23:23:22 -- spdkcli/nvmf.sh@69 -- # check_match 00:31:19.336 23:23:22 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:31:19.899 23:23:23 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:31:19.899 23:23:23 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:31:19.899 23:23:23 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:31:19.899 23:23:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:19.899 23:23:23 -- common/autotest_common.sh@10 -- # set +x 00:31:19.899 23:23:23 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:31:19.899 23:23:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:19.899 23:23:23 -- common/autotest_common.sh@10 -- # set +x 00:31:19.899 23:23:23 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:31:19.899 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:31:19.899 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:31:19.899 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:31:19.899 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:31:19.900 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:31:19.900 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:31:19.900 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:31:19.900 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:31:19.900 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:31:19.900 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:31:19.900 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:31:19.900 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:31:19.900 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:31:19.900 ' 00:31:25.158 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:31:25.158 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:31:25.158 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:31:25.158 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:31:25.158 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:31:25.158 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:31:25.158 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:31:25.158 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:31:25.158 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:31:25.158 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:31:25.158 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:31:25.158 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:31:25.158 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:31:25.158 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:31:25.158 23:23:28 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:31:25.158 23:23:28 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:25.158 23:23:28 -- common/autotest_common.sh@10 -- # set +x 00:31:25.158 23:23:28 -- spdkcli/nvmf.sh@90 -- # killprocess 2584322 00:31:25.158 23:23:28 -- common/autotest_common.sh@936 -- # '[' -z 2584322 ']' 00:31:25.158 23:23:28 -- common/autotest_common.sh@940 -- # kill -0 2584322 00:31:25.158 23:23:28 -- common/autotest_common.sh@941 -- # uname 00:31:25.158 23:23:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:25.158 23:23:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2584322 00:31:25.158 23:23:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:31:25.158 23:23:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:31:25.158 23:23:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2584322' 00:31:25.158 killing process with pid 2584322 00:31:25.158 23:23:28 -- common/autotest_common.sh@955 -- # kill 2584322 00:31:25.158 [2024-11-28 23:23:28.720256] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:31:25.158 23:23:28 -- common/autotest_common.sh@960 -- # wait 2584322 00:31:25.416 23:23:28 -- spdkcli/nvmf.sh@1 -- # cleanup 00:31:25.416 23:23:28 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:31:25.416 23:23:28 -- spdkcli/common.sh@13 -- # '[' -n 2584322 ']' 00:31:25.416 23:23:28 -- spdkcli/common.sh@14 -- # killprocess 2584322 00:31:25.416 23:23:28 -- common/autotest_common.sh@936 -- # '[' -z 2584322 ']' 00:31:25.416 23:23:28 -- common/autotest_common.sh@940 -- # kill -0 2584322 00:31:25.416 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2584322) - No such process 00:31:25.416 23:23:28 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2584322 is not found' 00:31:25.416 Process with pid 2584322 is not found 00:31:25.416 23:23:28 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:31:25.416 23:23:28 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:31:25.416 23:23:28 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:31:25.416 00:31:25.416 real 0m16.926s 00:31:25.416 user 0m36.055s 00:31:25.416 sys 0m0.778s 00:31:25.416 23:23:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:25.416 23:23:28 -- common/autotest_common.sh@10 -- # set +x 00:31:25.416 ************************************ 00:31:25.416 END TEST spdkcli_nvmf_tcp 00:31:25.416 ************************************ 00:31:25.416 23:23:28 -- spdk/autotest.sh@285 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:31:25.416 23:23:28 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:31:25.416 23:23:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:25.416 23:23:28 -- common/autotest_common.sh@10 -- # set +x 00:31:25.416 ************************************ 00:31:25.416 START TEST nvmf_identify_passthru 00:31:25.416 ************************************ 00:31:25.416 23:23:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:31:25.416 * Looking for test storage... 00:31:25.416 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:31:25.416 23:23:29 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:31:25.416 23:23:29 -- common/autotest_common.sh@1690 -- # lcov --version 00:31:25.416 23:23:29 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:31:25.675 23:23:29 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:31:25.676 23:23:29 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:31:25.676 23:23:29 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:31:25.676 23:23:29 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:31:25.676 23:23:29 -- scripts/common.sh@335 -- # IFS=.-: 00:31:25.676 23:23:29 -- scripts/common.sh@335 -- # read -ra ver1 00:31:25.676 23:23:29 -- scripts/common.sh@336 -- # IFS=.-: 00:31:25.676 23:23:29 -- scripts/common.sh@336 -- # read -ra ver2 00:31:25.676 23:23:29 -- scripts/common.sh@337 -- # local 'op=<' 00:31:25.676 23:23:29 -- scripts/common.sh@339 -- # ver1_l=2 00:31:25.676 23:23:29 -- scripts/common.sh@340 -- # ver2_l=1 00:31:25.676 23:23:29 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:31:25.676 23:23:29 -- scripts/common.sh@343 -- # case "$op" in 00:31:25.676 23:23:29 -- scripts/common.sh@344 -- # : 1 00:31:25.676 23:23:29 -- scripts/common.sh@363 -- # (( v = 0 )) 00:31:25.676 23:23:29 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:31:25.676 23:23:29 -- scripts/common.sh@364 -- # decimal 1 00:31:25.676 23:23:29 -- scripts/common.sh@352 -- # local d=1 00:31:25.676 23:23:29 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:31:25.676 23:23:29 -- scripts/common.sh@354 -- # echo 1 00:31:25.676 23:23:29 -- scripts/common.sh@364 -- # ver1[v]=1 00:31:25.676 23:23:29 -- scripts/common.sh@365 -- # decimal 2 00:31:25.676 23:23:29 -- scripts/common.sh@352 -- # local d=2 00:31:25.676 23:23:29 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:31:25.676 23:23:29 -- scripts/common.sh@354 -- # echo 2 00:31:25.676 23:23:29 -- scripts/common.sh@365 -- # ver2[v]=2 00:31:25.676 23:23:29 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:31:25.676 23:23:29 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:31:25.676 23:23:29 -- scripts/common.sh@367 -- # return 0 00:31:25.676 23:23:29 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:31:25.676 23:23:29 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:31:25.676 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:25.676 --rc genhtml_branch_coverage=1 00:31:25.676 --rc genhtml_function_coverage=1 00:31:25.676 --rc genhtml_legend=1 00:31:25.676 --rc geninfo_all_blocks=1 00:31:25.676 --rc geninfo_unexecuted_blocks=1 00:31:25.676 00:31:25.676 ' 00:31:25.676 23:23:29 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:31:25.676 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:25.676 --rc genhtml_branch_coverage=1 00:31:25.676 --rc genhtml_function_coverage=1 00:31:25.676 --rc genhtml_legend=1 00:31:25.676 --rc geninfo_all_blocks=1 00:31:25.676 --rc geninfo_unexecuted_blocks=1 00:31:25.676 00:31:25.676 ' 00:31:25.676 23:23:29 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:31:25.676 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:25.676 --rc genhtml_branch_coverage=1 00:31:25.676 --rc genhtml_function_coverage=1 00:31:25.676 --rc genhtml_legend=1 00:31:25.676 --rc geninfo_all_blocks=1 00:31:25.676 --rc geninfo_unexecuted_blocks=1 00:31:25.676 00:31:25.676 ' 00:31:25.676 23:23:29 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:31:25.676 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:25.676 --rc genhtml_branch_coverage=1 00:31:25.676 --rc genhtml_function_coverage=1 00:31:25.676 --rc genhtml_legend=1 00:31:25.676 --rc geninfo_all_blocks=1 00:31:25.676 --rc geninfo_unexecuted_blocks=1 00:31:25.676 00:31:25.676 ' 00:31:25.676 23:23:29 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:31:25.676 23:23:29 -- nvmf/common.sh@7 -- # uname -s 00:31:25.676 23:23:29 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:25.676 23:23:29 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:25.676 23:23:29 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:25.676 23:23:29 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:25.676 23:23:29 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:25.676 23:23:29 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:25.676 23:23:29 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:25.676 23:23:29 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:25.676 23:23:29 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:25.676 23:23:29 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:25.676 23:23:29 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:31:25.676 23:23:29 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:31:25.676 23:23:29 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:25.676 23:23:29 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:25.676 23:23:29 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:25.676 23:23:29 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:25.676 23:23:29 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:25.676 23:23:29 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:25.676 23:23:29 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:25.676 23:23:29 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:25.676 23:23:29 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:25.676 23:23:29 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:25.676 23:23:29 -- paths/export.sh@5 -- # export PATH 00:31:25.676 23:23:29 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:25.676 23:23:29 -- nvmf/common.sh@46 -- # : 0 00:31:25.676 23:23:29 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:31:25.676 23:23:29 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:31:25.676 23:23:29 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:31:25.676 23:23:29 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:25.676 23:23:29 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:25.676 23:23:29 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:31:25.676 23:23:29 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:31:25.676 23:23:29 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:31:25.676 23:23:29 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:25.676 23:23:29 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:25.676 23:23:29 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:25.676 23:23:29 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:25.676 23:23:29 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:25.676 23:23:29 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:25.677 23:23:29 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:25.677 23:23:29 -- paths/export.sh@5 -- # export PATH 00:31:25.677 23:23:29 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:25.677 23:23:29 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:31:25.677 23:23:29 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:31:25.677 23:23:29 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:31:25.677 23:23:29 -- nvmf/common.sh@436 -- # prepare_net_devs 00:31:25.677 23:23:29 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:31:25.677 23:23:29 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:31:25.677 23:23:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:25.677 23:23:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:25.677 23:23:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:25.677 23:23:29 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:31:25.677 23:23:29 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:31:25.677 23:23:29 -- nvmf/common.sh@284 -- # xtrace_disable 00:31:25.677 23:23:29 -- common/autotest_common.sh@10 -- # set +x 00:31:27.576 23:23:31 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:31:27.576 23:23:31 -- nvmf/common.sh@290 -- # pci_devs=() 00:31:27.576 23:23:31 -- nvmf/common.sh@290 -- # local -a pci_devs 00:31:27.576 23:23:31 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:31:27.576 23:23:31 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:31:27.576 23:23:31 -- nvmf/common.sh@292 -- # pci_drivers=() 00:31:27.576 23:23:31 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:31:27.576 23:23:31 -- nvmf/common.sh@294 -- # net_devs=() 00:31:27.576 23:23:31 -- nvmf/common.sh@294 -- # local -ga net_devs 00:31:27.576 23:23:31 -- nvmf/common.sh@295 -- # e810=() 00:31:27.576 23:23:31 -- nvmf/common.sh@295 -- # local -ga e810 00:31:27.576 23:23:31 -- nvmf/common.sh@296 -- # x722=() 00:31:27.576 23:23:31 -- nvmf/common.sh@296 -- # local -ga x722 00:31:27.576 23:23:31 -- nvmf/common.sh@297 -- # mlx=() 00:31:27.576 23:23:31 -- nvmf/common.sh@297 -- # local -ga mlx 00:31:27.576 23:23:31 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:31:27.576 23:23:31 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:31:27.576 23:23:31 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:31:27.576 23:23:31 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:31:27.576 23:23:31 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:31:27.576 23:23:31 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:31:27.576 23:23:31 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:31:27.576 23:23:31 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:31:27.576 23:23:31 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:31:27.576 23:23:31 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:31:27.576 23:23:31 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:31:27.576 23:23:31 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:31:27.576 23:23:31 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:31:27.576 23:23:31 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:31:27.576 23:23:31 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:31:27.576 23:23:31 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:31:27.576 23:23:31 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:31:27.576 23:23:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:27.576 23:23:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:31:27.576 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:31:27.576 23:23:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:27.576 23:23:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:27.576 23:23:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:27.576 23:23:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:27.576 23:23:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:27.576 23:23:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:27.576 23:23:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:31:27.576 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:31:27.576 23:23:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:27.576 23:23:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:27.576 23:23:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:27.576 23:23:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:27.576 23:23:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:27.576 23:23:31 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:31:27.576 23:23:31 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:31:27.576 23:23:31 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:31:27.576 23:23:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:27.576 23:23:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:27.576 23:23:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:27.576 23:23:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:27.576 23:23:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:31:27.576 Found net devices under 0000:0a:00.0: cvl_0_0 00:31:27.576 23:23:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:27.576 23:23:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:27.576 23:23:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:27.576 23:23:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:27.576 23:23:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:27.576 23:23:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:31:27.576 Found net devices under 0000:0a:00.1: cvl_0_1 00:31:27.576 23:23:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:27.576 23:23:31 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:31:27.576 23:23:31 -- nvmf/common.sh@402 -- # is_hw=yes 00:31:27.576 23:23:31 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:31:27.576 23:23:31 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:31:27.576 23:23:31 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:31:27.576 23:23:31 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:31:27.576 23:23:31 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:31:27.576 23:23:31 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:31:27.576 23:23:31 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:31:27.576 23:23:31 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:31:27.576 23:23:31 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:31:27.576 23:23:31 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:31:27.576 23:23:31 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:31:27.576 23:23:31 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:31:27.576 23:23:31 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:31:27.576 23:23:31 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:31:27.576 23:23:31 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:31:27.576 23:23:31 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:31:27.576 23:23:31 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:31:27.576 23:23:31 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:31:27.576 23:23:31 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:31:27.576 23:23:31 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:31:27.834 23:23:31 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:31:27.834 23:23:31 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:31:27.834 23:23:31 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:31:27.834 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:31:27.834 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.249 ms 00:31:27.834 00:31:27.834 --- 10.0.0.2 ping statistics --- 00:31:27.834 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:27.834 rtt min/avg/max/mdev = 0.249/0.249/0.249/0.000 ms 00:31:27.834 23:23:31 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:31:27.834 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:31:27.834 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.084 ms 00:31:27.834 00:31:27.834 --- 10.0.0.1 ping statistics --- 00:31:27.834 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:27.834 rtt min/avg/max/mdev = 0.084/0.084/0.084/0.000 ms 00:31:27.834 23:23:31 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:31:27.834 23:23:31 -- nvmf/common.sh@410 -- # return 0 00:31:27.834 23:23:31 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:31:27.834 23:23:31 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:31:27.834 23:23:31 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:31:27.834 23:23:31 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:31:27.834 23:23:31 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:31:27.834 23:23:31 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:31:27.834 23:23:31 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:31:27.834 23:23:31 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:31:27.834 23:23:31 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:27.834 23:23:31 -- common/autotest_common.sh@10 -- # set +x 00:31:27.834 23:23:31 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:31:27.834 23:23:31 -- common/autotest_common.sh@1519 -- # bdfs=() 00:31:27.834 23:23:31 -- common/autotest_common.sh@1519 -- # local bdfs 00:31:27.834 23:23:31 -- common/autotest_common.sh@1520 -- # bdfs=($(get_nvme_bdfs)) 00:31:27.834 23:23:31 -- common/autotest_common.sh@1520 -- # get_nvme_bdfs 00:31:27.834 23:23:31 -- common/autotest_common.sh@1508 -- # bdfs=() 00:31:27.834 23:23:31 -- common/autotest_common.sh@1508 -- # local bdfs 00:31:27.834 23:23:31 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:31:27.834 23:23:31 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:31:27.834 23:23:31 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:31:27.834 23:23:31 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:31:27.834 23:23:31 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:31:27.834 23:23:31 -- common/autotest_common.sh@1522 -- # echo 0000:88:00.0 00:31:27.834 23:23:31 -- target/identify_passthru.sh@16 -- # bdf=0000:88:00.0 00:31:27.834 23:23:31 -- target/identify_passthru.sh@17 -- # '[' -z 0000:88:00.0 ']' 00:31:27.834 23:23:31 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:31:27.834 23:23:31 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:31:27.834 23:23:31 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:31:28.091 EAL: No free 2048 kB hugepages reported on node 1 00:31:32.270 23:23:35 -- target/identify_passthru.sh@23 -- # nvme_serial_number=PHLJ916004901P0FGN 00:31:32.270 23:23:35 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:31:32.270 23:23:35 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:31:32.270 23:23:35 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:31:32.270 EAL: No free 2048 kB hugepages reported on node 1 00:31:36.453 23:23:39 -- target/identify_passthru.sh@24 -- # nvme_model_number=INTEL 00:31:36.453 23:23:39 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:31:36.453 23:23:39 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:36.453 23:23:39 -- common/autotest_common.sh@10 -- # set +x 00:31:36.453 23:23:39 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:31:36.453 23:23:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:36.453 23:23:39 -- common/autotest_common.sh@10 -- # set +x 00:31:36.453 23:23:39 -- target/identify_passthru.sh@31 -- # nvmfpid=2589075 00:31:36.453 23:23:39 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:31:36.453 23:23:39 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:31:36.453 23:23:39 -- target/identify_passthru.sh@35 -- # waitforlisten 2589075 00:31:36.453 23:23:39 -- common/autotest_common.sh@829 -- # '[' -z 2589075 ']' 00:31:36.453 23:23:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:36.453 23:23:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:31:36.453 23:23:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:36.453 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:36.453 23:23:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:31:36.453 23:23:39 -- common/autotest_common.sh@10 -- # set +x 00:31:36.453 [2024-11-28 23:23:39.919227] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:31:36.454 [2024-11-28 23:23:39.919319] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:31:36.454 EAL: No free 2048 kB hugepages reported on node 1 00:31:36.454 [2024-11-28 23:23:39.984105] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:31:36.712 [2024-11-28 23:23:40.074403] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:31:36.712 [2024-11-28 23:23:40.074561] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:31:36.712 [2024-11-28 23:23:40.074578] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:31:36.712 [2024-11-28 23:23:40.074590] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:31:36.712 [2024-11-28 23:23:40.074688] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:31:36.712 [2024-11-28 23:23:40.074772] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:31:36.712 [2024-11-28 23:23:40.074832] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:31:36.712 [2024-11-28 23:23:40.074834] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:36.712 23:23:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:31:36.712 23:23:40 -- common/autotest_common.sh@862 -- # return 0 00:31:36.712 23:23:40 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:31:36.712 23:23:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:36.712 23:23:40 -- common/autotest_common.sh@10 -- # set +x 00:31:36.712 INFO: Log level set to 20 00:31:36.712 INFO: Requests: 00:31:36.712 { 00:31:36.712 "jsonrpc": "2.0", 00:31:36.712 "method": "nvmf_set_config", 00:31:36.712 "id": 1, 00:31:36.712 "params": { 00:31:36.712 "admin_cmd_passthru": { 00:31:36.712 "identify_ctrlr": true 00:31:36.712 } 00:31:36.712 } 00:31:36.712 } 00:31:36.712 00:31:36.712 INFO: response: 00:31:36.712 { 00:31:36.712 "jsonrpc": "2.0", 00:31:36.712 "id": 1, 00:31:36.712 "result": true 00:31:36.712 } 00:31:36.712 00:31:36.712 23:23:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:36.712 23:23:40 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:31:36.712 23:23:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:36.712 23:23:40 -- common/autotest_common.sh@10 -- # set +x 00:31:36.712 INFO: Setting log level to 20 00:31:36.712 INFO: Setting log level to 20 00:31:36.712 INFO: Log level set to 20 00:31:36.712 INFO: Log level set to 20 00:31:36.712 INFO: Requests: 00:31:36.712 { 00:31:36.712 "jsonrpc": "2.0", 00:31:36.712 "method": "framework_start_init", 00:31:36.712 "id": 1 00:31:36.712 } 00:31:36.712 00:31:36.712 INFO: Requests: 00:31:36.712 { 00:31:36.712 "jsonrpc": "2.0", 00:31:36.712 "method": "framework_start_init", 00:31:36.712 "id": 1 00:31:36.712 } 00:31:36.712 00:31:36.712 [2024-11-28 23:23:40.255597] nvmf_tgt.c: 423:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:31:36.712 INFO: response: 00:31:36.712 { 00:31:36.712 "jsonrpc": "2.0", 00:31:36.712 "id": 1, 00:31:36.712 "result": true 00:31:36.712 } 00:31:36.712 00:31:36.712 INFO: response: 00:31:36.712 { 00:31:36.712 "jsonrpc": "2.0", 00:31:36.712 "id": 1, 00:31:36.712 "result": true 00:31:36.712 } 00:31:36.712 00:31:36.712 23:23:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:36.712 23:23:40 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:31:36.712 23:23:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:36.712 23:23:40 -- common/autotest_common.sh@10 -- # set +x 00:31:36.712 INFO: Setting log level to 40 00:31:36.712 INFO: Setting log level to 40 00:31:36.712 INFO: Setting log level to 40 00:31:36.712 [2024-11-28 23:23:40.265614] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:36.712 23:23:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:36.712 23:23:40 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:31:36.712 23:23:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:36.712 23:23:40 -- common/autotest_common.sh@10 -- # set +x 00:31:36.712 23:23:40 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 00:31:36.712 23:23:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:36.712 23:23:40 -- common/autotest_common.sh@10 -- # set +x 00:31:39.990 Nvme0n1 00:31:39.990 23:23:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:39.990 23:23:43 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:31:39.990 23:23:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:39.990 23:23:43 -- common/autotest_common.sh@10 -- # set +x 00:31:39.990 23:23:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:39.990 23:23:43 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:31:39.990 23:23:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:39.990 23:23:43 -- common/autotest_common.sh@10 -- # set +x 00:31:39.990 23:23:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:39.990 23:23:43 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:39.990 23:23:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:39.990 23:23:43 -- common/autotest_common.sh@10 -- # set +x 00:31:39.990 [2024-11-28 23:23:43.156849] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:39.990 23:23:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:39.990 23:23:43 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:31:39.990 23:23:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:39.990 23:23:43 -- common/autotest_common.sh@10 -- # set +x 00:31:39.990 [2024-11-28 23:23:43.164545] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:31:39.990 [ 00:31:39.990 { 00:31:39.990 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:31:39.990 "subtype": "Discovery", 00:31:39.990 "listen_addresses": [], 00:31:39.990 "allow_any_host": true, 00:31:39.990 "hosts": [] 00:31:39.990 }, 00:31:39.990 { 00:31:39.990 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:31:39.990 "subtype": "NVMe", 00:31:39.990 "listen_addresses": [ 00:31:39.990 { 00:31:39.990 "transport": "TCP", 00:31:39.990 "trtype": "TCP", 00:31:39.990 "adrfam": "IPv4", 00:31:39.990 "traddr": "10.0.0.2", 00:31:39.990 "trsvcid": "4420" 00:31:39.990 } 00:31:39.990 ], 00:31:39.990 "allow_any_host": true, 00:31:39.990 "hosts": [], 00:31:39.990 "serial_number": "SPDK00000000000001", 00:31:39.990 "model_number": "SPDK bdev Controller", 00:31:39.990 "max_namespaces": 1, 00:31:39.990 "min_cntlid": 1, 00:31:39.990 "max_cntlid": 65519, 00:31:39.990 "namespaces": [ 00:31:39.990 { 00:31:39.990 "nsid": 1, 00:31:39.990 "bdev_name": "Nvme0n1", 00:31:39.990 "name": "Nvme0n1", 00:31:39.990 "nguid": "49DA6BEFCE11454A84E857997BA38059", 00:31:39.990 "uuid": "49da6bef-ce11-454a-84e8-57997ba38059" 00:31:39.990 } 00:31:39.990 ] 00:31:39.990 } 00:31:39.990 ] 00:31:39.990 23:23:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:39.990 23:23:43 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:31:39.990 23:23:43 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:31:39.990 23:23:43 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:31:39.990 EAL: No free 2048 kB hugepages reported on node 1 00:31:39.990 23:23:43 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=PHLJ916004901P0FGN 00:31:39.990 23:23:43 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:31:39.990 23:23:43 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:31:39.990 23:23:43 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:31:39.990 EAL: No free 2048 kB hugepages reported on node 1 00:31:39.990 23:23:43 -- target/identify_passthru.sh@61 -- # nvmf_model_number=INTEL 00:31:39.990 23:23:43 -- target/identify_passthru.sh@63 -- # '[' PHLJ916004901P0FGN '!=' PHLJ916004901P0FGN ']' 00:31:39.990 23:23:43 -- target/identify_passthru.sh@68 -- # '[' INTEL '!=' INTEL ']' 00:31:39.990 23:23:43 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:39.990 23:23:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:39.990 23:23:43 -- common/autotest_common.sh@10 -- # set +x 00:31:39.991 23:23:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:39.991 23:23:43 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:31:39.991 23:23:43 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:31:39.991 23:23:43 -- nvmf/common.sh@476 -- # nvmfcleanup 00:31:39.991 23:23:43 -- nvmf/common.sh@116 -- # sync 00:31:39.991 23:23:43 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:31:39.991 23:23:43 -- nvmf/common.sh@119 -- # set +e 00:31:39.991 23:23:43 -- nvmf/common.sh@120 -- # for i in {1..20} 00:31:39.991 23:23:43 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:31:39.991 rmmod nvme_tcp 00:31:39.991 rmmod nvme_fabrics 00:31:39.991 rmmod nvme_keyring 00:31:39.991 23:23:43 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:31:39.991 23:23:43 -- nvmf/common.sh@123 -- # set -e 00:31:39.991 23:23:43 -- nvmf/common.sh@124 -- # return 0 00:31:39.991 23:23:43 -- nvmf/common.sh@477 -- # '[' -n 2589075 ']' 00:31:39.991 23:23:43 -- nvmf/common.sh@478 -- # killprocess 2589075 00:31:39.991 23:23:43 -- common/autotest_common.sh@936 -- # '[' -z 2589075 ']' 00:31:39.991 23:23:43 -- common/autotest_common.sh@940 -- # kill -0 2589075 00:31:39.991 23:23:43 -- common/autotest_common.sh@941 -- # uname 00:31:39.991 23:23:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:39.991 23:23:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2589075 00:31:39.991 23:23:43 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:31:39.991 23:23:43 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:31:39.991 23:23:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2589075' 00:31:39.991 killing process with pid 2589075 00:31:39.991 23:23:43 -- common/autotest_common.sh@955 -- # kill 2589075 00:31:39.991 [2024-11-28 23:23:43.566801] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:31:39.991 23:23:43 -- common/autotest_common.sh@960 -- # wait 2589075 00:31:41.890 23:23:45 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:31:41.890 23:23:45 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:31:41.890 23:23:45 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:31:41.890 23:23:45 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:31:41.890 23:23:45 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:31:41.890 23:23:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:41.890 23:23:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:41.890 23:23:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:43.791 23:23:47 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:31:43.791 00:31:43.791 real 0m18.176s 00:31:43.791 user 0m26.611s 00:31:43.791 sys 0m2.314s 00:31:43.791 23:23:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:43.791 23:23:47 -- common/autotest_common.sh@10 -- # set +x 00:31:43.791 ************************************ 00:31:43.791 END TEST nvmf_identify_passthru 00:31:43.791 ************************************ 00:31:43.791 23:23:47 -- spdk/autotest.sh@287 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:31:43.791 23:23:47 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:43.791 23:23:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:43.791 23:23:47 -- common/autotest_common.sh@10 -- # set +x 00:31:43.791 ************************************ 00:31:43.791 START TEST nvmf_dif 00:31:43.791 ************************************ 00:31:43.791 23:23:47 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:31:43.791 * Looking for test storage... 00:31:43.791 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:31:43.791 23:23:47 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:31:43.791 23:23:47 -- common/autotest_common.sh@1690 -- # lcov --version 00:31:43.791 23:23:47 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:31:43.791 23:23:47 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:31:43.791 23:23:47 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:31:43.791 23:23:47 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:31:43.791 23:23:47 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:31:43.791 23:23:47 -- scripts/common.sh@335 -- # IFS=.-: 00:31:43.791 23:23:47 -- scripts/common.sh@335 -- # read -ra ver1 00:31:43.791 23:23:47 -- scripts/common.sh@336 -- # IFS=.-: 00:31:43.791 23:23:47 -- scripts/common.sh@336 -- # read -ra ver2 00:31:43.791 23:23:47 -- scripts/common.sh@337 -- # local 'op=<' 00:31:43.791 23:23:47 -- scripts/common.sh@339 -- # ver1_l=2 00:31:43.791 23:23:47 -- scripts/common.sh@340 -- # ver2_l=1 00:31:43.791 23:23:47 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:31:43.791 23:23:47 -- scripts/common.sh@343 -- # case "$op" in 00:31:43.791 23:23:47 -- scripts/common.sh@344 -- # : 1 00:31:43.791 23:23:47 -- scripts/common.sh@363 -- # (( v = 0 )) 00:31:43.791 23:23:47 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:31:43.791 23:23:47 -- scripts/common.sh@364 -- # decimal 1 00:31:43.791 23:23:47 -- scripts/common.sh@352 -- # local d=1 00:31:43.791 23:23:47 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:31:43.791 23:23:47 -- scripts/common.sh@354 -- # echo 1 00:31:43.791 23:23:47 -- scripts/common.sh@364 -- # ver1[v]=1 00:31:43.791 23:23:47 -- scripts/common.sh@365 -- # decimal 2 00:31:43.791 23:23:47 -- scripts/common.sh@352 -- # local d=2 00:31:43.791 23:23:47 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:31:43.791 23:23:47 -- scripts/common.sh@354 -- # echo 2 00:31:43.791 23:23:47 -- scripts/common.sh@365 -- # ver2[v]=2 00:31:43.791 23:23:47 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:31:43.791 23:23:47 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:31:43.791 23:23:47 -- scripts/common.sh@367 -- # return 0 00:31:43.791 23:23:47 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:31:43.791 23:23:47 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:31:43.791 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:43.791 --rc genhtml_branch_coverage=1 00:31:43.791 --rc genhtml_function_coverage=1 00:31:43.791 --rc genhtml_legend=1 00:31:43.791 --rc geninfo_all_blocks=1 00:31:43.791 --rc geninfo_unexecuted_blocks=1 00:31:43.791 00:31:43.791 ' 00:31:43.791 23:23:47 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:31:43.791 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:43.791 --rc genhtml_branch_coverage=1 00:31:43.791 --rc genhtml_function_coverage=1 00:31:43.791 --rc genhtml_legend=1 00:31:43.791 --rc geninfo_all_blocks=1 00:31:43.791 --rc geninfo_unexecuted_blocks=1 00:31:43.791 00:31:43.791 ' 00:31:43.791 23:23:47 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:31:43.791 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:43.791 --rc genhtml_branch_coverage=1 00:31:43.791 --rc genhtml_function_coverage=1 00:31:43.791 --rc genhtml_legend=1 00:31:43.791 --rc geninfo_all_blocks=1 00:31:43.791 --rc geninfo_unexecuted_blocks=1 00:31:43.791 00:31:43.791 ' 00:31:43.791 23:23:47 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:31:43.792 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:43.792 --rc genhtml_branch_coverage=1 00:31:43.792 --rc genhtml_function_coverage=1 00:31:43.792 --rc genhtml_legend=1 00:31:43.792 --rc geninfo_all_blocks=1 00:31:43.792 --rc geninfo_unexecuted_blocks=1 00:31:43.792 00:31:43.792 ' 00:31:43.792 23:23:47 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:31:43.792 23:23:47 -- nvmf/common.sh@7 -- # uname -s 00:31:43.792 23:23:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:43.792 23:23:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:43.792 23:23:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:43.792 23:23:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:43.792 23:23:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:43.792 23:23:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:43.792 23:23:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:43.792 23:23:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:43.792 23:23:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:43.792 23:23:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:43.792 23:23:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:31:43.792 23:23:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:31:43.792 23:23:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:43.792 23:23:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:43.792 23:23:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:43.792 23:23:47 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:43.792 23:23:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:43.792 23:23:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:43.792 23:23:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:43.792 23:23:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:43.792 23:23:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:43.792 23:23:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:43.792 23:23:47 -- paths/export.sh@5 -- # export PATH 00:31:43.792 23:23:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:43.792 23:23:47 -- nvmf/common.sh@46 -- # : 0 00:31:43.792 23:23:47 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:31:43.792 23:23:47 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:31:43.792 23:23:47 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:31:43.792 23:23:47 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:43.792 23:23:47 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:43.792 23:23:47 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:31:43.792 23:23:47 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:31:43.792 23:23:47 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:31:43.792 23:23:47 -- target/dif.sh@15 -- # NULL_META=16 00:31:43.792 23:23:47 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:31:43.792 23:23:47 -- target/dif.sh@15 -- # NULL_SIZE=64 00:31:43.792 23:23:47 -- target/dif.sh@15 -- # NULL_DIF=1 00:31:43.792 23:23:47 -- target/dif.sh@135 -- # nvmftestinit 00:31:43.792 23:23:47 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:31:43.792 23:23:47 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:31:43.792 23:23:47 -- nvmf/common.sh@436 -- # prepare_net_devs 00:31:43.792 23:23:47 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:31:43.792 23:23:47 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:31:43.792 23:23:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:43.792 23:23:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:43.792 23:23:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:43.792 23:23:47 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:31:43.792 23:23:47 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:31:43.792 23:23:47 -- nvmf/common.sh@284 -- # xtrace_disable 00:31:43.792 23:23:47 -- common/autotest_common.sh@10 -- # set +x 00:31:46.324 23:23:49 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:31:46.324 23:23:49 -- nvmf/common.sh@290 -- # pci_devs=() 00:31:46.324 23:23:49 -- nvmf/common.sh@290 -- # local -a pci_devs 00:31:46.324 23:23:49 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:31:46.324 23:23:49 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:31:46.324 23:23:49 -- nvmf/common.sh@292 -- # pci_drivers=() 00:31:46.324 23:23:49 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:31:46.324 23:23:49 -- nvmf/common.sh@294 -- # net_devs=() 00:31:46.324 23:23:49 -- nvmf/common.sh@294 -- # local -ga net_devs 00:31:46.324 23:23:49 -- nvmf/common.sh@295 -- # e810=() 00:31:46.324 23:23:49 -- nvmf/common.sh@295 -- # local -ga e810 00:31:46.324 23:23:49 -- nvmf/common.sh@296 -- # x722=() 00:31:46.324 23:23:49 -- nvmf/common.sh@296 -- # local -ga x722 00:31:46.324 23:23:49 -- nvmf/common.sh@297 -- # mlx=() 00:31:46.324 23:23:49 -- nvmf/common.sh@297 -- # local -ga mlx 00:31:46.324 23:23:49 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:31:46.324 23:23:49 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:31:46.324 23:23:49 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:31:46.324 23:23:49 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:31:46.324 23:23:49 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:31:46.324 23:23:49 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:31:46.324 23:23:49 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:31:46.324 23:23:49 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:31:46.324 23:23:49 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:31:46.324 23:23:49 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:31:46.324 23:23:49 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:31:46.324 23:23:49 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:31:46.324 23:23:49 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:31:46.324 23:23:49 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:31:46.324 23:23:49 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:31:46.324 23:23:49 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:31:46.324 23:23:49 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:31:46.324 23:23:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:46.324 23:23:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:31:46.324 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:31:46.324 23:23:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:46.324 23:23:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:46.324 23:23:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:46.324 23:23:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:46.324 23:23:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:46.324 23:23:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:46.324 23:23:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:31:46.324 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:31:46.324 23:23:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:46.324 23:23:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:46.324 23:23:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:46.324 23:23:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:46.324 23:23:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:46.324 23:23:49 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:31:46.324 23:23:49 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:31:46.324 23:23:49 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:31:46.324 23:23:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:46.324 23:23:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:46.324 23:23:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:46.324 23:23:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:46.324 23:23:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:31:46.324 Found net devices under 0000:0a:00.0: cvl_0_0 00:31:46.325 23:23:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:46.325 23:23:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:46.325 23:23:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:46.325 23:23:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:46.325 23:23:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:46.325 23:23:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:31:46.325 Found net devices under 0000:0a:00.1: cvl_0_1 00:31:46.325 23:23:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:46.325 23:23:49 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:31:46.325 23:23:49 -- nvmf/common.sh@402 -- # is_hw=yes 00:31:46.325 23:23:49 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:31:46.325 23:23:49 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:31:46.325 23:23:49 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:31:46.325 23:23:49 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:31:46.325 23:23:49 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:31:46.325 23:23:49 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:31:46.325 23:23:49 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:31:46.325 23:23:49 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:31:46.325 23:23:49 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:31:46.325 23:23:49 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:31:46.325 23:23:49 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:31:46.325 23:23:49 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:31:46.325 23:23:49 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:31:46.325 23:23:49 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:31:46.325 23:23:49 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:31:46.325 23:23:49 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:31:46.325 23:23:49 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:31:46.325 23:23:49 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:31:46.325 23:23:49 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:31:46.325 23:23:49 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:31:46.325 23:23:49 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:31:46.325 23:23:49 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:31:46.325 23:23:49 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:31:46.325 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:31:46.325 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.274 ms 00:31:46.325 00:31:46.325 --- 10.0.0.2 ping statistics --- 00:31:46.325 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:46.325 rtt min/avg/max/mdev = 0.274/0.274/0.274/0.000 ms 00:31:46.325 23:23:49 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:31:46.325 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:31:46.325 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.092 ms 00:31:46.325 00:31:46.325 --- 10.0.0.1 ping statistics --- 00:31:46.325 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:46.325 rtt min/avg/max/mdev = 0.092/0.092/0.092/0.000 ms 00:31:46.325 23:23:49 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:31:46.325 23:23:49 -- nvmf/common.sh@410 -- # return 0 00:31:46.325 23:23:49 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:31:46.325 23:23:49 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:31:47.260 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:31:47.260 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:31:47.260 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:31:47.260 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:31:47.260 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:31:47.260 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:31:47.260 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:31:47.260 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:31:47.260 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:31:47.260 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:31:47.260 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:31:47.260 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:31:47.260 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:31:47.260 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:31:47.260 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:31:47.260 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:31:47.260 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:31:47.260 23:23:50 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:31:47.260 23:23:50 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:31:47.260 23:23:50 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:31:47.260 23:23:50 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:31:47.260 23:23:50 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:31:47.260 23:23:50 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:31:47.545 23:23:50 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:31:47.545 23:23:50 -- target/dif.sh@137 -- # nvmfappstart 00:31:47.545 23:23:50 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:31:47.545 23:23:50 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:47.545 23:23:50 -- common/autotest_common.sh@10 -- # set +x 00:31:47.545 23:23:50 -- nvmf/common.sh@469 -- # nvmfpid=2592395 00:31:47.545 23:23:50 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:31:47.545 23:23:50 -- nvmf/common.sh@470 -- # waitforlisten 2592395 00:31:47.545 23:23:50 -- common/autotest_common.sh@829 -- # '[' -z 2592395 ']' 00:31:47.545 23:23:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:47.545 23:23:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:31:47.545 23:23:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:47.545 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:47.545 23:23:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:31:47.545 23:23:50 -- common/autotest_common.sh@10 -- # set +x 00:31:47.545 [2024-11-28 23:23:50.914785] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:31:47.545 [2024-11-28 23:23:50.914878] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:31:47.545 EAL: No free 2048 kB hugepages reported on node 1 00:31:47.545 [2024-11-28 23:23:50.985066] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:31:47.545 [2024-11-28 23:23:51.072449] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:31:47.545 [2024-11-28 23:23:51.072637] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:31:47.545 [2024-11-28 23:23:51.072659] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:31:47.545 [2024-11-28 23:23:51.072675] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:31:47.545 [2024-11-28 23:23:51.072706] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:48.535 23:23:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:31:48.535 23:23:51 -- common/autotest_common.sh@862 -- # return 0 00:31:48.535 23:23:51 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:31:48.535 23:23:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:48.535 23:23:51 -- common/autotest_common.sh@10 -- # set +x 00:31:48.535 23:23:51 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:31:48.535 23:23:51 -- target/dif.sh@139 -- # create_transport 00:31:48.535 23:23:51 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:31:48.535 23:23:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:48.535 23:23:51 -- common/autotest_common.sh@10 -- # set +x 00:31:48.535 [2024-11-28 23:23:51.889922] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:48.535 23:23:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:48.535 23:23:51 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:31:48.535 23:23:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:48.535 23:23:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:48.535 23:23:51 -- common/autotest_common.sh@10 -- # set +x 00:31:48.535 ************************************ 00:31:48.535 START TEST fio_dif_1_default 00:31:48.535 ************************************ 00:31:48.535 23:23:51 -- common/autotest_common.sh@1114 -- # fio_dif_1 00:31:48.535 23:23:51 -- target/dif.sh@86 -- # create_subsystems 0 00:31:48.535 23:23:51 -- target/dif.sh@28 -- # local sub 00:31:48.535 23:23:51 -- target/dif.sh@30 -- # for sub in "$@" 00:31:48.535 23:23:51 -- target/dif.sh@31 -- # create_subsystem 0 00:31:48.535 23:23:51 -- target/dif.sh@18 -- # local sub_id=0 00:31:48.535 23:23:51 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:31:48.535 23:23:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:48.535 23:23:51 -- common/autotest_common.sh@10 -- # set +x 00:31:48.535 bdev_null0 00:31:48.535 23:23:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:48.535 23:23:51 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:48.535 23:23:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:48.535 23:23:51 -- common/autotest_common.sh@10 -- # set +x 00:31:48.535 23:23:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:48.535 23:23:51 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:48.535 23:23:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:48.535 23:23:51 -- common/autotest_common.sh@10 -- # set +x 00:31:48.535 23:23:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:48.535 23:23:51 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:48.535 23:23:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:48.535 23:23:51 -- common/autotest_common.sh@10 -- # set +x 00:31:48.536 [2024-11-28 23:23:51.926170] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:48.536 23:23:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:48.536 23:23:51 -- target/dif.sh@87 -- # fio /dev/fd/62 00:31:48.536 23:23:51 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:31:48.536 23:23:51 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:31:48.536 23:23:51 -- nvmf/common.sh@520 -- # config=() 00:31:48.536 23:23:51 -- nvmf/common.sh@520 -- # local subsystem config 00:31:48.536 23:23:51 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:48.536 23:23:51 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:48.536 23:23:51 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:48.536 { 00:31:48.536 "params": { 00:31:48.536 "name": "Nvme$subsystem", 00:31:48.536 "trtype": "$TEST_TRANSPORT", 00:31:48.536 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:48.536 "adrfam": "ipv4", 00:31:48.536 "trsvcid": "$NVMF_PORT", 00:31:48.536 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:48.536 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:48.536 "hdgst": ${hdgst:-false}, 00:31:48.536 "ddgst": ${ddgst:-false} 00:31:48.536 }, 00:31:48.536 "method": "bdev_nvme_attach_controller" 00:31:48.536 } 00:31:48.536 EOF 00:31:48.536 )") 00:31:48.536 23:23:51 -- target/dif.sh@82 -- # gen_fio_conf 00:31:48.536 23:23:51 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:48.536 23:23:51 -- target/dif.sh@54 -- # local file 00:31:48.536 23:23:51 -- target/dif.sh@56 -- # cat 00:31:48.536 23:23:51 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:48.536 23:23:51 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:48.536 23:23:51 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:48.536 23:23:51 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:48.536 23:23:51 -- common/autotest_common.sh@1330 -- # shift 00:31:48.536 23:23:51 -- nvmf/common.sh@542 -- # cat 00:31:48.536 23:23:51 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:48.536 23:23:51 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:48.536 23:23:51 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:48.536 23:23:51 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:48.536 23:23:51 -- target/dif.sh@72 -- # (( file <= files )) 00:31:48.536 23:23:51 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:48.536 23:23:51 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:48.536 23:23:51 -- nvmf/common.sh@544 -- # jq . 00:31:48.536 23:23:51 -- nvmf/common.sh@545 -- # IFS=, 00:31:48.536 23:23:51 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:48.536 "params": { 00:31:48.536 "name": "Nvme0", 00:31:48.536 "trtype": "tcp", 00:31:48.536 "traddr": "10.0.0.2", 00:31:48.536 "adrfam": "ipv4", 00:31:48.536 "trsvcid": "4420", 00:31:48.536 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:48.536 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:48.536 "hdgst": false, 00:31:48.536 "ddgst": false 00:31:48.536 }, 00:31:48.536 "method": "bdev_nvme_attach_controller" 00:31:48.536 }' 00:31:48.536 23:23:51 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:48.536 23:23:51 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:48.536 23:23:51 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:48.536 23:23:51 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:48.536 23:23:51 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:48.536 23:23:51 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:48.536 23:23:51 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:48.536 23:23:51 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:48.536 23:23:51 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:48.536 23:23:51 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:48.794 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:48.794 fio-3.35 00:31:48.794 Starting 1 thread 00:31:48.794 EAL: No free 2048 kB hugepages reported on node 1 00:31:49.053 [2024-11-28 23:23:52.571116] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:49.053 [2024-11-28 23:23:52.571201] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:01.251 00:32:01.251 filename0: (groupid=0, jobs=1): err= 0: pid=2592644: Thu Nov 28 23:24:02 2024 00:32:01.251 read: IOPS=97, BW=390KiB/s (399kB/s)(3904KiB/10013msec) 00:32:01.251 slat (nsec): min=4556, max=61050, avg=9415.06, stdev=2966.38 00:32:01.251 clat (usec): min=40811, max=48529, avg=41005.80, stdev=486.54 00:32:01.251 lat (usec): min=40819, max=48544, avg=41015.21, stdev=486.58 00:32:01.251 clat percentiles (usec): 00:32:01.251 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:32:01.252 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:32:01.252 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:32:01.252 | 99.00th=[41157], 99.50th=[41681], 99.90th=[48497], 99.95th=[48497], 00:32:01.252 | 99.99th=[48497] 00:32:01.252 bw ( KiB/s): min= 384, max= 416, per=99.51%, avg=388.80, stdev=11.72, samples=20 00:32:01.252 iops : min= 96, max= 104, avg=97.20, stdev= 2.93, samples=20 00:32:01.252 lat (msec) : 50=100.00% 00:32:01.252 cpu : usr=91.36%, sys=8.34%, ctx=25, majf=0, minf=258 00:32:01.252 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:01.252 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:01.252 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:01.252 issued rwts: total=976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:01.252 latency : target=0, window=0, percentile=100.00%, depth=4 00:32:01.252 00:32:01.252 Run status group 0 (all jobs): 00:32:01.252 READ: bw=390KiB/s (399kB/s), 390KiB/s-390KiB/s (399kB/s-399kB/s), io=3904KiB (3998kB), run=10013-10013msec 00:32:01.252 23:24:02 -- target/dif.sh@88 -- # destroy_subsystems 0 00:32:01.252 23:24:02 -- target/dif.sh@43 -- # local sub 00:32:01.252 23:24:02 -- target/dif.sh@45 -- # for sub in "$@" 00:32:01.252 23:24:02 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:01.252 23:24:02 -- target/dif.sh@36 -- # local sub_id=0 00:32:01.252 23:24:02 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:01.252 23:24:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:01.252 23:24:02 -- common/autotest_common.sh@10 -- # set +x 00:32:01.252 23:24:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:01.252 23:24:02 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:01.252 23:24:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:01.252 23:24:02 -- common/autotest_common.sh@10 -- # set +x 00:32:01.252 23:24:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:01.252 00:32:01.252 real 0m11.015s 00:32:01.252 user 0m10.215s 00:32:01.252 sys 0m1.101s 00:32:01.252 23:24:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:01.252 23:24:02 -- common/autotest_common.sh@10 -- # set +x 00:32:01.252 ************************************ 00:32:01.252 END TEST fio_dif_1_default 00:32:01.252 ************************************ 00:32:01.252 23:24:02 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:32:01.252 23:24:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:01.252 23:24:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:01.252 23:24:02 -- common/autotest_common.sh@10 -- # set +x 00:32:01.252 ************************************ 00:32:01.252 START TEST fio_dif_1_multi_subsystems 00:32:01.252 ************************************ 00:32:01.252 23:24:02 -- common/autotest_common.sh@1114 -- # fio_dif_1_multi_subsystems 00:32:01.252 23:24:02 -- target/dif.sh@92 -- # local files=1 00:32:01.252 23:24:02 -- target/dif.sh@94 -- # create_subsystems 0 1 00:32:01.252 23:24:02 -- target/dif.sh@28 -- # local sub 00:32:01.252 23:24:02 -- target/dif.sh@30 -- # for sub in "$@" 00:32:01.252 23:24:02 -- target/dif.sh@31 -- # create_subsystem 0 00:32:01.252 23:24:02 -- target/dif.sh@18 -- # local sub_id=0 00:32:01.252 23:24:02 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:32:01.252 23:24:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:01.252 23:24:02 -- common/autotest_common.sh@10 -- # set +x 00:32:01.252 bdev_null0 00:32:01.252 23:24:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:01.252 23:24:02 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:32:01.252 23:24:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:01.252 23:24:02 -- common/autotest_common.sh@10 -- # set +x 00:32:01.252 23:24:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:01.252 23:24:02 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:32:01.252 23:24:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:01.252 23:24:02 -- common/autotest_common.sh@10 -- # set +x 00:32:01.252 23:24:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:01.252 23:24:02 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:32:01.252 23:24:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:01.252 23:24:02 -- common/autotest_common.sh@10 -- # set +x 00:32:01.252 [2024-11-28 23:24:02.976731] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:01.252 23:24:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:01.252 23:24:02 -- target/dif.sh@30 -- # for sub in "$@" 00:32:01.252 23:24:02 -- target/dif.sh@31 -- # create_subsystem 1 00:32:01.252 23:24:02 -- target/dif.sh@18 -- # local sub_id=1 00:32:01.252 23:24:02 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:32:01.252 23:24:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:01.252 23:24:02 -- common/autotest_common.sh@10 -- # set +x 00:32:01.252 bdev_null1 00:32:01.252 23:24:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:01.252 23:24:02 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:32:01.252 23:24:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:01.252 23:24:02 -- common/autotest_common.sh@10 -- # set +x 00:32:01.252 23:24:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:01.252 23:24:02 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:32:01.252 23:24:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:01.252 23:24:02 -- common/autotest_common.sh@10 -- # set +x 00:32:01.252 23:24:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:01.252 23:24:03 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:32:01.252 23:24:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:01.252 23:24:03 -- common/autotest_common.sh@10 -- # set +x 00:32:01.252 23:24:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:01.252 23:24:03 -- target/dif.sh@95 -- # fio /dev/fd/62 00:32:01.252 23:24:03 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:32:01.252 23:24:03 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:32:01.252 23:24:03 -- nvmf/common.sh@520 -- # config=() 00:32:01.252 23:24:03 -- nvmf/common.sh@520 -- # local subsystem config 00:32:01.252 23:24:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:01.252 23:24:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:01.252 { 00:32:01.252 "params": { 00:32:01.252 "name": "Nvme$subsystem", 00:32:01.252 "trtype": "$TEST_TRANSPORT", 00:32:01.252 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:01.252 "adrfam": "ipv4", 00:32:01.252 "trsvcid": "$NVMF_PORT", 00:32:01.252 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:01.252 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:01.252 "hdgst": ${hdgst:-false}, 00:32:01.252 "ddgst": ${ddgst:-false} 00:32:01.252 }, 00:32:01.252 "method": "bdev_nvme_attach_controller" 00:32:01.252 } 00:32:01.252 EOF 00:32:01.252 )") 00:32:01.252 23:24:03 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:01.252 23:24:03 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:01.252 23:24:03 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:32:01.253 23:24:03 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:32:01.253 23:24:03 -- common/autotest_common.sh@1328 -- # local sanitizers 00:32:01.253 23:24:03 -- target/dif.sh@82 -- # gen_fio_conf 00:32:01.253 23:24:03 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:01.253 23:24:03 -- common/autotest_common.sh@1330 -- # shift 00:32:01.253 23:24:03 -- target/dif.sh@54 -- # local file 00:32:01.253 23:24:03 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:32:01.253 23:24:03 -- target/dif.sh@56 -- # cat 00:32:01.253 23:24:03 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:01.253 23:24:03 -- nvmf/common.sh@542 -- # cat 00:32:01.253 23:24:03 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:01.253 23:24:03 -- common/autotest_common.sh@1334 -- # grep libasan 00:32:01.253 23:24:03 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:01.253 23:24:03 -- target/dif.sh@72 -- # (( file = 1 )) 00:32:01.253 23:24:03 -- target/dif.sh@72 -- # (( file <= files )) 00:32:01.253 23:24:03 -- target/dif.sh@73 -- # cat 00:32:01.253 23:24:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:01.253 23:24:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:01.253 { 00:32:01.253 "params": { 00:32:01.253 "name": "Nvme$subsystem", 00:32:01.253 "trtype": "$TEST_TRANSPORT", 00:32:01.253 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:01.253 "adrfam": "ipv4", 00:32:01.253 "trsvcid": "$NVMF_PORT", 00:32:01.253 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:01.253 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:01.253 "hdgst": ${hdgst:-false}, 00:32:01.253 "ddgst": ${ddgst:-false} 00:32:01.253 }, 00:32:01.253 "method": "bdev_nvme_attach_controller" 00:32:01.253 } 00:32:01.253 EOF 00:32:01.253 )") 00:32:01.253 23:24:03 -- nvmf/common.sh@542 -- # cat 00:32:01.253 23:24:03 -- target/dif.sh@72 -- # (( file++ )) 00:32:01.253 23:24:03 -- target/dif.sh@72 -- # (( file <= files )) 00:32:01.253 23:24:03 -- nvmf/common.sh@544 -- # jq . 00:32:01.253 23:24:03 -- nvmf/common.sh@545 -- # IFS=, 00:32:01.253 23:24:03 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:32:01.253 "params": { 00:32:01.253 "name": "Nvme0", 00:32:01.253 "trtype": "tcp", 00:32:01.253 "traddr": "10.0.0.2", 00:32:01.253 "adrfam": "ipv4", 00:32:01.253 "trsvcid": "4420", 00:32:01.253 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:01.253 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:01.253 "hdgst": false, 00:32:01.253 "ddgst": false 00:32:01.253 }, 00:32:01.253 "method": "bdev_nvme_attach_controller" 00:32:01.253 },{ 00:32:01.253 "params": { 00:32:01.253 "name": "Nvme1", 00:32:01.253 "trtype": "tcp", 00:32:01.253 "traddr": "10.0.0.2", 00:32:01.253 "adrfam": "ipv4", 00:32:01.253 "trsvcid": "4420", 00:32:01.253 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:32:01.253 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:32:01.253 "hdgst": false, 00:32:01.253 "ddgst": false 00:32:01.253 }, 00:32:01.253 "method": "bdev_nvme_attach_controller" 00:32:01.253 }' 00:32:01.253 23:24:03 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:01.253 23:24:03 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:01.253 23:24:03 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:01.253 23:24:03 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:01.253 23:24:03 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:32:01.253 23:24:03 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:01.253 23:24:03 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:01.253 23:24:03 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:01.253 23:24:03 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:32:01.253 23:24:03 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:01.253 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:32:01.253 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:32:01.253 fio-3.35 00:32:01.253 Starting 2 threads 00:32:01.253 EAL: No free 2048 kB hugepages reported on node 1 00:32:01.253 [2024-11-28 23:24:03.847705] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:32:01.253 [2024-11-28 23:24:03.847751] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:11.265 00:32:11.265 filename0: (groupid=0, jobs=1): err= 0: pid=2594193: Thu Nov 28 23:24:13 2024 00:32:11.265 read: IOPS=97, BW=390KiB/s (399kB/s)(3904KiB/10007msec) 00:32:11.265 slat (nsec): min=7032, max=44175, avg=8849.60, stdev=2647.55 00:32:11.265 clat (usec): min=40714, max=43697, avg=40983.47, stdev=178.67 00:32:11.265 lat (usec): min=40721, max=43716, avg=40992.32, stdev=178.92 00:32:11.265 clat percentiles (usec): 00:32:11.265 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:32:11.265 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:32:11.265 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:32:11.265 | 99.00th=[41157], 99.50th=[41157], 99.90th=[43779], 99.95th=[43779], 00:32:11.265 | 99.99th=[43779] 00:32:11.265 bw ( KiB/s): min= 384, max= 416, per=33.78%, avg=388.80, stdev=11.72, samples=20 00:32:11.265 iops : min= 96, max= 104, avg=97.20, stdev= 2.93, samples=20 00:32:11.265 lat (msec) : 50=100.00% 00:32:11.265 cpu : usr=95.59%, sys=4.09%, ctx=15, majf=0, minf=193 00:32:11.265 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:11.265 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.265 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.265 issued rwts: total=976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.265 latency : target=0, window=0, percentile=100.00%, depth=4 00:32:11.265 filename1: (groupid=0, jobs=1): err= 0: pid=2594194: Thu Nov 28 23:24:13 2024 00:32:11.265 read: IOPS=189, BW=759KiB/s (777kB/s)(7600KiB/10015msec) 00:32:11.265 slat (nsec): min=6960, max=28177, avg=8768.11, stdev=2476.35 00:32:11.265 clat (usec): min=527, max=42419, avg=21056.54, stdev=20485.38 00:32:11.265 lat (usec): min=534, max=42430, avg=21065.31, stdev=20485.07 00:32:11.265 clat percentiles (usec): 00:32:11.265 | 1.00th=[ 562], 5.00th=[ 570], 10.00th=[ 578], 20.00th=[ 594], 00:32:11.265 | 30.00th=[ 603], 40.00th=[ 619], 50.00th=[ 3916], 60.00th=[41157], 00:32:11.265 | 70.00th=[41157], 80.00th=[41157], 90.00th=[42206], 95.00th=[42206], 00:32:11.265 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:32:11.265 | 99.99th=[42206] 00:32:11.265 bw ( KiB/s): min= 704, max= 768, per=65.99%, avg=758.40, stdev=23.45, samples=20 00:32:11.265 iops : min= 176, max= 192, avg=189.60, stdev= 5.86, samples=20 00:32:11.265 lat (usec) : 750=48.42%, 1000=1.37% 00:32:11.265 lat (msec) : 2=0.11%, 4=0.21%, 50=49.89% 00:32:11.265 cpu : usr=95.69%, sys=3.98%, ctx=15, majf=0, minf=131 00:32:11.265 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:11.265 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.265 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.265 issued rwts: total=1900,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.265 latency : target=0, window=0, percentile=100.00%, depth=4 00:32:11.265 00:32:11.265 Run status group 0 (all jobs): 00:32:11.265 READ: bw=1149KiB/s (1176kB/s), 390KiB/s-759KiB/s (399kB/s-777kB/s), io=11.2MiB (11.8MB), run=10007-10015msec 00:32:11.265 23:24:14 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:32:11.265 23:24:14 -- target/dif.sh@43 -- # local sub 00:32:11.265 23:24:14 -- target/dif.sh@45 -- # for sub in "$@" 00:32:11.265 23:24:14 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:11.265 23:24:14 -- target/dif.sh@36 -- # local sub_id=0 00:32:11.265 23:24:14 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:11.265 23:24:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.265 23:24:14 -- common/autotest_common.sh@10 -- # set +x 00:32:11.265 23:24:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.265 23:24:14 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:11.265 23:24:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.265 23:24:14 -- common/autotest_common.sh@10 -- # set +x 00:32:11.265 23:24:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.266 23:24:14 -- target/dif.sh@45 -- # for sub in "$@" 00:32:11.266 23:24:14 -- target/dif.sh@46 -- # destroy_subsystem 1 00:32:11.266 23:24:14 -- target/dif.sh@36 -- # local sub_id=1 00:32:11.266 23:24:14 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:32:11.266 23:24:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.266 23:24:14 -- common/autotest_common.sh@10 -- # set +x 00:32:11.266 23:24:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.266 23:24:14 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:32:11.266 23:24:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.266 23:24:14 -- common/autotest_common.sh@10 -- # set +x 00:32:11.266 23:24:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.266 00:32:11.266 real 0m11.331s 00:32:11.266 user 0m20.413s 00:32:11.266 sys 0m1.137s 00:32:11.266 23:24:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:11.266 23:24:14 -- common/autotest_common.sh@10 -- # set +x 00:32:11.266 ************************************ 00:32:11.266 END TEST fio_dif_1_multi_subsystems 00:32:11.266 ************************************ 00:32:11.266 23:24:14 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:32:11.266 23:24:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:11.266 23:24:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:11.266 23:24:14 -- common/autotest_common.sh@10 -- # set +x 00:32:11.266 ************************************ 00:32:11.266 START TEST fio_dif_rand_params 00:32:11.266 ************************************ 00:32:11.266 23:24:14 -- common/autotest_common.sh@1114 -- # fio_dif_rand_params 00:32:11.266 23:24:14 -- target/dif.sh@100 -- # local NULL_DIF 00:32:11.266 23:24:14 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:32:11.266 23:24:14 -- target/dif.sh@103 -- # NULL_DIF=3 00:32:11.266 23:24:14 -- target/dif.sh@103 -- # bs=128k 00:32:11.266 23:24:14 -- target/dif.sh@103 -- # numjobs=3 00:32:11.266 23:24:14 -- target/dif.sh@103 -- # iodepth=3 00:32:11.266 23:24:14 -- target/dif.sh@103 -- # runtime=5 00:32:11.266 23:24:14 -- target/dif.sh@105 -- # create_subsystems 0 00:32:11.266 23:24:14 -- target/dif.sh@28 -- # local sub 00:32:11.266 23:24:14 -- target/dif.sh@30 -- # for sub in "$@" 00:32:11.266 23:24:14 -- target/dif.sh@31 -- # create_subsystem 0 00:32:11.266 23:24:14 -- target/dif.sh@18 -- # local sub_id=0 00:32:11.266 23:24:14 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:32:11.266 23:24:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.266 23:24:14 -- common/autotest_common.sh@10 -- # set +x 00:32:11.266 bdev_null0 00:32:11.266 23:24:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.266 23:24:14 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:32:11.266 23:24:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.266 23:24:14 -- common/autotest_common.sh@10 -- # set +x 00:32:11.266 23:24:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.266 23:24:14 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:32:11.266 23:24:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.266 23:24:14 -- common/autotest_common.sh@10 -- # set +x 00:32:11.266 23:24:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.266 23:24:14 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:32:11.266 23:24:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.266 23:24:14 -- common/autotest_common.sh@10 -- # set +x 00:32:11.266 [2024-11-28 23:24:14.335020] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:11.266 23:24:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.266 23:24:14 -- target/dif.sh@106 -- # fio /dev/fd/62 00:32:11.266 23:24:14 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:32:11.266 23:24:14 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:32:11.266 23:24:14 -- nvmf/common.sh@520 -- # config=() 00:32:11.266 23:24:14 -- nvmf/common.sh@520 -- # local subsystem config 00:32:11.266 23:24:14 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:11.266 23:24:14 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:11.266 23:24:14 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:11.266 { 00:32:11.266 "params": { 00:32:11.266 "name": "Nvme$subsystem", 00:32:11.266 "trtype": "$TEST_TRANSPORT", 00:32:11.266 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:11.266 "adrfam": "ipv4", 00:32:11.266 "trsvcid": "$NVMF_PORT", 00:32:11.266 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:11.266 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:11.266 "hdgst": ${hdgst:-false}, 00:32:11.266 "ddgst": ${ddgst:-false} 00:32:11.266 }, 00:32:11.266 "method": "bdev_nvme_attach_controller" 00:32:11.266 } 00:32:11.266 EOF 00:32:11.266 )") 00:32:11.266 23:24:14 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:11.266 23:24:14 -- target/dif.sh@82 -- # gen_fio_conf 00:32:11.266 23:24:14 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:32:11.266 23:24:14 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:32:11.266 23:24:14 -- target/dif.sh@54 -- # local file 00:32:11.266 23:24:14 -- common/autotest_common.sh@1328 -- # local sanitizers 00:32:11.266 23:24:14 -- target/dif.sh@56 -- # cat 00:32:11.266 23:24:14 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:11.266 23:24:14 -- common/autotest_common.sh@1330 -- # shift 00:32:11.266 23:24:14 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:32:11.266 23:24:14 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:11.266 23:24:14 -- nvmf/common.sh@542 -- # cat 00:32:11.266 23:24:14 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:11.266 23:24:14 -- target/dif.sh@72 -- # (( file = 1 )) 00:32:11.266 23:24:14 -- common/autotest_common.sh@1334 -- # grep libasan 00:32:11.266 23:24:14 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:11.266 23:24:14 -- target/dif.sh@72 -- # (( file <= files )) 00:32:11.266 23:24:14 -- nvmf/common.sh@544 -- # jq . 00:32:11.266 23:24:14 -- nvmf/common.sh@545 -- # IFS=, 00:32:11.266 23:24:14 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:32:11.266 "params": { 00:32:11.266 "name": "Nvme0", 00:32:11.266 "trtype": "tcp", 00:32:11.266 "traddr": "10.0.0.2", 00:32:11.266 "adrfam": "ipv4", 00:32:11.266 "trsvcid": "4420", 00:32:11.266 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:11.266 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:11.266 "hdgst": false, 00:32:11.266 "ddgst": false 00:32:11.266 }, 00:32:11.266 "method": "bdev_nvme_attach_controller" 00:32:11.266 }' 00:32:11.266 23:24:14 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:11.266 23:24:14 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:11.266 23:24:14 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:11.266 23:24:14 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:11.266 23:24:14 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:32:11.266 23:24:14 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:11.266 23:24:14 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:11.266 23:24:14 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:11.266 23:24:14 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:32:11.266 23:24:14 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:11.266 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:32:11.266 ... 00:32:11.266 fio-3.35 00:32:11.266 Starting 3 threads 00:32:11.266 EAL: No free 2048 kB hugepages reported on node 1 00:32:11.523 [2024-11-28 23:24:15.128596] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:32:11.523 [2024-11-28 23:24:15.128689] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:16.780 00:32:16.780 filename0: (groupid=0, jobs=1): err= 0: pid=2596138: Thu Nov 28 23:24:20 2024 00:32:16.780 read: IOPS=224, BW=28.1MiB/s (29.4MB/s)(142MiB/5047msec) 00:32:16.780 slat (nsec): min=4372, max=69279, avg=17713.73, stdev=5016.40 00:32:16.780 clat (usec): min=4870, max=52570, avg=13302.91, stdev=5237.76 00:32:16.780 lat (usec): min=4881, max=52589, avg=13320.62, stdev=5237.43 00:32:16.780 clat percentiles (usec): 00:32:16.780 | 1.00th=[ 6063], 5.00th=[ 8717], 10.00th=[10028], 20.00th=[10814], 00:32:16.780 | 30.00th=[11469], 40.00th=[12256], 50.00th=[12911], 60.00th=[13566], 00:32:16.780 | 70.00th=[14091], 80.00th=[14746], 90.00th=[15533], 95.00th=[16057], 00:32:16.780 | 99.00th=[46924], 99.50th=[51119], 99.90th=[52691], 99.95th=[52691], 00:32:16.780 | 99.99th=[52691] 00:32:16.780 bw ( KiB/s): min=21504, max=33024, per=33.02%, avg=28928.00, stdev=3514.24, samples=10 00:32:16.780 iops : min= 168, max= 258, avg=226.00, stdev=27.46, samples=10 00:32:16.780 lat (msec) : 10=10.33%, 20=87.64%, 50=1.41%, 100=0.62% 00:32:16.780 cpu : usr=94.05%, sys=5.45%, ctx=8, majf=0, minf=134 00:32:16.780 IO depths : 1=1.1%, 2=98.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:16.780 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:16.780 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:16.780 issued rwts: total=1133,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:16.780 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:16.780 filename0: (groupid=0, jobs=1): err= 0: pid=2596139: Thu Nov 28 23:24:20 2024 00:32:16.780 read: IOPS=223, BW=28.0MiB/s (29.3MB/s)(141MiB/5045msec) 00:32:16.780 slat (nsec): min=4706, max=40775, avg=16016.01, stdev=3558.52 00:32:16.780 clat (usec): min=4616, max=53349, avg=13347.03, stdev=4551.01 00:32:16.780 lat (usec): min=4629, max=53364, avg=13363.04, stdev=4550.79 00:32:16.780 clat percentiles (usec): 00:32:16.780 | 1.00th=[ 5145], 5.00th=[ 8717], 10.00th=[10159], 20.00th=[11338], 00:32:16.780 | 30.00th=[11994], 40.00th=[12649], 50.00th=[13304], 60.00th=[13829], 00:32:16.780 | 70.00th=[14353], 80.00th=[14877], 90.00th=[15533], 95.00th=[16319], 00:32:16.780 | 99.00th=[45351], 99.50th=[48497], 99.90th=[52691], 99.95th=[53216], 00:32:16.780 | 99.99th=[53216] 00:32:16.780 bw ( KiB/s): min=27392, max=32768, per=32.94%, avg=28851.20, stdev=1650.49, samples=10 00:32:16.780 iops : min= 214, max= 256, avg=225.40, stdev=12.89, samples=10 00:32:16.780 lat (msec) : 10=9.21%, 20=89.55%, 50=0.97%, 100=0.27% 00:32:16.780 cpu : usr=95.62%, sys=3.89%, ctx=7, majf=0, minf=91 00:32:16.780 IO depths : 1=0.3%, 2=99.7%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:16.780 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:16.780 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:16.780 issued rwts: total=1129,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:16.780 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:16.780 filename0: (groupid=0, jobs=1): err= 0: pid=2596140: Thu Nov 28 23:24:20 2024 00:32:16.780 read: IOPS=238, BW=29.8MiB/s (31.2MB/s)(149MiB/5005msec) 00:32:16.780 slat (nsec): min=4906, max=55056, avg=18383.17, stdev=4653.35 00:32:16.780 clat (usec): min=4980, max=53751, avg=12572.24, stdev=5695.51 00:32:16.780 lat (usec): min=4992, max=53778, avg=12590.62, stdev=5695.43 00:32:16.780 clat percentiles (usec): 00:32:16.780 | 1.00th=[ 5407], 5.00th=[ 9372], 10.00th=[ 9896], 20.00th=[10421], 00:32:16.780 | 30.00th=[10814], 40.00th=[11207], 50.00th=[11600], 60.00th=[12125], 00:32:16.780 | 70.00th=[12649], 80.00th=[13304], 90.00th=[14615], 95.00th=[15401], 00:32:16.780 | 99.00th=[50594], 99.50th=[53216], 99.90th=[53740], 99.95th=[53740], 00:32:16.780 | 99.99th=[53740] 00:32:16.780 bw ( KiB/s): min=21547, max=35072, per=34.75%, avg=30442.70, stdev=4063.16, samples=10 00:32:16.780 iops : min= 168, max= 274, avg=237.80, stdev=31.83, samples=10 00:32:16.780 lat (msec) : 10=11.83%, 20=86.16%, 50=1.01%, 100=1.01% 00:32:16.780 cpu : usr=93.92%, sys=4.80%, ctx=80, majf=0, minf=105 00:32:16.780 IO depths : 1=0.8%, 2=99.2%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:16.780 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:16.780 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:16.780 issued rwts: total=1192,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:16.780 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:16.780 00:32:16.780 Run status group 0 (all jobs): 00:32:16.780 READ: bw=85.5MiB/s (89.7MB/s), 28.0MiB/s-29.8MiB/s (29.3MB/s-31.2MB/s), io=432MiB (453MB), run=5005-5047msec 00:32:17.039 23:24:20 -- target/dif.sh@107 -- # destroy_subsystems 0 00:32:17.039 23:24:20 -- target/dif.sh@43 -- # local sub 00:32:17.039 23:24:20 -- target/dif.sh@45 -- # for sub in "$@" 00:32:17.039 23:24:20 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:17.039 23:24:20 -- target/dif.sh@36 -- # local sub_id=0 00:32:17.039 23:24:20 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:17.039 23:24:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:17.039 23:24:20 -- common/autotest_common.sh@10 -- # set +x 00:32:17.039 23:24:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:17.039 23:24:20 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:17.039 23:24:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:17.039 23:24:20 -- common/autotest_common.sh@10 -- # set +x 00:32:17.039 23:24:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:17.039 23:24:20 -- target/dif.sh@109 -- # NULL_DIF=2 00:32:17.039 23:24:20 -- target/dif.sh@109 -- # bs=4k 00:32:17.039 23:24:20 -- target/dif.sh@109 -- # numjobs=8 00:32:17.039 23:24:20 -- target/dif.sh@109 -- # iodepth=16 00:32:17.039 23:24:20 -- target/dif.sh@109 -- # runtime= 00:32:17.039 23:24:20 -- target/dif.sh@109 -- # files=2 00:32:17.039 23:24:20 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:32:17.039 23:24:20 -- target/dif.sh@28 -- # local sub 00:32:17.039 23:24:20 -- target/dif.sh@30 -- # for sub in "$@" 00:32:17.039 23:24:20 -- target/dif.sh@31 -- # create_subsystem 0 00:32:17.039 23:24:20 -- target/dif.sh@18 -- # local sub_id=0 00:32:17.039 23:24:20 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:32:17.039 23:24:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:17.039 23:24:20 -- common/autotest_common.sh@10 -- # set +x 00:32:17.039 bdev_null0 00:32:17.039 23:24:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:17.039 23:24:20 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:32:17.039 23:24:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:17.039 23:24:20 -- common/autotest_common.sh@10 -- # set +x 00:32:17.039 23:24:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:17.039 23:24:20 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:32:17.039 23:24:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:17.039 23:24:20 -- common/autotest_common.sh@10 -- # set +x 00:32:17.039 23:24:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:17.039 23:24:20 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:32:17.039 23:24:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:17.039 23:24:20 -- common/autotest_common.sh@10 -- # set +x 00:32:17.039 [2024-11-28 23:24:20.523461] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:17.040 23:24:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:17.040 23:24:20 -- target/dif.sh@30 -- # for sub in "$@" 00:32:17.040 23:24:20 -- target/dif.sh@31 -- # create_subsystem 1 00:32:17.040 23:24:20 -- target/dif.sh@18 -- # local sub_id=1 00:32:17.040 23:24:20 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:32:17.040 23:24:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:17.040 23:24:20 -- common/autotest_common.sh@10 -- # set +x 00:32:17.040 bdev_null1 00:32:17.040 23:24:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:17.040 23:24:20 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:32:17.040 23:24:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:17.040 23:24:20 -- common/autotest_common.sh@10 -- # set +x 00:32:17.040 23:24:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:17.040 23:24:20 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:32:17.040 23:24:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:17.040 23:24:20 -- common/autotest_common.sh@10 -- # set +x 00:32:17.040 23:24:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:17.040 23:24:20 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:32:17.040 23:24:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:17.040 23:24:20 -- common/autotest_common.sh@10 -- # set +x 00:32:17.040 23:24:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:17.040 23:24:20 -- target/dif.sh@30 -- # for sub in "$@" 00:32:17.040 23:24:20 -- target/dif.sh@31 -- # create_subsystem 2 00:32:17.040 23:24:20 -- target/dif.sh@18 -- # local sub_id=2 00:32:17.040 23:24:20 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:32:17.040 23:24:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:17.040 23:24:20 -- common/autotest_common.sh@10 -- # set +x 00:32:17.040 bdev_null2 00:32:17.040 23:24:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:17.040 23:24:20 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:32:17.040 23:24:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:17.040 23:24:20 -- common/autotest_common.sh@10 -- # set +x 00:32:17.040 23:24:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:17.040 23:24:20 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:32:17.040 23:24:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:17.040 23:24:20 -- common/autotest_common.sh@10 -- # set +x 00:32:17.040 23:24:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:17.040 23:24:20 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:32:17.040 23:24:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:17.040 23:24:20 -- common/autotest_common.sh@10 -- # set +x 00:32:17.040 23:24:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:17.040 23:24:20 -- target/dif.sh@112 -- # fio /dev/fd/62 00:32:17.040 23:24:20 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:32:17.040 23:24:20 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:32:17.040 23:24:20 -- nvmf/common.sh@520 -- # config=() 00:32:17.040 23:24:20 -- nvmf/common.sh@520 -- # local subsystem config 00:32:17.040 23:24:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:17.040 23:24:20 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:17.040 23:24:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:17.040 { 00:32:17.040 "params": { 00:32:17.040 "name": "Nvme$subsystem", 00:32:17.040 "trtype": "$TEST_TRANSPORT", 00:32:17.040 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:17.040 "adrfam": "ipv4", 00:32:17.040 "trsvcid": "$NVMF_PORT", 00:32:17.040 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:17.040 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:17.040 "hdgst": ${hdgst:-false}, 00:32:17.040 "ddgst": ${ddgst:-false} 00:32:17.040 }, 00:32:17.040 "method": "bdev_nvme_attach_controller" 00:32:17.040 } 00:32:17.040 EOF 00:32:17.040 )") 00:32:17.040 23:24:20 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:17.040 23:24:20 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:32:17.040 23:24:20 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:32:17.040 23:24:20 -- common/autotest_common.sh@1328 -- # local sanitizers 00:32:17.040 23:24:20 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:17.040 23:24:20 -- target/dif.sh@82 -- # gen_fio_conf 00:32:17.040 23:24:20 -- common/autotest_common.sh@1330 -- # shift 00:32:17.040 23:24:20 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:32:17.040 23:24:20 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:17.040 23:24:20 -- target/dif.sh@54 -- # local file 00:32:17.040 23:24:20 -- target/dif.sh@56 -- # cat 00:32:17.040 23:24:20 -- nvmf/common.sh@542 -- # cat 00:32:17.040 23:24:20 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:17.040 23:24:20 -- common/autotest_common.sh@1334 -- # grep libasan 00:32:17.040 23:24:20 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:17.040 23:24:20 -- target/dif.sh@72 -- # (( file = 1 )) 00:32:17.040 23:24:20 -- target/dif.sh@72 -- # (( file <= files )) 00:32:17.040 23:24:20 -- target/dif.sh@73 -- # cat 00:32:17.040 23:24:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:17.040 23:24:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:17.040 { 00:32:17.040 "params": { 00:32:17.040 "name": "Nvme$subsystem", 00:32:17.040 "trtype": "$TEST_TRANSPORT", 00:32:17.040 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:17.040 "adrfam": "ipv4", 00:32:17.040 "trsvcid": "$NVMF_PORT", 00:32:17.040 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:17.040 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:17.040 "hdgst": ${hdgst:-false}, 00:32:17.040 "ddgst": ${ddgst:-false} 00:32:17.040 }, 00:32:17.040 "method": "bdev_nvme_attach_controller" 00:32:17.040 } 00:32:17.040 EOF 00:32:17.040 )") 00:32:17.040 23:24:20 -- nvmf/common.sh@542 -- # cat 00:32:17.040 23:24:20 -- target/dif.sh@72 -- # (( file++ )) 00:32:17.040 23:24:20 -- target/dif.sh@72 -- # (( file <= files )) 00:32:17.040 23:24:20 -- target/dif.sh@73 -- # cat 00:32:17.040 23:24:20 -- target/dif.sh@72 -- # (( file++ )) 00:32:17.040 23:24:20 -- target/dif.sh@72 -- # (( file <= files )) 00:32:17.040 23:24:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:17.040 23:24:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:17.040 { 00:32:17.040 "params": { 00:32:17.040 "name": "Nvme$subsystem", 00:32:17.040 "trtype": "$TEST_TRANSPORT", 00:32:17.040 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:17.040 "adrfam": "ipv4", 00:32:17.040 "trsvcid": "$NVMF_PORT", 00:32:17.040 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:17.040 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:17.040 "hdgst": ${hdgst:-false}, 00:32:17.040 "ddgst": ${ddgst:-false} 00:32:17.040 }, 00:32:17.040 "method": "bdev_nvme_attach_controller" 00:32:17.040 } 00:32:17.040 EOF 00:32:17.040 )") 00:32:17.040 23:24:20 -- nvmf/common.sh@542 -- # cat 00:32:17.040 23:24:20 -- nvmf/common.sh@544 -- # jq . 00:32:17.040 23:24:20 -- nvmf/common.sh@545 -- # IFS=, 00:32:17.040 23:24:20 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:32:17.040 "params": { 00:32:17.040 "name": "Nvme0", 00:32:17.040 "trtype": "tcp", 00:32:17.040 "traddr": "10.0.0.2", 00:32:17.040 "adrfam": "ipv4", 00:32:17.040 "trsvcid": "4420", 00:32:17.040 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:17.040 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:17.040 "hdgst": false, 00:32:17.040 "ddgst": false 00:32:17.040 }, 00:32:17.040 "method": "bdev_nvme_attach_controller" 00:32:17.040 },{ 00:32:17.040 "params": { 00:32:17.040 "name": "Nvme1", 00:32:17.040 "trtype": "tcp", 00:32:17.040 "traddr": "10.0.0.2", 00:32:17.040 "adrfam": "ipv4", 00:32:17.040 "trsvcid": "4420", 00:32:17.040 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:32:17.040 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:32:17.040 "hdgst": false, 00:32:17.040 "ddgst": false 00:32:17.040 }, 00:32:17.040 "method": "bdev_nvme_attach_controller" 00:32:17.040 },{ 00:32:17.040 "params": { 00:32:17.040 "name": "Nvme2", 00:32:17.040 "trtype": "tcp", 00:32:17.040 "traddr": "10.0.0.2", 00:32:17.040 "adrfam": "ipv4", 00:32:17.040 "trsvcid": "4420", 00:32:17.040 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:32:17.040 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:32:17.040 "hdgst": false, 00:32:17.040 "ddgst": false 00:32:17.040 }, 00:32:17.040 "method": "bdev_nvme_attach_controller" 00:32:17.040 }' 00:32:17.040 23:24:20 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:17.040 23:24:20 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:17.040 23:24:20 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:17.040 23:24:20 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:17.040 23:24:20 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:32:17.040 23:24:20 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:17.040 23:24:20 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:17.040 23:24:20 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:17.040 23:24:20 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:32:17.040 23:24:20 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:17.299 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:32:17.299 ... 00:32:17.299 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:32:17.299 ... 00:32:17.299 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:32:17.299 ... 00:32:17.299 fio-3.35 00:32:17.299 Starting 24 threads 00:32:17.299 EAL: No free 2048 kB hugepages reported on node 1 00:32:18.233 [2024-11-28 23:24:21.722364] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:32:18.233 [2024-11-28 23:24:21.722436] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:30.443 00:32:30.443 filename0: (groupid=0, jobs=1): err= 0: pid=2597022: Thu Nov 28 23:24:31 2024 00:32:30.443 read: IOPS=201, BW=806KiB/s (826kB/s)(8064KiB/10002msec) 00:32:30.443 slat (usec): min=8, max=144, avg=71.73, stdev=36.11 00:32:30.443 clat (msec): min=26, max=418, avg=78.76, stdev=100.63 00:32:30.443 lat (msec): min=26, max=418, avg=78.83, stdev=100.62 00:32:30.443 clat percentiles (msec): 00:32:30.443 | 1.00th=[ 29], 5.00th=[ 30], 10.00th=[ 30], 20.00th=[ 31], 00:32:30.443 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 31], 60.00th=[ 32], 00:32:30.443 | 70.00th=[ 32], 80.00th=[ 34], 90.00th=[ 271], 95.00th=[ 305], 00:32:30.443 | 99.00th=[ 397], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], 00:32:30.443 | 99.99th=[ 418] 00:32:30.443 bw ( KiB/s): min= 128, max= 2176, per=3.81%, avg=741.05, stdev=830.17, samples=19 00:32:30.443 iops : min= 32, max= 544, avg=185.26, stdev=207.54, samples=19 00:32:30.443 lat (msec) : 50=80.16%, 250=6.45%, 500=13.39% 00:32:30.443 cpu : usr=97.76%, sys=1.41%, ctx=55, majf=0, minf=41 00:32:30.443 IO depths : 1=5.9%, 2=12.1%, 4=25.0%, 8=50.4%, 16=6.6%, 32=0.0%, >=64=0.0% 00:32:30.443 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.443 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.443 issued rwts: total=2016,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:30.443 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:30.443 filename0: (groupid=0, jobs=1): err= 0: pid=2597023: Thu Nov 28 23:24:31 2024 00:32:30.443 read: IOPS=201, BW=806KiB/s (825kB/s)(8064KiB/10007msec) 00:32:30.443 slat (usec): min=12, max=138, avg=41.26, stdev=26.24 00:32:30.443 clat (msec): min=11, max=553, avg=79.03, stdev=105.27 00:32:30.443 lat (msec): min=11, max=553, avg=79.07, stdev=105.28 00:32:30.443 clat percentiles (msec): 00:32:30.443 | 1.00th=[ 27], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:32:30.443 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 31], 60.00th=[ 32], 00:32:30.443 | 70.00th=[ 32], 80.00th=[ 34], 90.00th=[ 271], 95.00th=[ 313], 00:32:30.443 | 99.00th=[ 405], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 550], 00:32:30.443 | 99.99th=[ 550] 00:32:30.443 bw ( KiB/s): min= 128, max= 2048, per=3.77%, avg=734.32, stdev=818.19, samples=19 00:32:30.443 iops : min= 32, max= 512, avg=183.58, stdev=204.55, samples=19 00:32:30.443 lat (msec) : 20=0.79%, 50=80.16%, 250=5.75%, 500=13.19%, 750=0.10% 00:32:30.443 cpu : usr=97.64%, sys=1.47%, ctx=51, majf=0, minf=32 00:32:30.443 IO depths : 1=5.6%, 2=11.9%, 4=25.0%, 8=50.6%, 16=6.9%, 32=0.0%, >=64=0.0% 00:32:30.443 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.443 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.443 issued rwts: total=2016,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:30.443 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:30.443 filename0: (groupid=0, jobs=1): err= 0: pid=2597024: Thu Nov 28 23:24:31 2024 00:32:30.443 read: IOPS=201, BW=805KiB/s (825kB/s)(8064KiB/10015msec) 00:32:30.443 slat (nsec): min=6832, max=99640, avg=33208.43, stdev=11821.19 00:32:30.443 clat (msec): min=26, max=584, avg=79.19, stdev=103.52 00:32:30.443 lat (msec): min=26, max=584, avg=79.22, stdev=103.52 00:32:30.443 clat percentiles (msec): 00:32:30.443 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:32:30.443 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 32], 60.00th=[ 32], 00:32:30.443 | 70.00th=[ 32], 80.00th=[ 35], 90.00th=[ 271], 95.00th=[ 300], 00:32:30.443 | 99.00th=[ 405], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 584], 00:32:30.443 | 99.99th=[ 584] 00:32:30.443 bw ( KiB/s): min= 112, max= 2052, per=4.11%, avg=800.20, stdev=845.61, samples=20 00:32:30.443 iops : min= 28, max= 513, avg=200.05, stdev=211.40, samples=20 00:32:30.443 lat (msec) : 50=80.16%, 250=8.04%, 500=11.71%, 750=0.10% 00:32:30.443 cpu : usr=98.44%, sys=1.00%, ctx=110, majf=0, minf=31 00:32:30.443 IO depths : 1=6.0%, 2=12.3%, 4=25.0%, 8=50.2%, 16=6.5%, 32=0.0%, >=64=0.0% 00:32:30.443 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.443 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.443 issued rwts: total=2016,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:30.443 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:30.443 filename0: (groupid=0, jobs=1): err= 0: pid=2597025: Thu Nov 28 23:24:31 2024 00:32:30.443 read: IOPS=204, BW=817KiB/s (837kB/s)(8192KiB/10027msec) 00:32:30.443 slat (usec): min=8, max=151, avg=33.85, stdev=20.83 00:32:30.443 clat (msec): min=26, max=418, avg=78.06, stdev=98.07 00:32:30.443 lat (msec): min=26, max=418, avg=78.10, stdev=98.08 00:32:30.443 clat percentiles (msec): 00:32:30.443 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:32:30.443 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 32], 60.00th=[ 32], 00:32:30.443 | 70.00th=[ 32], 80.00th=[ 110], 90.00th=[ 271], 95.00th=[ 300], 00:32:30.443 | 99.00th=[ 397], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], 00:32:30.443 | 99.99th=[ 418] 00:32:30.443 bw ( KiB/s): min= 128, max= 2048, per=4.17%, avg=812.80, stdev=840.15, samples=20 00:32:30.443 iops : min= 32, max= 512, avg=203.20, stdev=210.04, samples=20 00:32:30.443 lat (msec) : 50=79.59%, 100=0.10%, 250=8.01%, 500=12.30% 00:32:30.443 cpu : usr=98.04%, sys=1.32%, ctx=66, majf=0, minf=46 00:32:30.443 IO depths : 1=5.8%, 2=12.0%, 4=25.0%, 8=50.5%, 16=6.7%, 32=0.0%, >=64=0.0% 00:32:30.443 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.443 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.443 issued rwts: total=2048,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:30.443 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:30.443 filename0: (groupid=0, jobs=1): err= 0: pid=2597026: Thu Nov 28 23:24:31 2024 00:32:30.443 read: IOPS=201, BW=805KiB/s (824kB/s)(8056KiB/10009msec) 00:32:30.443 slat (usec): min=8, max=123, avg=24.79, stdev=21.26 00:32:30.443 clat (msec): min=11, max=584, avg=79.35, stdev=105.47 00:32:30.443 lat (msec): min=11, max=584, avg=79.37, stdev=105.49 00:32:30.443 clat percentiles (msec): 00:32:30.443 | 1.00th=[ 22], 5.00th=[ 28], 10.00th=[ 31], 20.00th=[ 31], 00:32:30.443 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:30.444 | 70.00th=[ 32], 80.00th=[ 41], 90.00th=[ 268], 95.00th=[ 313], 00:32:30.444 | 99.00th=[ 405], 99.50th=[ 498], 99.90th=[ 514], 99.95th=[ 584], 00:32:30.444 | 99.99th=[ 584] 00:32:30.444 bw ( KiB/s): min= 112, max= 2112, per=3.78%, avg=735.16, stdev=827.64, samples=19 00:32:30.444 iops : min= 28, max= 528, avg=183.79, stdev=206.91, samples=19 00:32:30.444 lat (msec) : 20=0.30%, 50=80.64%, 250=5.76%, 500=13.11%, 750=0.20% 00:32:30.444 cpu : usr=98.38%, sys=1.04%, ctx=53, majf=0, minf=34 00:32:30.444 IO depths : 1=0.6%, 2=2.0%, 4=6.2%, 8=75.1%, 16=16.0%, 32=0.0%, >=64=0.0% 00:32:30.444 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.444 complete : 0=0.0%, 4=90.3%, 8=8.0%, 16=1.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.444 issued rwts: total=2014,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:30.444 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:30.444 filename0: (groupid=0, jobs=1): err= 0: pid=2597027: Thu Nov 28 23:24:31 2024 00:32:30.444 read: IOPS=201, BW=805KiB/s (824kB/s)(8064KiB/10021msec) 00:32:30.444 slat (usec): min=6, max=161, avg=57.75, stdev=40.19 00:32:30.444 clat (msec): min=15, max=626, avg=79.01, stdev=103.82 00:32:30.444 lat (msec): min=15, max=626, avg=79.07, stdev=103.83 00:32:30.444 clat percentiles (msec): 00:32:30.444 | 1.00th=[ 29], 5.00th=[ 30], 10.00th=[ 30], 20.00th=[ 31], 00:32:30.444 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 31], 60.00th=[ 32], 00:32:30.444 | 70.00th=[ 32], 80.00th=[ 35], 90.00th=[ 271], 95.00th=[ 305], 00:32:30.444 | 99.00th=[ 443], 99.50th=[ 447], 99.90th=[ 550], 99.95th=[ 625], 00:32:30.444 | 99.99th=[ 625] 00:32:30.444 bw ( KiB/s): min= 128, max= 2052, per=4.11%, avg=800.20, stdev=849.13, samples=20 00:32:30.444 iops : min= 32, max= 513, avg=200.05, stdev=212.28, samples=20 00:32:30.444 lat (msec) : 20=0.10%, 50=80.06%, 100=0.10%, 250=8.13%, 500=11.41% 00:32:30.444 lat (msec) : 750=0.20% 00:32:30.444 cpu : usr=97.54%, sys=1.45%, ctx=110, majf=0, minf=38 00:32:30.444 IO depths : 1=5.7%, 2=11.9%, 4=25.0%, 8=50.6%, 16=6.8%, 32=0.0%, >=64=0.0% 00:32:30.444 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.444 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.444 issued rwts: total=2016,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:30.444 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:30.444 filename0: (groupid=0, jobs=1): err= 0: pid=2597028: Thu Nov 28 23:24:31 2024 00:32:30.444 read: IOPS=202, BW=811KiB/s (830kB/s)(8128KiB/10027msec) 00:32:30.444 slat (usec): min=6, max=160, avg=66.59, stdev=36.61 00:32:30.444 clat (msec): min=28, max=551, avg=78.38, stdev=103.01 00:32:30.444 lat (msec): min=28, max=551, avg=78.45, stdev=103.02 00:32:30.444 clat percentiles (msec): 00:32:30.444 | 1.00th=[ 29], 5.00th=[ 30], 10.00th=[ 30], 20.00th=[ 31], 00:32:30.444 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 31], 60.00th=[ 32], 00:32:30.444 | 70.00th=[ 32], 80.00th=[ 45], 90.00th=[ 268], 95.00th=[ 300], 00:32:30.444 | 99.00th=[ 405], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 550], 00:32:30.444 | 99.99th=[ 550] 00:32:30.444 bw ( KiB/s): min= 128, max= 2048, per=4.14%, avg=806.40, stdev=840.77, samples=20 00:32:30.444 iops : min= 32, max= 512, avg=201.60, stdev=210.19, samples=20 00:32:30.444 lat (msec) : 50=80.31%, 250=6.99%, 500=12.60%, 750=0.10% 00:32:30.444 cpu : usr=98.61%, sys=0.90%, ctx=45, majf=0, minf=38 00:32:30.444 IO depths : 1=6.0%, 2=12.2%, 4=25.0%, 8=50.3%, 16=6.5%, 32=0.0%, >=64=0.0% 00:32:30.444 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.444 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.444 issued rwts: total=2032,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:30.444 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:30.444 filename0: (groupid=0, jobs=1): err= 0: pid=2597029: Thu Nov 28 23:24:31 2024 00:32:30.444 read: IOPS=215, BW=860KiB/s (881kB/s)(8624KiB/10026msec) 00:32:30.444 slat (usec): min=5, max=122, avg=24.00, stdev=26.61 00:32:30.444 clat (msec): min=18, max=323, avg=74.23, stdev=80.87 00:32:30.444 lat (msec): min=18, max=323, avg=74.25, stdev=80.89 00:32:30.444 clat percentiles (msec): 00:32:30.444 | 1.00th=[ 21], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:32:30.444 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:30.444 | 70.00th=[ 32], 80.00th=[ 174], 90.00th=[ 218], 95.00th=[ 257], 00:32:30.444 | 99.00th=[ 300], 99.50th=[ 317], 99.90th=[ 321], 99.95th=[ 326], 00:32:30.444 | 99.99th=[ 326] 00:32:30.444 bw ( KiB/s): min= 176, max= 2048, per=4.40%, avg=856.00, stdev=812.94, samples=20 00:32:30.444 iops : min= 44, max= 512, avg=214.00, stdev=203.23, samples=20 00:32:30.444 lat (msec) : 20=0.28%, 50=76.07%, 100=0.09%, 250=17.35%, 500=6.22% 00:32:30.444 cpu : usr=98.38%, sys=1.05%, ctx=44, majf=0, minf=57 00:32:30.444 IO depths : 1=4.8%, 2=9.9%, 4=21.5%, 8=56.1%, 16=7.7%, 32=0.0%, >=64=0.0% 00:32:30.444 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.444 complete : 0=0.0%, 4=93.1%, 8=1.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.444 issued rwts: total=2156,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:30.444 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:30.444 filename1: (groupid=0, jobs=1): err= 0: pid=2597030: Thu Nov 28 23:24:31 2024 00:32:30.444 read: IOPS=201, BW=805KiB/s (825kB/s)(8064KiB/10013msec) 00:32:30.444 slat (usec): min=8, max=158, avg=71.60, stdev=41.82 00:32:30.444 clat (msec): min=15, max=499, avg=78.83, stdev=104.16 00:32:30.444 lat (msec): min=15, max=499, avg=78.91, stdev=104.16 00:32:30.444 clat percentiles (msec): 00:32:30.444 | 1.00th=[ 29], 5.00th=[ 30], 10.00th=[ 30], 20.00th=[ 31], 00:32:30.444 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 31], 60.00th=[ 31], 00:32:30.444 | 70.00th=[ 32], 80.00th=[ 35], 90.00th=[ 271], 95.00th=[ 309], 00:32:30.444 | 99.00th=[ 418], 99.50th=[ 493], 99.90th=[ 493], 99.95th=[ 502], 00:32:30.444 | 99.99th=[ 502] 00:32:30.444 bw ( KiB/s): min= 128, max= 2048, per=4.11%, avg=800.00, stdev=848.82, samples=20 00:32:30.444 iops : min= 32, max= 512, avg=200.00, stdev=212.20, samples=20 00:32:30.444 lat (msec) : 20=0.79%, 50=79.37%, 250=7.34%, 500=12.50% 00:32:30.444 cpu : usr=98.63%, sys=0.93%, ctx=17, majf=0, minf=37 00:32:30.444 IO depths : 1=5.8%, 2=12.0%, 4=25.0%, 8=50.5%, 16=6.7%, 32=0.0%, >=64=0.0% 00:32:30.444 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.444 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.444 issued rwts: total=2016,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:30.444 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:30.444 filename1: (groupid=0, jobs=1): err= 0: pid=2597031: Thu Nov 28 23:24:31 2024 00:32:30.444 read: IOPS=201, BW=806KiB/s (825kB/s)(8064KiB/10007msec) 00:32:30.444 slat (usec): min=9, max=148, avg=61.50, stdev=35.67 00:32:30.444 clat (msec): min=6, max=496, avg=78.87, stdev=104.88 00:32:30.444 lat (msec): min=6, max=496, avg=78.93, stdev=104.89 00:32:30.444 clat percentiles (msec): 00:32:30.444 | 1.00th=[ 29], 5.00th=[ 30], 10.00th=[ 31], 20.00th=[ 31], 00:32:30.444 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 31], 60.00th=[ 32], 00:32:30.444 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 271], 95.00th=[ 300], 00:32:30.444 | 99.00th=[ 405], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 498], 00:32:30.444 | 99.99th=[ 498] 00:32:30.444 bw ( KiB/s): min= 128, max= 2048, per=3.77%, avg=734.32, stdev=818.31, samples=19 00:32:30.444 iops : min= 32, max= 512, avg=183.58, stdev=204.58, samples=19 00:32:30.444 lat (msec) : 10=0.10%, 20=0.69%, 50=80.16%, 250=5.56%, 500=13.49% 00:32:30.444 cpu : usr=97.35%, sys=1.58%, ctx=84, majf=0, minf=30 00:32:30.444 IO depths : 1=5.8%, 2=12.1%, 4=25.0%, 8=50.4%, 16=6.7%, 32=0.0%, >=64=0.0% 00:32:30.444 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.444 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.444 issued rwts: total=2016,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:30.444 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:30.444 filename1: (groupid=0, jobs=1): err= 0: pid=2597032: Thu Nov 28 23:24:31 2024 00:32:30.444 read: IOPS=201, BW=806KiB/s (826kB/s)(8064KiB/10003msec) 00:32:30.444 slat (usec): min=6, max=129, avg=37.16, stdev=17.49 00:32:30.444 clat (msec): min=30, max=496, avg=79.02, stdev=103.03 00:32:30.444 lat (msec): min=30, max=496, avg=79.06, stdev=103.03 00:32:30.444 clat percentiles (msec): 00:32:30.444 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:32:30.444 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 31], 60.00th=[ 32], 00:32:30.444 | 70.00th=[ 32], 80.00th=[ 48], 90.00th=[ 271], 95.00th=[ 300], 00:32:30.444 | 99.00th=[ 405], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 498], 00:32:30.444 | 99.99th=[ 498] 00:32:30.444 bw ( KiB/s): min= 128, max= 2176, per=3.81%, avg=741.05, stdev=824.55, samples=19 00:32:30.444 iops : min= 32, max= 544, avg=185.26, stdev=206.14, samples=19 00:32:30.444 lat (msec) : 50=80.06%, 100=0.10%, 250=7.24%, 500=12.60% 00:32:30.444 cpu : usr=97.86%, sys=1.24%, ctx=32, majf=0, minf=42 00:32:30.444 IO depths : 1=5.9%, 2=12.2%, 4=25.0%, 8=50.3%, 16=6.6%, 32=0.0%, >=64=0.0% 00:32:30.444 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.444 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.444 issued rwts: total=2016,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:30.444 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:30.444 filename1: (groupid=0, jobs=1): err= 0: pid=2597033: Thu Nov 28 23:24:31 2024 00:32:30.444 read: IOPS=204, BW=817KiB/s (837kB/s)(8192KiB/10021msec) 00:32:30.444 slat (nsec): min=8266, max=64691, avg=21241.02, stdev=9411.33 00:32:30.444 clat (msec): min=13, max=479, avg=78.09, stdev=96.01 00:32:30.444 lat (msec): min=13, max=479, avg=78.11, stdev=96.02 00:32:30.444 clat percentiles (msec): 00:32:30.444 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:32:30.444 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:30.444 | 70.00th=[ 32], 80.00th=[ 150], 90.00th=[ 271], 95.00th=[ 296], 00:32:30.444 | 99.00th=[ 351], 99.50th=[ 405], 99.90th=[ 405], 99.95th=[ 481], 00:32:30.444 | 99.99th=[ 481] 00:32:30.444 bw ( KiB/s): min= 128, max= 2052, per=4.18%, avg=813.00, stdev=839.85, samples=20 00:32:30.444 iops : min= 32, max= 513, avg=203.25, stdev=209.96, samples=20 00:32:30.444 lat (msec) : 20=0.20%, 50=78.71%, 100=0.78%, 250=8.50%, 500=11.82% 00:32:30.444 cpu : usr=98.55%, sys=1.07%, ctx=17, majf=0, minf=34 00:32:30.444 IO depths : 1=5.5%, 2=11.7%, 4=24.9%, 8=50.9%, 16=7.0%, 32=0.0%, >=64=0.0% 00:32:30.444 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.445 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.445 issued rwts: total=2048,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:30.445 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:30.445 filename1: (groupid=0, jobs=1): err= 0: pid=2597034: Thu Nov 28 23:24:31 2024 00:32:30.445 read: IOPS=201, BW=807KiB/s (826kB/s)(8072KiB/10007msec) 00:32:30.445 slat (nsec): min=8112, max=95079, avg=29125.91, stdev=15341.31 00:32:30.445 clat (msec): min=11, max=580, avg=79.11, stdev=105.93 00:32:30.445 lat (msec): min=11, max=580, avg=79.14, stdev=105.93 00:32:30.445 clat percentiles (msec): 00:32:30.445 | 1.00th=[ 19], 5.00th=[ 26], 10.00th=[ 29], 20.00th=[ 31], 00:32:30.445 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 32], 60.00th=[ 32], 00:32:30.445 | 70.00th=[ 32], 80.00th=[ 39], 90.00th=[ 271], 95.00th=[ 313], 00:32:30.445 | 99.00th=[ 418], 99.50th=[ 447], 99.90th=[ 542], 99.95th=[ 584], 00:32:30.445 | 99.99th=[ 584] 00:32:30.445 bw ( KiB/s): min= 128, max= 2104, per=3.78%, avg=735.16, stdev=831.56, samples=19 00:32:30.445 iops : min= 32, max= 526, avg=183.79, stdev=207.89, samples=19 00:32:30.445 lat (msec) : 20=1.78%, 50=78.79%, 100=0.40%, 250=6.54%, 500=12.29% 00:32:30.445 lat (msec) : 750=0.20% 00:32:30.445 cpu : usr=98.53%, sys=1.06%, ctx=19, majf=0, minf=33 00:32:30.445 IO depths : 1=2.9%, 2=6.5%, 4=19.5%, 8=60.4%, 16=10.8%, 32=0.0%, >=64=0.0% 00:32:30.445 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.445 complete : 0=0.0%, 4=93.0%, 8=2.4%, 16=4.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.445 issued rwts: total=2018,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:30.445 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:30.445 filename1: (groupid=0, jobs=1): err= 0: pid=2597035: Thu Nov 28 23:24:31 2024 00:32:30.445 read: IOPS=205, BW=823KiB/s (843kB/s)(8256KiB/10027msec) 00:32:30.445 slat (nsec): min=6717, max=75816, avg=31671.56, stdev=9540.15 00:32:30.445 clat (msec): min=26, max=410, avg=77.45, stdev=93.11 00:32:30.445 lat (msec): min=26, max=410, avg=77.48, stdev=93.10 00:32:30.445 clat percentiles (msec): 00:32:30.445 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:32:30.445 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 32], 60.00th=[ 32], 00:32:30.445 | 70.00th=[ 32], 80.00th=[ 190], 90.00th=[ 268], 95.00th=[ 279], 00:32:30.445 | 99.00th=[ 313], 99.50th=[ 351], 99.90th=[ 351], 99.95th=[ 409], 00:32:30.445 | 99.99th=[ 409] 00:32:30.445 bw ( KiB/s): min= 128, max= 2048, per=4.21%, avg=819.20, stdev=835.13, samples=20 00:32:30.445 iops : min= 32, max= 512, avg=204.80, stdev=208.78, samples=20 00:32:30.445 lat (msec) : 50=79.07%, 250=7.85%, 500=13.08% 00:32:30.445 cpu : usr=97.98%, sys=1.34%, ctx=83, majf=0, minf=36 00:32:30.445 IO depths : 1=6.2%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:32:30.445 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.445 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.445 issued rwts: total=2064,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:30.445 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:30.445 filename1: (groupid=0, jobs=1): err= 0: pid=2597036: Thu Nov 28 23:24:31 2024 00:32:30.445 read: IOPS=199, BW=800KiB/s (819kB/s)(8000KiB/10002msec) 00:32:30.445 slat (usec): min=5, max=101, avg=25.87, stdev=19.32 00:32:30.445 clat (msec): min=27, max=445, avg=79.77, stdev=104.63 00:32:30.445 lat (msec): min=27, max=445, avg=79.80, stdev=104.64 00:32:30.445 clat percentiles (msec): 00:32:30.445 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:32:30.445 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:30.445 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 271], 95.00th=[ 305], 00:32:30.445 | 99.00th=[ 409], 99.50th=[ 447], 99.90th=[ 447], 99.95th=[ 447], 00:32:30.445 | 99.99th=[ 447] 00:32:30.445 bw ( KiB/s): min= 128, max= 2176, per=3.77%, avg=734.32, stdev=834.71, samples=19 00:32:30.445 iops : min= 32, max= 544, avg=183.58, stdev=208.68, samples=19 00:32:30.445 lat (msec) : 50=80.80%, 250=6.30%, 500=12.90% 00:32:30.445 cpu : usr=98.42%, sys=1.02%, ctx=60, majf=0, minf=36 00:32:30.445 IO depths : 1=5.9%, 2=12.2%, 4=25.0%, 8=50.4%, 16=6.6%, 32=0.0%, >=64=0.0% 00:32:30.445 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.445 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.445 issued rwts: total=2000,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:30.445 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:30.445 filename1: (groupid=0, jobs=1): err= 0: pid=2597037: Thu Nov 28 23:24:31 2024 00:32:30.445 read: IOPS=205, BW=823KiB/s (843kB/s)(8256KiB/10027msec) 00:32:30.445 slat (usec): min=8, max=116, avg=31.85, stdev=14.44 00:32:30.445 clat (msec): min=26, max=394, avg=77.47, stdev=93.16 00:32:30.445 lat (msec): min=26, max=394, avg=77.50, stdev=93.16 00:32:30.445 clat percentiles (msec): 00:32:30.445 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:32:30.445 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 32], 60.00th=[ 32], 00:32:30.445 | 70.00th=[ 32], 80.00th=[ 150], 90.00th=[ 271], 95.00th=[ 284], 00:32:30.445 | 99.00th=[ 347], 99.50th=[ 359], 99.90th=[ 393], 99.95th=[ 397], 00:32:30.445 | 99.99th=[ 397] 00:32:30.445 bw ( KiB/s): min= 128, max= 2048, per=4.21%, avg=819.20, stdev=835.02, samples=20 00:32:30.445 iops : min= 32, max= 512, avg=204.80, stdev=208.75, samples=20 00:32:30.445 lat (msec) : 50=78.29%, 100=0.78%, 250=9.21%, 500=11.72% 00:32:30.445 cpu : usr=98.30%, sys=1.08%, ctx=70, majf=0, minf=33 00:32:30.445 IO depths : 1=5.4%, 2=11.7%, 4=25.0%, 8=50.8%, 16=7.1%, 32=0.0%, >=64=0.0% 00:32:30.445 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.445 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.445 issued rwts: total=2064,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:30.445 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:30.445 filename2: (groupid=0, jobs=1): err= 0: pid=2597038: Thu Nov 28 23:24:31 2024 00:32:30.445 read: IOPS=204, BW=818KiB/s (837kB/s)(8192KiB/10020msec) 00:32:30.445 slat (usec): min=8, max=144, avg=46.04, stdev=27.69 00:32:30.445 clat (msec): min=28, max=348, avg=77.84, stdev=93.23 00:32:30.445 lat (msec): min=28, max=348, avg=77.89, stdev=93.23 00:32:30.445 clat percentiles (msec): 00:32:30.445 | 1.00th=[ 30], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:32:30.445 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 31], 60.00th=[ 32], 00:32:30.445 | 70.00th=[ 32], 80.00th=[ 197], 90.00th=[ 271], 95.00th=[ 279], 00:32:30.445 | 99.00th=[ 313], 99.50th=[ 351], 99.90th=[ 351], 99.95th=[ 351], 00:32:30.445 | 99.99th=[ 351] 00:32:30.445 bw ( KiB/s): min= 128, max= 2052, per=4.18%, avg=813.00, stdev=839.45, samples=20 00:32:30.445 iops : min= 32, max= 513, avg=203.25, stdev=209.86, samples=20 00:32:30.445 lat (msec) : 50=78.91%, 250=9.18%, 500=11.91% 00:32:30.445 cpu : usr=98.37%, sys=1.12%, ctx=29, majf=0, minf=41 00:32:30.445 IO depths : 1=5.9%, 2=12.1%, 4=25.0%, 8=50.4%, 16=6.6%, 32=0.0%, >=64=0.0% 00:32:30.445 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.445 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.445 issued rwts: total=2048,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:30.445 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:30.445 filename2: (groupid=0, jobs=1): err= 0: pid=2597039: Thu Nov 28 23:24:31 2024 00:32:30.445 read: IOPS=201, BW=806KiB/s (825kB/s)(8064KiB/10006msec) 00:32:30.445 slat (nsec): min=8027, max=56997, avg=21521.60, stdev=8219.59 00:32:30.445 clat (msec): min=15, max=579, avg=79.20, stdev=103.65 00:32:30.445 lat (msec): min=15, max=579, avg=79.22, stdev=103.65 00:32:30.445 clat percentiles (msec): 00:32:30.445 | 1.00th=[ 30], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:32:30.445 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 32], 60.00th=[ 32], 00:32:30.445 | 70.00th=[ 32], 80.00th=[ 35], 90.00th=[ 271], 95.00th=[ 300], 00:32:30.445 | 99.00th=[ 418], 99.50th=[ 493], 99.90th=[ 493], 99.95th=[ 584], 00:32:30.445 | 99.99th=[ 584] 00:32:30.445 bw ( KiB/s): min= 128, max= 2048, per=3.77%, avg=734.32, stdev=817.95, samples=19 00:32:30.445 iops : min= 32, max= 512, avg=183.58, stdev=204.49, samples=19 00:32:30.445 lat (msec) : 20=0.79%, 50=79.37%, 250=7.04%, 500=12.70%, 750=0.10% 00:32:30.445 cpu : usr=98.57%, sys=1.02%, ctx=16, majf=0, minf=36 00:32:30.445 IO depths : 1=5.2%, 2=11.4%, 4=25.0%, 8=51.1%, 16=7.3%, 32=0.0%, >=64=0.0% 00:32:30.445 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.445 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.445 issued rwts: total=2016,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:30.445 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:30.445 filename2: (groupid=0, jobs=1): err= 0: pid=2597040: Thu Nov 28 23:24:31 2024 00:32:30.445 read: IOPS=199, BW=800KiB/s (819kB/s)(8000KiB/10006msec) 00:32:30.445 slat (usec): min=4, max=118, avg=35.01, stdev=14.48 00:32:30.445 clat (msec): min=26, max=553, avg=79.73, stdev=105.83 00:32:30.445 lat (msec): min=26, max=553, avg=79.77, stdev=105.83 00:32:30.445 clat percentiles (msec): 00:32:30.445 | 1.00th=[ 29], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:32:30.445 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 31], 60.00th=[ 32], 00:32:30.445 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 271], 95.00th=[ 326], 00:32:30.445 | 99.00th=[ 405], 99.50th=[ 498], 99.90th=[ 550], 99.95th=[ 550], 00:32:30.445 | 99.99th=[ 550] 00:32:30.445 bw ( KiB/s): min= 128, max= 2048, per=3.74%, avg=727.58, stdev=818.30, samples=19 00:32:30.445 iops : min= 32, max= 512, avg=181.89, stdev=204.58, samples=19 00:32:30.445 lat (msec) : 50=80.80%, 250=5.90%, 500=13.20%, 750=0.10% 00:32:30.445 cpu : usr=98.03%, sys=1.36%, ctx=19, majf=0, minf=32 00:32:30.445 IO depths : 1=5.7%, 2=12.0%, 4=25.0%, 8=50.6%, 16=6.8%, 32=0.0%, >=64=0.0% 00:32:30.445 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.445 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.445 issued rwts: total=2000,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:30.445 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:30.445 filename2: (groupid=0, jobs=1): err= 0: pid=2597041: Thu Nov 28 23:24:31 2024 00:32:30.445 read: IOPS=203, BW=812KiB/s (832kB/s)(8128KiB/10009msec) 00:32:30.445 slat (usec): min=5, max=159, avg=54.02, stdev=41.38 00:32:30.445 clat (msec): min=16, max=445, avg=78.34, stdev=100.65 00:32:30.445 lat (msec): min=16, max=445, avg=78.39, stdev=100.66 00:32:30.445 clat percentiles (msec): 00:32:30.445 | 1.00th=[ 30], 5.00th=[ 30], 10.00th=[ 31], 20.00th=[ 31], 00:32:30.445 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 32], 60.00th=[ 32], 00:32:30.445 | 70.00th=[ 32], 80.00th=[ 100], 90.00th=[ 271], 95.00th=[ 300], 00:32:30.445 | 99.00th=[ 409], 99.50th=[ 447], 99.90th=[ 447], 99.95th=[ 447], 00:32:30.445 | 99.99th=[ 447] 00:32:30.445 bw ( KiB/s): min= 128, max= 2048, per=4.14%, avg=806.40, stdev=843.04, samples=20 00:32:30.446 iops : min= 32, max= 512, avg=201.60, stdev=210.76, samples=20 00:32:30.446 lat (msec) : 20=0.69%, 50=78.84%, 100=0.69%, 250=7.97%, 500=11.81% 00:32:30.446 cpu : usr=98.47%, sys=1.08%, ctx=31, majf=0, minf=31 00:32:30.446 IO depths : 1=6.2%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:32:30.446 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.446 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.446 issued rwts: total=2032,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:30.446 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:30.446 filename2: (groupid=0, jobs=1): err= 0: pid=2597042: Thu Nov 28 23:24:31 2024 00:32:30.446 read: IOPS=205, BW=823KiB/s (843kB/s)(8256KiB/10028msec) 00:32:30.446 slat (usec): min=3, max=113, avg=36.13, stdev=21.87 00:32:30.446 clat (msec): min=28, max=347, avg=77.44, stdev=92.79 00:32:30.446 lat (msec): min=28, max=347, avg=77.47, stdev=92.80 00:32:30.446 clat percentiles (msec): 00:32:30.446 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:32:30.446 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:30.446 | 70.00th=[ 32], 80.00th=[ 190], 90.00th=[ 268], 95.00th=[ 279], 00:32:30.446 | 99.00th=[ 313], 99.50th=[ 347], 99.90th=[ 347], 99.95th=[ 347], 00:32:30.446 | 99.99th=[ 347] 00:32:30.446 bw ( KiB/s): min= 128, max= 2048, per=4.21%, avg=819.20, stdev=835.13, samples=20 00:32:30.446 iops : min= 32, max= 512, avg=204.80, stdev=208.78, samples=20 00:32:30.446 lat (msec) : 50=78.97%, 100=0.19%, 250=7.66%, 500=13.18% 00:32:30.446 cpu : usr=98.01%, sys=1.10%, ctx=112, majf=0, minf=33 00:32:30.446 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:32:30.446 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.446 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.446 issued rwts: total=2064,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:30.446 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:30.446 filename2: (groupid=0, jobs=1): err= 0: pid=2597043: Thu Nov 28 23:24:31 2024 00:32:30.446 read: IOPS=201, BW=805KiB/s (825kB/s)(8064KiB/10014msec) 00:32:30.446 slat (usec): min=8, max=176, avg=59.08, stdev=42.78 00:32:30.446 clat (msec): min=15, max=577, avg=78.97, stdev=104.19 00:32:30.446 lat (msec): min=15, max=577, avg=79.03, stdev=104.20 00:32:30.446 clat percentiles (msec): 00:32:30.446 | 1.00th=[ 29], 5.00th=[ 30], 10.00th=[ 30], 20.00th=[ 31], 00:32:30.446 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 32], 60.00th=[ 32], 00:32:30.446 | 70.00th=[ 32], 80.00th=[ 34], 90.00th=[ 271], 95.00th=[ 309], 00:32:30.446 | 99.00th=[ 418], 99.50th=[ 493], 99.90th=[ 493], 99.95th=[ 575], 00:32:30.446 | 99.99th=[ 575] 00:32:30.446 bw ( KiB/s): min= 128, max= 2048, per=4.11%, avg=800.00, stdev=848.58, samples=20 00:32:30.446 iops : min= 32, max= 512, avg=200.00, stdev=212.14, samples=20 00:32:30.446 lat (msec) : 20=0.79%, 50=79.37%, 250=7.24%, 500=12.50%, 750=0.10% 00:32:30.446 cpu : usr=97.34%, sys=1.61%, ctx=221, majf=0, minf=36 00:32:30.446 IO depths : 1=5.7%, 2=11.9%, 4=25.0%, 8=50.6%, 16=6.8%, 32=0.0%, >=64=0.0% 00:32:30.446 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.446 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.446 issued rwts: total=2016,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:30.446 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:30.446 filename2: (groupid=0, jobs=1): err= 0: pid=2597044: Thu Nov 28 23:24:31 2024 00:32:30.446 read: IOPS=202, BW=812KiB/s (831kB/s)(8128KiB/10016msec) 00:32:30.446 slat (usec): min=8, max=126, avg=34.45, stdev=14.35 00:32:30.446 clat (msec): min=26, max=481, avg=78.56, stdev=97.89 00:32:30.446 lat (msec): min=26, max=481, avg=78.59, stdev=97.89 00:32:30.446 clat percentiles (msec): 00:32:30.446 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:32:30.446 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 31], 60.00th=[ 32], 00:32:30.446 | 70.00th=[ 32], 80.00th=[ 157], 90.00th=[ 271], 95.00th=[ 300], 00:32:30.446 | 99.00th=[ 384], 99.50th=[ 409], 99.90th=[ 447], 99.95th=[ 481], 00:32:30.446 | 99.99th=[ 481] 00:32:30.446 bw ( KiB/s): min= 128, max= 2052, per=4.14%, avg=806.60, stdev=844.06, samples=20 00:32:30.446 iops : min= 32, max= 513, avg=201.65, stdev=211.01, samples=20 00:32:30.446 lat (msec) : 50=79.53%, 250=7.97%, 500=12.50% 00:32:30.446 cpu : usr=97.66%, sys=1.34%, ctx=138, majf=0, minf=35 00:32:30.446 IO depths : 1=5.4%, 2=11.6%, 4=25.0%, 8=50.9%, 16=7.1%, 32=0.0%, >=64=0.0% 00:32:30.446 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.446 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.446 issued rwts: total=2032,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:30.446 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:30.446 filename2: (groupid=0, jobs=1): err= 0: pid=2597045: Thu Nov 28 23:24:31 2024 00:32:30.446 read: IOPS=201, BW=806KiB/s (825kB/s)(8064KiB/10010msec) 00:32:30.446 slat (usec): min=5, max=160, avg=59.31, stdev=44.13 00:32:30.446 clat (msec): min=13, max=579, avg=78.92, stdev=104.47 00:32:30.446 lat (msec): min=14, max=579, avg=78.98, stdev=104.45 00:32:30.446 clat percentiles (msec): 00:32:30.446 | 1.00th=[ 29], 5.00th=[ 30], 10.00th=[ 30], 20.00th=[ 31], 00:32:30.446 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 31], 60.00th=[ 32], 00:32:30.446 | 70.00th=[ 32], 80.00th=[ 35], 90.00th=[ 271], 95.00th=[ 309], 00:32:30.446 | 99.00th=[ 418], 99.50th=[ 493], 99.90th=[ 493], 99.95th=[ 584], 00:32:30.446 | 99.99th=[ 584] 00:32:30.446 bw ( KiB/s): min= 128, max= 2048, per=4.11%, avg=800.00, stdev=848.58, samples=20 00:32:30.446 iops : min= 32, max= 512, avg=200.00, stdev=212.14, samples=20 00:32:30.446 lat (msec) : 20=0.79%, 50=79.37%, 250=7.24%, 500=12.50%, 750=0.10% 00:32:30.446 cpu : usr=97.32%, sys=1.70%, ctx=62, majf=0, minf=32 00:32:30.446 IO depths : 1=5.6%, 2=11.9%, 4=25.0%, 8=50.6%, 16=6.9%, 32=0.0%, >=64=0.0% 00:32:30.446 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.446 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.446 issued rwts: total=2016,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:30.446 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:30.446 00:32:30.446 Run status group 0 (all jobs): 00:32:30.446 READ: bw=19.0MiB/s (19.9MB/s), 800KiB/s-860KiB/s (819kB/s-881kB/s), io=191MiB (200MB), run=10002-10028msec 00:32:30.446 23:24:32 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:32:30.446 23:24:32 -- target/dif.sh@43 -- # local sub 00:32:30.446 23:24:32 -- target/dif.sh@45 -- # for sub in "$@" 00:32:30.446 23:24:32 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:30.446 23:24:32 -- target/dif.sh@36 -- # local sub_id=0 00:32:30.446 23:24:32 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:30.446 23:24:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:30.446 23:24:32 -- common/autotest_common.sh@10 -- # set +x 00:32:30.446 23:24:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:30.446 23:24:32 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:30.446 23:24:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:30.446 23:24:32 -- common/autotest_common.sh@10 -- # set +x 00:32:30.446 23:24:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:30.446 23:24:32 -- target/dif.sh@45 -- # for sub in "$@" 00:32:30.446 23:24:32 -- target/dif.sh@46 -- # destroy_subsystem 1 00:32:30.446 23:24:32 -- target/dif.sh@36 -- # local sub_id=1 00:32:30.446 23:24:32 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:32:30.446 23:24:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:30.446 23:24:32 -- common/autotest_common.sh@10 -- # set +x 00:32:30.446 23:24:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:30.446 23:24:32 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:32:30.446 23:24:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:30.446 23:24:32 -- common/autotest_common.sh@10 -- # set +x 00:32:30.446 23:24:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:30.446 23:24:32 -- target/dif.sh@45 -- # for sub in "$@" 00:32:30.446 23:24:32 -- target/dif.sh@46 -- # destroy_subsystem 2 00:32:30.446 23:24:32 -- target/dif.sh@36 -- # local sub_id=2 00:32:30.446 23:24:32 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:32:30.446 23:24:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:30.446 23:24:32 -- common/autotest_common.sh@10 -- # set +x 00:32:30.446 23:24:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:30.446 23:24:32 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:32:30.446 23:24:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:30.446 23:24:32 -- common/autotest_common.sh@10 -- # set +x 00:32:30.446 23:24:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:30.446 23:24:32 -- target/dif.sh@115 -- # NULL_DIF=1 00:32:30.446 23:24:32 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:32:30.446 23:24:32 -- target/dif.sh@115 -- # numjobs=2 00:32:30.446 23:24:32 -- target/dif.sh@115 -- # iodepth=8 00:32:30.446 23:24:32 -- target/dif.sh@115 -- # runtime=5 00:32:30.446 23:24:32 -- target/dif.sh@115 -- # files=1 00:32:30.446 23:24:32 -- target/dif.sh@117 -- # create_subsystems 0 1 00:32:30.446 23:24:32 -- target/dif.sh@28 -- # local sub 00:32:30.446 23:24:32 -- target/dif.sh@30 -- # for sub in "$@" 00:32:30.446 23:24:32 -- target/dif.sh@31 -- # create_subsystem 0 00:32:30.446 23:24:32 -- target/dif.sh@18 -- # local sub_id=0 00:32:30.446 23:24:32 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:32:30.446 23:24:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:30.446 23:24:32 -- common/autotest_common.sh@10 -- # set +x 00:32:30.446 bdev_null0 00:32:30.446 23:24:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:30.446 23:24:32 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:32:30.446 23:24:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:30.446 23:24:32 -- common/autotest_common.sh@10 -- # set +x 00:32:30.446 23:24:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:30.446 23:24:32 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:32:30.446 23:24:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:30.446 23:24:32 -- common/autotest_common.sh@10 -- # set +x 00:32:30.446 23:24:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:30.446 23:24:32 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:32:30.446 23:24:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:30.446 23:24:32 -- common/autotest_common.sh@10 -- # set +x 00:32:30.446 [2024-11-28 23:24:32.296973] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:30.446 23:24:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:30.447 23:24:32 -- target/dif.sh@30 -- # for sub in "$@" 00:32:30.447 23:24:32 -- target/dif.sh@31 -- # create_subsystem 1 00:32:30.447 23:24:32 -- target/dif.sh@18 -- # local sub_id=1 00:32:30.447 23:24:32 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:32:30.447 23:24:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:30.447 23:24:32 -- common/autotest_common.sh@10 -- # set +x 00:32:30.447 bdev_null1 00:32:30.447 23:24:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:30.447 23:24:32 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:32:30.447 23:24:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:30.447 23:24:32 -- common/autotest_common.sh@10 -- # set +x 00:32:30.447 23:24:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:30.447 23:24:32 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:32:30.447 23:24:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:30.447 23:24:32 -- common/autotest_common.sh@10 -- # set +x 00:32:30.447 23:24:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:30.447 23:24:32 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:32:30.447 23:24:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:30.447 23:24:32 -- common/autotest_common.sh@10 -- # set +x 00:32:30.447 23:24:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:30.447 23:24:32 -- target/dif.sh@118 -- # fio /dev/fd/62 00:32:30.447 23:24:32 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:32:30.447 23:24:32 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:32:30.447 23:24:32 -- nvmf/common.sh@520 -- # config=() 00:32:30.447 23:24:32 -- nvmf/common.sh@520 -- # local subsystem config 00:32:30.447 23:24:32 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:30.447 23:24:32 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:30.447 { 00:32:30.447 "params": { 00:32:30.447 "name": "Nvme$subsystem", 00:32:30.447 "trtype": "$TEST_TRANSPORT", 00:32:30.447 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:30.447 "adrfam": "ipv4", 00:32:30.447 "trsvcid": "$NVMF_PORT", 00:32:30.447 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:30.447 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:30.447 "hdgst": ${hdgst:-false}, 00:32:30.447 "ddgst": ${ddgst:-false} 00:32:30.447 }, 00:32:30.447 "method": "bdev_nvme_attach_controller" 00:32:30.447 } 00:32:30.447 EOF 00:32:30.447 )") 00:32:30.447 23:24:32 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:30.447 23:24:32 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:30.447 23:24:32 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:32:30.447 23:24:32 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:32:30.447 23:24:32 -- target/dif.sh@82 -- # gen_fio_conf 00:32:30.447 23:24:32 -- common/autotest_common.sh@1328 -- # local sanitizers 00:32:30.447 23:24:32 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:30.447 23:24:32 -- target/dif.sh@54 -- # local file 00:32:30.447 23:24:32 -- common/autotest_common.sh@1330 -- # shift 00:32:30.447 23:24:32 -- target/dif.sh@56 -- # cat 00:32:30.447 23:24:32 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:32:30.447 23:24:32 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:30.447 23:24:32 -- nvmf/common.sh@542 -- # cat 00:32:30.447 23:24:32 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:30.447 23:24:32 -- common/autotest_common.sh@1334 -- # grep libasan 00:32:30.447 23:24:32 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:30.447 23:24:32 -- target/dif.sh@72 -- # (( file = 1 )) 00:32:30.447 23:24:32 -- target/dif.sh@72 -- # (( file <= files )) 00:32:30.447 23:24:32 -- target/dif.sh@73 -- # cat 00:32:30.447 23:24:32 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:30.447 23:24:32 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:30.447 { 00:32:30.447 "params": { 00:32:30.447 "name": "Nvme$subsystem", 00:32:30.447 "trtype": "$TEST_TRANSPORT", 00:32:30.447 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:30.447 "adrfam": "ipv4", 00:32:30.447 "trsvcid": "$NVMF_PORT", 00:32:30.447 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:30.447 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:30.447 "hdgst": ${hdgst:-false}, 00:32:30.447 "ddgst": ${ddgst:-false} 00:32:30.447 }, 00:32:30.447 "method": "bdev_nvme_attach_controller" 00:32:30.447 } 00:32:30.447 EOF 00:32:30.447 )") 00:32:30.447 23:24:32 -- nvmf/common.sh@542 -- # cat 00:32:30.447 23:24:32 -- target/dif.sh@72 -- # (( file++ )) 00:32:30.447 23:24:32 -- target/dif.sh@72 -- # (( file <= files )) 00:32:30.447 23:24:32 -- nvmf/common.sh@544 -- # jq . 00:32:30.447 23:24:32 -- nvmf/common.sh@545 -- # IFS=, 00:32:30.447 23:24:32 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:32:30.447 "params": { 00:32:30.447 "name": "Nvme0", 00:32:30.447 "trtype": "tcp", 00:32:30.447 "traddr": "10.0.0.2", 00:32:30.447 "adrfam": "ipv4", 00:32:30.447 "trsvcid": "4420", 00:32:30.447 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:30.447 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:30.447 "hdgst": false, 00:32:30.447 "ddgst": false 00:32:30.447 }, 00:32:30.447 "method": "bdev_nvme_attach_controller" 00:32:30.447 },{ 00:32:30.447 "params": { 00:32:30.447 "name": "Nvme1", 00:32:30.447 "trtype": "tcp", 00:32:30.447 "traddr": "10.0.0.2", 00:32:30.447 "adrfam": "ipv4", 00:32:30.447 "trsvcid": "4420", 00:32:30.447 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:32:30.447 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:32:30.447 "hdgst": false, 00:32:30.447 "ddgst": false 00:32:30.447 }, 00:32:30.447 "method": "bdev_nvme_attach_controller" 00:32:30.447 }' 00:32:30.447 23:24:32 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:30.447 23:24:32 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:30.447 23:24:32 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:30.447 23:24:32 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:30.447 23:24:32 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:32:30.447 23:24:32 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:30.447 23:24:32 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:30.447 23:24:32 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:30.447 23:24:32 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:32:30.447 23:24:32 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:30.447 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:32:30.447 ... 00:32:30.447 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:32:30.447 ... 00:32:30.447 fio-3.35 00:32:30.447 Starting 4 threads 00:32:30.447 EAL: No free 2048 kB hugepages reported on node 1 00:32:30.447 [2024-11-28 23:24:33.076080] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:32:30.447 [2024-11-28 23:24:33.076150] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:34.635 00:32:34.635 filename0: (groupid=0, jobs=1): err= 0: pid=2598475: Thu Nov 28 23:24:38 2024 00:32:34.635 read: IOPS=1830, BW=14.3MiB/s (15.0MB/s)(71.6MiB/5003msec) 00:32:34.635 slat (usec): min=3, max=111, avg=21.33, stdev= 9.57 00:32:34.635 clat (usec): min=624, max=9816, avg=4291.43, stdev=576.04 00:32:34.635 lat (usec): min=644, max=9831, avg=4312.76, stdev=576.15 00:32:34.635 clat percentiles (usec): 00:32:34.635 | 1.00th=[ 2573], 5.00th=[ 3523], 10.00th=[ 3818], 20.00th=[ 4080], 00:32:34.635 | 30.00th=[ 4178], 40.00th=[ 4228], 50.00th=[ 4293], 60.00th=[ 4359], 00:32:34.635 | 70.00th=[ 4424], 80.00th=[ 4490], 90.00th=[ 4686], 95.00th=[ 5145], 00:32:34.635 | 99.00th=[ 6390], 99.50th=[ 6915], 99.90th=[ 7898], 99.95th=[ 9765], 00:32:34.635 | 99.99th=[ 9765] 00:32:34.635 bw ( KiB/s): min=14464, max=15104, per=24.97%, avg=14654.40, stdev=182.50, samples=10 00:32:34.635 iops : min= 1808, max= 1888, avg=1831.80, stdev=22.81, samples=10 00:32:34.635 lat (usec) : 750=0.01%, 1000=0.09% 00:32:34.635 lat (msec) : 2=0.55%, 4=15.86%, 10=83.49% 00:32:34.635 cpu : usr=87.43%, sys=7.76%, ctx=163, majf=0, minf=0 00:32:34.635 IO depths : 1=0.3%, 2=16.9%, 4=56.2%, 8=26.6%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:34.635 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:34.635 complete : 0=0.0%, 4=91.6%, 8=8.4%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:34.635 issued rwts: total=9160,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:34.635 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:34.635 filename0: (groupid=0, jobs=1): err= 0: pid=2598476: Thu Nov 28 23:24:38 2024 00:32:34.635 read: IOPS=1846, BW=14.4MiB/s (15.1MB/s)(72.2MiB/5003msec) 00:32:34.635 slat (usec): min=3, max=288, avg=18.94, stdev=11.43 00:32:34.635 clat (usec): min=817, max=7870, avg=4265.53, stdev=573.00 00:32:34.635 lat (usec): min=828, max=7882, avg=4284.48, stdev=573.19 00:32:34.635 clat percentiles (usec): 00:32:34.635 | 1.00th=[ 2802], 5.00th=[ 3359], 10.00th=[ 3687], 20.00th=[ 3982], 00:32:34.635 | 30.00th=[ 4146], 40.00th=[ 4228], 50.00th=[ 4293], 60.00th=[ 4359], 00:32:34.635 | 70.00th=[ 4424], 80.00th=[ 4490], 90.00th=[ 4621], 95.00th=[ 5145], 00:32:34.635 | 99.00th=[ 6521], 99.50th=[ 7046], 99.90th=[ 7635], 99.95th=[ 7832], 00:32:34.635 | 99.99th=[ 7898] 00:32:34.635 bw ( KiB/s): min=14176, max=15328, per=25.17%, avg=14772.80, stdev=379.08, samples=10 00:32:34.635 iops : min= 1772, max= 1916, avg=1846.60, stdev=47.39, samples=10 00:32:34.635 lat (usec) : 1000=0.05% 00:32:34.635 lat (msec) : 2=0.18%, 4=20.08%, 10=79.69% 00:32:34.635 cpu : usr=95.90%, sys=3.62%, ctx=13, majf=0, minf=0 00:32:34.635 IO depths : 1=0.1%, 2=15.0%, 4=57.1%, 8=27.7%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:34.635 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:34.635 complete : 0=0.0%, 4=92.3%, 8=7.7%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:34.635 issued rwts: total=9240,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:34.635 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:34.635 filename1: (groupid=0, jobs=1): err= 0: pid=2598477: Thu Nov 28 23:24:38 2024 00:32:34.635 read: IOPS=1821, BW=14.2MiB/s (14.9MB/s)(71.2MiB/5002msec) 00:32:34.635 slat (nsec): min=3760, max=73368, avg=19726.68, stdev=11160.60 00:32:34.635 clat (usec): min=703, max=7908, avg=4319.50, stdev=562.57 00:32:34.635 lat (usec): min=711, max=7926, avg=4339.23, stdev=562.32 00:32:34.635 clat percentiles (usec): 00:32:34.635 | 1.00th=[ 2737], 5.00th=[ 3556], 10.00th=[ 3851], 20.00th=[ 4080], 00:32:34.635 | 30.00th=[ 4178], 40.00th=[ 4228], 50.00th=[ 4293], 60.00th=[ 4359], 00:32:34.635 | 70.00th=[ 4424], 80.00th=[ 4490], 90.00th=[ 4752], 95.00th=[ 5211], 00:32:34.635 | 99.00th=[ 6521], 99.50th=[ 6849], 99.90th=[ 7373], 99.95th=[ 7635], 00:32:34.635 | 99.99th=[ 7898] 00:32:34.635 bw ( KiB/s): min=14272, max=15136, per=24.83%, avg=14572.40, stdev=235.91, samples=10 00:32:34.635 iops : min= 1784, max= 1892, avg=1821.50, stdev=29.54, samples=10 00:32:34.635 lat (usec) : 750=0.03%, 1000=0.01% 00:32:34.635 lat (msec) : 2=0.31%, 4=15.31%, 10=84.34% 00:32:34.635 cpu : usr=95.12%, sys=4.34%, ctx=10, majf=0, minf=0 00:32:34.635 IO depths : 1=0.1%, 2=15.7%, 4=57.1%, 8=27.2%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:34.635 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:34.635 complete : 0=0.0%, 4=91.9%, 8=8.1%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:34.635 issued rwts: total=9113,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:34.635 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:34.635 filename1: (groupid=0, jobs=1): err= 0: pid=2598478: Thu Nov 28 23:24:38 2024 00:32:34.635 read: IOPS=1836, BW=14.3MiB/s (15.0MB/s)(71.8MiB/5003msec) 00:32:34.635 slat (nsec): min=3676, max=73248, avg=17352.92, stdev=10375.99 00:32:34.635 clat (usec): min=668, max=8294, avg=4299.69, stdev=531.43 00:32:34.635 lat (usec): min=676, max=8323, avg=4317.05, stdev=531.57 00:32:34.635 clat percentiles (usec): 00:32:34.635 | 1.00th=[ 2868], 5.00th=[ 3523], 10.00th=[ 3818], 20.00th=[ 4080], 00:32:34.635 | 30.00th=[ 4178], 40.00th=[ 4228], 50.00th=[ 4293], 60.00th=[ 4359], 00:32:34.635 | 70.00th=[ 4424], 80.00th=[ 4490], 90.00th=[ 4686], 95.00th=[ 5080], 00:32:34.635 | 99.00th=[ 6456], 99.50th=[ 6915], 99.90th=[ 7504], 99.95th=[ 7701], 00:32:34.635 | 99.99th=[ 8291] 00:32:34.635 bw ( KiB/s): min=14464, max=14880, per=25.03%, avg=14687.70, stdev=149.32, samples=10 00:32:34.635 iops : min= 1808, max= 1860, avg=1835.90, stdev=18.71, samples=10 00:32:34.635 lat (usec) : 750=0.02%, 1000=0.04% 00:32:34.635 lat (msec) : 2=0.25%, 4=16.58%, 10=83.10% 00:32:34.635 cpu : usr=95.14%, sys=4.36%, ctx=12, majf=0, minf=0 00:32:34.635 IO depths : 1=0.3%, 2=11.7%, 4=59.6%, 8=28.4%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:34.635 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:34.635 complete : 0=0.0%, 4=93.0%, 8=7.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:34.635 issued rwts: total=9186,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:34.635 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:34.635 00:32:34.635 Run status group 0 (all jobs): 00:32:34.635 READ: bw=57.3MiB/s (60.1MB/s), 14.2MiB/s-14.4MiB/s (14.9MB/s-15.1MB/s), io=287MiB (301MB), run=5002-5003msec 00:32:34.894 23:24:38 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:32:34.894 23:24:38 -- target/dif.sh@43 -- # local sub 00:32:34.894 23:24:38 -- target/dif.sh@45 -- # for sub in "$@" 00:32:34.894 23:24:38 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:34.894 23:24:38 -- target/dif.sh@36 -- # local sub_id=0 00:32:34.894 23:24:38 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:34.894 23:24:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:34.894 23:24:38 -- common/autotest_common.sh@10 -- # set +x 00:32:34.894 23:24:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:34.894 23:24:38 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:34.894 23:24:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:34.894 23:24:38 -- common/autotest_common.sh@10 -- # set +x 00:32:34.894 23:24:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:34.894 23:24:38 -- target/dif.sh@45 -- # for sub in "$@" 00:32:34.894 23:24:38 -- target/dif.sh@46 -- # destroy_subsystem 1 00:32:34.894 23:24:38 -- target/dif.sh@36 -- # local sub_id=1 00:32:34.894 23:24:38 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:32:34.894 23:24:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:34.894 23:24:38 -- common/autotest_common.sh@10 -- # set +x 00:32:34.894 23:24:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:34.894 23:24:38 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:32:34.894 23:24:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:34.894 23:24:38 -- common/autotest_common.sh@10 -- # set +x 00:32:34.894 23:24:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:34.894 00:32:34.894 real 0m24.150s 00:32:34.894 user 4m33.070s 00:32:34.894 sys 0m5.625s 00:32:34.894 23:24:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:34.894 23:24:38 -- common/autotest_common.sh@10 -- # set +x 00:32:34.894 ************************************ 00:32:34.894 END TEST fio_dif_rand_params 00:32:34.894 ************************************ 00:32:34.894 23:24:38 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:32:34.894 23:24:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:34.894 23:24:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:34.894 23:24:38 -- common/autotest_common.sh@10 -- # set +x 00:32:34.894 ************************************ 00:32:34.894 START TEST fio_dif_digest 00:32:34.894 ************************************ 00:32:34.894 23:24:38 -- common/autotest_common.sh@1114 -- # fio_dif_digest 00:32:34.894 23:24:38 -- target/dif.sh@123 -- # local NULL_DIF 00:32:34.894 23:24:38 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:32:34.894 23:24:38 -- target/dif.sh@125 -- # local hdgst ddgst 00:32:34.894 23:24:38 -- target/dif.sh@127 -- # NULL_DIF=3 00:32:34.894 23:24:38 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:32:34.894 23:24:38 -- target/dif.sh@127 -- # numjobs=3 00:32:34.894 23:24:38 -- target/dif.sh@127 -- # iodepth=3 00:32:34.894 23:24:38 -- target/dif.sh@127 -- # runtime=10 00:32:34.894 23:24:38 -- target/dif.sh@128 -- # hdgst=true 00:32:34.894 23:24:38 -- target/dif.sh@128 -- # ddgst=true 00:32:34.894 23:24:38 -- target/dif.sh@130 -- # create_subsystems 0 00:32:34.894 23:24:38 -- target/dif.sh@28 -- # local sub 00:32:34.894 23:24:38 -- target/dif.sh@30 -- # for sub in "$@" 00:32:34.894 23:24:38 -- target/dif.sh@31 -- # create_subsystem 0 00:32:34.894 23:24:38 -- target/dif.sh@18 -- # local sub_id=0 00:32:34.894 23:24:38 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:32:34.894 23:24:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:34.894 23:24:38 -- common/autotest_common.sh@10 -- # set +x 00:32:34.894 bdev_null0 00:32:34.894 23:24:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:35.153 23:24:38 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:32:35.153 23:24:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:35.153 23:24:38 -- common/autotest_common.sh@10 -- # set +x 00:32:35.153 23:24:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:35.153 23:24:38 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:32:35.153 23:24:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:35.153 23:24:38 -- common/autotest_common.sh@10 -- # set +x 00:32:35.153 23:24:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:35.153 23:24:38 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:32:35.153 23:24:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:35.153 23:24:38 -- common/autotest_common.sh@10 -- # set +x 00:32:35.153 [2024-11-28 23:24:38.518999] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:35.153 23:24:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:35.153 23:24:38 -- target/dif.sh@131 -- # fio /dev/fd/62 00:32:35.153 23:24:38 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:32:35.153 23:24:38 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:32:35.153 23:24:38 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:35.153 23:24:38 -- nvmf/common.sh@520 -- # config=() 00:32:35.153 23:24:38 -- nvmf/common.sh@520 -- # local subsystem config 00:32:35.153 23:24:38 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:35.153 23:24:38 -- target/dif.sh@82 -- # gen_fio_conf 00:32:35.153 23:24:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:35.153 23:24:38 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:32:35.153 23:24:38 -- target/dif.sh@54 -- # local file 00:32:35.153 23:24:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:35.153 { 00:32:35.153 "params": { 00:32:35.153 "name": "Nvme$subsystem", 00:32:35.153 "trtype": "$TEST_TRANSPORT", 00:32:35.153 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:35.153 "adrfam": "ipv4", 00:32:35.153 "trsvcid": "$NVMF_PORT", 00:32:35.153 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:35.153 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:35.153 "hdgst": ${hdgst:-false}, 00:32:35.153 "ddgst": ${ddgst:-false} 00:32:35.153 }, 00:32:35.153 "method": "bdev_nvme_attach_controller" 00:32:35.153 } 00:32:35.153 EOF 00:32:35.153 )") 00:32:35.153 23:24:38 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:32:35.153 23:24:38 -- target/dif.sh@56 -- # cat 00:32:35.153 23:24:38 -- common/autotest_common.sh@1328 -- # local sanitizers 00:32:35.153 23:24:38 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:35.153 23:24:38 -- common/autotest_common.sh@1330 -- # shift 00:32:35.153 23:24:38 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:32:35.153 23:24:38 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:35.153 23:24:38 -- nvmf/common.sh@542 -- # cat 00:32:35.153 23:24:38 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:35.153 23:24:38 -- target/dif.sh@72 -- # (( file = 1 )) 00:32:35.153 23:24:38 -- target/dif.sh@72 -- # (( file <= files )) 00:32:35.153 23:24:38 -- common/autotest_common.sh@1334 -- # grep libasan 00:32:35.153 23:24:38 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:35.153 23:24:38 -- nvmf/common.sh@544 -- # jq . 00:32:35.153 23:24:38 -- nvmf/common.sh@545 -- # IFS=, 00:32:35.153 23:24:38 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:32:35.153 "params": { 00:32:35.153 "name": "Nvme0", 00:32:35.153 "trtype": "tcp", 00:32:35.153 "traddr": "10.0.0.2", 00:32:35.153 "adrfam": "ipv4", 00:32:35.153 "trsvcid": "4420", 00:32:35.153 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:35.153 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:35.153 "hdgst": true, 00:32:35.153 "ddgst": true 00:32:35.153 }, 00:32:35.153 "method": "bdev_nvme_attach_controller" 00:32:35.153 }' 00:32:35.153 23:24:38 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:35.153 23:24:38 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:35.153 23:24:38 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:35.153 23:24:38 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:35.153 23:24:38 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:32:35.153 23:24:38 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:35.153 23:24:38 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:35.153 23:24:38 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:35.153 23:24:38 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:32:35.153 23:24:38 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:35.411 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:32:35.411 ... 00:32:35.411 fio-3.35 00:32:35.411 Starting 3 threads 00:32:35.411 EAL: No free 2048 kB hugepages reported on node 1 00:32:35.669 [2024-11-28 23:24:39.231960] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:32:35.669 [2024-11-28 23:24:39.232009] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:47.864 00:32:47.864 filename0: (groupid=0, jobs=1): err= 0: pid=2599263: Thu Nov 28 23:24:49 2024 00:32:47.864 read: IOPS=203, BW=25.5MiB/s (26.7MB/s)(256MiB/10044msec) 00:32:47.864 slat (nsec): min=4690, max=93274, avg=17153.17, stdev=4669.87 00:32:47.864 clat (usec): min=10265, max=55146, avg=14671.18, stdev=1582.36 00:32:47.864 lat (usec): min=10279, max=55160, avg=14688.34, stdev=1582.26 00:32:47.864 clat percentiles (usec): 00:32:47.864 | 1.00th=[12125], 5.00th=[13042], 10.00th=[13435], 20.00th=[13829], 00:32:47.864 | 30.00th=[14222], 40.00th=[14353], 50.00th=[14615], 60.00th=[14877], 00:32:47.864 | 70.00th=[15139], 80.00th=[15401], 90.00th=[15926], 95.00th=[16188], 00:32:47.864 | 99.00th=[16909], 99.50th=[17433], 99.90th=[20579], 99.95th=[52691], 00:32:47.864 | 99.99th=[55313] 00:32:47.864 bw ( KiB/s): min=25600, max=26624, per=32.75%, avg=26191.35, stdev=341.04, samples=20 00:32:47.864 iops : min= 200, max= 208, avg=204.60, stdev= 2.68, samples=20 00:32:47.864 lat (msec) : 20=99.76%, 50=0.15%, 100=0.10% 00:32:47.864 cpu : usr=94.39%, sys=4.50%, ctx=115, majf=0, minf=246 00:32:47.864 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:47.864 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:47.864 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:47.864 issued rwts: total=2048,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:47.864 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:47.864 filename0: (groupid=0, jobs=1): err= 0: pid=2599264: Thu Nov 28 23:24:49 2024 00:32:47.864 read: IOPS=208, BW=26.0MiB/s (27.3MB/s)(261MiB/10047msec) 00:32:47.864 slat (nsec): min=5603, max=54314, avg=17570.09, stdev=4614.38 00:32:47.864 clat (usec): min=8332, max=51430, avg=14379.14, stdev=1477.01 00:32:47.864 lat (usec): min=8346, max=51460, avg=14396.71, stdev=1477.19 00:32:47.864 clat percentiles (usec): 00:32:47.864 | 1.00th=[12125], 5.00th=[12780], 10.00th=[13173], 20.00th=[13566], 00:32:47.864 | 30.00th=[13829], 40.00th=[14091], 50.00th=[14353], 60.00th=[14615], 00:32:47.864 | 70.00th=[14877], 80.00th=[15139], 90.00th=[15533], 95.00th=[15926], 00:32:47.864 | 99.00th=[16712], 99.50th=[16909], 99.90th=[21103], 99.95th=[46924], 00:32:47.864 | 99.99th=[51643] 00:32:47.864 bw ( KiB/s): min=25394, max=28416, per=33.41%, avg=26716.10, stdev=681.11, samples=20 00:32:47.864 iops : min= 198, max= 222, avg=208.70, stdev= 5.36, samples=20 00:32:47.864 lat (msec) : 10=0.43%, 20=99.33%, 50=0.19%, 100=0.05% 00:32:47.864 cpu : usr=88.75%, sys=6.99%, ctx=273, majf=0, minf=157 00:32:47.864 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:47.864 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:47.864 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:47.864 issued rwts: total=2090,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:47.864 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:47.864 filename0: (groupid=0, jobs=1): err= 0: pid=2599266: Thu Nov 28 23:24:49 2024 00:32:47.864 read: IOPS=212, BW=26.6MiB/s (27.9MB/s)(267MiB/10047msec) 00:32:47.864 slat (nsec): min=4724, max=50859, avg=17825.89, stdev=4564.57 00:32:47.864 clat (usec): min=10587, max=55040, avg=14048.35, stdev=2083.91 00:32:47.864 lat (usec): min=10598, max=55058, avg=14066.18, stdev=2083.94 00:32:47.864 clat percentiles (usec): 00:32:47.864 | 1.00th=[11863], 5.00th=[12518], 10.00th=[12780], 20.00th=[13173], 00:32:47.864 | 30.00th=[13566], 40.00th=[13829], 50.00th=[13960], 60.00th=[14222], 00:32:47.864 | 70.00th=[14353], 80.00th=[14615], 90.00th=[15008], 95.00th=[15401], 00:32:47.864 | 99.00th=[16188], 99.50th=[17171], 99.90th=[53216], 99.95th=[54789], 00:32:47.864 | 99.99th=[54789] 00:32:47.864 bw ( KiB/s): min=24576, max=28160, per=34.20%, avg=27353.60, stdev=748.78, samples=20 00:32:47.864 iops : min= 192, max= 220, avg=213.70, stdev= 5.85, samples=20 00:32:47.864 lat (msec) : 20=99.72%, 50=0.09%, 100=0.19% 00:32:47.864 cpu : usr=94.15%, sys=5.27%, ctx=25, majf=0, minf=107 00:32:47.864 IO depths : 1=0.1%, 2=100.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:47.864 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:47.864 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:47.864 issued rwts: total=2139,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:47.864 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:47.864 00:32:47.864 Run status group 0 (all jobs): 00:32:47.864 READ: bw=78.1MiB/s (81.9MB/s), 25.5MiB/s-26.6MiB/s (26.7MB/s-27.9MB/s), io=785MiB (823MB), run=10044-10047msec 00:32:47.864 23:24:49 -- target/dif.sh@132 -- # destroy_subsystems 0 00:32:47.864 23:24:49 -- target/dif.sh@43 -- # local sub 00:32:47.864 23:24:49 -- target/dif.sh@45 -- # for sub in "$@" 00:32:47.864 23:24:49 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:47.864 23:24:49 -- target/dif.sh@36 -- # local sub_id=0 00:32:47.864 23:24:49 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:47.864 23:24:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:47.864 23:24:49 -- common/autotest_common.sh@10 -- # set +x 00:32:47.864 23:24:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:47.864 23:24:49 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:47.864 23:24:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:47.864 23:24:49 -- common/autotest_common.sh@10 -- # set +x 00:32:47.864 23:24:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:47.864 00:32:47.864 real 0m11.204s 00:32:47.864 user 0m29.008s 00:32:47.864 sys 0m1.988s 00:32:47.864 23:24:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:47.864 23:24:49 -- common/autotest_common.sh@10 -- # set +x 00:32:47.864 ************************************ 00:32:47.864 END TEST fio_dif_digest 00:32:47.864 ************************************ 00:32:47.864 23:24:49 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:32:47.864 23:24:49 -- target/dif.sh@147 -- # nvmftestfini 00:32:47.864 23:24:49 -- nvmf/common.sh@476 -- # nvmfcleanup 00:32:47.864 23:24:49 -- nvmf/common.sh@116 -- # sync 00:32:47.864 23:24:49 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:32:47.864 23:24:49 -- nvmf/common.sh@119 -- # set +e 00:32:47.864 23:24:49 -- nvmf/common.sh@120 -- # for i in {1..20} 00:32:47.864 23:24:49 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:32:47.864 rmmod nvme_tcp 00:32:47.864 rmmod nvme_fabrics 00:32:47.864 rmmod nvme_keyring 00:32:47.864 23:24:49 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:32:47.864 23:24:49 -- nvmf/common.sh@123 -- # set -e 00:32:47.864 23:24:49 -- nvmf/common.sh@124 -- # return 0 00:32:47.864 23:24:49 -- nvmf/common.sh@477 -- # '[' -n 2592395 ']' 00:32:47.864 23:24:49 -- nvmf/common.sh@478 -- # killprocess 2592395 00:32:47.864 23:24:49 -- common/autotest_common.sh@936 -- # '[' -z 2592395 ']' 00:32:47.864 23:24:49 -- common/autotest_common.sh@940 -- # kill -0 2592395 00:32:47.864 23:24:49 -- common/autotest_common.sh@941 -- # uname 00:32:47.864 23:24:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:32:47.864 23:24:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2592395 00:32:47.864 23:24:49 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:32:47.864 23:24:49 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:32:47.864 23:24:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2592395' 00:32:47.864 killing process with pid 2592395 00:32:47.864 23:24:49 -- common/autotest_common.sh@955 -- # kill 2592395 00:32:47.864 23:24:49 -- common/autotest_common.sh@960 -- # wait 2592395 00:32:47.865 23:24:50 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:32:47.865 23:24:50 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:32:47.865 Waiting for block devices as requested 00:32:47.865 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:32:47.865 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:47.865 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:48.123 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:48.123 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:48.123 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:48.123 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:48.123 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:48.381 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:48.381 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:48.381 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:48.381 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:48.639 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:48.639 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:48.639 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:48.639 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:48.898 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:48.898 23:24:52 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:32:48.898 23:24:52 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:32:48.898 23:24:52 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:32:48.898 23:24:52 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:32:48.898 23:24:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:48.898 23:24:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:48.898 23:24:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:50.798 23:24:54 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:32:50.798 00:32:50.798 real 1m7.222s 00:32:50.798 user 6m30.508s 00:32:50.798 sys 0m16.447s 00:32:50.798 23:24:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:50.798 23:24:54 -- common/autotest_common.sh@10 -- # set +x 00:32:50.799 ************************************ 00:32:50.799 END TEST nvmf_dif 00:32:50.799 ************************************ 00:32:51.057 23:24:54 -- spdk/autotest.sh@288 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:32:51.057 23:24:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:51.057 23:24:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:51.057 23:24:54 -- common/autotest_common.sh@10 -- # set +x 00:32:51.057 ************************************ 00:32:51.057 START TEST nvmf_abort_qd_sizes 00:32:51.057 ************************************ 00:32:51.057 23:24:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:32:51.057 * Looking for test storage... 00:32:51.057 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:32:51.057 23:24:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:32:51.057 23:24:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:32:51.057 23:24:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:32:51.057 23:24:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:32:51.057 23:24:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:32:51.057 23:24:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:32:51.057 23:24:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:32:51.057 23:24:54 -- scripts/common.sh@335 -- # IFS=.-: 00:32:51.057 23:24:54 -- scripts/common.sh@335 -- # read -ra ver1 00:32:51.057 23:24:54 -- scripts/common.sh@336 -- # IFS=.-: 00:32:51.057 23:24:54 -- scripts/common.sh@336 -- # read -ra ver2 00:32:51.057 23:24:54 -- scripts/common.sh@337 -- # local 'op=<' 00:32:51.057 23:24:54 -- scripts/common.sh@339 -- # ver1_l=2 00:32:51.057 23:24:54 -- scripts/common.sh@340 -- # ver2_l=1 00:32:51.057 23:24:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:32:51.057 23:24:54 -- scripts/common.sh@343 -- # case "$op" in 00:32:51.057 23:24:54 -- scripts/common.sh@344 -- # : 1 00:32:51.058 23:24:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:32:51.058 23:24:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:32:51.058 23:24:54 -- scripts/common.sh@364 -- # decimal 1 00:32:51.058 23:24:54 -- scripts/common.sh@352 -- # local d=1 00:32:51.058 23:24:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:32:51.058 23:24:54 -- scripts/common.sh@354 -- # echo 1 00:32:51.058 23:24:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:32:51.058 23:24:54 -- scripts/common.sh@365 -- # decimal 2 00:32:51.058 23:24:54 -- scripts/common.sh@352 -- # local d=2 00:32:51.058 23:24:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:32:51.058 23:24:54 -- scripts/common.sh@354 -- # echo 2 00:32:51.058 23:24:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:32:51.058 23:24:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:32:51.058 23:24:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:32:51.058 23:24:54 -- scripts/common.sh@367 -- # return 0 00:32:51.058 23:24:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:32:51.058 23:24:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:32:51.058 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:51.058 --rc genhtml_branch_coverage=1 00:32:51.058 --rc genhtml_function_coverage=1 00:32:51.058 --rc genhtml_legend=1 00:32:51.058 --rc geninfo_all_blocks=1 00:32:51.058 --rc geninfo_unexecuted_blocks=1 00:32:51.058 00:32:51.058 ' 00:32:51.058 23:24:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:32:51.058 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:51.058 --rc genhtml_branch_coverage=1 00:32:51.058 --rc genhtml_function_coverage=1 00:32:51.058 --rc genhtml_legend=1 00:32:51.058 --rc geninfo_all_blocks=1 00:32:51.058 --rc geninfo_unexecuted_blocks=1 00:32:51.058 00:32:51.058 ' 00:32:51.058 23:24:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:32:51.058 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:51.058 --rc genhtml_branch_coverage=1 00:32:51.058 --rc genhtml_function_coverage=1 00:32:51.058 --rc genhtml_legend=1 00:32:51.058 --rc geninfo_all_blocks=1 00:32:51.058 --rc geninfo_unexecuted_blocks=1 00:32:51.058 00:32:51.058 ' 00:32:51.058 23:24:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:32:51.058 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:51.058 --rc genhtml_branch_coverage=1 00:32:51.058 --rc genhtml_function_coverage=1 00:32:51.058 --rc genhtml_legend=1 00:32:51.058 --rc geninfo_all_blocks=1 00:32:51.058 --rc geninfo_unexecuted_blocks=1 00:32:51.058 00:32:51.058 ' 00:32:51.058 23:24:54 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:32:51.058 23:24:54 -- nvmf/common.sh@7 -- # uname -s 00:32:51.058 23:24:54 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:32:51.058 23:24:54 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:32:51.058 23:24:54 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:32:51.058 23:24:54 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:32:51.058 23:24:54 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:32:51.058 23:24:54 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:32:51.058 23:24:54 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:32:51.058 23:24:54 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:32:51.058 23:24:54 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:32:51.058 23:24:54 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:32:51.058 23:24:54 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:32:51.058 23:24:54 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:32:51.058 23:24:54 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:32:51.058 23:24:54 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:32:51.058 23:24:54 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:32:51.058 23:24:54 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:32:51.058 23:24:54 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:32:51.058 23:24:54 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:32:51.058 23:24:54 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:32:51.058 23:24:54 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:51.058 23:24:54 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:51.058 23:24:54 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:51.058 23:24:54 -- paths/export.sh@5 -- # export PATH 00:32:51.058 23:24:54 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:51.058 23:24:54 -- nvmf/common.sh@46 -- # : 0 00:32:51.058 23:24:54 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:32:51.058 23:24:54 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:32:51.058 23:24:54 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:32:51.058 23:24:54 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:32:51.058 23:24:54 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:32:51.058 23:24:54 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:32:51.058 23:24:54 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:32:51.058 23:24:54 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:32:51.058 23:24:54 -- target/abort_qd_sizes.sh@73 -- # nvmftestinit 00:32:51.058 23:24:54 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:32:51.058 23:24:54 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:32:51.058 23:24:54 -- nvmf/common.sh@436 -- # prepare_net_devs 00:32:51.058 23:24:54 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:32:51.058 23:24:54 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:32:51.058 23:24:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:51.058 23:24:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:51.058 23:24:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:51.058 23:24:54 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:32:51.058 23:24:54 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:32:51.058 23:24:54 -- nvmf/common.sh@284 -- # xtrace_disable 00:32:51.058 23:24:54 -- common/autotest_common.sh@10 -- # set +x 00:32:53.586 23:24:56 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:32:53.586 23:24:56 -- nvmf/common.sh@290 -- # pci_devs=() 00:32:53.586 23:24:56 -- nvmf/common.sh@290 -- # local -a pci_devs 00:32:53.586 23:24:56 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:32:53.586 23:24:56 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:32:53.586 23:24:56 -- nvmf/common.sh@292 -- # pci_drivers=() 00:32:53.586 23:24:56 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:32:53.586 23:24:56 -- nvmf/common.sh@294 -- # net_devs=() 00:32:53.586 23:24:56 -- nvmf/common.sh@294 -- # local -ga net_devs 00:32:53.586 23:24:56 -- nvmf/common.sh@295 -- # e810=() 00:32:53.586 23:24:56 -- nvmf/common.sh@295 -- # local -ga e810 00:32:53.586 23:24:56 -- nvmf/common.sh@296 -- # x722=() 00:32:53.586 23:24:56 -- nvmf/common.sh@296 -- # local -ga x722 00:32:53.586 23:24:56 -- nvmf/common.sh@297 -- # mlx=() 00:32:53.586 23:24:56 -- nvmf/common.sh@297 -- # local -ga mlx 00:32:53.586 23:24:56 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:32:53.586 23:24:56 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:32:53.586 23:24:56 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:32:53.586 23:24:56 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:32:53.586 23:24:56 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:32:53.586 23:24:56 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:32:53.586 23:24:56 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:32:53.586 23:24:56 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:32:53.586 23:24:56 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:32:53.586 23:24:56 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:32:53.586 23:24:56 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:32:53.586 23:24:56 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:32:53.586 23:24:56 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:32:53.586 23:24:56 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:32:53.586 23:24:56 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:32:53.586 23:24:56 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:32:53.586 23:24:56 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:32:53.586 23:24:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:53.586 23:24:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:32:53.586 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:32:53.586 23:24:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:53.586 23:24:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:53.586 23:24:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:53.586 23:24:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:53.586 23:24:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:53.586 23:24:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:53.586 23:24:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:32:53.586 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:32:53.586 23:24:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:53.586 23:24:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:53.586 23:24:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:53.586 23:24:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:53.586 23:24:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:53.586 23:24:56 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:32:53.586 23:24:56 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:32:53.586 23:24:56 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:32:53.586 23:24:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:53.586 23:24:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:53.586 23:24:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:53.586 23:24:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:53.586 23:24:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:32:53.586 Found net devices under 0000:0a:00.0: cvl_0_0 00:32:53.586 23:24:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:53.586 23:24:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:53.586 23:24:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:53.586 23:24:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:53.586 23:24:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:53.587 23:24:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:32:53.587 Found net devices under 0000:0a:00.1: cvl_0_1 00:32:53.587 23:24:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:53.587 23:24:56 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:32:53.587 23:24:56 -- nvmf/common.sh@402 -- # is_hw=yes 00:32:53.587 23:24:56 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:32:53.587 23:24:56 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:32:53.587 23:24:56 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:32:53.587 23:24:56 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:32:53.587 23:24:56 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:32:53.587 23:24:56 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:32:53.587 23:24:56 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:32:53.587 23:24:56 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:32:53.587 23:24:56 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:32:53.587 23:24:56 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:32:53.587 23:24:56 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:32:53.587 23:24:56 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:32:53.587 23:24:56 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:32:53.587 23:24:56 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:32:53.587 23:24:56 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:32:53.587 23:24:56 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:32:53.587 23:24:56 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:32:53.587 23:24:56 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:32:53.587 23:24:56 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:32:53.587 23:24:56 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:32:53.587 23:24:56 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:32:53.587 23:24:56 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:32:53.587 23:24:56 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:32:53.587 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:32:53.587 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.258 ms 00:32:53.587 00:32:53.587 --- 10.0.0.2 ping statistics --- 00:32:53.587 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:53.587 rtt min/avg/max/mdev = 0.258/0.258/0.258/0.000 ms 00:32:53.587 23:24:56 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:32:53.587 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:32:53.587 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.130 ms 00:32:53.587 00:32:53.587 --- 10.0.0.1 ping statistics --- 00:32:53.587 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:53.587 rtt min/avg/max/mdev = 0.130/0.130/0.130/0.000 ms 00:32:53.587 23:24:56 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:32:53.587 23:24:56 -- nvmf/common.sh@410 -- # return 0 00:32:53.587 23:24:56 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:32:53.587 23:24:56 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:32:54.581 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:32:54.581 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:32:54.581 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:32:54.581 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:32:54.581 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:32:54.581 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:32:54.581 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:32:54.581 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:32:54.581 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:32:54.581 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:32:54.581 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:32:54.581 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:32:54.581 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:32:54.581 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:32:54.581 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:32:54.581 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:32:55.514 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:32:55.514 23:24:59 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:32:55.514 23:24:59 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:32:55.514 23:24:59 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:32:55.514 23:24:59 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:32:55.514 23:24:59 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:32:55.514 23:24:59 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:32:55.514 23:24:59 -- target/abort_qd_sizes.sh@74 -- # nvmfappstart -m 0xf 00:32:55.514 23:24:59 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:32:55.514 23:24:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:32:55.514 23:24:59 -- common/autotest_common.sh@10 -- # set +x 00:32:55.514 23:24:59 -- nvmf/common.sh@469 -- # nvmfpid=2604268 00:32:55.514 23:24:59 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:32:55.514 23:24:59 -- nvmf/common.sh@470 -- # waitforlisten 2604268 00:32:55.514 23:24:59 -- common/autotest_common.sh@829 -- # '[' -z 2604268 ']' 00:32:55.514 23:24:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:32:55.514 23:24:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:32:55.514 23:24:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:32:55.514 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:32:55.514 23:24:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:32:55.514 23:24:59 -- common/autotest_common.sh@10 -- # set +x 00:32:55.772 [2024-11-28 23:24:59.157192] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:32:55.772 [2024-11-28 23:24:59.157283] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:32:55.772 EAL: No free 2048 kB hugepages reported on node 1 00:32:55.772 [2024-11-28 23:24:59.232734] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:32:55.772 [2024-11-28 23:24:59.327968] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:32:55.772 [2024-11-28 23:24:59.328120] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:32:55.772 [2024-11-28 23:24:59.328137] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:32:55.772 [2024-11-28 23:24:59.328159] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:32:55.772 [2024-11-28 23:24:59.328221] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:32:55.772 [2024-11-28 23:24:59.328251] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:32:55.772 [2024-11-28 23:24:59.328325] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:32:55.772 [2024-11-28 23:24:59.328327] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:32:56.703 23:25:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:32:56.703 23:25:00 -- common/autotest_common.sh@862 -- # return 0 00:32:56.703 23:25:00 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:32:56.703 23:25:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:32:56.703 23:25:00 -- common/autotest_common.sh@10 -- # set +x 00:32:56.703 23:25:00 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:32:56.703 23:25:00 -- target/abort_qd_sizes.sh@76 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:32:56.703 23:25:00 -- target/abort_qd_sizes.sh@78 -- # mapfile -t nvmes 00:32:56.703 23:25:00 -- target/abort_qd_sizes.sh@78 -- # nvme_in_userspace 00:32:56.703 23:25:00 -- scripts/common.sh@311 -- # local bdf bdfs 00:32:56.703 23:25:00 -- scripts/common.sh@312 -- # local nvmes 00:32:56.703 23:25:00 -- scripts/common.sh@314 -- # [[ -n 0000:88:00.0 ]] 00:32:56.703 23:25:00 -- scripts/common.sh@315 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:32:56.703 23:25:00 -- scripts/common.sh@320 -- # for bdf in "${nvmes[@]}" 00:32:56.703 23:25:00 -- scripts/common.sh@321 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:88:00.0 ]] 00:32:56.703 23:25:00 -- scripts/common.sh@322 -- # uname -s 00:32:56.703 23:25:00 -- scripts/common.sh@322 -- # [[ Linux == FreeBSD ]] 00:32:56.703 23:25:00 -- scripts/common.sh@325 -- # bdfs+=("$bdf") 00:32:56.703 23:25:00 -- scripts/common.sh@327 -- # (( 1 )) 00:32:56.703 23:25:00 -- scripts/common.sh@328 -- # printf '%s\n' 0000:88:00.0 00:32:56.703 23:25:00 -- target/abort_qd_sizes.sh@79 -- # (( 1 > 0 )) 00:32:56.703 23:25:00 -- target/abort_qd_sizes.sh@81 -- # nvme=0000:88:00.0 00:32:56.703 23:25:00 -- target/abort_qd_sizes.sh@83 -- # run_test spdk_target_abort spdk_target 00:32:56.704 23:25:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:56.704 23:25:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:56.704 23:25:00 -- common/autotest_common.sh@10 -- # set +x 00:32:56.704 ************************************ 00:32:56.704 START TEST spdk_target_abort 00:32:56.704 ************************************ 00:32:56.704 23:25:00 -- common/autotest_common.sh@1114 -- # spdk_target 00:32:56.704 23:25:00 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:32:56.704 23:25:00 -- target/abort_qd_sizes.sh@44 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:32:56.704 23:25:00 -- target/abort_qd_sizes.sh@46 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:88:00.0 -b spdk_target 00:32:56.704 23:25:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:56.704 23:25:00 -- common/autotest_common.sh@10 -- # set +x 00:32:59.981 spdk_targetn1 00:32:59.981 23:25:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:59.981 23:25:03 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:32:59.981 23:25:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:59.981 23:25:03 -- common/autotest_common.sh@10 -- # set +x 00:32:59.981 [2024-11-28 23:25:03.074446] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:32:59.982 23:25:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:59.982 23:25:03 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:spdk_target -a -s SPDKISFASTANDAWESOME 00:32:59.982 23:25:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:59.982 23:25:03 -- common/autotest_common.sh@10 -- # set +x 00:32:59.982 23:25:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:59.982 23:25:03 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:spdk_target spdk_targetn1 00:32:59.982 23:25:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:59.982 23:25:03 -- common/autotest_common.sh@10 -- # set +x 00:32:59.982 23:25:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:59.982 23:25:03 -- target/abort_qd_sizes.sh@51 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:spdk_target -t tcp -a 10.0.0.2 -s 4420 00:32:59.982 23:25:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:59.982 23:25:03 -- common/autotest_common.sh@10 -- # set +x 00:32:59.982 [2024-11-28 23:25:03.106754] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:59.982 23:25:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:59.982 23:25:03 -- target/abort_qd_sizes.sh@53 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:spdk_target 00:32:59.982 23:25:03 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:32:59.982 23:25:03 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:32:59.982 23:25:03 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:32:59.982 23:25:03 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:32:59.982 23:25:03 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:32:59.982 23:25:03 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:32:59.982 23:25:03 -- target/abort_qd_sizes.sh@24 -- # local target r 00:32:59.982 23:25:03 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:32:59.982 23:25:03 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:59.982 23:25:03 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:32:59.982 23:25:03 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:59.982 23:25:03 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:32:59.982 23:25:03 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:59.982 23:25:03 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:32:59.982 23:25:03 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:59.982 23:25:03 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:32:59.982 23:25:03 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:59.982 23:25:03 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:59.982 23:25:03 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:59.982 23:25:03 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:59.982 EAL: No free 2048 kB hugepages reported on node 1 00:33:03.260 Initializing NVMe Controllers 00:33:03.260 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:33:03.260 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:33:03.260 Initialization complete. Launching workers. 00:33:03.260 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 12999, failed: 0 00:33:03.260 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1212, failed to submit 11787 00:33:03.260 success 744, unsuccess 468, failed 0 00:33:03.260 23:25:06 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:33:03.260 23:25:06 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:33:03.260 EAL: No free 2048 kB hugepages reported on node 1 00:33:06.539 Initializing NVMe Controllers 00:33:06.539 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:33:06.539 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:33:06.539 Initialization complete. Launching workers. 00:33:06.539 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 8669, failed: 0 00:33:06.539 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1205, failed to submit 7464 00:33:06.539 success 358, unsuccess 847, failed 0 00:33:06.539 23:25:09 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:33:06.539 23:25:09 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:33:06.539 EAL: No free 2048 kB hugepages reported on node 1 00:33:09.817 Initializing NVMe Controllers 00:33:09.817 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:33:09.817 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:33:09.817 Initialization complete. Launching workers. 00:33:09.817 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 31861, failed: 0 00:33:09.817 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 2817, failed to submit 29044 00:33:09.817 success 538, unsuccess 2279, failed 0 00:33:09.817 23:25:12 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:spdk_target 00:33:09.817 23:25:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:09.817 23:25:12 -- common/autotest_common.sh@10 -- # set +x 00:33:09.817 23:25:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:09.817 23:25:12 -- target/abort_qd_sizes.sh@56 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:33:09.817 23:25:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:09.817 23:25:12 -- common/autotest_common.sh@10 -- # set +x 00:33:10.752 23:25:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:10.752 23:25:14 -- target/abort_qd_sizes.sh@62 -- # killprocess 2604268 00:33:10.752 23:25:14 -- common/autotest_common.sh@936 -- # '[' -z 2604268 ']' 00:33:10.752 23:25:14 -- common/autotest_common.sh@940 -- # kill -0 2604268 00:33:10.752 23:25:14 -- common/autotest_common.sh@941 -- # uname 00:33:10.752 23:25:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:33:10.752 23:25:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2604268 00:33:10.752 23:25:14 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:33:10.752 23:25:14 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:33:10.752 23:25:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2604268' 00:33:10.752 killing process with pid 2604268 00:33:10.752 23:25:14 -- common/autotest_common.sh@955 -- # kill 2604268 00:33:10.752 23:25:14 -- common/autotest_common.sh@960 -- # wait 2604268 00:33:11.013 00:33:11.013 real 0m14.268s 00:33:11.013 user 0m57.160s 00:33:11.013 sys 0m2.462s 00:33:11.013 23:25:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:33:11.013 23:25:14 -- common/autotest_common.sh@10 -- # set +x 00:33:11.013 ************************************ 00:33:11.013 END TEST spdk_target_abort 00:33:11.013 ************************************ 00:33:11.013 23:25:14 -- target/abort_qd_sizes.sh@84 -- # run_test kernel_target_abort kernel_target 00:33:11.013 23:25:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:33:11.013 23:25:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:33:11.013 23:25:14 -- common/autotest_common.sh@10 -- # set +x 00:33:11.013 ************************************ 00:33:11.013 START TEST kernel_target_abort 00:33:11.013 ************************************ 00:33:11.013 23:25:14 -- common/autotest_common.sh@1114 -- # kernel_target 00:33:11.013 23:25:14 -- target/abort_qd_sizes.sh@66 -- # local name=kernel_target 00:33:11.013 23:25:14 -- target/abort_qd_sizes.sh@68 -- # configure_kernel_target kernel_target 00:33:11.013 23:25:14 -- nvmf/common.sh@621 -- # kernel_name=kernel_target 00:33:11.013 23:25:14 -- nvmf/common.sh@622 -- # nvmet=/sys/kernel/config/nvmet 00:33:11.013 23:25:14 -- nvmf/common.sh@623 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/kernel_target 00:33:11.013 23:25:14 -- nvmf/common.sh@624 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:33:11.013 23:25:14 -- nvmf/common.sh@625 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:33:11.013 23:25:14 -- nvmf/common.sh@627 -- # local block nvme 00:33:11.013 23:25:14 -- nvmf/common.sh@629 -- # [[ ! -e /sys/module/nvmet ]] 00:33:11.013 23:25:14 -- nvmf/common.sh@630 -- # modprobe nvmet 00:33:11.013 23:25:14 -- nvmf/common.sh@633 -- # [[ -e /sys/kernel/config/nvmet ]] 00:33:11.013 23:25:14 -- nvmf/common.sh@635 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:33:12.388 Waiting for block devices as requested 00:33:12.388 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:33:12.388 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:33:12.388 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:33:12.388 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:33:12.648 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:33:12.648 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:33:12.648 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:33:12.648 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:33:12.907 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:33:12.907 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:33:12.907 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:33:12.907 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:33:13.165 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:33:13.165 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:33:13.165 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:33:13.165 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:33:13.165 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:33:13.424 23:25:16 -- nvmf/common.sh@638 -- # for block in /sys/block/nvme* 00:33:13.424 23:25:16 -- nvmf/common.sh@639 -- # [[ -e /sys/block/nvme0n1 ]] 00:33:13.424 23:25:16 -- nvmf/common.sh@640 -- # block_in_use nvme0n1 00:33:13.424 23:25:16 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:33:13.424 23:25:16 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:33:13.424 No valid GPT data, bailing 00:33:13.425 23:25:16 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:33:13.425 23:25:16 -- scripts/common.sh@393 -- # pt= 00:33:13.425 23:25:16 -- scripts/common.sh@394 -- # return 1 00:33:13.425 23:25:16 -- nvmf/common.sh@640 -- # nvme=/dev/nvme0n1 00:33:13.425 23:25:16 -- nvmf/common.sh@643 -- # [[ -b /dev/nvme0n1 ]] 00:33:13.425 23:25:16 -- nvmf/common.sh@645 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:33:13.425 23:25:16 -- nvmf/common.sh@646 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:33:13.425 23:25:16 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:33:13.425 23:25:16 -- nvmf/common.sh@652 -- # echo SPDK-kernel_target 00:33:13.425 23:25:16 -- nvmf/common.sh@654 -- # echo 1 00:33:13.425 23:25:16 -- nvmf/common.sh@655 -- # echo /dev/nvme0n1 00:33:13.425 23:25:16 -- nvmf/common.sh@656 -- # echo 1 00:33:13.425 23:25:16 -- nvmf/common.sh@662 -- # echo 10.0.0.1 00:33:13.425 23:25:16 -- nvmf/common.sh@663 -- # echo tcp 00:33:13.425 23:25:16 -- nvmf/common.sh@664 -- # echo 4420 00:33:13.425 23:25:16 -- nvmf/common.sh@665 -- # echo ipv4 00:33:13.425 23:25:16 -- nvmf/common.sh@668 -- # ln -s /sys/kernel/config/nvmet/subsystems/kernel_target /sys/kernel/config/nvmet/ports/1/subsystems/ 00:33:13.425 23:25:16 -- nvmf/common.sh@671 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.1 -t tcp -s 4420 00:33:13.425 00:33:13.425 Discovery Log Number of Records 2, Generation counter 2 00:33:13.425 =====Discovery Log Entry 0====== 00:33:13.425 trtype: tcp 00:33:13.425 adrfam: ipv4 00:33:13.425 subtype: current discovery subsystem 00:33:13.425 treq: not specified, sq flow control disable supported 00:33:13.425 portid: 1 00:33:13.425 trsvcid: 4420 00:33:13.425 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:33:13.425 traddr: 10.0.0.1 00:33:13.425 eflags: none 00:33:13.425 sectype: none 00:33:13.425 =====Discovery Log Entry 1====== 00:33:13.425 trtype: tcp 00:33:13.425 adrfam: ipv4 00:33:13.425 subtype: nvme subsystem 00:33:13.425 treq: not specified, sq flow control disable supported 00:33:13.425 portid: 1 00:33:13.425 trsvcid: 4420 00:33:13.425 subnqn: kernel_target 00:33:13.425 traddr: 10.0.0.1 00:33:13.425 eflags: none 00:33:13.425 sectype: none 00:33:13.425 23:25:17 -- target/abort_qd_sizes.sh@69 -- # rabort tcp IPv4 10.0.0.1 4420 kernel_target 00:33:13.425 23:25:17 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:33:13.425 23:25:17 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:33:13.425 23:25:17 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:33:13.425 23:25:17 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:33:13.425 23:25:17 -- target/abort_qd_sizes.sh@21 -- # local subnqn=kernel_target 00:33:13.425 23:25:17 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:33:13.425 23:25:17 -- target/abort_qd_sizes.sh@24 -- # local target r 00:33:13.425 23:25:17 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:33:13.425 23:25:17 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:33:13.425 23:25:17 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:33:13.425 23:25:17 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:33:13.425 23:25:17 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:33:13.425 23:25:17 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:33:13.425 23:25:17 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:33:13.425 23:25:17 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:33:13.425 23:25:17 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:33:13.425 23:25:17 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:33:13.425 23:25:17 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:33:13.425 23:25:17 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:33:13.425 23:25:17 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:33:13.684 EAL: No free 2048 kB hugepages reported on node 1 00:33:16.964 Initializing NVMe Controllers 00:33:16.964 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:33:16.964 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:33:16.964 Initialization complete. Launching workers. 00:33:16.964 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 44931, failed: 0 00:33:16.964 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 44931, failed to submit 0 00:33:16.964 success 0, unsuccess 44931, failed 0 00:33:16.964 23:25:20 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:33:16.964 23:25:20 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:33:16.965 EAL: No free 2048 kB hugepages reported on node 1 00:33:20.239 Initializing NVMe Controllers 00:33:20.239 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:33:20.239 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:33:20.239 Initialization complete. Launching workers. 00:33:20.239 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 81753, failed: 0 00:33:20.239 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 20614, failed to submit 61139 00:33:20.239 success 0, unsuccess 20614, failed 0 00:33:20.239 23:25:23 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:33:20.239 23:25:23 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:33:20.239 EAL: No free 2048 kB hugepages reported on node 1 00:33:22.792 Initializing NVMe Controllers 00:33:22.792 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:33:22.792 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:33:22.792 Initialization complete. Launching workers. 00:33:22.792 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 84098, failed: 0 00:33:22.792 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 21018, failed to submit 63080 00:33:22.792 success 0, unsuccess 21018, failed 0 00:33:22.792 23:25:26 -- target/abort_qd_sizes.sh@70 -- # clean_kernel_target 00:33:22.792 23:25:26 -- nvmf/common.sh@675 -- # [[ -e /sys/kernel/config/nvmet/subsystems/kernel_target ]] 00:33:22.792 23:25:26 -- nvmf/common.sh@677 -- # echo 0 00:33:22.792 23:25:26 -- nvmf/common.sh@679 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/kernel_target 00:33:22.792 23:25:26 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:33:22.792 23:25:26 -- nvmf/common.sh@681 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:33:22.792 23:25:26 -- nvmf/common.sh@682 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:33:22.792 23:25:26 -- nvmf/common.sh@684 -- # modules=(/sys/module/nvmet/holders/*) 00:33:22.792 23:25:26 -- nvmf/common.sh@686 -- # modprobe -r nvmet_tcp nvmet 00:33:23.051 00:33:23.051 real 0m11.885s 00:33:23.051 user 0m5.881s 00:33:23.051 sys 0m2.264s 00:33:23.051 23:25:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:33:23.051 23:25:26 -- common/autotest_common.sh@10 -- # set +x 00:33:23.051 ************************************ 00:33:23.051 END TEST kernel_target_abort 00:33:23.051 ************************************ 00:33:23.051 23:25:26 -- target/abort_qd_sizes.sh@86 -- # trap - SIGINT SIGTERM EXIT 00:33:23.051 23:25:26 -- target/abort_qd_sizes.sh@87 -- # nvmftestfini 00:33:23.051 23:25:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:33:23.051 23:25:26 -- nvmf/common.sh@116 -- # sync 00:33:23.051 23:25:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:33:23.051 23:25:26 -- nvmf/common.sh@119 -- # set +e 00:33:23.051 23:25:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:33:23.051 23:25:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:33:23.051 rmmod nvme_tcp 00:33:23.051 rmmod nvme_fabrics 00:33:23.051 rmmod nvme_keyring 00:33:23.051 23:25:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:33:23.051 23:25:26 -- nvmf/common.sh@123 -- # set -e 00:33:23.051 23:25:26 -- nvmf/common.sh@124 -- # return 0 00:33:23.051 23:25:26 -- nvmf/common.sh@477 -- # '[' -n 2604268 ']' 00:33:23.051 23:25:26 -- nvmf/common.sh@478 -- # killprocess 2604268 00:33:23.051 23:25:26 -- common/autotest_common.sh@936 -- # '[' -z 2604268 ']' 00:33:23.051 23:25:26 -- common/autotest_common.sh@940 -- # kill -0 2604268 00:33:23.051 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2604268) - No such process 00:33:23.051 23:25:26 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2604268 is not found' 00:33:23.051 Process with pid 2604268 is not found 00:33:23.051 23:25:26 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:33:23.051 23:25:26 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:33:24.426 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:33:24.426 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:33:24.426 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:33:24.426 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:33:24.426 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:33:24.426 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:33:24.426 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:33:24.426 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:33:24.426 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:33:24.426 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:33:24.426 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:33:24.426 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:33:24.426 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:33:24.426 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:33:24.426 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:33:24.426 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:33:24.426 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:33:24.426 23:25:27 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:33:24.426 23:25:27 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:33:24.426 23:25:27 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:33:24.426 23:25:27 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:33:24.426 23:25:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:33:24.426 23:25:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:33:24.426 23:25:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:33:26.955 23:25:29 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:33:26.955 00:33:26.955 real 0m35.538s 00:33:26.955 user 1m5.457s 00:33:26.955 sys 0m8.289s 00:33:26.955 23:25:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:33:26.955 23:25:29 -- common/autotest_common.sh@10 -- # set +x 00:33:26.955 ************************************ 00:33:26.955 END TEST nvmf_abort_qd_sizes 00:33:26.955 ************************************ 00:33:26.955 23:25:29 -- spdk/autotest.sh@298 -- # '[' 0 -eq 1 ']' 00:33:26.955 23:25:29 -- spdk/autotest.sh@302 -- # '[' 0 -eq 1 ']' 00:33:26.955 23:25:29 -- spdk/autotest.sh@306 -- # '[' 0 -eq 1 ']' 00:33:26.955 23:25:29 -- spdk/autotest.sh@311 -- # '[' 0 -eq 1 ']' 00:33:26.955 23:25:29 -- spdk/autotest.sh@320 -- # '[' 0 -eq 1 ']' 00:33:26.955 23:25:29 -- spdk/autotest.sh@325 -- # '[' 0 -eq 1 ']' 00:33:26.955 23:25:29 -- spdk/autotest.sh@329 -- # '[' 0 -eq 1 ']' 00:33:26.955 23:25:29 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:33:26.955 23:25:29 -- spdk/autotest.sh@337 -- # '[' 0 -eq 1 ']' 00:33:26.955 23:25:29 -- spdk/autotest.sh@342 -- # '[' 0 -eq 1 ']' 00:33:26.955 23:25:29 -- spdk/autotest.sh@346 -- # '[' 0 -eq 1 ']' 00:33:26.955 23:25:29 -- spdk/autotest.sh@353 -- # [[ 0 -eq 1 ]] 00:33:26.955 23:25:29 -- spdk/autotest.sh@357 -- # [[ 0 -eq 1 ]] 00:33:26.955 23:25:29 -- spdk/autotest.sh@361 -- # [[ 0 -eq 1 ]] 00:33:26.955 23:25:29 -- spdk/autotest.sh@365 -- # [[ 0 -eq 1 ]] 00:33:26.955 23:25:29 -- spdk/autotest.sh@370 -- # trap - SIGINT SIGTERM EXIT 00:33:26.955 23:25:29 -- spdk/autotest.sh@372 -- # timing_enter post_cleanup 00:33:26.955 23:25:29 -- common/autotest_common.sh@722 -- # xtrace_disable 00:33:26.955 23:25:29 -- common/autotest_common.sh@10 -- # set +x 00:33:26.955 23:25:29 -- spdk/autotest.sh@373 -- # autotest_cleanup 00:33:26.955 23:25:29 -- common/autotest_common.sh@1381 -- # local autotest_es=0 00:33:26.955 23:25:29 -- common/autotest_common.sh@1382 -- # xtrace_disable 00:33:26.955 23:25:29 -- common/autotest_common.sh@10 -- # set +x 00:33:28.328 INFO: APP EXITING 00:33:28.328 INFO: killing all VMs 00:33:28.328 INFO: killing vhost app 00:33:28.328 INFO: EXIT DONE 00:33:29.261 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:33:29.261 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:33:29.261 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:33:29.261 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:33:29.261 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:33:29.519 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:33:29.519 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:33:29.519 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:33:29.519 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:33:29.519 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:33:29.519 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:33:29.519 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:33:29.519 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:33:29.519 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:33:29.519 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:33:29.519 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:33:29.519 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:33:30.893 Cleaning 00:33:30.893 Removing: /var/run/dpdk/spdk0/config 00:33:30.893 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:33:30.893 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:33:30.893 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:33:30.893 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:33:30.893 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:33:30.893 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:33:30.893 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:33:30.893 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:33:30.893 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:33:30.893 Removing: /var/run/dpdk/spdk0/hugepage_info 00:33:30.893 Removing: /var/run/dpdk/spdk1/config 00:33:30.893 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:33:30.893 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:33:30.893 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:33:30.893 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:33:30.893 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:33:30.893 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:33:30.893 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:33:30.893 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:33:30.893 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:33:30.893 Removing: /var/run/dpdk/spdk1/hugepage_info 00:33:30.893 Removing: /var/run/dpdk/spdk1/mp_socket 00:33:30.893 Removing: /var/run/dpdk/spdk2/config 00:33:30.893 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:33:30.893 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:33:30.893 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:33:30.893 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:33:30.893 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:33:30.893 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:33:30.893 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:33:30.893 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:33:30.893 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:33:30.893 Removing: /var/run/dpdk/spdk2/hugepage_info 00:33:30.893 Removing: /var/run/dpdk/spdk3/config 00:33:30.893 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:33:30.893 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:33:30.893 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:33:30.893 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:33:30.893 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:33:30.893 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:33:30.893 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:33:30.893 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:33:30.893 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:33:30.893 Removing: /var/run/dpdk/spdk3/hugepage_info 00:33:30.893 Removing: /var/run/dpdk/spdk4/config 00:33:30.893 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:33:30.893 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:33:30.893 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:33:30.893 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:33:30.893 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:33:30.893 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:33:30.893 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:33:30.893 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:33:30.893 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:33:30.893 Removing: /var/run/dpdk/spdk4/hugepage_info 00:33:30.893 Removing: /dev/shm/bdev_svc_trace.1 00:33:30.893 Removing: /dev/shm/nvmf_trace.0 00:33:30.893 Removing: /dev/shm/spdk_tgt_trace.pid2324197 00:33:30.893 Removing: /var/run/dpdk/spdk0 00:33:30.893 Removing: /var/run/dpdk/spdk1 00:33:30.893 Removing: /var/run/dpdk/spdk2 00:33:30.893 Removing: /var/run/dpdk/spdk3 00:33:30.893 Removing: /var/run/dpdk/spdk4 00:33:30.893 Removing: /var/run/dpdk/spdk_pid2322479 00:33:30.893 Removing: /var/run/dpdk/spdk_pid2323241 00:33:30.893 Removing: /var/run/dpdk/spdk_pid2324197 00:33:30.893 Removing: /var/run/dpdk/spdk_pid2324696 00:33:30.893 Removing: /var/run/dpdk/spdk_pid2326042 00:33:30.893 Removing: /var/run/dpdk/spdk_pid2327004 00:33:30.893 Removing: /var/run/dpdk/spdk_pid2327212 00:33:30.893 Removing: /var/run/dpdk/spdk_pid2327535 00:33:30.893 Removing: /var/run/dpdk/spdk_pid2327881 00:33:30.893 Removing: /var/run/dpdk/spdk_pid2328090 00:33:30.893 Removing: /var/run/dpdk/spdk_pid2328255 00:33:30.893 Removing: /var/run/dpdk/spdk_pid2328427 00:33:30.893 Removing: /var/run/dpdk/spdk_pid2328719 00:33:30.893 Removing: /var/run/dpdk/spdk_pid2329056 00:33:30.893 Removing: /var/run/dpdk/spdk_pid2331608 00:33:30.893 Removing: /var/run/dpdk/spdk_pid2331905 00:33:30.893 Removing: /var/run/dpdk/spdk_pid2332080 00:33:30.893 Removing: /var/run/dpdk/spdk_pid2332222 00:33:30.893 Removing: /var/run/dpdk/spdk_pid2332653 00:33:30.893 Removing: /var/run/dpdk/spdk_pid2332790 00:33:30.893 Removing: /var/run/dpdk/spdk_pid2333110 00:33:30.893 Removing: /var/run/dpdk/spdk_pid2333249 00:33:30.893 Removing: /var/run/dpdk/spdk_pid2333419 00:33:30.893 Removing: /var/run/dpdk/spdk_pid2333561 00:33:30.893 Removing: /var/run/dpdk/spdk_pid2333731 00:33:30.893 Removing: /var/run/dpdk/spdk_pid2333875 00:33:30.893 Removing: /var/run/dpdk/spdk_pid2334249 00:33:30.893 Removing: /var/run/dpdk/spdk_pid2334477 00:33:30.893 Removing: /var/run/dpdk/spdk_pid2334732 00:33:30.893 Removing: /var/run/dpdk/spdk_pid2334910 00:33:30.893 Removing: /var/run/dpdk/spdk_pid2335024 00:33:30.893 Removing: /var/run/dpdk/spdk_pid2335116 00:33:30.893 Removing: /var/run/dpdk/spdk_pid2335263 00:33:30.893 Removing: /var/run/dpdk/spdk_pid2335451 00:33:30.893 Removing: /var/run/dpdk/spdk_pid2335683 00:33:30.893 Removing: /var/run/dpdk/spdk_pid2335844 00:33:30.893 Removing: /var/run/dpdk/spdk_pid2335984 00:33:30.893 Removing: /var/run/dpdk/spdk_pid2336187 00:33:30.893 Removing: /var/run/dpdk/spdk_pid2336405 00:33:30.893 Removing: /var/run/dpdk/spdk_pid2336574 00:33:30.893 Removing: /var/run/dpdk/spdk_pid2336715 00:33:30.893 Removing: /var/run/dpdk/spdk_pid2336882 00:33:30.893 Removing: /var/run/dpdk/spdk_pid2337133 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2337294 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2337434 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2337611 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2337852 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2338021 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2338161 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2338377 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2338579 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2338736 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2338888 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2339070 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2339300 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2339462 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2339609 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2339791 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2340029 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2340189 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2340337 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2340510 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2340756 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2340909 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2341062 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2341247 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2341527 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2341761 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2341903 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2342159 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2342329 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2342717 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2343045 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2343409 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2345495 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2402952 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2405757 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2413008 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2416372 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2418882 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2419296 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2423191 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2423193 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2423866 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2424542 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2425106 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2425537 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2425657 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2425801 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2425942 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2425944 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2426620 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2427177 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2427856 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2428263 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2428274 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2428538 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2429591 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2430477 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2436586 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2436869 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2439556 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2443450 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2445690 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2452327 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2457737 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2459087 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2459766 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2471033 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2473287 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2476117 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2477336 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2478777 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2478976 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2479133 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2479401 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2479863 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2481276 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2482263 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2482716 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2486339 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2489921 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2493466 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2517984 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2520731 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2524660 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2525638 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2526755 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2529584 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2532634 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2537027 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2537068 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2540046 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2540246 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2540390 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2540660 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2540703 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2541781 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2543114 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2544332 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2545546 00:33:31.152 Removing: /var/run/dpdk/spdk_pid2546769 00:33:31.153 Removing: /var/run/dpdk/spdk_pid2547991 00:33:31.153 Removing: /var/run/dpdk/spdk_pid2551994 00:33:31.153 Removing: /var/run/dpdk/spdk_pid2552342 00:33:31.153 Removing: /var/run/dpdk/spdk_pid2553663 00:33:31.153 Removing: /var/run/dpdk/spdk_pid2554540 00:33:31.153 Removing: /var/run/dpdk/spdk_pid2558334 00:33:31.153 Removing: /var/run/dpdk/spdk_pid2560491 00:33:31.153 Removing: /var/run/dpdk/spdk_pid2564747 00:33:31.153 Removing: /var/run/dpdk/spdk_pid2568380 00:33:31.153 Removing: /var/run/dpdk/spdk_pid2572048 00:33:31.153 Removing: /var/run/dpdk/spdk_pid2572470 00:33:31.153 Removing: /var/run/dpdk/spdk_pid2572890 00:33:31.153 Removing: /var/run/dpdk/spdk_pid2573434 00:33:31.153 Removing: /var/run/dpdk/spdk_pid2574026 00:33:31.153 Removing: /var/run/dpdk/spdk_pid2574583 00:33:31.153 Removing: /var/run/dpdk/spdk_pid2575133 00:33:31.153 Removing: /var/run/dpdk/spdk_pid2575566 00:33:31.153 Removing: /var/run/dpdk/spdk_pid2578357 00:33:31.153 Removing: /var/run/dpdk/spdk_pid2578508 00:33:31.153 Removing: /var/run/dpdk/spdk_pid2582376 00:33:31.153 Removing: /var/run/dpdk/spdk_pid2582554 00:33:31.153 Removing: /var/run/dpdk/spdk_pid2584322 00:33:31.411 Removing: /var/run/dpdk/spdk_pid2589498 00:33:31.411 Removing: /var/run/dpdk/spdk_pid2589503 00:33:31.411 Removing: /var/run/dpdk/spdk_pid2592581 00:33:31.411 Removing: /var/run/dpdk/spdk_pid2594015 00:33:31.411 Removing: /var/run/dpdk/spdk_pid2595957 00:33:31.411 Removing: /var/run/dpdk/spdk_pid2596835 00:33:31.411 Removing: /var/run/dpdk/spdk_pid2598288 00:33:31.411 Removing: /var/run/dpdk/spdk_pid2599183 00:33:31.411 Removing: /var/run/dpdk/spdk_pid2604710 00:33:31.411 Removing: /var/run/dpdk/spdk_pid2605114 00:33:31.411 Removing: /var/run/dpdk/spdk_pid2605523 00:33:31.411 Removing: /var/run/dpdk/spdk_pid2606999 00:33:31.411 Removing: /var/run/dpdk/spdk_pid2607408 00:33:31.411 Removing: /var/run/dpdk/spdk_pid2607821 00:33:31.411 Clean 00:33:31.411 killing process with pid 2294043 00:33:41.378 killing process with pid 2294040 00:33:41.378 killing process with pid 2294042 00:33:41.378 killing process with pid 2294041 00:33:41.378 23:25:43 -- common/autotest_common.sh@1446 -- # return 0 00:33:41.378 23:25:43 -- spdk/autotest.sh@374 -- # timing_exit post_cleanup 00:33:41.378 23:25:43 -- common/autotest_common.sh@728 -- # xtrace_disable 00:33:41.378 23:25:43 -- common/autotest_common.sh@10 -- # set +x 00:33:41.378 23:25:43 -- spdk/autotest.sh@376 -- # timing_exit autotest 00:33:41.378 23:25:43 -- common/autotest_common.sh@728 -- # xtrace_disable 00:33:41.378 23:25:43 -- common/autotest_common.sh@10 -- # set +x 00:33:41.378 23:25:43 -- spdk/autotest.sh@377 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:33:41.378 23:25:43 -- spdk/autotest.sh@379 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:33:41.378 23:25:43 -- spdk/autotest.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:33:41.378 23:25:43 -- spdk/autotest.sh@381 -- # [[ y == y ]] 00:33:41.378 23:25:43 -- spdk/autotest.sh@383 -- # hostname 00:33:41.378 23:25:43 -- spdk/autotest.sh@383 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-gp-11 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:33:41.378 geninfo: WARNING: invalid characters removed from testname! 00:34:07.991 23:26:11 -- spdk/autotest.sh@384 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:12.177 23:26:15 -- spdk/autotest.sh@385 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:14.708 23:26:17 -- spdk/autotest.sh@389 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info --ignore-errors unused,unused '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:17.239 23:26:20 -- spdk/autotest.sh@390 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:19.769 23:26:23 -- spdk/autotest.sh@391 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:23.052 23:26:25 -- spdk/autotest.sh@392 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:25.579 23:26:28 -- spdk/autotest.sh@393 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:34:25.579 23:26:28 -- common/autotest_common.sh@1689 -- $ [[ y == y ]] 00:34:25.579 23:26:28 -- common/autotest_common.sh@1690 -- $ lcov --version 00:34:25.579 23:26:28 -- common/autotest_common.sh@1690 -- $ awk '{print $NF}' 00:34:25.579 23:26:28 -- common/autotest_common.sh@1690 -- $ lt 1.15 2 00:34:25.579 23:26:28 -- scripts/common.sh@372 -- $ cmp_versions 1.15 '<' 2 00:34:25.579 23:26:28 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:34:25.579 23:26:28 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:34:25.579 23:26:28 -- scripts/common.sh@335 -- $ IFS=.-: 00:34:25.579 23:26:28 -- scripts/common.sh@335 -- $ read -ra ver1 00:34:25.579 23:26:28 -- scripts/common.sh@336 -- $ IFS=.-: 00:34:25.579 23:26:28 -- scripts/common.sh@336 -- $ read -ra ver2 00:34:25.579 23:26:28 -- scripts/common.sh@337 -- $ local 'op=<' 00:34:25.579 23:26:28 -- scripts/common.sh@339 -- $ ver1_l=2 00:34:25.579 23:26:28 -- scripts/common.sh@340 -- $ ver2_l=1 00:34:25.579 23:26:28 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:34:25.579 23:26:28 -- scripts/common.sh@343 -- $ case "$op" in 00:34:25.579 23:26:28 -- scripts/common.sh@344 -- $ : 1 00:34:25.579 23:26:28 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:34:25.579 23:26:28 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:34:25.579 23:26:28 -- scripts/common.sh@364 -- $ decimal 1 00:34:25.579 23:26:28 -- scripts/common.sh@352 -- $ local d=1 00:34:25.579 23:26:28 -- scripts/common.sh@353 -- $ [[ 1 =~ ^[0-9]+$ ]] 00:34:25.579 23:26:28 -- scripts/common.sh@354 -- $ echo 1 00:34:25.579 23:26:28 -- scripts/common.sh@364 -- $ ver1[v]=1 00:34:25.579 23:26:28 -- scripts/common.sh@365 -- $ decimal 2 00:34:25.579 23:26:28 -- scripts/common.sh@352 -- $ local d=2 00:34:25.579 23:26:28 -- scripts/common.sh@353 -- $ [[ 2 =~ ^[0-9]+$ ]] 00:34:25.579 23:26:28 -- scripts/common.sh@354 -- $ echo 2 00:34:25.579 23:26:28 -- scripts/common.sh@365 -- $ ver2[v]=2 00:34:25.579 23:26:28 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:34:25.579 23:26:28 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:34:25.579 23:26:28 -- scripts/common.sh@367 -- $ return 0 00:34:25.579 23:26:28 -- common/autotest_common.sh@1691 -- $ lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:34:25.579 23:26:28 -- common/autotest_common.sh@1703 -- $ export 'LCOV_OPTS= 00:34:25.579 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:25.579 --rc genhtml_branch_coverage=1 00:34:25.579 --rc genhtml_function_coverage=1 00:34:25.579 --rc genhtml_legend=1 00:34:25.579 --rc geninfo_all_blocks=1 00:34:25.579 --rc geninfo_unexecuted_blocks=1 00:34:25.579 00:34:25.579 ' 00:34:25.579 23:26:28 -- common/autotest_common.sh@1703 -- $ LCOV_OPTS=' 00:34:25.579 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:25.579 --rc genhtml_branch_coverage=1 00:34:25.579 --rc genhtml_function_coverage=1 00:34:25.579 --rc genhtml_legend=1 00:34:25.579 --rc geninfo_all_blocks=1 00:34:25.579 --rc geninfo_unexecuted_blocks=1 00:34:25.579 00:34:25.579 ' 00:34:25.579 23:26:28 -- common/autotest_common.sh@1704 -- $ export 'LCOV=lcov 00:34:25.579 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:25.579 --rc genhtml_branch_coverage=1 00:34:25.579 --rc genhtml_function_coverage=1 00:34:25.579 --rc genhtml_legend=1 00:34:25.579 --rc geninfo_all_blocks=1 00:34:25.579 --rc geninfo_unexecuted_blocks=1 00:34:25.579 00:34:25.579 ' 00:34:25.579 23:26:28 -- common/autotest_common.sh@1704 -- $ LCOV='lcov 00:34:25.579 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:25.579 --rc genhtml_branch_coverage=1 00:34:25.579 --rc genhtml_function_coverage=1 00:34:25.579 --rc genhtml_legend=1 00:34:25.579 --rc geninfo_all_blocks=1 00:34:25.579 --rc geninfo_unexecuted_blocks=1 00:34:25.579 00:34:25.579 ' 00:34:25.579 23:26:28 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:34:25.579 23:26:28 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:34:25.579 23:26:28 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:34:25.579 23:26:28 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:34:25.579 23:26:28 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:25.579 23:26:28 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:25.579 23:26:28 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:25.579 23:26:28 -- paths/export.sh@5 -- $ export PATH 00:34:25.579 23:26:28 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:25.579 23:26:28 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:34:25.579 23:26:28 -- common/autobuild_common.sh@440 -- $ date +%s 00:34:25.579 23:26:28 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732832788.XXXXXX 00:34:25.579 23:26:28 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732832788.YVni7P 00:34:25.579 23:26:28 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:34:25.579 23:26:28 -- common/autobuild_common.sh@446 -- $ '[' -n v23.11 ']' 00:34:25.579 23:26:28 -- common/autobuild_common.sh@447 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:34:25.579 23:26:28 -- common/autobuild_common.sh@447 -- $ scanbuild_exclude=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk' 00:34:25.579 23:26:28 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:34:25.579 23:26:28 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:34:25.579 23:26:28 -- common/autobuild_common.sh@456 -- $ get_config_params 00:34:25.579 23:26:28 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:34:25.579 23:26:28 -- common/autotest_common.sh@10 -- $ set +x 00:34:25.579 23:26:28 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build' 00:34:25.579 23:26:28 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j48 00:34:25.579 23:26:28 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:25.579 23:26:28 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:34:25.579 23:26:28 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:34:25.579 23:26:28 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:34:25.579 23:26:28 -- spdk/autopackage.sh@19 -- $ timing_finish 00:34:25.579 23:26:28 -- common/autotest_common.sh@734 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:34:25.579 23:26:28 -- common/autotest_common.sh@735 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:34:25.579 23:26:28 -- common/autotest_common.sh@737 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:34:25.579 23:26:28 -- spdk/autopackage.sh@20 -- $ exit 0 00:34:25.579 + [[ -n 2238938 ]] 00:34:25.579 + sudo kill 2238938 00:34:25.599 [Pipeline] } 00:34:25.615 [Pipeline] // stage 00:34:25.620 [Pipeline] } 00:34:25.635 [Pipeline] // timeout 00:34:25.640 [Pipeline] } 00:34:25.654 [Pipeline] // catchError 00:34:25.660 [Pipeline] } 00:34:25.675 [Pipeline] // wrap 00:34:25.682 [Pipeline] } 00:34:25.695 [Pipeline] // catchError 00:34:25.705 [Pipeline] stage 00:34:25.709 [Pipeline] { (Epilogue) 00:34:25.722 [Pipeline] catchError 00:34:25.724 [Pipeline] { 00:34:25.737 [Pipeline] echo 00:34:25.739 Cleanup processes 00:34:25.745 [Pipeline] sh 00:34:26.028 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:26.028 2620118 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:26.042 [Pipeline] sh 00:34:26.323 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:26.324 ++ grep -v 'sudo pgrep' 00:34:26.324 ++ awk '{print $1}' 00:34:26.324 + sudo kill -9 00:34:26.324 + true 00:34:26.336 [Pipeline] sh 00:34:26.619 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:34:36.597 [Pipeline] sh 00:34:36.879 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:34:36.879 Artifacts sizes are good 00:34:36.893 [Pipeline] archiveArtifacts 00:34:36.900 Archiving artifacts 00:34:37.063 [Pipeline] sh 00:34:37.391 + sudo chown -R sys_sgci: /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:34:37.406 [Pipeline] cleanWs 00:34:37.415 [WS-CLEANUP] Deleting project workspace... 00:34:37.415 [WS-CLEANUP] Deferred wipeout is used... 00:34:37.421 [WS-CLEANUP] done 00:34:37.423 [Pipeline] } 00:34:37.441 [Pipeline] // catchError 00:34:37.454 [Pipeline] sh 00:34:37.734 + logger -p user.info -t JENKINS-CI 00:34:37.742 [Pipeline] } 00:34:37.756 [Pipeline] // stage 00:34:37.761 [Pipeline] } 00:34:37.775 [Pipeline] // node 00:34:37.781 [Pipeline] End of Pipeline 00:34:37.824 Finished: SUCCESS